Meghan Markle and Prince Harry getting the cold shoulder from Montecito neighbors

"No one wants to be seen with them," says a source.