i moved here 6 months back. live in south bay (sunnyvale) and commute to the city for work.
For starters, the weather in the city simply sucks. Its cold, windy and foggy most of the times - on the contrary, south bay remains clear, sunny and quite warm.
Even bigger gripe against bay area is the cost of living. Everything from housing to everday stuff to gas is insanely expensive. Paying 1600$ + for a crappy apartment built in the 60's without any washer dryer was a huge shock as compared to raleigh, where i moved from.