My friend lives in a small studio apartment by Japan town and pays $2000 a month and shares with a room mate divided by a shower curtain. Hope that answers your question.
Send me a pm with more information like if you are moving there alone or with family, desired commute time, work location, etc and I will offer up what I know.
Buddy of mine just moved into Walnut Creek. There are some "deals" out there but you have to sacrifice a bit. This apartment complex has a cheaper unit (1BR) at $1750/mo but it's right next to the bart (loud). This location is at least two hours from MV though so probably not what you are looking for. Best way to live cheap out here is to roommate up and prepare to live small. :/
Mountain View/Cupertino are very expensive thanks to companies like Google and Apple. Best to look at Alum Rock or South San Jose. Get used to commuting!