The limit on fresh water is a local problem. Maybe that's an issue in California during dry years, but not in North Carolina or Iowa, which are subject to completely different rainfall patterns.
But neither of those places has the diversity or scale of California’s agricultural system—it’s one of the most reliable suppliers of the food on America’s plate. And that’s why California’s water problem is a local problem for most Americans.
Yup, drupes and nuts account for about 10% of California's water usage, behind only domestic animal agriculture (~30%) and feed exported for foreign animal agriculture (~15%).