There just aren't that many unusually desirable neighbourhoods, most are clustered around the average. Obviously, most average families can't actually end up living in neighbourhoods of above average desirability by definition.