everything is about the environment. If you have an under stimulating environment then even your health is affected.

Read about the WWII pregnant survivors of holocaust where their lack of food evolved into the fetus being stingy with proteins and sugars and now they are experiencing health problems because now their body stores more than it needs and weight gain and other health factors arose.

So yes, environment can be detrimental to not only brain, but full physiological development