If the goal is to have cheap, dedicated space where you can build stuff, it probably makes a lot more sense to buy an old but sizable house, with land, in a remote place. These are cheaper than garages, and no one will be there to complain about the noise, or how bad your activity looks to the neighborhood. The cost of living tends to be cheaper than in metro areas too.
There are drawbacks too, but it is not like you are going to commute, so one of the biggest one is out. For internet and utilities, some remote places are remarkably well served.
Now, if you are doing software, you don't need any of that, all you need is a computer and you can do it from your bedroom.
You need to live, for most of us that means more than whatever hacking we are doing in our garage/shed. If you have independent wealth and no family moving to a cheap area might be a good option. However if you need a job to support yourself where you live must be in range of that job (though many reading this are able to work from home, most of the world cannot). Family means your spouse - where does she/he need to be for work - this limits where you can live just as much (and if both of you have to go to work what jobs both of you can take) . You can force move your kids to a rural area but they will not be happy about losing all their friends (many do this anyway, but it should be a consideration even if you do it to them. Family also means extended family - where does your sister, parents, in-laws live - moving away from them is hard. Likewise everything about family and your kids friends applies to your friends - do you really want to move away from them? There is also safety - the cheap side of town is often cheap for a reason, do you want to wear a bulletproof vest around all the time?
So realistically: cannot move to a cheap house on some land.
You don't even need to live in the mountains of Wyoming or wherever. I live about an hour west of Boston and have a 2-car garage and plenty of space for hobbies in a location that is not particularly expensive.
