I love how you contrast the "3D printer" vs. "block of marble" - this feels intuitively correct to me.
I wonder if one way to think about the necessary evolution here looking to a more traditional separation of concerns. Memory is split (and managed entirely separately) from business logic (the intelligence of the LLM)?
Clad (YC W23) | Full Stack Software Engineer | New York City | Full Time | https://withclad.com/
Clad is construction management software to get physical infrastructure built faster.
We're starting with internet infrastructure, and work with ISPs and general contractors to automate the back-office tasks that slow down construction (think - managing subcontractors, bidding out work, tracking projects, and handling invoices).
We raised $2.7M from a stellar set of investors including Y Combinator, and are growing quickly (5x'ed revenue since January).
Exactly why the power grids are so challenged is a bit above my intellectual or educational pay grade. (I'm neither an electrical engineer nor a city planner.) But I do know that the system is aging and is stretched to capacity. SoCal, in particular, is riddled with more issues than NorCal -- probably because of greater population, more A/C usage during the hot summer months, etc.
I wonder if one way to think about the necessary evolution here looking to a more traditional separation of concerns. Memory is split (and managed entirely separately) from business logic (the intelligence of the LLM)?