I did my MSc thesis on ML in 2019 and so I‘m definitely no expert but one mental model worked well for me.
Machine learning models learn thousands of small functions which map input to output. A higher level "function" will choose which function is used to map the input to the output. So that’s what amazed me in about ChatGPT: think about all the little things it must understand to do what it does. For example, the model learned how to interpret if clauses and other language nuances, how variable definitions should be used, what words are in other languages.
Machine learning models learn thousands of small functions which map input to output. A higher level "function" will choose which function is used to map the input to the output. So that’s what amazed me in about ChatGPT: think about all the little things it must understand to do what it does. For example, the model learned how to interpret if clauses and other language nuances, how variable definitions should be used, what words are in other languages.