There has been some work on training on lots of different data sets and then specializing on the one you care about. But I think people were trying that approach pre-2022 as well.
Sorry, I don't have references off the top of my head. I just recall coming across it while I was working on something related to timeseries forecasting.
