Hey everyone,
I am trying to figure out how DevOps requirements change with services that build on top of LLMs. I got a couple questions for everyone who actually tried to deploy something into prod.
Have you implemented a service that uses langchain and runs in production? What have your experiences been? Did you need to set up extra infrastructure to deploy it? Did you use open source models?