Congrats and keep up the good work! Can you describe your tech stack and challenges you faced in your first 6 months - we love to learn from your experiences.
We have worked extensively with many of the latest LLM models and tried many different techniques to solve the various problems for our customers.
We use a combination of tools from Google and OpenAI to leverage LLMs. We use React and Heroku to support the web application.
The biggest challenge so far has been getting good field extraction and the ability to accurately search millions of documents using NLP. We've iterated our tools several times and finally reached a good solution that adequately solves the biggest needs of our customers.
We've built a RAG and iterated several times in order to try and get the best configurations for our customers.
Take a look at the online subscription of WSJ - there is no online way to cancel the online subscription, you need to call a number and try to survive their retention script.