how does Klarity scale with more complex models or larger datasets? Does it maintain the same level of insight and actionable suggestions as the model grows in size and complexity? Great release btw

It should work with any type of model, obviously longer chain of thoughts will be more difficult to analyse by the evaluation model, because it will have way more reasoning steps to identify and separate. The quality of the outcome depends a lot on the chosen model to give you insights. We tested with Llama3-70B and worked smoothly most of the times.

Very interesting approach!! what models are u currently consider to integrate?

We want to integrate reasoning models as next steps because we see a lot of value in understanding better CoTs behaviour (DeepSeek R1 & Co)

Okay thanks that sounds great, have u also thought about extending the scope beyond language models?