The (non-privacy related) issue is the same - if you resort to screen shots, you've thrown away tons of valuable metadata.
And, as long as there's an API, I am fairly certain that maintaining a compat layer is a lot less work than retuning the LLM when the images change. (And you'll want to adjust your tuning, at least with current SOTA, or your error rate will reach Unpleasantville fairly quickly)
Yes, it seems easier on the face of it - but the reality of building an LLM pipeline will quickly point out a lot of edge cases.
And, as long as there's an API, I am fairly certain that maintaining a compat layer is a lot less work than retuning the LLM when the images change. (And you'll want to adjust your tuning, at least with current SOTA, or your error rate will reach Unpleasantville fairly quickly)
Yes, it seems easier on the face of it - but the reality of building an LLM pipeline will quickly point out a lot of edge cases.