Yes
GPT-4-V works extremely well (when combined with Segment Anything)
abrichr on Hacker News
In the thread “ScreenAI: A visual LLM for UI and visually-situated language understanding”, replying to this comment
Helped: Combining GPT-4-V with Segment Anything for good results.
We haven't been able to use Claude 3 Opus vision yet because we're in Canada, but GPT-4-V works extremely well (when combined with Segment Anything). See: https://github.com/OpenAdaptAI/OpenAdapt/pull/610 (work in progress). …