Apple introduces VSAS-Bench for evaluating streaming vision-language models

Apple ML Research

VSAS-Bench evaluates streaming vision-language models in real-time settings, measuring performance on interactive tasks such as command following and question answering. The benchmark includes 406 queries across 13 scenarios, testing proactive streaming and real-time interaction capabilities.

applevision-languagebenchmarks

Apple ML Research

20 days ago