A benchmark that blocks text-extraction shortcuts could push agent evaluation toward real visual professional work.
Multimodal Knowledge Agent (MKA) is a Google DeepMind benchmark dataset for evaluating autonomous AI agents on complex, multi-step visual knowledge work. Each of its 10 showcase tasks uses a multi-file workspace that plain OCR or text extraction cannot solve.