JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
Existing benchmarks have been letting agents look better than they actually are by testing only single-device tasks. Cross-device workflows are where real automation fails: state transfer, platform switching, context maintenance. If you're building an AI assistant product that needs to actually work in the real world, this paper exposes where your agent will struggle. The benchmark itself is useful, but the finding is more important than the tool.