Apps · PROJECT NOTES
SPA-Bench
An Android-agent evaluation framework with single-app and cross-app tasks in English and Chinese, trajectory annotations and an automated scoring pipeline.
What can you do with it?
Compare mobile agents across varied apps and measure task completion together with execution and resource-use metrics.
What should you know before using it?
Requires an Android device/emulator, ADB, app setup and configured model backends. The preconfigured emulator snapshot is still marked coming soon. Evaluation uses model-based judgments and annotated components. Framework code is MIT; individual apps have separate terms.
What is verified here?
This entry was reviewed against original project material. We have not independently run the software or reproduced its results. AI-development claims are author-reported; check upstream for current versions, setup requirements, and licenses.
- Resource type
- Environment + benchmark
- Provenance
- Development provenance not established
- Reviewed
- Platforms
- Android