AI can what?

Apps · PROJECT NOTES

Terminal-Bench

A versioned collection of executable terminal tasks with containerized starting environments, reference solutions and automated checks for agent outcomes.

EvaluationConsult upstream documentation

What can you do with it?

Test whether an agent can complete multi-step command-line work against executable outcome checks.

What should you know before using it?

The current repository is a continuously updated benchmark, while the linked paper describes Terminal-Bench 2.0. Pin dataset and harness versions for comparisons. Harbor and a supported sandbox backend are required; provider costs and task dependencies vary. Repository license is Apache 2.0.

What is verified here?

This entry was reviewed against original project material. We have not independently run the software or reproduced its results. AI-development claims are author-reported; check upstream for current versions, setup requirements, and licenses.

Resource type
Environment + benchmark
Provenance
Development provenance not established
Reviewed
Platforms
Consult upstream documentation

Compare resources for this goal

More in this category