A browser-agent safety evaluation toolkit with synthetic websites, behavior datasets and trajectory classifiers for studying whether agents follow harmful requests.
A live-website evaluation framework with everyday task specifications, browser-agent harnesses, trace capture and request-based or trajectory-based scoring.
An OpenAI-published generated browser tool that reads a CSV file and configures bar, line, pie or doughnut charts with column mapping, colors and PNG download logic.
A reconstruction benchmark with public code for agents to explore Plotly+Dash dashboards and reproduce their visual design and interactive behavior; its DashboardMimic data is gated.
A benchmark of webpage interaction transitions, pairing before-and-after screenshots with action annotations and public generation and evaluation code.
A video-to-webpage reconstruction benchmark with user-interaction recordings, static assets, action sequences and public code that evaluates generated pages.
An agentic-search benchmark for long-horizon web research and citation-backed synthesis, with a released judge-agent framework and versioned task-specific evaluators.
A collection of compact browser tasks for clicking, typing, selecting and manipulating interface elements, exposed through Gymnasium and JavaScript interfaces.
A live-web benchmark with tasks across public websites, trajectory submissions and WebJudge evaluation, maintained separately from the offline Mind2Web dataset.
A separately maintained WebArena evaluation artifact with revised task definitions, structured response checks and offline scoring from captured network traces.
A public collection of live-website task instructions spanning reading, account changes and file operations, accompanied by published evaluation results.
A distinct task suite built on WebArena's websites, emphasizing tedious workflows that require retaining many details, performing calculations and tracking information across pages.
A dataset and benchmark for conversational web navigation, with multi-turn human demonstrations, page observations and action-prediction evaluation tools.
A self-hostable shopping benchmark with four different stores, designed for cross-shop product comparison, vague requirements, compatible alternatives and simulated checkout.
A simulated shopping website where agents search, inspect and select products to satisfy natural-language requests, with HTML and simplified text interfaces.
Showcases document software made with AI. Environments support interaction. Benchmarks define evaluation tasks; datasets provide training or evaluation material. Resource types and development provenance are labeled separately.
Follow every entry back to its evidence.
We record original links, review dates, and known limits. Demos and code belong to their upstream projects. Read our method ↗