Apps · PROJECT NOTES
BIRD-Interact
An interactive text-to-SQL environment with database state, supporting knowledge, a user simulator and executable checks for query and update tasks.
What can you do with it?
Test whether agents clarify ambiguous requests, inspect database knowledge and recover from SQL errors during an interaction.
What should you know before using it?
Full evaluation needs ground-truth/test files requested separately from the authors. Legacy and ADK runners, datasets and task counts differ; verify the chosen version and database initialization. ADK is an implementation of this benchmark, not a separate benchmark. Code is MIT; data is CC BY-SA 4.0.
What is verified here?
This entry was reviewed against original project material. We have not independently run the software or reproduced its results. AI-development claims are author-reported; check upstream for current versions, setup requirements, and licenses.
- Resource type
- Environment + benchmark
- Provenance
- Development provenance not established
- Reviewed
- Platforms
- Consult upstream documentation