Apps · PROJECT NOTES
CADWorld
A FreeCAD computer-use benchmark that evaluates screenshot-driven GUI work through executable checks on saved CAD projects and engineering outputs.
What can you do with it?
Evaluate modeling, sketch constraints, assembly, manufacturing and simulation workflows against task-specific artifact requirements.
What should you know before using it?
Requires a Linux/KVM Docker host and the Ubuntu FreeCAD VM. CAM-task evaluation, live or offline, needs a host FreeCAD 1.1.x console; most other checks parse files in Python. Omitting FreeCAD can invalidate CAM scores. Keep the 200-task GUI benchmark distinct from the paper's 50-task terminal-only ablation. A project-wide code license was not found in the reviewed root or package metadata.
What is verified here?
License note: The task dataset declares Apache-2.0; the VM Hub card separately declares MIT. These declarations do not replace FreeCAD or other bundled software terms and do not resolve the missing project-wide GitHub code license.
This entry was reviewed against original project material. We have not independently run the software or reproduced its results. AI-development claims are author-reported; check upstream for current versions, setup requirements, and licenses.
- Resource type
- Environment + benchmark
- Provenance
- Development provenance not established
- Reviewed
- Platforms
- Linux