The benchmarks evaluate LM agent on SWE/Computer-use tasks across different operating systems.
SWE-bench-Live
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
SWE-bench-Live
Here we host SWE-bench-Live dataset, with continuous monthly updates!
models 0
None public yet
datasets 6
SWE-bench-Live/SWE-bench-Live
Viewer • Updated • 3.69k • 33.6k • 10
SWE-bench-Live/MultiLang
Viewer • Updated • 1.08k • 15.9k • 3
SWE-bench-Live/Windows
Viewer • Updated • 66 • 1.1k • 1
SWE-bench-Live/OS-bench
Viewer • Updated • 140 • 908 • 1
SWE-bench-Live/ORACLE-SWE
Viewer • Updated • 8 • 726 • 2
SWE-bench-Live/repo-build-test-benchmark
Viewer • Updated • 152 • 1.22k