SWE-bench

community

https://swe-bench.com

SWE-bench

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

john-b-yang updated a dataset about 13 hours ago

SWE-bench/SWE-bench_Multimodal

john-b-yang updated a dataset about 13 hours ago

SWE-bench/SWE-bench_Multilingual

john-b-yang updated a dataset about 14 hours ago

SWE-bench/SWE-bench

View all activity

Papers

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

View all Papers

Organization Card

Community About org cards

SWE-bench

We are a team of researchers across Stanford University and Princeton University working on LMs and AI systems for software engineering.

In this organization, you will find the assets for several projects in the SWE-* research ecosystem, notably:

SWE-bench (Lite, Verified, Multimodal, Multilingual)
SWE-smith
SWE-agent

Collections 3

View 3 collections

models 3

datasets 17

SWE-bench/SWE-bench_Multilingual

Benchmark • Updated about 10 hours ago • 300 • 41.2k • 22

SWE-bench/SWE-bench_Multimodal

Viewer • Updated about 13 hours ago • 612 • 3.95k • 12

SWE-bench/SWE-bench_Verified

Benchmark • Updated about 13 hours ago • 500 • 76.3k • 135

SWE-bench/SWE-bench

Viewer • Updated about 14 hours ago • 21.5k • 31.9k • 35

SWE-bench/SWE-bench_Lite

Viewer • Updated about 17 hours ago • 323 • 34.7k • 23

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 1.64k • 1

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 1.59k

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 1.51k

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 2.38k

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 1.35k • 2

View 17 datasets

SWE-bench

AI & ML interests

Recent Activity

Papers

SWE-bench

Collections 3

SWE-bench/SWE-bench_Verified

SWE-bench/SWE-bench_Multilingual

SWE-bench/SWE-bench_Multimodal

SWE-bench/SWE-bench_Lite

SWE-bench/SWE-smith-py

SWE-bench/SWE-smith-go

SWE-bench/SWE-smith-rs

SWE-bench/SWE-smith-cpp

SWE-bench/SWE-bench_Verified

SWE-bench/SWE-bench_Multilingual

SWE-bench/SWE-bench_Multimodal

SWE-bench/SWE-bench_Lite

SWE-bench/SWE-smith-py

SWE-bench/SWE-smith-go

SWE-bench/SWE-smith-rs

SWE-bench/SWE-smith-cpp

models 3

SWE-bench/SWE-agent-LM-7B

SWE-bench/SWE-Rater-32B

SWE-bench/SWE-agent-LM-32B

datasets 17

SWE-bench/SWE-bench_Multilingual

SWE-bench/SWE-bench_Multimodal

SWE-bench/SWE-bench_Verified

SWE-bench/SWE-bench

SWE-bench/SWE-bench_Lite

SWE-bench/SWE-prime

SWE-bench/SWE-smith-cpp

SWE-bench/SWE-smith-ts

SWE-bench/SWE-smith-java

SWE-bench/SWE-smith-rs

AI & ML interests

Recent Activity

Papers

Team members 7

SWE-bench

Collections 3

models 3 Sort: Recently updated

datasets 17 Sort: Recently updated

models 3

datasets 17