The tasks and counterfactuals from the Mechanistic Interpretability Benchmark.
AI & ML interests
Principled evaluation of mechanistic interpretability methods.
datasets 7
mib-bench/ravel
Viewer • Updated • 117k • 159
mib-bench/arithmetic_subtraction
Viewer • Updated • 20.9k • 334
mib-bench/arithmetic_addition
Viewer • Updated • 40.4k • 530
mib-bench/ioi
Viewer • Updated • 21k • 7.31k • 1
mib-bench/arc_easy
Viewer • Updated • 4.01k • 1.28k
mib-bench/arc_challenge
Viewer • Updated • 2k • 727
mib-bench/copycolors_mcqa
Viewer • Updated • 1.89k • 1.62k