Add attention head characterization scripts and ablation experiments#403

Open

lee-goodfire wants to merge 81 commits intodevfrom

feature/attn_plots

Commits on Feb 19, 2026

Add plot_mean_ci script

claude-spd1
and
claude
committed
Add plot_component_head_norms script

claude-spd1
and
claude
committed
Add plot_head_spread script

claude-spd1
and
claude
committed
Add plot_attention_weights script

claude-spd1
and
claude
committed
Add plot_per_head_component_activations script

claude-spd1
and
claude
committed
Add plot_attention_contributions script

claude-spd1
and
claude
committed
Add plot_kv_coactivation script

claude-spd1
and
claude
committed
Add plot_kv_vt_similarity script

claude-spd1
and
claude
committed
Add attention_stories script for Q->K->V interaction chain reports

claude-spd1
and
claude
committed
Rename plot_attention_contributions to plot_qk_c_attention_contributions

claude-spd1
and
claude
committed
Add dotenv loading to app backend server

claude-spd1
and
claude
committed
Remove readonly from InterpDB in InterpRepo.open

claude-spd1
and
claude
committed
Add RoPE-aware QK attention computation with multi-offset support

claude-spd1
and
claude
committed
Add clustering configs for s-275c8f21

claude-spd1
and
claude
committed
Fix clustering dataset loader to respect is_tokenized from task config

claude-spd1
and
claude
committed
Read streaming setting from task config in clustering dataset loader

claude-spd1
and
claude
committed
Reduce clustering batch_size to 32 for s-275c8f21

claude-spd1
and
claude
committed
Increase clustering iters to 5000 for s-275c8f21

claude-spd1
and
claude
committed
Add 10k and 25k iter clustering configs for s-275c8f21

claude-spd1
and
claude
committed
Add per-head and line plot visualizations to QK attention contributions

claude-spd1
and
claude
committed
Add previous-token head detection script

claude-spd1
and
claude
committed
Add induction head detection script

claude-spd1
and
claude
committed
Add duplicate-token head detection script

claude-spd1
and
claude
committed
Add positional head detection script

claude-spd1
and
claude
committed
Add delimiter head detection script

claude-spd1
and
claude
committed
Add successor head detection script

claude-spd1
and
claude
committed
Add S-inhibition head detection script

claude-spd1
and
claude
committed
Add SPD component-level induction head characterization script

claude-spd1
and
claude
committed
Add attention head characterization report for s-275c8f21

claude-spd1
and
claude
committed
Add harvest data schema migration notes

claude-spd1
and
claude
committed
Extract shared collect_attention_patterns utility and fix GQA bug

claude-spd1
and
claude
committed
Update clustering config: batch_size=1024, iters=1000

claude-spd1
and
claude
committed
Update clustering batch_size to 512 (1024 OOM'd)

claude-spd1
and
claude
committed
Update clustering batch_size to 256 (512 also OOM'd)

claude-spd1
and
claude
committed
Update plotting scripts for new harvest schema

claude-spd1
and
claude
committed
Update clustering iters to 20000

claude-spd1
and
claude
committed

Commits on Feb 20, 2026

Commits on Feb 22, 2026

Commits on Feb 24, 2026

Commits on Feb 25, 2026

Commits on Feb 26, 2026