2026-06-17 | Maxwell
Goal: Divide Grammar generation to separate Subject from Object position recursion
Summary: Define arbitrary complex for a noun and verb without sentential CP
Work sessions
| In | Out | Task |
|---|---|---|
| 08:15 | 08:30 | Planning for the day |
- Present at weekly update, work on tasks from previous day
Reading
Causal Mediation via Activation Patching Vig et al. 2020 Decompose direct/indirect Causal Tracing (Mediation with Ablations) Meng et al 2022 Add noise to the input embedding and then start restoring original versions and see what happens Lookbacks https://arxiv.org/pdf/2505.14685
Reprioritize Modify Data generation to include Object Recursion, no Subject Recursion Modify data generation to include depth generalization/random samples Add Weight Decay and test for grokking generalization Shrink model size Visualize the cosine similarity of token embeddings of terminals as a heatmap Modify heatmap visualization to be the same order/shifted by one Add visualization with arcs Patching experiment TBD