2025-11-11 | Neo et al. 2024
Goal: Reproducing Neo et al. 2024
Summary: Change of Basis and Next-token neurons
Work sessions
| In | Out |
|---|---|
| 09:30 | 10:00 |
| 13:00 | 15:15 |
Neo et al. 2024
- Deep dive on 3Blue1Brown Change of basis | Chapter 13, Essence of linear algebra to understand how \(W_{down}\) stores information in its column vectors.
- Read through Neo et al. 2024 with working understanding of MLP Interpretability Next-token neuron analysis
Next Steps
- Understand Individual Attention Head Attribution