Skip to content

2026-04-16 | Feature Geometry

Goal: Train Decoder only LLM on a syntatically Head Final vs. Head Initial Grammar to probe for feeature geometry

Summary: Prototype a Context Free Grammar that's syntactically left/right headed; Train and visualize residual stream geometry

Work sessions

In Out
07:00 09:30