2026-03-28 | Predictive Concept Decoders
Goal: Predictive Concept Decoders
Summary: End-to-end PCD MCP
Work sessions
| In | Out |
|---|---|
| 09:30 | 16:30 |
Goals
-
Understand the Finetuning Mixture and process
-
Interpretability on the TopK Concepts
-
Tutorials
Deatils
Worked on creating an MVP of the PCD with Claude Code. SynthSys creating with Haiku for Qwen2.5-1.5B-Instruct. However, pretraining was done without a chat template! I will re-check the impact of this mismatch when reproducing the paper "by hand".