Mixture of Linear Transforms (MOLTs)

Writeup: Extending Sparse Mixture of Linear Transforms

Github: github.com/Ky-Ng/repro-molts

Anthropic Transformer Circuits Thread: Sparse mixtures of linear transforms (Introduced by Anthropic in July 2025 as an alternative to Transcoders)