Skip to content

2026-05-21 | Maxwell

Goal: Train Toy Seq2Seq Transformer (Vaswani et al.) on translation from English to Zapanese

Summary: Toy transformer can generalize to unseen examples of same depth but not unseen recursive depths (using complementizer phrases)

Work sessions

In Out
15:00 17:00