Skip to content

2026-06-09 | Maxwell

Goal: Finish Relative Clause Grammar, Train Toy Models, Read Bind Entries in Context

Summary: Finish reading up on Subject Relative Clauses

Work sessions

In Out Task
11:00 13:20 Write Relative Clause CFG
14:00 17:20 Write Relative Clause CFG

Goals

  1. 🟡 [in progress] [P0] Send by EOD: samples of

    a. Finish Relative Clauses in CFG

    b. Redefine “depth” to generate samples

    c. Partition sentences by complexity

  2. 🟡 [P0] Find Seq2Seq and Decoder only model which can fit data

  3. 🟡 [P1: Stretch but very interested in] Understand Feng & Steinhardt “How do Language Models Bind Entities in Context?”

    a. I would really like to try an activation patching experiment before Thursday!

Questions for Today

  1. How do we define “Computation”?

  2. What does it mean to have a “Computational System”?

  3. What does it mean to treat “Language as Computation/a Computational System”?

Meetings

None

Summary

No updates; continuing to work on item 1