2026-06-09 | Maxwell
Goal: Finish Relative Clause Grammar, Train Toy Models, Read Bind Entries in Context
Summary: Finish reading up on Subject Relative Clauses
Work sessions
| In | Out | Task |
|---|---|---|
| 11:00 | 13:20 | Write Relative Clause CFG |
| 14:00 | 17:20 | Write Relative Clause CFG |
Goals
-
🟡 [in progress] [P0] Send by EOD: samples of
a. Finish Relative Clauses in CFG
b. Redefine “depth” to generate samples
c. Partition sentences by complexity
-
🟡 [P0] Find Seq2Seq and Decoder only model which can fit data
-
🟡 [P1: Stretch but very interested in] Understand Feng & Steinhardt “How do Language Models Bind Entities in Context?”
a. I would really like to try an activation patching experiment before Thursday!
Questions for Today
-
How do we define “Computation”?
-
What does it mean to have a “Computational System”?
-
What does it mean to treat “Language as Computation/a Computational System”?
Meetings
None
Summary
No updates; continuing to work on item 1