2025-11-29 | Reproducing Neo et al.
Goal: Reproduce Neo et al. 2024
Summary: Limitting memory footprint: Stream in The Pile and use Max Heap approach to store top-k activating prompts
Work sessions
| In | Out |
|---|---|
| 00:00 | 00:35 |
| 13:20 | 14:30 |
Reproducing Neo et al.
- Battling through tokenizer batch shapes (see 2025-12-01 for the followup)