Skip to content

2026-06-02 | Maxwell

Goal: Analyze Cross Attention heatmaps

Summary: Debug visualization code and format exportable html viewer

Work sessions

In Out Task
09:00 17:00 Debug visualization code and format exportable html viewer

Goals

  1. [P0] Start working on tooling for visualizing attention matrices

    a. Format and send attention matrices

    b. Debug Vawani RoPE adapter

  2. [P0] Document updates from standup meeting, Grissom meeting, and detailed weekly goals

  3. [P1] Read “How do Language Models Bind Entities in Context?”

Meetings

  1. Work with Professor Iskarous to visualize Attention Matrices

Summary

  1. ✅ [P0] Start working on tooling for visualizing attention matrices

    a. Format and send attention matrices

    b. Debug Vawani RoPE adapter

  2. ✅ [P0] Document updates from standup meeting, Grissom meeting, and detailed weekly goals

  3. 🟡 [not started] [P1] Read “How do Language Models Bind Entities in Context?”