↓Skip to main content

Representation Learning

Abstract digital art of dense attention lines compressing into a compact constellation of concept nodes that continue as a long stream of light

Replacing Gemma-3 Global Attention with Concepts (Toward Longer Context)

26 July 2026·2408 words·12 mins

Abstract colorful streams compressing through a narrow concept bottleneck and expanding into richer geometric structure

Quicker Failures lead to better questions: How AI Helped Me Steer my research forward

8 March 2026·2522 words·12 mins