↓Skip to main content

Concept Reasoning

MrCogito — Concept Reasoning Model

15 February 2026·Updated: 26 April 2026·2285 words·11 mins

Open research on concept-bottleneck transformers. ~21M parameters, deliberate. Phase 2 runs through an agentic auto-research loop.

Abstract digital art: a warm stream of text-like particles compresses into a small bright constellation of concept nodes, held up by a lone silhouette, while cool blue streams weave through a grid of glowing cells

A Memory That Reads by Content: Trained on Short Books, Still Finding Facts at 128K Tokens

27 September 2026·2199 words·11 mins

Abstract digital art of dense attention lines compressing into a compact constellation of concept nodes that continue as a long stream of light

Replacing Gemma-3 Global Attention with Concepts (Toward Longer Context)

26 July 2026·2408 words·12 mins