LarQL Vindex Viewer — explore the universal four-stage circuit in open transformer models

This interactive 3D viewer plots learned features for nine open transformer models — Gemma 4 E2B, Ministral 3B, MedGemma 1.5 4B, Qwen3 0.6B and 8B, Qwen3.6 35B MoE, Llama 3.1 8B, GPT-OSS 120B MoE, and Bonsai b1.58 2B — and shows the universal four-stage circuit they share: broadcast, domain, entity commitment, and prediction. Compare any model against the 1-bit Bonsai dissolution to see what happens when the circuit disappears. The viewer uses Three.js to render every feature point and a 12-second demo tour explains the four stages. Vindex IDs link back to the corresponding Hugging Face repositories so you can verify each model independently. Drag to orbit, scroll to zoom, click a feature for a layer-by-layer trace.

Click a feature · drag to orbit · scroll to zoom
↗ HF

C4 TEMPERATURE
CIRCUIT
Gate-3: —
C1 SPARSITY
C2 TOP-8
C3 COHERENCE
C4 TEMP
SPECTRUM
VINDEX ID

Circuit Stages

Broadcast (0%)
Domain (20-25%)
Entity (45-55%)
Prediction (90%+)
Transition
Dissolved (1-bit)

Circuit Comparison

Loading…