All tracers
llama.cpp
through the weights ·
2ca15f5
· Llama 3.1 8B Q4_K_M · RTX 4090
Prompt pass
Bare prompt
Decode step
Inference tracer
Every weight, in the order one token reads them
Q4_K
Q6_K
F32 norms
CPU
⏮
◀
▶ Trace
▶▶
TRACE A FORWARD PASS
Press ▶ to read the weights one token at a time