🔥 So much to do, so little time.

R PRO

juiceb0xc0de

21 17 82

https://github.com/JuiceB0xC0de

AI & ML interests

You can call me McDreamy M.D. I'll be your attending neural network brain surgeon.

Recent Activity

new activity about 4 hours ago

Smilyai-labs/Nova-1-Standard-1.3B-Preview:Early training brain atlas: a progress snapshot

new activity about 5 hours ago

Qwen/Qwen3.5-2B:Qwen3.5-2B Brain Atlas — The Editable One

new activity about 5 hours ago

Qwen/Qwen3.5-27B:Qwen3.5-27B brain atlas activation census, OV-circuits, and capability fence (64layers)

View all activity

Organizations

😅 You ever fumble on a project? Please someone tell me I'm not alone. I fumbled at step one and remained oblivious for the remainder of the project. Funny story, I was under the assumption that Qwen/Qwen3-8B was the base model that the paired with the Qwen SAE released by Alibaba. I didn't realize there was a Qwen3-8b-Base model until after the 12 hours of independent mapping techniques I had applied to the model that was missing the -Base suffix. 🤗 My bad, I'm just a bartender. I should not be unsupervised.

Not all is lost however. The outcome was a very in depth neural network atlas complete with its own SQLite queryable database for the Qwen3-8B model I can now share with you all. The data base combines these methods for a full in depth dive:

- Neuron Taxonomy
- Category Separation Scoring
- Co-activation Analysis
- Per-Head Decomposition
- Component Comparison
- Attribution Patching
- Sparse Non-negative Matrix Factorization
- NeuronLens
- DAS SVD rotation
- Cross-layer Coherence
- SQLite database

So if you've ever wondered where a specific behaviour or ability lives in the hidden dimensions of Qwen-8B or perhaps wanted to make informed quantization decisions please enjoy the fruits of my ill-informed labour lol. 😂

juiceb0xc0de/qwen3-8b-atlas
Qwen/Qwen3-8B