AI & ML interests

Create the best 1M-1B parameters thinking model(All on CPU)

Recent Activity

AxionLab-official  updated a Space 15 days ago
AxionLab-Co/README
AxionLab-official  updated a model 28 days ago
AxionLab-Co/DogeAI2.5-0.2B
AxionLab-official  published a model 28 days ago
AxionLab-Co/DogeAI2.5-0.2B
View all activity

AxionLab-official 
posted an update 2 days ago
AxionLab-official 
posted an update 12 days ago
view post
Post
250
Someone ran Supra-50M-Instruct ON A 1GHZ 1999 CPU

https://www.reddit.com/r/LocalLLM/comments/1tm21ar/i_see_your_strix_halo_and_raise_you_a_vintage/

"As a fun experiment, I decided to try running the recently released Supra-50m on a 26-year-old machine I keep for retro Windows 9.X games. Although the model was somewhat silly and inconsistent, the performance wasn't bad, reaching around 1.3 tok/s with CPU inference alone.

Since this CPU doesn't have SSE2, I changed from llama.cpp to llama2.ce and asked Claude to write a custom tokenizer.

It's crazy to think that with the right file size of 200 MB, we could have experienced this magic back in 1999" - u/drone_stonks, r/localllm
AxionLab-official 
posted an update 15 days ago
view post
Post
226
We RELEASED!

SupraLabs just released our 50M model!
Base, Instruct Weights are there, you can use!

You can check blog to more informations!(Writing blog yet!)
AxionLab-official 
updated a Space 15 days ago

Emergent Properties

2
#1 opened about 2 months ago by
Xecut