Ishant06/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled
Text Generation • 0.8B • Updated • 21 • 5
🏝️ On Vacation
Kai Ruan
6cf
AI & ML interests
None yet
Recent Activity
liked a model 2 days ago
Ishant06/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled authored a paper 2 days ago
When Does Muon Help Agentic Reinforcement Learning? authored a paper 2 days ago
PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual CoordinationOrganizations
liked a
model 2 days ago
authored 2
papers 2 days ago
upvoted a paper 2 days ago
submitted a
paper to Daily Papers 2 days ago
liked a
dataset 6 days ago
upvoted a collection 6 days ago
liked 3
models 7 days ago
liked a
model 12 days ago
liked a
model 13 days ago
reacted to danielhanchen's post with 🤗👍🚀🔥 13 days ago
Post
6012
DeepSeek-V4 can now run locally with Unsloth GGUFs! 🐳
Run lossless DeepSeek-V4-Flash on 168GB RAM or
3-bit works on 110GB Mac, RAM, VRAM setups.
Run via Unsloth Studio or llama.cpp.
GGUF: unsloth/DeepSeek-V4-Flash-GGUF
Guide: https://unsloth.ai/docs/models/deepseek-v4
Run lossless DeepSeek-V4-Flash on 168GB RAM or
3-bit works on 110GB Mac, RAM, VRAM setups.
Run via Unsloth Studio or llama.cpp.
GGUF: unsloth/DeepSeek-V4-Flash-GGUF
Guide: https://unsloth.ai/docs/models/deepseek-v4
upvoted an article 14 days ago
Article
A brief history of distillation in AI
sergiopaniego
• • 3 replied to sergiopaniego's post 14 days ago
very helpful blog, thank you 🤗
reacted to sergiopaniego's post with ❤️👍 14 days ago
Post
7665
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
- 3 replies