Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

nm-research updated a dataset 16 minutes ago

inference-optimization/Qwen3-30B-A3B-responses

nm-research published a dataset 17 minutes ago

inference-optimization/Qwen3-30B-A3B-responses

nm-research updated a dataset about 4 hours ago

inference-optimization/Qwen3-32B-responses

View all activity

inference-optimization 's models 363

inference-optimization/llama3_8b_5.0_bits_mode_noise_stiched

5B • Updated 26 days ago • 24

inference-optimization/llama3_8b_5.0_bits_mode_hybrid_stiched

5B • Updated 26 days ago • 27

inference-optimization/llama3_8b_5.0_bits_mode_heuristic_stiched

5B • Updated 26 days ago • 28

inference-optimization/llama3_8b_6.0_bits_mode_hybrid_stiched

6B • Updated 26 days ago • 53

inference-optimization/qwen3-8b-peagle-speculators

Updated 26 days ago

inference-optimization/peagle-gemma4

2B • Updated 27 days ago • 4

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated 28 days ago • 89

inference-optimization/MiniMax-M2.5-BF16

Text Generation • 229B • Updated 28 days ago • 195

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated 28 days ago • 21

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 6

inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers

34B • Updated Apr 28 • 3

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor

26B • Updated Apr 23 • 6

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 23 • 5

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 23 • 4

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor

23B • Updated Apr 23 • 5

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 23 • 3

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor

21B • Updated Apr 23 • 6

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor

21B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor

21B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor

19B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor

19B • Updated Apr 23 • 1

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor

19B • Updated Apr 23 • 14

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 7

inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor

27B • Updated Apr 22 • 3