Inference Providers
Active filters: AWQ
QuantTrio/Qwen3.6-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 80.1k
• 13
QuantTrio/gemma-4-31B-it-AWQ
Image-Text-to-Text
• 31B • Updated • 108k
• 10
QuantTrio/MiniMax-M2.7-AWQ
Text Generation
• 229B • Updated • 1.03k
• 4
QuantTrio/Qwen3.5-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 405k
• 43
Text Generation
• 754B • Updated • 164
• 2
selode-ai/Qwen-3.6-35B-A3B-VRAP-4-bit-AWQ-21.2GB
Image-Text-to-Text
• 29B • Updated • 61
• 10
solidrust/Llama-3-8B-Instruct-abliterated-v2-AWQ
Text Generation
• 8B • Updated • 80
• 1
solidrust/Mistral-7B-Instruct-v0.3-AWQ
Text Generation
• 7B • Updated • 4.07k
• 10
QuantTrio/GLM-4.7-Flash-AWQ
Text Generation
• 31B • Updated • 95.4k
• 12
QuantTrio/MiniMax-M2.5-AWQ
Text Generation
• 229B • Updated • 89.8k
• 15
QuantTrio/Qwen3.5-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 212k
• 18
QuantTrio/Qwen3.5-122B-A10B-AWQ
Image-Text-to-Text
• 125B • Updated • 70.2k
• 26
Text Generation
• 586B • Updated • 4.56k
• 6
QuantTrio/Qwen3.6-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 143
• 1
abhinavkulkarni/mosaicml-mpt-7b-instruct-w4-g128-awq
Text Generation
• Updated • 17
abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq
Text Generation
• 1B • Updated • 41
abhinavkulkarni/VMware-open-llama-7b-open-instruct-w4-g128-awq
Text Generation
• Updated • 12
abhinavkulkarni/VMware-open-llama-13b-open-instruct-w4-g128-awq
Text Generation
• Updated • 7
• 3
abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq
Text Generation
• Updated • 9
• 5
abhinavkulkarni/psmathur-orca_mini_v2_7b-w4-g128-awq
Text Generation
• Updated • 15
• 2
abhinavkulkarni/Salesforce-codegen25-7b-multi-w4-g128-awq
Text Generation
• Updated • 17
• 2
abhinavkulkarni/psmathur-orca_mini_v2_13b-w4-g128-awq
Text Generation
• Updated • 10
• 2
abhinavkulkarni/mosaicml-mpt-30b-instruct-w4-g128-awq
Text Generation
• Updated • 20
• 2
abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq
Text Generation
• 4B • Updated • 17
abhinavkulkarni/VMware-open-llama-7b-v2-open-instruct-w4-g128-awq
Text Generation
• Updated • 7
abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq
Text Generation
• Updated • 15
• 2
abhinavkulkarni/Salesforce-codegen25-7b-instruct-w4-g128-awq
Text Generation
• Updated • 16
• 3
abhinavkulkarni/meta-llama-Llama-2-7b-chat-hf-w4-g128-awq
Text Generation
• Updated • 9
• 6
abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq
Text Generation
• Updated • 9
• 1
abhinavkulkarni/stabilityai-StableBeluga-7B-w4-g128-awq
Text Generation
• Updated • 7
• 1