Puxis97/Mixtral-8x7B-Python-Coder-CodeAlpaca 🐍

This model is a Mixtral 8x7B Instruct model fine-tuned using QLoRA on the CodeAlpaca 20K dataset to specialize in Python code instruction following and generation.

• Developed by: Puxis97
• License: apache-2.0
• Finetuned from model : mistralai/Mixtral-8x7B-Instruct-v0.1

Training Details

This fine-tuned model was built for high-efficiency using Unsloth's QLoRA optimizations and the Hugging Face TRL library, resulting in a powerful, instruction-following code generation model that runs on consumer GPUs.

Setting	Value
Base Model	mistralai/Mixtral-8x7B-Instruct-v0.1
Dataset	HuggingFaceH4/CodeAlpaca_20K
Method	QLoRA (4-bit quantization)
Task	Code Instruction Following / Python Coding