Instructions to use FastVideo/FastMochi-diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FastVideo/FastMochi-diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("FastVideo/FastMochi-diffusers", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Any chance for an fp16 .safetensors version?
#1
by CCP6 - opened
Hello,
Thank you for your efforts on making these "heavy" new SOTA model faster to generate. Unfortunately the Mochi Fast model you share here now is 40gb putting it out of VRAM range of any consumer GFX card. Is there any possibility you could convert/host an fp16 version? Thanks for reading/considering!!