It makes sense and that's noted @John6666
Charles Bensimon
cbensimon
AI & ML interests
None yet
Recent Activity
liked a model about 3 hours ago
cbensimon/WanTransformer3DModel-sm120-cu130-raa updated a Space about 3 hours ago
zerogpu-aoti/wan2-2-fp8da-aoti-faster liked a Space about 3 hours ago
FrameAI4687/Omni-Video-FactoryOrganizations
replied to their post 11 months ago
replied to their post 11 months ago
cc @sayakpaul for visibility
posted an update 11 months ago
Post
4603
🚀 ZeroGPU now supports PyTorch native quantization via
While it hasn’t been battle-tested yet,
Let us know if you run into any issues — and we’re excited to see what the community will build!
torchaoWhile it hasn’t been battle-tested yet,
Int8WeightOnlyConfig is already working flawlessly in our tests.Let us know if you run into any issues — and we’re excited to see what the community will build!
import spaces
from diffusers import FluxPipeline
from torchao.quantization.quant_api import Int8WeightOnlyConfig, quantize_
pipeline = FluxPipeline.from_pretrained(...).to('cuda')
quantize_(pipeline.transformer, Int8WeightOnlyConfig()) # Or any other component(s)
@spaces.GPU
def generate(prompt: str):
return pipeline(prompt).images[0]
- 5 replies
replied to their post 12 months ago
PS: note that you also probably need to push a dummy / empty commit in order to trigger a spaces package update
posted an update 12 months ago
Post
6169
🚀 ZeroGPU
Nothing too fancy for now—ZeroGPU Spaces still default to
- 💰 size-based quotas / pricing (
- 🦣 the upcoming
You can as of now control GPU size via a Space variable. Accepted values:
-
-
-
The auto mode checks total CUDA tensor size during startup:
- More than 30GB →
- Otherwise →
medium size is now available as a power-user featureNothing too fancy for now—ZeroGPU Spaces still default to
large (70GB VRAM)—but this paves the way for:- 💰 size-based quotas / pricing (
medium will offer significantly more usage than large)- 🦣 the upcoming
xlarge size (141GB VRAM)You can as of now control GPU size via a Space variable. Accepted values:
-
auto (future default)-
medium-
large (current default)The auto mode checks total CUDA tensor size during startup:
- More than 30GB →
large- Otherwise →
medium 
- 3 replies
Hi @sebblers , this should not be the case.
Could you try running an image generation on this Space:
https://huggingface.co/spaces/black-forest-labs/FLUX.1-schnell
(make sure to be logged-in to your HuggingFace account)
Sorry for the inconvenience
Hi @Keltezaa ,
By my rough calculation the current recovery rate for GPU time spend is 18min per every 60sec of GPU usage
You are not very far from reality. Actually, you get back half of your consumed quotas every 5h, which means that if you completely use your 25 minutes of quota, you'll get 12.5 minutes back after 5 hours (not all at once but progressively, in a logarithmic fashion). This gives a bit more than 60s every 18min when your quotas are empty. In the end, if used at its maximum, we end up with up to 30 hours of GPU per month
The second thing that bothers me a bit is that some Errors, or failed image generation do not refund the usage. So if an image fails due to whatever error. It still gets added to the usage and as mentioned before recovers very slow
I understand your concern but ZeroGPU does not guarantee execution results (as opposed to inference API products).
It is rather a cloud runtime that supports running arbitrary / user-defined (CUDA) applications.
Subscribing to Pro allows you to create such apps, as well as using them (yours or others) a lot more than free users
Hoping that it helps clarifying things.
Let me know if you have further concerns
posted an update over 1 year ago
Post
4792
Hello everybody,
We've rolled out a major update to ZeroGPU! All the Spaces are now running on it.
Major improvements:
1. GPU cold starts about twice as fast!
2. RAM usage reduced by two-thirds, allowing more effective resource usage, meaning more GPUs for the community!
3. ZeroGPU initializations (coldstarts) can now be tracked and displayed (use
4. Improved compatibility and PyTorch integration, increasing ZeroGPU compatible spaces without requiring any modifications!
Feel free to answer in the post if you have any questions
🤗 Best regards,
Charles
We've rolled out a major update to ZeroGPU! All the Spaces are now running on it.
Major improvements:
1. GPU cold starts about twice as fast!
2. RAM usage reduced by two-thirds, allowing more effective resource usage, meaning more GPUs for the community!
3. ZeroGPU initializations (coldstarts) can now be tracked and displayed (use
progress=gr.Progress(track_tqdm=True))4. Improved compatibility and PyTorch integration, increasing ZeroGPU compatible spaces without requiring any modifications!
Feel free to answer in the post if you have any questions
🤗 Best regards,
Charles
reacted to multimodalart's post with ❤️ over 1 year ago
Post
35634
New feature 🔥
Image models and LoRAs now have little previews 🤏
If you don't know where to start to find them, I invite you to browse cool LoRAs in the profile of some amazing fine-tuners: @artificialguybr , @alvdansen , @DoctorDiffusion , @e-n-v-y , @KappaNeuro @ostris
Image models and LoRAs now have little previews 🤏
If you don't know where to start to find them, I invite you to browse cool LoRAs in the profile of some amazing fine-tuners: @artificialguybr , @alvdansen , @DoctorDiffusion , @e-n-v-y , @KappaNeuro @ostris
- 3 replies
reacted to ehristoforu's post with 🔥👍 almost 2 years ago
Post
1942
I decided to play around with FluentlyXL v4 😉
👉 Model: fluently/Fluently-XL-v4
✨ Playground: fluently/Fluently-Playground
👉 Model: fluently/Fluently-XL-v4
✨ Playground: fluently/Fluently-Playground
reacted to Wauplin's post with 🔥 about 2 years ago
Post
2357
🚀 Just released version 0.22.0 of the
Exciting updates include:
✨ Chat-completion API in the InferenceClient!
🤖 Official inference types in InferenceClient!
🧩 Better config and tags in
🏆 Generate model cards for your
🏎️ x3 download speed in
Check out the full release notes for more details: Wauplin/huggingface_hub#5 👀
huggingface_hub Python library!Exciting updates include:
✨ Chat-completion API in the InferenceClient!
🤖 Official inference types in InferenceClient!
🧩 Better config and tags in
ModelHubMixin!🏆 Generate model cards for your
ModelHubMixin integrations! 🏎️ x3 download speed in
HfFileSystem!!Check out the full release notes for more details: Wauplin/huggingface_hub#5 👀
- 2 replies
You are now accepted in the beta @nxphi47 and @CharlieLiveh, enjoy!
reacted to merve's post with 🤗👍 over 2 years ago
Post
Migrated all my GPU consuming Spaces to ZERO, it was super easy to do so (add three lines of code and voila!) and the start-up time decreased dramatically as well 💜
- 17 replies
reacted to vicgalle's post with 🤯 over 2 years ago
Post
Can you merge models of different sizes? ⚗️
Well, yes, if the models are somewhat compatible. Here is an experiment I did. I wanted to merge two of the best performing models: mlabonne/NeuralBeagle14-7B and jeonsworld/CarbonVillain-en-10.7B-v4
Here is my recipe:
1. Expand the layers of NeuralBeagle to 10.7B ala frankenmerge.
2. DPO-tune the previous model with a high-quality preference dataset, argilla/distilabel-intel-orca-dpo-pairs
3. Merge the previous model with CarbonVillain (needs —allow-crimes in mergekit! 🔪)
And here is the resulting model, CarbonBeagle-11B, which ranked top in the leaderboard for its size class:
vicgalle/CarbonBeagle-11B
Well, yes, if the models are somewhat compatible. Here is an experiment I did. I wanted to merge two of the best performing models: mlabonne/NeuralBeagle14-7B and jeonsworld/CarbonVillain-en-10.7B-v4
Here is my recipe:
1. Expand the layers of NeuralBeagle to 10.7B ala frankenmerge.
2. DPO-tune the previous model with a high-quality preference dataset, argilla/distilabel-intel-orca-dpo-pairs
3. Merge the previous model with CarbonVillain (needs —allow-crimes in mergekit! 🔪)
And here is the resulting model, CarbonBeagle-11B, which ranked top in the leaderboard for its size class:
vicgalle/CarbonBeagle-11B
- 2 replies
Hi @koisose, no special requirement we simply quickly check your HF profile and then accept you (I will make sure that we don't miss your profile). Don't hesitate to read https://huggingface.co/zero-gpu-explorers organization card that currently acts as (the only) documentation for ZeroGPU
reacted to mrfakename's post with 👍 over 2 years ago
reacted to alvarobartt's post with ❤️ over 2 years ago
Post
💨 Notux 8x7b was just released!
From Argilla, we recently fine-tuned Mixtral 8x7b Instruct from Mistral AI using DPO, and a binarized and curated version of UltraFeedback, to find out it outperforms every other MoE-based model on the Hub.
- argilla/notux-8x7b-v1
- argilla/ultrafeedback-binarized-preferences-cleaned
From Argilla, we recently fine-tuned Mixtral 8x7b Instruct from Mistral AI using DPO, and a binarized and curated version of UltraFeedback, to find out it outperforms every other MoE-based model on the Hub.
- argilla/notux-8x7b-v1
- argilla/ultrafeedback-binarized-preferences-cleaned
- 19 replies