Update README.md
#3
by Yi30 - opened
README.md
CHANGED
|
@@ -83,7 +83,7 @@ curl -noproxy '*' http://localhost::8000/v1/chat/completions \
|
|
| 83 |
|
| 84 |
### Generate the model
|
| 85 |
```bash
|
| 86 |
-
auto_round --model Qwen/Qwen3-Next-80B-A3B-Instruct --scheme W4A16 --output_dir tmp_autoround
|
| 87 |
```
|
| 88 |
|
| 89 |
## Evaluate Results
|
|
|
|
| 83 |
|
| 84 |
### Generate the model
|
| 85 |
```bash
|
| 86 |
+
AR_DISABLE_COPY_MTP_WEIGHTS=1 auto_round --model Qwen/Qwen3-Next-80B-A3B-Instruct --scheme W4A16 --output_dir tmp_autoround
|
| 87 |
```
|
| 88 |
|
| 89 |
## Evaluate Results
|