Instructions to use kdf/javascript-docstring-generation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kdf/javascript-docstring-generation with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="kdf/javascript-docstring-generation")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("kdf/javascript-docstring-generation") model = AutoModelForCausalLM.from_pretrained("kdf/javascript-docstring-generation") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use kdf/javascript-docstring-generation with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "kdf/javascript-docstring-generation" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kdf/javascript-docstring-generation", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/kdf/javascript-docstring-generation
- SGLang
How to use kdf/javascript-docstring-generation with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "kdf/javascript-docstring-generation" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kdf/javascript-docstring-generation", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "kdf/javascript-docstring-generation" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kdf/javascript-docstring-generation", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use kdf/javascript-docstring-generation with Docker Model Runner:
docker model run hf.co/kdf/javascript-docstring-generation
| license: apache-2.0 | |
| widget: | |
| - text: "<|endoftext|>\nfunction getDateAfterNDay(n){\n return moment().add(n, 'day')\n}\n// docstring\n/**" | |
| ## Basic info | |
| model based [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) | |
| fine-tuned with data [codeparrot/github-code-clean](https://huggingface.co/datasets/codeparrot/github-code-clean) | |
| data filter by JavaScript and TypeScript | |
| ## Usage | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForCausalLM | |
| model_type = 'kdf/javascript-docstring-generation' | |
| tokenizer = AutoTokenizer.from_pretrained(model_type) | |
| model = AutoModelForCausalLM.from_pretrained(model_type) | |
| inputs = tokenizer('''<|endoftext|> | |
| function getDateAfterNDay(n){ | |
| return moment().add(n, 'day') | |
| } | |
| // docstring | |
| /**''', return_tensors='pt') | |
| doc_max_length = 128 | |
| generated_ids = model.generate( | |
| **inputs, | |
| max_length=inputs.input_ids.shape[1] + doc_max_length, | |
| do_sample=False, | |
| return_dict_in_generate=True, | |
| num_return_sequences=1, | |
| output_scores=True, | |
| pad_token_id=50256, | |
| eos_token_id=50256 # <|endoftext|> | |
| ) | |
| ret = tokenizer.decode(generated_ids.sequences[0], skip_special_tokens=False) | |
| print(ret) | |
| ``` | |
| ## Prompt | |
| You could give model a style or a specific language, for example: | |
| ```python | |
| inputs = tokenizer('''<|endoftext|> | |
| function add(a, b){ | |
| return a + b; | |
| } | |
| // docstring | |
| /** | |
| * Calculate number add. | |
| * @param a {number} the first number to add | |
| * @param b {number} the second number to add | |
| * @return the result of a + b | |
| */ | |
| <|endoftext|> | |
| function getDateAfterNDay(n){ | |
| return moment().add(n, 'day') | |
| } | |
| // docstring | |
| /**''', return_tensors='pt') | |
| doc_max_length = 128 | |
| generated_ids = model.generate( | |
| **inputs, | |
| max_length=inputs.input_ids.shape[1] + doc_max_length, | |
| do_sample=False, | |
| return_dict_in_generate=True, | |
| num_return_sequences=1, | |
| output_scores=True, | |
| pad_token_id=50256, | |
| eos_token_id=50256 # <|endoftext|> | |
| ) | |
| ret = tokenizer.decode(generated_ids.sequences[0], skip_special_tokens=False) | |
| print(ret) | |
| inputs = tokenizer('''<|endoftext|> | |
| function add(a, b){ | |
| return a + b; | |
| } | |
| // docstring | |
| /** | |
| * 计算数字相加 | |
| * @param a {number} 第一个加数 | |
| * @param b {number} 第二个加数 | |
| * @return 返回 a + b 的结果 | |
| */ | |
| <|endoftext|> | |
| function getDateAfterNDay(n){ | |
| return moment().add(n, 'day') | |
| } | |
| // docstring | |
| /**''', return_tensors='pt') | |
| doc_max_length = 128 | |
| generated_ids = model.generate( | |
| **inputs, | |
| max_length=inputs.input_ids.shape[1] + doc_max_length, | |
| do_sample=False, | |
| return_dict_in_generate=True, | |
| num_return_sequences=1, | |
| output_scores=True, | |
| pad_token_id=50256, | |
| eos_token_id=50256 # <|endoftext|> | |
| ) | |
| ret = tokenizer.decode(generated_ids.sequences[0], skip_special_tokens=False) | |
| print(ret) | |
| ``` |