Instructions to use CodeTed/Chinese_Grammarly with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use CodeTed/Chinese_Grammarly with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="CodeTed/Chinese_Grammarly")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("CodeTed/Chinese_Grammarly")
model = AutoModelForSeq2SeqLM.from_pretrained("CodeTed/Chinese_Grammarly", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use CodeTed/Chinese_Grammarly with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "CodeTed/Chinese_Grammarly"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "CodeTed/Chinese_Grammarly",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/CodeTed/Chinese_Grammarly

SGLang

How to use CodeTed/Chinese_Grammarly with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "CodeTed/Chinese_Grammarly" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "CodeTed/Chinese_Grammarly",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "CodeTed/Chinese_Grammarly" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "CodeTed/Chinese_Grammarly",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use CodeTed/Chinese_Grammarly with Docker Model Runner:
```
docker model run hf.co/CodeTed/Chinese_Grammarly
```

Chinese_Grammarly

Commit History

Oct 25, 2024

08:52
Adding `safetensors` variant of this model⁠

SFconvertbot

Verified signature
b0b9e79

May 2, 2024

11:16
Update README.md

CodeTed

Verified signature
c4dfe0e
11:15
Update README.md

CodeTed

Verified signature
2746f45

Jan 5, 2024

15:03
Update README.md

CodeTed

d73b4ed

Oct 27, 2023

02:54
update pretrained version

TedYeh

50dbbd0
02:50
update pretrained model

TedYeh

3372a5a

Oct 15, 2023

15:11
Update README.md

CodeTed

5eacccf
15:06
Update README.md

CodeTed

2128c3c
15:02
Update README.md

CodeTed

826116f
14:04
Merge branch 'main' of https://huggingface.co/CodeTed/CGEDit into main

TedYeh

38ad601
13:55
Upload model

TedYeh

7bdf904
13:40
Update README.md

CodeTed

e49eb71
13:33
Create README.md⁠

CodeTed

e2f5204
13:21
initial commit

CodeTed

02066c3

Commit History

Oct 25, 2024

Adding `safetensors` variant of this model⁠

May 2, 2024

Update README.md

Update README.md

Jan 5, 2024

Update README.md

Oct 27, 2023

update pretrained version

update pretrained model

Oct 15, 2023

Update README.md

Update README.md

Update README.md

Merge branch 'main' of https://huggingface.co/CodeTed/CGEDit into main

Upload model

Update README.md

Create README.md⁠

initial commit