Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Instructions to use JYL480/Test_DistBERTModel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JYL480/Test_DistBERTModel with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="JYL480/Test_DistBERTModel")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("JYL480/Test_DistBERTModel") model = AutoModelForCausalLM.from_pretrained("JYL480/Test_DistBERTModel", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use JYL480/Test_DistBERTModel with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "JYL480/Test_DistBERTModel" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JYL480/Test_DistBERTModel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/JYL480/Test_DistBERTModel
- SGLang
How to use JYL480/Test_DistBERTModel with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "JYL480/Test_DistBERTModel" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JYL480/Test_DistBERTModel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "JYL480/Test_DistBERTModel" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JYL480/Test_DistBERTModel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use JYL480/Test_DistBERTModel with Docker Model Runner:
docker model run hf.co/JYL480/Test_DistBERTModel
Commit History
-
End of training
Verified signature5de3f68 -
Training in progress, step 13500
Verified signature85073d8 -
Training in progress, step 13000
Verified signatureecb7703 -
Training in progress, step 12500
Verified signature7434d05 -
Training in progress, step 12000
Verified signaturef63d7e8 -
Training in progress, step 11500
Verified signature27a13f9 -
Training in progress, step 11000
Verified signature5ff174f -
Training in progress, step 10500
Verified signature4559a1d -
Training in progress, step 10000
Verified signaturee843a4f -
Training in progress, step 9500
Verified signaturebbb81ed -
Training in progress, step 9000
Verified signature08ebba0 -
Training in progress, step 8500
Verified signature67cfd72 -
Training in progress, step 8000
Verified signaturef81ae71 -
Training in progress, step 7500
Verified signature7e566e4 -
Training in progress, step 7000
Verified signaturebd11d3e -
Training in progress, step 6500
Verified signaturee2d2602 -
Training in progress, step 6000
Verified signature60987f7 -
Training in progress, step 5500
Verified signature9f0e90a -
Training in progress, step 5000
Verified signature1667cfe -
Training in progress, step 4500
Verified signaturec639a1b -
Training in progress, step 4000
Verified signatureb9d934c -
Training in progress, step 3500
Verified signatured9c2ff3 -
Training in progress, step 3000
Verified signature7839458 -
Training in progress, step 2500
Verified signature7c20918 -
Training in progress, step 2000
Verified signaturef527612 -
Training in progress, step 1500
Verified signature71e0c17 -
Training in progress, step 1000
Verified signature423f9d6 -
Training in progress, step 500
Verified signaturedaa84b8 -
End of training
Verified signature73753f5 -
Training in progress, step 6000
Verified signature29090b2 -
Training in progress, step 5500
Verified signatured7da64e -
Training in progress, step 5000
Verified signaturee8557b9 -
Training in progress, step 4500
Verified signature89900a7 -
Training in progress, step 4000
Verified signaturea084353 -
Training in progress, step 3500
Verified signature6a896a0 -
Training in progress, step 3000
Verified signature8b3da4f -
Training in progress, step 2500
Verified signature3b541f5 -
Training in progress, step 2000
Verified signaturec9efd2b -
Training in progress, step 1500
Verified signatureae3e684 -
Training in progress, step 1000
Verified signaturec51c1e9 -
Training in progress, step 500
Verified signature990f2de -
End of training
Verified signature671caba -
Training in progress, step 3500
Verified signaturef305759 -
Training in progress, step 3000
Verified signaturec198477 -
Training in progress, step 2500
Verified signature23193b5 -
Training in progress, step 2000
Verified signature9bbfbba -
Training in progress, step 1500
Verified signaturef828c0c -
Training in progress, step 1000
Verified signature726b3fc -
Training in progress, step 500
Verified signaturefeb56e0 -
initial commit
Verified signature19a71c9