nm-testing/whisper-large-v3.w4a16
Automatic Speech Recognition • 2B • Updated • 30
• 2
nm-testing/whisper-large-v2.w4a16
2B • Updated • 13
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation • 16B • Updated • 654
nm-testing/llama2.c-stories42M-gsm8k-stacked-compressed
48.6M • Updated • 836
nm-testing/llama2.c-stories42M-gsm8k-sparse-only-uncompressed
58.1M • Updated • 970
nm-testing/llama2.c-stories42M-gsm8k-sparse-only-compressed
48.6M • Updated • 856
nm-testing/llama2.c-stories42M-gsm8k-quantized-only-compressed
58.1M • Updated • 1.09k
nm-testing/Meta-Llama-3-8B-Instruct-AttnQuantOnly
8B • Updated • 16
nm-testing/Meta-Llama-3-8B-FP8-AttnQuant-WeightQuant
8B • Updated • 18
nm-testing/Meta-Llama-3-8B-FP8-AttnQuant
8B • Updated • 14
nm-testing/pixtral-12b-FP8-dynamic-all
13B • Updated • 23
nm-testing/pixtral-12b-W4A16-G128
13B • Updated • 16
nm-testing/Qwen2-VL-2B-Instruct-Sparse-0.6
2B • Updated • 27
nm-testing/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
Updated
nm-testing/glm-4v-9b-W4A16-G128
14B • Updated • 26
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-partial-24-remaining-fp8-compressed
1B • Updated • 17
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-partial-24-entire-fp8-compressed
1B • Updated • 19
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-partial-24
1B • Updated • 15
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-full-sparse24
1B • Updated • 21
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-0-5-remaining-fp8-compressed
1B • Updated • 19
nm-testing/whisper-large-v2-FP8-dynamic
2B • Updated • 19
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-layer-0-5-fp8-compressed
1B • Updated • 16
nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-layer-0-fp8-compressed
1B • Updated • 16
nm-testing/Mistral-7B-Instruct-v0.32of4-sparse
7B • Updated • 11
nm-testing/granite-8b-code-instruct-128k2of4-sparse
8B • Updated • 23
nm-testing/granite-3.1-8b-instruct2of4-sparse
8B • Updated • 13
nm-testing/Mistral-7B-Instruct-v0.3-W4A16-G128
7B • Updated • 15
nm-testing/Mistral-7B-Instruct-v0.3-W8A8-Dynamic-Per-Token
7B • Updated • 18
nm-testing/granite-8b-code-instruct-128k-W4A16-G128
8B • Updated • 24
nm-testing/granite-8b-code-instruct-128k-W8A8-Dynamic-Per-Token
8B • Updated • 27