GGUFs models for local AI Inference quantized with MACaQ (https://github.com/huawei-csl/MACaQ)
HUAWEI Computing Systems Lab
company
Verified
AI & ML interests
None defined yet.
Recent Activity
Papers
MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks
models 24
huawei-csl/Qwen3.6-35B-A3B-MACaQ-R-GGUF
Text Generation • 35B • Updated • 546 • 8
huawei-csl/Qwen3-8B-PreSINQ-GGUF
Text Generation • 8B • Updated • 63 • 2
huawei-csl/Qwen3-0.6B-PreSINQ-GGUF
Text Generation • 0.6B • Updated • 63 • 2
huawei-csl/Qwen3-4B-PreSINQ-GGUF
Text Generation • 4B • Updated • 109 • 8
huawei-csl/Qwen3-1.7B-PreSINQ-GGUF
Text Generation • 2B • Updated • 87 • 3
huawei-csl/Qwen3-Next-80B-A3B-Instruct-4bit-SINQ
Text Generation • Updated • 27 • 2
huawei-csl/Qwen3-Next-80B-A3B-Instruct-3bit-SINQ
Text Generation • Updated • 39 • 2
huawei-csl/Qwen3-32B-3bit-ASINQ
Text Generation • 6B • Updated • 25 • 5
huawei-csl/Apertus-8B-2509-4bit-SINQ
Text Generation • 5B • Updated • 19 • 2
huawei-csl/Qwen3-32B-3bit-SINQ
Text Generation • 6B • Updated • 23 • 6