MACaQ Collection GGUFs models for local AI Inference quantized with MACaQ (https://github.com/huawei-csl/MACaQ) • 1 item • Updated about 22 hours ago • 2
MACaQ Collection GGUFs models for local AI Inference quantized with MACaQ (https://github.com/huawei-csl/MACaQ) • 1 item • Updated about 22 hours ago • 2
MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations Paper • 2611.10649 • Published 6 days ago • 31
MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations Paper • 2611.10649 • Published 6 days ago • 31
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks Paper • 2606.03458 • Published Jun 2 • 62 • 10
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks Paper • 2606.03458 • Published Jun 2 • 62 • 10
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks Paper • 2606.03458 • Published Jun 2 • 62
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks Paper • 2606.03458 • Published Jun 2 • 62