Running on Zero Agents Quant Converter W4A8 INT8 ConvRot ๐ง Convert safetensors checkpoints to quantized formats
Sleeping Agents Quant Converter W4A8 INT8 ConvRot ๐ง Convert safetensors models to CPUโfriendly quantized format