"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX
v1k
xbruce22
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
Comfy-Org/MiniMax-H3 liked a model 4 days ago
NousResearch/Arete-27B new activity 20 days ago
Nanbeige/Nanbeige4.3-33B:Please release fp8Organizations
