Qwen3.8-27B 2-bit GGUFs, 8.31-8.55 GB. WikiText-2 PPL measured on one 12 GB laptop GPU, same 20 windows.
AI & ML interests
None defined yet.
Recent Activity
View all activity
2-bit GGUFs for llama.cpp: Qwen3.8-27B in 8.31 GB (fits a 12 GB GPU), Qwen3.5 4B/2B/0.8B, Qwen3 4B/1.7B/0.6B, Llama-3.1-8B, GPU fit calculator.
-
LLM GPU fit: Pingala-8 2-bit vs 4-bit
🧮1Will a model fit your GPU as Pingala-8 2-bit or Q4_K_M?
-
Genrius-AI/Qwen3.8-27B-Pingala8-2bit
Text Generation • 10B • Updated • 1.13k -
Genrius-AI/Qwen3-4B-Pingala8-2bit
Text Generation • 1B • Updated • 1.36k • 1 -
Genrius-AI/Qwen3.5-4B-Pingala8-2bit
Text Generation • 2B • Updated • 1.08k
Qwen3.8-27B 2-bit GGUFs, 8.31-8.55 GB. WikiText-2 PPL measured on one 12 GB laptop GPU, same 20 windows.
2-bit GGUFs for llama.cpp: Qwen3.8-27B in 8.31 GB (fits a 12 GB GPU), Qwen3.5 4B/2B/0.8B, Qwen3 4B/1.7B/0.6B, Llama-3.1-8B, GPU fit calculator.
-
LLM GPU fit: Pingala-8 2-bit vs 4-bit
🧮1Will a model fit your GPU as Pingala-8 2-bit or Q4_K_M?
-
Genrius-AI/Qwen3.8-27B-Pingala8-2bit
Text Generation • 10B • Updated • 1.13k -
Genrius-AI/Qwen3-4B-Pingala8-2bit
Text Generation • 1B • Updated • 1.36k • 1 -
Genrius-AI/Qwen3.5-4B-Pingala8-2bit
Text Generation • 2B • Updated • 1.08k