Volko
Volko76
AI & ML interests
Quantization, Fine-tune, Agentic Frameworks
Recent Activity
liked a dataset 6 days ago
markov-ai/gaming-500-hours liked a dataset 7 days ago
urish/pirate-chat liked a Space about 2 months ago
mkmenta/try-gpt-1-and-gpt-2Organizations
A list of Qwen2.5 Coder base quantized in GGUF
A CPU + GPU support type of quantization. It's currently the most used quantization method. Read more here : https://github.com/ggerganov/llama.cpp
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 40 -
Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 113 -
Volko76/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 64 -
Volko76/Qwen2.5-Coder-7B-Instruct-GGUF
Text Generation • 8B • Updated • 71
A list of Qwen2.5 Coder quantized in GGUF
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 40 -
Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 113 -
Volko76/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 64 -
Volko76/Qwen2.5-Coder-7B-Instruct-GGUF
Text Generation • 8B • Updated • 71
A complete open source small coding model quantized in GGUF
A collection of models quantized for EXL2, one of the fastest quantisation method. https://github.com/turboderp/exllamav2
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-2.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-3.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2
Text Generation • Updated
A list of Qwen2.5 Coder quantized in GGUF
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 40 -
Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 113 -
Volko76/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 64 -
Volko76/Qwen2.5-Coder-7B-Instruct-GGUF
Text Generation • 8B • Updated • 71
A list of Qwen2.5 Coder base quantized in GGUF
A complete open source small coding model quantized in GGUF
A CPU + GPU support type of quantization. It's currently the most used quantization method. Read more here : https://github.com/ggerganov/llama.cpp
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 40 -
Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 113 -
Volko76/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 64 -
Volko76/Qwen2.5-Coder-7B-Instruct-GGUF
Text Generation • 8B • Updated • 71
A collection of models quantized for EXL2, one of the fastest quantisation method. https://github.com/turboderp/exllamav2
-
Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-2.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-3.0bpw-exl2
Text Generation • Updated -
Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2
Text Generation • Updated