eaddario/granite-4.1-30b-GGUF
Text Generation • 29B • Updated • 122
Ed Addario PRO
eaddario
AI & ML interests
Finding ways to optimize LLMs' inference performance in resource-constrained environments (e.g. commodity hardware, desktops, laptops, mobiles, edge devices, etc.)
Recent Activity
new activity 6 days ago
eaddario/Qwen3.6-27B-GGUF:Great quants! 122b? upvoted a collection about 1 month ago
Inference Optimized Checkpoints (with Model Optimizer) new activity about 2 months ago
eaddario/gemma-4-26B-A4B-it-GGUF:Methodology of using F16 as intermediate conversion and baseline?Organizations
eaddario/granite-4.1-8b-GGUF
Text Generation • 9B • Updated • 114
eaddario/Qwen3.6-27B-GGUF
Image-Text-to-Text • 27B • Updated • 339 • 4
eaddario/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 264 • 2
eaddario/gemma-4-E4B-it-GGUF
Any-to-Any • 8B • Updated • 252
eaddario/gemma-4-E2B-it-GGUF
Any-to-Any • 5B • Updated • 201
eaddario/gemma-4-26B-A4B-it-GGUF
Any-to-Any • 25B • Updated • 179
eaddario/Qwen3.5-9B-GGUF
Text Generation • 9B • Updated • 3.66k • 5
eaddario/Qwen3.5-4B-GGUF
Text Generation • 4B • Updated • 264
eaddario/Ministral-3-14B-Instruct-2512-GGUF
Text Generation • 14B • Updated • 265
eaddario/Ministral-3-14B-Reasoning-2512-GGUF
Text Generation • 14B • Updated • 345
eaddario/Olmo-3-7B-Instruct-GGUF
Text Generation • 7B • Updated • 407
eaddario/Olmo-3-7B-Think-GGUF
Text Generation • 7B • Updated • 340
eaddario/GLM-4.6V-Flash-GGUF
Image-Text-to-Text • 9B • Updated • 267 • 4
eaddario/Apriel-1.6-15b-Thinker-GGUF
Image-Text-to-Text • 14B • Updated • 592 • 2
eaddario/Mistral-Small-3.2-24B-Instruct-2506-pruned-GGUF
Text Generation • 22B • Updated • 216
eaddario/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Text Generation • 24B • Updated • 400
eaddario/Devstral-Small-2505-pruned-GGUF
Text Generation • 24B • Updated • 198
eaddario/Devstral-Small-2505-GGUF
Text Generation • 24B • Updated • 108
eaddario/gemma-3-12b-it-GGUF
Text Generation • 12B • Updated • 881
eaddario/gemma-3-12b-it-pruned-GGUF
Text Generation • 12B • Updated • 329 • 5
eaddario/Qwen3-30B-A3B-GGUF
Text Generation • 31B • Updated • 451 • 4
eaddario/Qwen3-30B-A3B-pruned-GGUF
Text Generation • 29B • Updated • 225 • 4
eaddario/Dolphin-Mistral-24B-Venice-Edition-GGUF
Text Generation • 24B • Updated • 843 • 6
eaddario/Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF
Text Generation • 24B • Updated • 470 • 1
eaddario/Dolphin3.0-R1-Mistral-24B-GGUF
Text Generation • 24B • Updated • 2.8k • 1
eaddario/Dolphin3.0-Mistral-24B-GGUF
Text Generation • 24B • Updated • 505 • 2
eaddario/OLMo-2-1124-7B-Instruct-GGUF
Text Generation • 7B • Updated • 121
eaddario/Qwen3-8B-GGUF
Text Generation • 8B • Updated • 369 • 1
eaddario/Llama-xLAM-2-8b-fc-r-GGUF
Text Generation • 8B • Updated • 172 • 1