dark-pen/apodex-1.0-2B-SFT-rebased
Image-Text-to-Text • 2B • Updated • 44
J C
dark-pen
AI & ML interests
None yet
Recent Activity
upvoted an article about 7 hours ago
Distillation in 2026 (so far): which frontier models use it and how reacted to sergiopaniego's post with 👍 about 7 hours ago
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL! upvoted a paper about 10 hours ago
Random Long-Context Access for Mamba via Hardware-aligned Hierarchical
Sparse AttentionOrganizations
dark-pen/apodex-1.0-4B-SFT-rebased
Image-Text-to-Text • 5B • Updated • 107
dark-pen/apodex-1.0-0.8B-SFT-rebased
Image-Text-to-Text • 0.9B • Updated • 140
dark-pen/GRM2a-3b
4B • Updated • 3
dark-pen/ExGRPO-LUFFY-7B-Continual-IQ4_XS-GGUF
Text Generation • 8B • Updated • 11
dark-pen/Remix-R1-Distilled-Qwen-7B-IQ4_XS-GGUF
8B • Updated • 11
dark-pen/Klear-AgentForge-8B-IQ4_XS-GGUF
8B • Updated • 11
dark-pen/Eva-4B-V2-IQ4_XS-GGUF
Text Classification • 4B • Updated • 10 • 2
dark-pen/EmbeddingsG300M-ft-Q6_K-GGUF
Sentence Similarity • 0.3B • Updated • 9
dark-pen/DASD-4B-Thinking-IQ4_XS-GGUF
Text Generation • 4B • Updated • 14
dark-pen/mR3-Qwen3-4B-en-prompt-en-thinking-IQ4_XS-GGUF
4B • Updated • 5
dark-pen/Nemotron-Orchestrator-8B-IQ4_XS-GGUF
8B • Updated • 3
dark-pen/Logics-STEM-8B-RL-IQ4_XS-GGUF
8B • Updated • 7
dark-pen/brief-pro-IQ4_XS-GGUF
4B • Updated • 3
dark-pen/frosty-jan
Updated
dark-pen/bert-finetuned-ner
0.1B • Updated • 1
dark-pen/REBEL-Llama-3-Armo-iter_3-Q4_K_M-GGUF
8B • Updated • 10
dark-pen/REBEL-Llama-3-Armo-iter_3-IQ4_XS-GGUF
8B • Updated • 4
dark-pen/REBEL-Llama-3-Armo-iter_3-IQ4_NL-GGUF
8B • Updated • 9