GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 22 • 2
🏗️ Building on HF
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a Space about 22 hours ago
StentorLabs/SLM_Arena new activity 1 day ago
GODELEV/Arithmetic-XL:[bot] Conversion to Parquet reacted to Banaxi-Tech's post with 👀 3 days ago
A new model is coming!
Its going to take a long time on my 5070 Ti so expect a release in ~1 month.
We think this model is going to be SOTA For its size.
Our Mini Version will be 25M Parameters and Pro with 140M.
The Pro version has a 3072 Context Window (Extensible to up to 6K with RoPE) And the Mini version has a context window of 4096 (Up to 8K with RoPE)
Meanwhile we are currently working on a Instruct Version of our BananaMind 1.5 Base.
The training will start this weekend
We are very exited to release it when its done!Organizations
None yet
GODELEV/Exp-1
9.85M • Updated • 522 • 1
GODELEV/TOK-16K
Updated
GODELEV/TOK-8K
Updated
GODELEV/TOK-32K
Updated
GODELEV/Ant-10M
Text Generation • 9.9M • Updated • 139 • 4
GODELEV/Archaea-74M
Text Generation • 74M • Updated • 313 • 4
GODELEV/TOK-4K
Updated
GODELEV/Ant-5M
Text Generation • 4.71M • Updated • 679 • 2
GODELEV/Test-1-4000
Text Generation • 0.2B • Updated • 93
GODELEV/Test-1-3000
Text Generation • 0.2B • Updated • 22
GODELEV/Test-1-2000
Text Generation • 0.2B • Updated • 21