Neurlang Project's picture

Neurlang Project

neurlang

AI & ML interests

hashtrons/weightless (non neural) networks

Recent Activity

reacted to ginigen-ai's post with 🤯 about 4 hours ago
šŸ³ The RoboCasa Kitchen Leaderboard What does it take for a robot to handle kitchen chores the way a person does? It has to see (Vision), understand instructions (Language), and actually act (Action) — and VLA (Vision-Language-Action) models are emerging as the answer. They're the bridge between large multimodal models and real-world embodied control. RoboCasa Kitchen is a leading robot-learning benchmark in which a single-arm robot (Franka Panda) performs 24 atomic manipulation tasks — picking up cups and bowls, opening drawers and doors, turning faucets, pressing buttons, and more — inside a photorealistic simulated kitchen. Because the layout and object placement are randomized every episode, it tests genuine generalization rather than memorized motions. The score (success rate, SR) is the average fraction of the 24 tasks completed as instructed, measured over multiple seeds so results aren't down to luck. The catch: this benchmark has no official leaderboard, and protocols (number of demonstrations, evaluation setup) differ from paper to paper, leaving scores scattered. Lining the numbers up naively quickly turns into an apples-to-oranges comparison. This leaderboard fixes that by collecting published scores with their sources and comparing only what is genuinely comparable. It's split into three tables: šŸ† Kitchen 24-task (matched) — head-to-head under identical conditions (per the RLDX-1 Technical Report). This is the core ranking you can actually trust. āž• Other protocols — self-reported under different setups (e.g. fewer demos). Not directly comparable, so kept separate. šŸ¤– GR1-Tabletop — a different, humanoid-based variant suite, separated to avoid confusion. Any researcher can submit their own model's score directly, and submissions are reviewed before they appear on the board. Every number links to its source paper, so you can verify it yourself. šŸ‘‰ https://huggingface.co/spaces/ginigen-ai/robocasa-kitchen-leaderboard
reacted to pankajpandey-dev's post with šŸš€ 4 days ago
šŸ‡®šŸ‡³ New in my Hindi LLM Series: Gemma-4 E4B, fine-tuned for Hindi — and it runs on your laptop's CPU. I fine-tuned Google's new Gemma-4 E4B on ~10k Hindi instruction pairs (AI4Bharat: anudesh + dolly) using Unsloth + LoRA, on a single L4 GPU. Then I ran an honest side-by-side eval: base Gemma-4 vs my fine-tune, across 25 Hindi prompts. The results were interesting šŸ‘‡ āœ… My fine-tune is more concise — ask for "3 tips" and it gives exactly 3. Base writes a 1,200-character essay. āœ… Pure native Hindi — base keeps slipping into English ("ą¤øą¤‚ą¤¤ą„ą¤²ą¤æą¤¤ आहार (Eat a Balanced Diet)", "तारा (Star)"). My fine-tune stays in clean Hindi. āœ… Tighter instruction-following — ask for a "short message" and it gives one, not a menu of options. āš–ļø And to be honest: base Gemma-4 is more detailed and comprehensive. I didn't build a "smarter" model — I built a focused, Hindi-native, edge-friendly one that runs as a 5GB GGUF (Q4) on CPU. šŸ”— Try it: Live demo (CPU): https://huggingface.co/spaces/pankajpandey-dev/gemma-4-e4b-hindi-demo GGUF (Ollama/llama.cpp): https://huggingface.co/pankajpandey-dev/gemma-4-e4b-hindi-instruct-GGUF 16-bit model: https://huggingface.co/pankajpandey-dev/gemma-4-e4b-hindi-instruct Built with @unsloth Ā· Data by @ai4bharat šŸ™ #Hindi #LLM #Gemma #Unsloth #IndicNLP #GGUF
View all activity

Organizations

None yet