Hugging Face's logo
Fabien Herry's picture
3 3

Fabien Herry

Gahnos
·

AI & ML interests

Currently learning to become an IA Dev

Recent Activity

liked a Space 3 days ago
Qwen/Qwen3-TTS
reacted to mindchain's post with 🧠 24 days ago
Neural Traffic Control: Orchestrating Multi-Path Reasoning 🚥 The future of AI isn't just about "better" models—it’s about high-precision orchestration. We are moving from linear processing to Parallel MTP-Reasoning, where we manage neural traffic across stabilized, transparent, and recursive highways. 1️⃣ The Backbone: Stabilized High-Dimensional Routing (arXiv:2512.24880) Using DeepSeek’s mHC (Manifold-Constrained Hyper-Connections), we solve the instability of deep MoE architectures. By projecting weight updates onto the Birkhoff Polytope, we ensure that our "Simpsons-style" expert lanes maintain mathematical identity. This is the hardware-level stability needed to run multiple reasoning paths without collapse. 2️⃣ The Vision: Gemma Scope 2 & Feature Steering You can't steer what you can't see. Gemma Scope 2 provides the "X-ray" for our highways. By using Sparse Autoencoders (SAEs), our Meta-Controller identifies the active features in each expert lane. We don't just route data; we route intent by monitoring feature-drift in real-time. 3️⃣ The Logic: Recursive Open Meta-Agents (arXiv:2512.24601) We integrate the ROMA (Recursive Open Meta-Agent) framework. Instead of a flat response, the model operates in a recursive loop, refining its internal state before any output occurs. This is the "brain" of our [Meta-Controller GitHub Repo], enabling the model to simulate and discard weak logic internally. 4️⃣ The Simulation: Parallel MTP-Reasoning This is where it comes together: Multi-Token Prediction (MTP) meets Parallel Simulation. Our Python-driven controller runs three parallel Gemma 3 instances. The Process: 3 paths generated simultaneously. The Filter: A 500-token lookahead window. The Decision: The Meta-Controller uses SAE-data from Gemma Scope to select the path with the highest logical fidelity. The Result: A self-correcting, transparent, and multi-threaded reasoning engine. We aren't just scaling parameters; we are scaling architectural precision. 🧠
reacted to pcuenq's post with 🔥 24 days ago
👉 What happened in AI in 2025? 👈 We prepared the 2025 version of the HF AI Timeline Grid, highlighting open vs API-based model releases, and allowing you to browse and filter by access, modality, and release type! Play with it here: https://huggingface.co/spaces/2025-ai-timeline/2025-ai-timeline Here's my personal quarterly TL;DR: 1️⃣ Q1 — Learning to Reason Deepseek not only releases a top-notch reasoning model, but shows how to train them and compete with closed frontier models. OpenAI debuts Deep Research. Significant milestones: DeepSeek R1 & R1-Zero, Qwen 2.5 VL, OpenAI Deep Research, Gemini 2.5 Pro (experimental) 2️⃣ Q2 — Multimodality and Coding More LLMs embrace multimodality by default, and there's a surge in coding agents. Strong vision, audio, and generative models emerge. Significant milestones: Llama 4, Qwen 3, Imagen 4, OpenAI Codex, Google Jules, Claude 4 3️⃣ Q3 — "Gold" rush, OpenAI opens up, the community goes bananas Flagship models get gold in Math olympiads and hard benchmarks. OpenAI releases strong open source models and Google releases the much anticipated nano-banana for image generation and editing. Agentic workflows become commonplace. Significant milestones: Gemini and OpenAI IMO Gold, gpt-oss, Gemini 2.5 Flash Image, Grok 4, Claude Sonnet 4.5 4️⃣ Q4 — Mistral returns, leaderboard hill-climbing Mistral is back with updated model families. All labs release impressive models to wrap up the year! Significant milestones: Claude Opus 4.5, DeepSeek Math V2, FLUX 2, GPT 5.1, Kimi K2 Thinking, Nano Banana Pro, GLM 4.7, Gemini 3, Mistral 3, MiniMax M2.1 🤯 Credits 🙏 NHLOCAL for the source data https://github.com/NHLOCAL/AiTimeline 🫡 @reach-vb for the original idea, design and recipe 🙌 @ariG23498 and yours truly for compiling and verifying the 2025 edition 🥳 Here's to 2026, wishing it becomes the best year ever for open releases and on-device-first use-cases! 🥂
View all activity

Organizations

Hugging Face Discord Community's profile picture