bird-of-paradise/deepseek-mla
Text Generation
•
Updated
•
13
Jen Wei PRO
bird-of-paradise
AI & ML interests
My research interests span the full stack of GenAI R&D: from efficient transformer architectures and RL for reasoning tasks, down to the practical challenges of optimizers(Muon) and distributed systems(FSDP).
Recent Activity
published
an
article
about 7 hours ago
Reproducing and Validating Distributed Muon 🐢✨: A Practical Verification of Communication Efficiency Claims
updated
a Space
11 days ago
bird-of-paradise/post-training-techniques-guide
updated
a dataset
12 days ago
bird-of-paradise/muon-distributed-reproducibility
Organizations
None yet