✍️
Highlights
- Pro
Lists (8)
Awesome Projects
Awesome open-source projects12 repositories
Cuda & Compilers
Projects about Cuda/compilers21 repositories
Large Models
Open source large models14 repositories
Learning Materials
Open Courses & Textbooks & Paper Reading33 repositories
ML System
Repositories about Machine Learning System50 repositories
Other
Other repositories16 repositories
Seek My Future
Graduate Application/Job Finding14 repositories
SGlang dev
working16 repositories
Starred repositories
MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts
Measuring frontier coding agents on original, long-horizon engineering tasks
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms
sgl-project / DeepGEMM
Forked from deepseek-ai/DeepGEMMDeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.
An agentic skills framework & software development methodology that works.
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal d…
The offical repo for "LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling"
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.
Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels.
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocations such as NCCL, ...)
Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini 3.1 Pro, GPT 5.6 Series, Grok 4.5, Claude mod…
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞