HuaizhengZhang/AI-Infra-from-Zero-to-Hero

Model Serving

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

GitHub →Website →

6.3

GitHub Metrics

Stars

3.9k

Forks

377

Open Issues

Watchers

130

Contributors

Weekly Commits

Language

—

License

MIT

Last Commit

Jul 25, 2025

Created

Jan 7, 2019

Latest Release

—

Release Date

—

Synced: Apr 16, 2026

Quality Scores

Documentation Qualityw: 20%

7.4

Has docs site (https://huaizheng.xyz/). Description: 256 chars. Stars signal: 3,880. Contributors: 25. Score: 7.4/10

Community Healthw: 20%

6.9

Stars: 3,880. Contributors: 25. Watchers: 130. Forks: 377. Issue ratio: 0.4%. Score: 6.9/10

Maintenance Velocityw: 15%

2.4

Last commit: 265d ago. Weekly commits: 0. No releases published. Maturity bonus: 7.3y old. Score: 2.4/10

API Design & DXw: 20%

7.9

Stars/issues ratio: 259. Has documentation site. Permissive license: MIT. Popularity signal: 3,880 stars. Score: 7.9/10

Production Readinessw: 15%

5.3

Battle-tested: 3,880 stars. Peer review: 25 contributors. No versioned releases. Licensed: MIT. Age: 7.3 years. Maintenance: last commit 265d ago. Score: 5.3/10

Ecosystem Integrationw: 10%

6.8

Fork interest: 377. Integration-friendly: MIT. Adoption: 3,880 stars. Has web presence. Score: 6.8/10