HuaizhengZhang/AI-Infra-from-Zero-to-Hero

Model Serving

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

GitHub →Website →

6.1

GitHub Metrics

Stars

4.3k

Forks

410

Open Issues

Watchers

134

Contributors

Weekly Commits

Language

—

License

MIT

Last Commit

Jul 25, 2025

Created

Jan 7, 2019

Latest Release

—

Release Date

—

Synced: Aug 28, 2026

Quality Scores

Documentation Qualityw: 20%

7.5

Has docs site (https://huaizheng.xyz/). Description: 256 chars. Stars signal: 4,312. Contributors: 25. Score: 7.5/10

Community Healthw: 20%

7.0

Stars: 4,312. Contributors: 25. Watchers: 134. Forks: 410. Issue ratio: 0.3%. Score: 7/10

Maintenance Velocityw: 15%

1.1

Last commit: 399d ago. Weekly commits: 0. No releases published. Maturity bonus: 7.6y old. Score: 1.1/10

API Design & DXw: 20%

7.9

Stars/issues ratio: 308. Has documentation site. Permissive license: MIT. Popularity signal: 4,312 stars. Score: 7.9/10

Production Readinessw: 15%

5.3

Battle-tested: 4,312 stars. Peer review: 25 contributors. No versioned releases. Licensed: MIT. Age: 7.6 years. Maintenance: last commit 399d ago. Score: 5.3/10

Ecosystem Integrationw: 10%

6.9

Fork interest: 410. Integration-friendly: MIT. Adoption: 4,312 stars. Has web presence. Score: 6.9/10