Tiiny-AI/PowerInfer

Inference Engines

High-speed Large Language Model Serving for Local Deployment

GitHub →

6.8

GitHub Metrics

Stars

9.3k

Forks

562

Open Issues

130

Watchers

101

Contributors

399

Weekly Commits

Language

C++

License

MIT

Last Commit

Jan 24, 2026

Created

Dec 15, 2023

Latest Release

—

Release Date

—

Synced: Apr 16, 2026

Quality Scores

Documentation Qualityw: 20%

6.0

No dedicated docs site. Description: 60 chars. Stars signal: 9,328. Contributors: 399. Score: 6/10

Community Healthw: 20%

8.2

Stars: 9,328. Contributors: 399. Watchers: 101. Forks: 562. Issue ratio: 1.4%. Score: 8.2/10

Maintenance Velocityw: 15%

4.6

Last commit: 82d ago. Weekly commits: 0. No releases published. Maturity bonus: 2.3y old. Score: 4.6/10

API Design & DXw: 20%

7.0

Stars/issues ratio: 72. No dedicated API docs. Permissive license: MIT. Popularity signal: 9,328 stars. Score: 7/10

Production Readinessw: 15%

7.1

Battle-tested: 9,328 stars. Peer review: 399 contributors. No versioned releases. Licensed: MIT. Age: 2.3 years. Maintenance: last commit 82d ago. Score: 7.1/10

Ecosystem Integrationw: 10%

7.6

Fork interest: 562. Ecosystem: C++. Integration-friendly: MIT. Adoption: 9,328 stars. Score: 7.6/10