Michael-A-Kuykendall/shimmy

Inference Engines

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

GitHub →

6.2

GitHub Metrics

Stars

4.0k

Forks

345

Open Issues

Watchers

Contributors

Weekly Commits

Language

Rust

License

Apache-2.0

Last Commit

Mar 26, 2026

Created

Aug 29, 2025

Latest Release

v1.9.0

Release Date

Jan 10, 2026

Synced: Apr 16, 2026

Quality Scores

Documentation Qualityw: 20%

4.4

No dedicated docs site. Description: 151 chars. Stars signal: 4,000. Contributors: 4. Score: 4.4/10

Community Healthw: 20%

5.4

Stars: 4,000. Contributors: 4. Watchers: 33. Forks: 345. Issue ratio: 0.9%. Score: 5.4/10

Maintenance Velocityw: 15%

6.9

Last commit: 21d ago. Weekly commits: 0. Latest release: v1.9.0. Score: 6.9/10

API Design & DXw: 20%

7.7

Stars/issues ratio: 108. Typed language: Rust. No dedicated API docs. Permissive license: Apache-2.0. Popularity signal: 4,000 stars. Score: 7.7/10

Production Readinessw: 15%

5.7

Battle-tested: 4,000 stars. Peer review: 4 contributors. Versioned: v1.9.0. Licensed: Apache-2.0. Age: 0.6 years. Maintenance: last commit 21d ago. Score: 5.7/10

Ecosystem Integrationw: 10%

7.9

Fork interest: 345. Major ecosystem: Rust. Integration-friendly: Apache-2.0. Adoption: 4,000 stars. Score: 7.9/10