raketenkater/ggrun

Model Serving

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.

GitHub →

4.9

GitHub Metrics

Stars

282

Forks

Open Issues

Watchers

Contributors

Weekly Commits

Language

License

MIT

Last Commit

Oct 26, 2026

Created

Mar 11, 2026

Latest Release

v3.2.12

Release Date

Oct 18, 2026

Synced: Oct 27, 2026

Quality Scores

Documentation Qualityw: 20%

3.9

No dedicated docs site. Description: 275 chars. Stars signal: 282. Contributors: 3. Score: 3.9/10

Community Healthw: 20%

2.5

Stars: 282. Contributors: 3. Watchers: 3. Forks: 19. Issue ratio: 2.5%. Score: 2.5/10

Maintenance Velocityw: 15%

8.2

Last commit: 0d ago. Weekly commits: 1. Latest release: v3.2.12. Score: 8.2/10

API Design & DXw: 20%

6.5

Stars/issues ratio: 40. Typed language: Go. No dedicated API docs. Permissive license: MIT. Popularity signal: 282 stars. Score: 6.5/10

Production Readinessw: 15%

3.8

Battle-tested: 282 stars. Peer review: 3 contributors. Versioned: v3.2.12. Licensed: MIT. Age: 0.6 years. Maintenance: last commit 0d ago. Score: 3.8/10

Ecosystem Integrationw: 10%

4.8

Fork interest: 19. Major ecosystem: Go. Integration-friendly: MIT. Adoption: 282 stars. Score: 4.8/10