STACKQUADRANT

ServerlessLLM/ServerlessLLM

Model Serving

Serverless LLM Serving for Everyone.

5.6
GitHub Metrics
Stars
711
Forks
76
Open Issues
45
Watchers
11
Contributors
18
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
May 4, 2026
Created
Jan 23, 2024
Latest Release
v0.8.0
Release Date
Nov 3, 2025
Synced: Aug 28, 2026
Quality Scores
Documentation Qualityw: 20%
6.1

Has docs site (https://serverlessllm.github.io/). Description: 36 chars. Stars signal: 710. Contributors: 18. Score: 6.1/10

Community Healthw: 20%
4.5

Stars: 710. Contributors: 18. Watchers: 11. Forks: 76. Issue ratio: 6.3%. Score: 4.5/10

Maintenance Velocityw: 15%
4.4

Last commit: 115d ago. Weekly commits: 0. Latest release: v0.8.0. Maturity bonus: 2.6y old. Score: 4.4/10

API Design & DXw: 20%
6.6

Stars/issues ratio: 16. Dynamic language: Python. Has documentation site. Permissive license: Apache-2.0. Popularity signal: 710 stars. Score: 6.6/10

Production Readinessw: 15%
5.4

Battle-tested: 710 stars. Peer review: 18 contributors. Versioned: v0.8.0. Licensed: Apache-2.0. Age: 2.6 years. Maintenance: last commit 115d ago. Score: 5.4/10

Ecosystem Integrationw: 10%
6.6

Fork interest: 76. Major ecosystem: Python. Integration-friendly: Apache-2.0. Adoption: 710 stars. Has web presence. Score: 6.6/10

Tags
cudahuggingface-transformerslarge-language-modelsmodel-as-a-servicemodel-servingpytorchserverless-inference
Radar
Documentation Quality
Community Health
Maintenance Velocity
API Design & DX
Production Readiness
Ecosystem Integration