STACKQUADRANT

ServerlessLLM/ServerlessLLM

Model Serving

Serverless LLM Serving for Everyone.

5.9
GitHub Metrics
Stars
674
Forks
70
Open Issues
45
Watchers
11
Contributors
18
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
Mar 6, 2026
Created
Jan 23, 2024
Latest Release
v0.8.0
Release Date
Nov 3, 2025
Synced: Apr 16, 2026
Quality Scores
Documentation Qualityw: 20%
6.1

Has docs site (https://serverlessllm.github.io/). Description: 36 chars. Stars signal: 674. Contributors: 18. Score: 6.1/10

Community Healthw: 20%
4.5

Stars: 674. Contributors: 18. Watchers: 11. Forks: 70. Issue ratio: 6.7%. Score: 4.5/10

Maintenance Velocityw: 15%
6.3

Last commit: 41d ago. Weekly commits: 0. Latest release: v0.8.0. Maturity bonus: 2.2y old. Score: 6.3/10

API Design & DXw: 20%
6.6

Stars/issues ratio: 15. Dynamic language: Python. Has documentation site. Permissive license: Apache-2.0. Popularity signal: 674 stars. Score: 6.6/10

Production Readinessw: 15%
5.9

Battle-tested: 674 stars. Peer review: 18 contributors. Versioned: v0.8.0. Licensed: Apache-2.0. Age: 2.2 years. Maintenance: last commit 41d ago. Score: 5.9/10

Ecosystem Integrationw: 10%
6.5

Fork interest: 70. Major ecosystem: Python. Integration-friendly: Apache-2.0. Adoption: 674 stars. Has web presence. Score: 6.5/10

Tags
cudahuggingface-transformerslarge-language-modelsmodel-as-a-servicemodel-servingpytorchserverless-inference
Radar
Documentation Quality
Community Health
Maintenance Velocity
API Design & DX
Production Readiness
Ecosystem Integration