EvolvingLMMs-Lab/lmms-eval

Evaluation & Testing

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

GitHub →Website →

7.5

GitHub Metrics

Stars

4.0k

Forks

561

Open Issues

Watchers

Contributors

184

Weekly Commits

Language

Python

License

NOASSERTION

Last Commit

Apr 15, 2026

Created

Mar 7, 2024

Latest Release

v0.7.1

Release Date

Mar 15, 2026

Synced: Apr 16, 2026

Quality Scores

Documentation Qualityw: 20%

7.7

Has docs site (https://www.lmms-lab.com). Description: 84 chars. Stars signal: 4,026. Contributors: 184. Score: 7.7/10

Community Healthw: 20%

7.1

Stars: 4,026. Contributors: 184. Watchers: 6. Forks: 561. Issue ratio: 0.6%. Score: 7.1/10

Maintenance Velocityw: 15%

7.6

Last commit: 1d ago. Weekly commits: 0. Latest release: v0.7.1. Maturity bonus: 2.1y old. Score: 7.6/10

API Design & DXw: 20%

7.6

Stars/issues ratio: 155. Dynamic language: Python. Has documentation site. License: NOASSERTION. Popularity signal: 4,026 stars. Score: 7.6/10

Production Readinessw: 15%

7.7

Battle-tested: 4,026 stars. Peer review: 184 contributors. Versioned: v0.7.1. Licensed: NOASSERTION. Age: 2.1 years. Maintenance: last commit 1d ago. Score: 7.7/10

Ecosystem Integrationw: 10%

7.2

Fork interest: 561. Major ecosystem: Python. License: NOASSERTION. Adoption: 4,026 stars. Has web presence. Score: 7.2/10