Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

An autonomous agent that takes work, does work, gets paid, and gets better at it.

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

A throughput-oriented high-performance serving framework for LLMs

The Typescript MCP Framework

A highly optimized LLM inference acceleration engine for Llama and its variants.

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

A scalable inference server for models optimized with OpenVINO™

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

An open-source computer vision framework to build and deploy apps in minutes

Model Deployment at Scale on Kubernetes 🦄️

Agentic testing for agentic codebases

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Model-agnostic plug-n-play LangChain/LangGraph agents powered entirely by MCP tools over HTTP/SSE.

Free AI Desktop Agent for Windows, macOS & Linux - Automate email, calendar, browser, code generation. 13+ AI providers, Ollama, Telegram remote control. No Docker, no terminal. 🦎

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Framework for enhancing LLMs for RAG tasks using fine-tuning.

Blades is a Go-based multimodal AI Agent framework.

A curated collection of awesome AI Agents and LLM Apps built with multiple tech stacks, showcasing real-world implementations using OpenAI, Gemini, local models, and various AI frameworks.

End-to-end Generative Optimization for AI Agents

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

Python Deep Agent framework built on top of Pydantic-AI, designed to help you quickly build production-grade autonomous AI agents with planning, filesystem operations, subagent delegation, skills, and structured outputs—in just 10 lines of code.

Serverless LLM Serving for Everyone.

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。

Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

Awesome papers involving LLMs in Social Science.

Daydreams is a set of tools for building agents for commerce

FastAPI Skeleton App to serve machine learning models production-ready.

The .NET library to build AI agents with 30+ built-in connectors.

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

LLM (Large Language Model) FineTuning

Deliver safe & effective language models

Deliver safe & effective language models

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

Rapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.

Data-Driven Evaluation for LLM-Powered Applications

MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

irresponsible innovation. Try now at https://chat.dev/

A fast and minimal framework for building agentic systems

Mock everything your AI app talks to — LLM APIs, MCP, A2A, vector DBs, search. One package, one port, zero dependencies.

Repo for fine-tuning Casual LLMs

A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.