Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

Awesome papers involving LLMs in Social Science.

The .NET library to build AI agents with 30+ built-in connectors.

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

Daydreams is a set of tools for building agents for commerce

The Linux OS for AI Agents — Persistent memory, autonomy, and time-awareness for any LLM. Own the state. Rent the intelligence.

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

FastAPI Skeleton App to serve machine learning models production-ready.

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

LLM (Large Language Model) FineTuning

Deliver safe & effective language models

Deliver safe & effective language models

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

AI equity research agent with resilient workflows, Redis Lua single-flight, pgvector RAG, versioned reports, evidence tracing, and RAG evaluation.

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

Autonomous prediction market trading agent | Wang Transform pricing engine calibrated on 291K+ contracts | Kalshi · Polymarket · Solana DFlow · Jito bundles · 633 tests

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Data-Driven Evaluation for LLM-Powered Applications

irresponsible innovation. Try now at https://chat.dev/

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

A fast and minimal framework for building agentic systems

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Repo for fine-tuning Casual LLMs

Computer-Use SDK for E2E QA Testing

A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

Open-source autonomous AI agent — runs on Claude-web, Gemini-web, Kimi-web, Deepseek-web and more for free and Every paid model via liteLLM. No API key required.

xFasterTransformer — open-source AI/LLM project.

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

A REST API for Caffe using Docker and Go

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

A curated collection of resources for 🌌 Azure OpenAI, 🦙 LLMs (RAG, Agents).

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework

Make your OpenClaw AI agent faster, smarter, and cheaper. Speed optimization, memory architecture, context management, model selection, and one-shot development guide.

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)

A Production-Ready Framework for Building Composable AI Agents

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.

Super-Efficient RLHF Training of LLMs with Parameter Reallocation