Awesome papers involving LLMs in Social Science.

The .NET library to build AI agents with 30+ built-in connectors.

Daydreams is a set of tools for building agents for commerce

FastAPI Skeleton App to serve machine learning models production-ready.

Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

The Linux OS for AI Agents — Persistent memory, autonomy, and time-awareness for any LLM. Own the state. Rent the intelligence.

LLM (Large Language Model) FineTuning

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

Deliver safe & effective language models

Deliver safe & effective language models

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

Free, open-source AWS emulator. LocalStack alternative: 26 services, 1,924 operations, 100% conformance. No account, no auth token, no paid tier.

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

Data-Driven Evaluation for LLM-Powered Applications

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

irresponsible innovation. Try now at https://chat.dev/

A fast and minimal framework for building agentic systems

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Repo for fine-tuning Casual LLMs

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

xFasterTransformer — open-source AI/LLM project.

A REST API for Caffe using Docker and Go

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

A curated collection of resources for 🌌 Azure OpenAI, 🦙 LLMs (RAG, Agents).

LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

Make your OpenClaw AI agent faster, smarter, and cheaper. Speed optimization, memory architecture, context management, model selection, and one-shot development guide.

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.

Open-source autonomous AI agent — runs on Claude-web, Gemini-web, Kimi-web, Deepseek-web and more for free and Every paid model via liteLLM. No API key required.

A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)

A Production-Ready Framework for Building Composable AI Agents

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

Rust + CUDA inference engine for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. Serves safetensors and GGUF over an OpenAI-compatible API, with per-device tuned defaults and speculative decode gated byte-identical to plain decode. Hosted instance: inference.tiyuvta.ai

A list of LLMs Tools & Projects

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.