RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

Optimizing inference proxy for LLMs

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Everything you need to know to build your own RAG application

🚀 2026 最系统的 AI Agent 速成指南｜智能体实战教程 · 完整学习路径 + 实战项目 + 面试题库 · 对标大模型应用开发工程师岗位 · 覆盖LangChain / LangGraph / Coze / Dify / MCP / skills / LLM / RAG / 提示词 · 企业级部署与微调 · 从0到企业级落地 + 从学习到上线项目 + 面试准备一体化

Harness LLMs with Multi-Agent Programming

🔍 导出并模糊搜索 Telegram 聊天记录 | Export and fuzzy search your Telegram chat history

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

A wonderful list of Game Development resources.

ACID Document Database

A modular Agentic RAG built with LangGraph — learn Retrieval-Augmented Generation Agents in minutes.

Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP Support

Easiest and laziest way for building multi-agent LLMs applications.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

🦞 OpenClaw (Clawdbot/Moltbot) 汉化版 - 开源个人 AI 助手中文版 | Claude/ChatGPT LLM 接入 | WhatsApp/Telegram/Discord 多平台 | 每小时自动同步 | CLI + Dashboard 全中文 | 全流程搭建教程，以及排错指南！

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.

The Agent Memory Stack

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Evaluation and Tracking for LLM Experiments and AI Agents

Just talk to your agent — it learns and EVOLVES.

OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database). Upload your own custom knowledge base files (PDF, txt, epub, etc) using a simple React frontend.

Build production-ready AI agents in both Python and Typescript.

II-Agent: a new open-source framework to build and deploy intelligent agents

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

[KDD'2026] "VideoRAG: Chat with Your Videos"

Enterprise-grade (40m+ LOC) codebase intelligence, zero-setup, local & private Plugin/Skill/Extension or MCP: hybrid semantic search, polyglot dependency graphs, symbol-level impact analysis & call-flow, interactive HTML viewer, cross-project & branch-aware search, DB/API/infra knowledge. 61% less tokens, 84% fewer calls, 37x faster. Cloud in beta.

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Sparsity-aware deep learning inference runtime for CPUs

MiroFlow is an agent framework that enables tool-use agent tasks, featuring a reproducible GAIA score of 82.4%.

🏆 Top-1 on 5+ benchmarks | Web UI | Supports MiroThinker, Claude, Kimi, OpenAI

AI Multi-Agent Framework in .NET

Implementation for MatMul-free LM.

AI agent microservice

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).