MiroFlow is an agent framework that enables tool-use agent tasks, featuring a reproducible GAIA score of 82.4%.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

AI Multi-Agent Framework in .NET

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

AI agent microservice

Implementation for MatMul-free LM.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.

Community maintained hardware plugin for vLLM on Ascend

LLM Finetuning with peft

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

A framework-agnostic, git-native standard for defining AI agents

A framework-agnostic, git-native standard for defining AI agents

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

🧠 AI-powered enterprise search engine 🔎

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

All-in-one platform for search, recommendations, RAG, and analytics offered via API

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

Hyper efficient storage for GPU workloads. Feed your GPUs at blazing fast speeds.

Awesome papers about unifying LLMs and KGs

Turn any computer or edge device into a command center for your computer vision projects.

A simple, performant and scalable Jax LLM!

VCP 部署在 AI 模型 API 与前端应用之间，是面向AGI OS开发和探索的工业级基建示范项目。通过统一指令协议、多层级持久化记忆、分布式插件引擎及多 Agent 协作框架，将原本“无状态、无记忆、无工具调用能力”的大语言模型，彻底改造成拥有永久自我意识、物理世界操作权及群体协作智能的完整智能体系统。

verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"

Mastering Applied AI, One Concept at a Time

China Unicom's Yuanjing Wanwu Agent Platform is an enterprise-grade, multi-tenant AI agent development platform. It helps users build applications such as intelligent agents, workflows, and rag, and also supports model management. The platform features a developer-friendly license, and we welcome all developers to build upon the platform.

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

Open-source AI reverse-engineering agent using Ghidra and LLMs to reconstruct and validate C/C++ functions from binaries.

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Portable AI agent orchestration with mechanical protocol enforcement. 186 agents, zero runtime dependencies.

Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.

🏕️ Reproducible development environment for humans and agents

A secure low code honeypot framework, leveraging AI for System Virtualization.

A secure low code honeypot framework, leveraging AI for System Virtualization.

Free AI Desktop Agent for Windows, macOS & Linux - Automate email, calendar, browser, code generation. 13+ AI providers, Ollama, Telegram remote control. No Docker, no terminal. 🦎

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

MoBA: Mixture of Block Attention for Long-Context LLMs

NestJS Helper + AI Chatbot Development

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Your Automatic Prompt Engineering Assistant for GenAI Applications

AICI: Prompts as (Wasm) Programs

Deploy your agentic worfklows to production

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL