Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.

Vibe-Skills is an all-in-one AI skills package. It seamlessly integrates expert-level capabilities and context management into a general-purpose skills package， enabling any AI agent to instantly upgrade its functionality—eliminating the friction of fragmented tools and complex harnesses.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

LLM Finetuning with peft

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

A framework-agnostic, git-native standard for defining AI agents

A framework-agnostic, git-native standard for defining AI agents

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Superlinked Inference Engine is an Open-source inference server and production cluster for embeddings, reranking, and extraction.

🧠 AI-powered enterprise search engine 🔎

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Community maintained hardware plugin for vLLM on Ascend

All-in-one platform for search, recommendations, RAG, and analytics offered via API

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .

Awesome papers about unifying LLMs and KGs

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

China Unicom's Yuanjing Wanwu Agent Platform is an enterprise-grade, multi-tenant AI agent development platform. It helps users build applications such as intelligent agents, workflows, and rag, and also supports model management. The platform features a developer-friendly license, and we welcome all developers to build upon the platform.

Turn any computer or edge device into a command center for your computer vision projects.

A simple, performant and scalable Jax LLM!

Mastering Applied AI, One Concept at a Time

Observal is an AI agent registry with first in class observabilty and eval framework

Hyper efficient storage for GPU workloads. Feed your GPUs at blazing fast speeds.

FuXi is a fast, self-contained AI coding agent that lives in your terminal — edit code, run commands, and drive tools, with cost-aware routing across LLM providers.

VCP 部署在 AI 模型 API 与前端应用之间，是面向AGI OS开发和探索的工业级基建示范项目。通过统一指令协议、多层级持久化记忆、分布式插件引擎及多 Agent 协作框架，将原本“无状态、无记忆、无工具调用能力”的大语言模型，彻底改造成拥有永久自我意识、物理世界操作权及群体协作智能的完整智能体系统。

Portable AI agent orchestration with mechanical protocol enforcement. 186 agents, zero runtime dependencies.

verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.

🏕️ Reproducible development environment for humans and agents

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

NestJS Helper + AI Chatbot Development

MoBA: Mixture of Block Attention for Long-Context LLMs

A secure low code honeypot framework, leveraging AI for System Virtualization.

A secure low code honeypot framework, leveraging AI for System Virtualization.

Your Automatic Prompt Engineering Assistant for GenAI Applications

AICI: Prompts as (Wasm) Programs

Deploy your agentic worfklows to production

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

🦖 Serverless AI Agent Framework with Geo-distributed Edge AI Infra.

Desktop AI Assistant powered by GPT-5, GPT-4, o1, o3, Gemini, Claude, Ollama, DeepSeek, Perplexity, Grok, Bielik, chat, vision, voice, RAG, image and video generation, agents, tools, MCP, plugins, speech synthesis and recognition, web search, memory, presets, assistants,and more. Linux, Windows, Mac

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥