STACKQUADRANT

kvcached

ovg-project/kvcached
6.4

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Inference Engines
★ 2.0k◇ 234PythonApache-2.0today

py-gpt

szczyglis-dev/py-gpt
6.7

Desktop AI Assistant powered by GPT-5, GPT-4, o1, o3, Gemini, Claude, Ollama, DeepSeek, Perplexity, Grok, Bielik, chat, vision, voice, RAG, image and video generation, agents, tools, MCP, plugins, speech synthesis and recognition, web search, memory, presets, assistants,and more. Linux, Windows, Mac

Agent Frameworks
★ 2.0k◇ 353PythonNOASSERTION21d ago

full-stack-ai-agent-template

vstorm-co/full-stack-ai-agent-template
6.7

Full-stack AI app generator — FastAPI + Next.js with agents, RAG, streaming, auth, and 20+ integrations out of the box.

Agent Frameworks
★ 2.0k◇ 389PythonMIT1d ago

yomo

yomorun/yomo
6.1

🦖 Serverless AI Agent Framework with Geo-distributed Edge AI Infra.

Agent Frameworks
★ 1.9k◇ 149Rust1d ago

MiniOneRec

AkaliKong/MiniOneRec
5.7

Minimal reproduction of OneRec

LLM Frameworks
★ 1.9k◇ 285PythonApache-2.08d ago

Awesome-Embodied-Robotics-and-Agent

zchoi/Awesome-Embodied-Robotics-and-Agent
6.1

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

LLM Frameworks
★ 1.9k◇ 103Apache-2.0today

jido

agentjido/jido
6.9

🤖 Autonomous agent framework for Elixir. Built for distributed, autonomous behavior and dynamic workflows.

Agent Frameworks
★ 1.9k◇ 122ElixirApache-2.0today

LongWriter

THUDM/LongWriter
4.7

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Fine-tuning Tools
★ 1.9k◇ 186PythonApache-2.01y ago

AgentsMeetRL

thinkwee/AgentsMeetRL
5.6

Awesome List for Agentic RL

LLM Frameworks
★ 1.9k◇ 77HTML6d ago

beta9

beam-cloud/beta9
6.7

Ultrafast serverless GPU inference, sandboxes, and background jobs

Fine-tuning Tools
★ 1.8k◇ 174GoAGPL-3.0today

Curator

NVIDIA-NeMo/Curator
6.3

Scalable data pre processing and curation toolkit for LLMs

Fine-tuning Tools
★ 1.8k◇ 356PythonApache-2.01d ago

DATAGEN

zi-yue-1129/DATAGEN
6.0

DATAGEN: AI-driven multi-agent research assistant automating hypothesis generation, data analysis, and report writing.

LLM Frameworks
★ 1.8k◇ 255PythonMITtoday

DATAGEN

starpig1129/DATAGEN
6.0

DATAGEN: AI-driven multi-agent research assistant automating hypothesis generation, data analysis, and report writing.

LLM Frameworks
★ 1.8k◇ 255PythonMITtoday

raptor

parthsarthi03/raptor
5.1

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

LLM Frameworks
★ 1.8k◇ 235PythonMIT2y ago

curator

bespokelabsai/curator
6.8

Synthetic data curation for post-training and structured data extraction

Fine-tuning Tools
★ 1.8k◇ 153PythonApache-2.01d ago

Jackrong-llm-finetuning-guide

R6410418/Jackrong-llm-finetuning-guide
5.5

Jackrong-llm-finetuning-guide — open-source AI/LLM project.

Fine-tuning Tools
★ 1.7k◇ 273Jupyter NotebookApache-2.03mo ago

mlrun

mlrun/mlrun
7.5

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

Model Serving
★ 1.7k◇ 315PythonApache-2.0today

dlrover

intelligent-machine-learning/dlrover
6.4

DLRover: An Automatic Distributed Deep Learning System

Fine-tuning Tools
★ 1.7k◇ 219PythonNOASSERTION5d ago

Agently

AgentEra/Agently
7.1

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code

Agent Frameworks
★ 1.7k◇ 184PythonApache-2.013d ago

aisheets

huggingface/aisheets
6.2

Build, enrich, and transform datasets using AI models with no code

Evaluation & Testing
★ 1.7k◇ 142TypeScriptApache-2.01mo ago

ai-devkit

codeaholicguy/ai-devkit
6.2

Make AI coding agents follow a repeatable engineering workflow with planning, memory, verification, skills, and review. One config. All agents. Same workflow.

Agent Frameworks
★ 1.7k◇ 259TypeScript1d ago

nobodywho

nobodywho-ooo/nobodywho
6.9

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Inference Engines
★ 1.6k◇ 98RustEUPL-1.2today

vllm-mlx

waybarrios/vllm-mlx
7.1

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

Model Serving
★ 1.6k◇ 233PythonApache-2.01d ago

sglang-omni

sgl-project/sglang-omni
6.8

SGLang-Omni empowers high-performance serving for TTS, ASR, speech and omni models.

Model Serving
★ 1.6k◇ 651PythonApache-2.0today

Seed1.5-VL

ByteDance-Seed/Seed1.5-VL
4.9

Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving state-of-the-art performance on 38 out of 60 public benchmarks.

LLM Frameworks
★ 1.6k◇ 65Jupyter NotebookApache-2.01y ago

FuzzyAI

cyberark/FuzzyAI
5.2

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

Evaluation & Testing
★ 1.6k◇ 218Jupyter NotebookApache-2.08mo ago

ouroboros

razzant/ouroboros
6.6

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

Agent Frameworks
★ 1.6k◇ 683PythonMITtoday

nvidia_gpu_exporter

utkuozdemir/nvidia_gpu_exporter
6.7

Nvidia GPU exporter for prometheus using nvidia-smi binary

Fine-tuning Tools
★ 1.6k◇ 155GoMITtoday

Director

video-db/Director
5.6

AI video agents framework for next-gen video interactions and workflows.

LLM Frameworks
★ 1.6k◇ 253PythonMIT9mo ago

better-agents

langwatch/better-agents
5.4

Standards for building agents, better

Agent Frameworks
★ 1.6k◇ 148TypeScriptMIT4mo ago

Tracely-ai

Jwuthri/Tracely-ai
6.2

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

Evaluation & Testing
★ 1.5k◇ 174PythonMIT19d ago

NeuroSploit

JoasASantos/NeuroSploit
5.7

NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).

LLM Frameworks
★ 1.5k◇ 353Rust8d ago

NeuroSploit

CyberSecurityUP/NeuroSploit
5.7

NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).

LLM Frameworks
★ 1.5k◇ 353Rust8d ago

agents

inkeep/agents
6.5

Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For shipping AI assistants and multi-agent AI workflows.

Agent Frameworks
★ 1.5k◇ 181TypeScriptNOASSERTIONtoday

home-llm

acon96/home-llm
5.9

A Home Assistant integration & Model to control your smart home using a Local LLM

LLM Frameworks
★ 1.5k◇ 157Python16d ago

mlx-tune

ARahim3/mlx-tune
5.2

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Fine-tuning Tools
★ 1.4k◇ 100PythonApache-2.04mo ago

awesome-japanese-llm

llm-jp/awesome-japanese-llm
6.3

日本語LLMまとめ - Overview of Japanese LLMs

LLM Frameworks
★ 1.4k◇ 48TypeScriptApache-2.01d ago

kitops

kitops-ml/kitops
7.0

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Model Serving
★ 1.4k◇ 187GoApache-2.0today

rtp-llm

alibaba/rtp-llm
6.3

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Model Serving
★ 1.4k◇ 290PythonApache-2.0today

TinyEngram

AutoArk/TinyEngram
4.5

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Fine-tuning Tools
★ 1.4k◇ 88Python5mo ago

text-to-lora

SakanaAI/text-to-lora
5.0

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

Fine-tuning Tools
★ 1.3k◇ 92PythonApache-2.01y ago

Awesome-Knowledge-Distillation-of-LLMs

Tebmer/Awesome-Knowledge-Distillation-of-LLMs
4.0

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

LLM Frameworks
★ 1.3k◇ 761y ago

hopsworks

logicalclocks/hopsworks
5.8

Hopsworks - Data-Intensive AI platform with a Feature Store

Model Serving
★ 1.3k◇ 159JavaAGPL-3.01y ago

sre

SmythOS/sre
5.9

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

Agent Frameworks
★ 1.3k◇ 203TypeScriptMIT6mo ago

passmark

bug0inc/passmark
5.9

The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.

Evaluation & Testing
★ 1.3k◇ 187TypeScriptNOASSERTION1mo ago

prompty

microsoft/prompty
7.0

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

Evaluation & Testing
★ 1.3k◇ 133RustMITtoday

AWorld

inclusionAI/AWorld
6.7

Build, evaluate and train General Multi-Agent Assistance with ease

Agent Frameworks
★ 1.2k◇ 129PythonMIT4d ago

open-steps

kharmanskyi/open-steps
6.4

Skills that translate your coding agent's output into plain language: honest reports, straight verdicts, steps you can follow. MIT.

Prompt Engineering
★ 1.2k◇ 111ShellMIT21d ago