STACKQUADRANT

agent-governance-toolkit

microsoft/agent-governance-toolkit
7.2

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Agent Frameworks
6.1k1.1kPythonMIT2d ago

helicone

Helicone/helicone
7.5

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

AI DevOps
6.1k658TypeScriptApache-2.02d ago

zcf

UfoMiao/zcf
7.5

Zero-Config Code Flow for Claude code & Codex

Agent Frameworks
6.1k420TypeScriptMIT5d ago

awesome-ai-tools

mahseema/awesome-ai-tools
5.8

A curated list of Artificial Intelligence Top Tools

Agent Frameworks
6.1k2.1kMIT7mo ago

AI-Infra-Guard

Tencent/AI-Infra-Guard
7.8

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Evaluation & Testing
6.0k553PythonApache-2.0today

enchanted

gluonfield/enchanted
6.3

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

LLM Frameworks
6.0k426SwiftApache-2.01mo ago

cactus

cactus-compute/cactus
7.3

Low-latency AI engine for mobile devices & wearables

LLM Frameworks
5.9k495C++NOASSERTION1d ago

Awesome-LLMOps

tensorchord/Awesome-LLMOps
6.3

An awesome & curated list of best LLMOps tools for developers

AI DevOps
5.9k1.0kShellCC0-1.03mo ago

helix-db

HelixDB/helix-db
7.6

HelixDB is an open-source graph-vector database built from scratch in Rust.

Vector Databases
5.9k342RustAGPL-3.0today

kserve

kserve/kserve
8.2

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Inference Engines
5.8k1.6kGoApache-2.0today

shimmy

Michael-A-Kuykendall/shimmy
6.6

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

Inference Engines
5.8k561RustApache-2.0today

rllm

rllm-org/rllm
7.3

Democratizing Reinforcement Learning for LLMs

Agent Frameworks
5.8k612PythonApache-2.04d ago

pyspur

PySpur-Dev/pyspur
6.8

A visual playground for agentic workflows: Iterate over your agents 10x faster

LLM Frameworks
5.8k429TypeScriptApache-2.01mo ago

giskard-oss

Giskard-AI/giskard-oss
7.9

🐢 Open-Source Evaluation & Testing library for LLM Agents

AI DevOps
5.8k524PythonApache-2.0today

ouroboros

Q00/ouroboros
7.8

Agent OS: Stop prompting. Start specifying. A Socratic interview gates the spec on an ambiguity score, then one command drives execution, a 3-stage evaluation gate, and a budgeted evolution loop. MCP server, 13 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more.

Evaluation & Testing
5.7k570PythonMITtoday

coze-loop

coze-dev/coze-loop
7.2

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

AI DevOps
5.7k796GoApache-2.0today

gpustack

gpustack/gpustack
7.1

Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.

Inference Engines
5.6k629PythonApache-2.0today

zenml

zenml-io/zenml
7.6

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

AI DevOps
5.6k654PythonApache-2.0today

lemonade

lemonade-sdk/lemonade
7.6

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Inference Engines
5.5k479C++Apache-2.0today

MineContext

volcengine/MineContext
6.2

MineContext is your proactive context-aware AI partner(Context-Engineering+ChatGPT Pulse)

Vector Databases
5.5k409PythonApache-2.03mo ago

Awesome-LLM-Inference

xlite-dev/Awesome-LLM-Inference
6.6

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Inference Engines
5.5k429PythonGPL-3.013d ago

TaskingAI

TaskingAI/TaskingAI
6.0

The open source platform for AI-native application development.

RAG Libraries
5.4k356PythonApache-2.01y ago

semantic-router

vllm-project/semantic-router
7.5

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Fine-tuning Tools
5.4k844GoApache-2.0today

agentscope-java

agentscope-ai/agentscope-java
6.8

Build distributed, production-grade, long-running agents.

Agent Frameworks
5.3k1.2kJavatoday

superduper

superduper-io/superduper
6.3

Superduper: End-to-end framework for building custom AI applications and agents.

Vector Databases
5.3k544PythonApache-2.012mo ago

LLM-Engineers-Handbook

PacktPublishing/LLM-Engineers-Handbook
6.4

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

Evaluation & Testing
5.3k1.3kPythonMIT4mo ago

Olares

beclab/Olares
7.4

Olares: An Open-Source Personal Cloud to Reclaim Your Data

Model Serving
5.2k321GoAGPL-3.0today

awesome-vibe-coding

filipecalegario/awesome-vibe-coding
5.6

A curated list of vibe coding references, collaborating with AI to write code.

Agent Frameworks
5.2k660CC0-1.04mo ago

h2o-llmstudio

h2oai/h2o-llmstudio
7.5

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Fine-tuning Tools
5.2k555PythonApache-2.09d ago

AutoRAG

Marker-Inc-Korea/AutoRAG
7.7

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

RAG Libraries
5.1k433TypeScriptApache-2.0today

SPTAG

microsoft/SPTAG
6.6

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

Vector Databases
5.0k622C++MIT7d ago

eko

FellouAI/eko
6.7

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

Inference Engines
5.0k442TypeScriptMIT5mo ago

skillhub

iflytek/skillhub
7.4

Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.

Agent Frameworks
4.9k800JavaApache-2.0today

ag2

ag2ai/ag2
8.0

AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/sNGSwQME3x

Agent Frameworks
4.9k707PythonApache-2.0today

code-graph-rag

vitali87/code-graph-rag
7.6

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

RAG Libraries
4.8k642PythonMITtoday

Integuru

Integuru-AI/Integuru
6.2

The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.

Agent Frameworks
4.8k382PythonAGPL-3.02mo ago

infinity

infiniflow/infinity
7.5

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Vector Databases
4.7k441C++Apache-2.0today

youtu-agent

TencentCloudADP/youtu-agent
6.2

A simple yet powerful agent framework that delivers with open-source models

Agent Frameworks
4.6k478PythonNOASSERTION5mo ago

claude-code-guide

zebbern/claude-code-guide
5.9

Claude Code Guide - Setup, Commands, workflows, agents, skills & tips-n-tricks

Agent Frameworks
4.6k462PythonMITtoday

agenta

Agenta-AI/agenta
7.6

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Evaluation & Testing
4.6k645TypeScriptNOASSERTIONtoday

tiny-llm

skyzh/tiny-llm
7.1

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

LLM Frameworks
4.5k369PythonApache-2.01d ago

kungfu

kungfu-systems/kungfu
7.9

Your agents don’t hand off the work. Kungfu keeps the same Work moving across Codex, Claude, OpenCode, and your own execution surface.

Agent Frameworks
4.5k1.3kC++Apache-2.0today

m_flow

FlowElement-xinliuyuansu/m_flow
6.7

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Vector Databases
4.5k257PythonApache-2.024d ago

m_flow

FlowElement-ai/m_flow
6.7

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Vector Databases
4.5k257PythonApache-2.024d ago

AIGC-Interview-Book

WeThinkIn/AIGC-Interview-Book
6.3

【三年面试五年模拟】AIGC算法工程师面试秘籍。涵盖AIGC、LLM大模型、传统深度学习、自动驾驶、AI Agent、机器学习、计算机视觉、自然语言处理、强化学习、大数据挖掘、具身智能、元宇宙、AGI等AI行业面试笔试干货经验与核心知识。

Agent Frameworks
4.5k456GPL-3.0today

RuVector

ruvnet/RuVector
7.3

RuVector is a High Performance, Real-Time, Self-Learning, Vector Graph Neural Network, and Database built in Rust.

Inference Engines
4.5k590RustMITtoday

ruvector

ruvnet/ruvector
7.3

RuVector is a High Performance, Real-Time, Self-Learning, Vector Graph Neural Network, and Database built in Rust.

Inference Engines
4.5k590RustMITtoday

crate

crate/crate
7.9

CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene.

Vector Databases
4.4k611JavaApache-2.0today