STACKQUADRANT

machine-learning-systems-design

chiphuyen/machine-learning-systems-design
5.3

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dmls-book`

AI DevOps
10.4k1.6kHTML3y ago

phoenix

Arize-ai/phoenix
7.4

AI Observability & Evaluation

Prompt Engineering
10.3k946PythonNOASSERTIONtoday

skypilot

skypilot-org/skypilot
7.9

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Fine-tuning Tools
10.2k1.1kPythonApache-2.02d ago

oceanbase

oceanbase/oceanbase
7.7

The Fastest Distributed Database for Transactional, Analytical, and AI Workloads.

Vector Databases
10.2k1.9kC++NOASSERTION1d ago

metaflow

Netflix/metaflow
7.8

Build, Manage and Deploy AI/ML Systems

AI DevOps
10.2k1.3kPythonApache-2.02d ago

awesome-nanobanana-pro

ZeroLu/awesome-nanobanana-pro
6.4

🚀 An awesome list of curated Nano Banana pro prompts and examples. Your go-to resource for mastering prompt engineering and exploring the creative potential of the Nano banana pro(Nano banana 2) AI image model.

Prompt Engineering
10.1k857MIT1mo ago

MemOS

MemTensor/MemOS
7.7

AI memory OS for LLM and Agent systems(moltbot,clawdbot,openclaw), enabling persistent Skill memory for cross-task skill reuse and evolution.

RAG Libraries
10.0k911TypeScriptApache-2.01d ago

prompt-master

nidhinjs/prompt-master
6.1

A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention

Prompt Engineering
10.0k1.2kMIT18d ago

voltagent

VoltAgent/voltagent
7.9

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

LLM Frameworks
9.8k1.0kTypeScriptMIT5d ago

pycaret

pycaret/pycaret
7.6

Open-source, low-code AutoML platform for Python. PyCaret 4.0: sklearn-native engine + React control plane.

AI DevOps
9.8k1.9kPythonNOASSERTION4d ago

PowerInfer

Tiiny-AI/PowerInfer
6.9

High-speed Large Language Model Serving for Local Deployment

Inference Engines
9.6k586C++MIT1mo ago

ralph-claude-code

frankbria/ralph-claude-code
6.5

Autonomous AI development loop for Claude Code with intelligent exit detection

Agent Frameworks
9.5k723ShellMIT8d ago

databend

databendlabs/databend
7.8

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

Vector Databases
9.4k888RustNOASSERTIONtoday

cai

aliasrobotics/cai
7.3

Cybersecurity AI (CAI), the framework for AI Security

LLM Frameworks
9.3k1.4kPythonNOASSERTION17d ago

deeplake

activeloopai/deeplake
7.8

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

Vector Databases
9.2k718C++Apache-2.01mo ago

KAG

OpenSPG/KAG
6.7

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

LLM Frameworks
8.9k692PythonApache-2.05mo ago

evolver

EvoMap/evolver
7.0

The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai

Agent Frameworks
8.8k817JavaScriptGPL-3.0today

BentoML

bentoml/BentoML
8.0

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Inference Engines
8.7k979PythonApache-2.06d ago

local-deep-research

LearningCircuit/local-deep-research
7.1

Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local & Encrypted.

RAG Libraries
8.6k759PythonMITtoday

awesome-LLM-resources

WangRongsheng/awesome-LLM-resources
6.5

🧑‍🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.

RAG Libraries
8.6k910Apache-2.04d ago

ChatGPT-Shortcut

rockbenben/ChatGPT-Shortcut
7.3

🚀💪Maximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (English/中文/Español/العربية). 让生产力加倍的 AI 快捷指令。更高效地管理提示词,在分享社区中发现适用于不同场景的灵感。

Prompt Engineering
8.6k939TypeScriptMIT6d ago

presenton

presenton/presenton
7.5

Open-Source AI Presentation Generator and API (Gamma, Beautiful AI, Decktopus Alternative)

Agent Frameworks
8.6k1.3kTypeScriptApache-2.01d ago

reor

reorproject/reor
6.0

Private & local AI personal knowledge management app for high entropy people.

Vector Databases
8.6k527JavaScriptAGPL-3.01y ago

awesome-prompts

ai-boost/awesome-prompts
6.7

Curated list of chatgpt prompts from the top-rated GPTs in the GPTs Store. Prompt Engineering, prompt attack & prompt protect. Advanced Prompt Engineering papers.

Prompt Engineering
8.3k784GPL-3.0today

MiroThinker

MiroMindAI/MiroThinker
6.8

MiroThinker is an open source deep research agent optimized for research and prediction. It achieves a 80.8% Avg@8 score on the challenging GAIA benchmark.

Agent Frameworks
8.3k645PythonMIT2mo ago

garak

NVIDIA/garak
7.5

the LLM vulnerability scanner

Evaluation & Testing
8.2k1.1kPythonApache-2.02d ago

awesome-gpt4o-images

jamez-bondos/awesome-gpt4o-images
5.8

Awesome curated collection of images and prompts generated by GPT-4o and gpt-image-1. Explore AI generated visuals created with ChatGPT and Sora, showcasing OpenAI’s advanced image generation capabilities.

Prompt Engineering
8.1k1.8kJavaScriptNOASSERTION1y ago

GPTCache

zilliztech/GPTCache
6.3

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Vector Databases
8.1k583PythonMIT11mo ago

lmdeploy

InternLM/lmdeploy
7.5

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Inference Engines
7.9k700PythonApache-2.02d ago

deep-searcher

zilliztech/deep-searcher
6.6

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Vector Databases
7.9k764PythonApache-2.07mo ago

R2R

SciPhi-AI/R2R
6.2

SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

RAG Libraries
7.9k640PythonMIT7mo ago

Upsonic

Upsonic/Upsonic
7.6

Agent Framework For Fintech and Banks

Agent Frameworks
7.9k737PythonMIT10d ago

server

MariaDB/server
7.8

MariaDB server is a community developed fork of MySQL server. Started by core members of the original MySQL team, MariaDB actively works with outside developers to deliver the most featureful, stable, and sanely licensed open SQL server in the industry.

Vector Databases
7.8k2.1kC++GPL-2.0today

rig

0xPlaygrounds/rig
7.9

⚙️🦀 Build modular and scalable LLM Applications in Rust

LLM Frameworks
7.8k860RustMIT1d ago

evidently

evidentlyai/evidently
7.3

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

AI DevOps
7.6k873Jupyter NotebookApache-2.01mo ago

Prompt_Engineering

NirDiamant/Prompt_Engineering
6.0

This repository offers a comprehensive collection of tutorials and implementations for Prompt Engineering techniques, ranging from fundamental concepts to advanced strategies. It serves as an essential resource for mastering the art of effectively communicating with and leveraging large language models in AI applications.

Prompt Engineering
7.6k985Jupyter NotebookNOASSERTION11d ago

inkos

Narcooo/inkos
6.3

Autonomous novel writing CLI AI Agent — agents write, audit, and revise novels with human review gates

Agent Frameworks
7.6k1.4kTypeScriptAGPL-3.03d ago

code2prompt

mufeedvh/code2prompt
7.5

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Prompt Engineering
7.4k426RustMIT6d ago

FinRobot

AI4Finance-Foundation/FinRobot
6.9

FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀

Prompt Engineering
7.4k1.2kJupyter NotebookApache-2.01mo ago

openllmetry

traceloop/openllmetry
7.6

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

AI DevOps
7.2k1.0kPythonApache-2.0today

InternLM

InternLM/InternLM
6.7

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

LLM Frameworks
7.2k507PythonApache-2.08mo ago

Bindu

GetBindu/Bindu
7.2

Bindu: Turn any AI agent into a living microservice - interoperable, observable, composable.

Agent Frameworks
7.2k411PythonNOASSERTION6d ago

opencompass

open-compass/opencompass
7.4

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

LLM Frameworks
7.1k794PythonApache-2.02d ago

flyte

flyteorg/flyte
8.2

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Fine-tuning Tools
7.1k837GoApache-2.0today

feast

feast-dev/feast
8.0

The Open Source Feature Store for AI/ML

AI DevOps
7.1k1.4kPythonApache-2.0today

vespa

vespa-engine/vespa
8.0

AI + Data, online. https://vespa.ai

Vector Databases
7.0k721JavaApache-2.0today

postgresml

postgresml/postgresml
6.3

Postgres with GPUs for ML/AI apps.

Vector Databases
6.8k362RustMIT12mo ago

clearml

clearml/clearml
7.6

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

AI DevOps
6.7k782PythonApache-2.04d ago