Private & local AI personal knowledge management app for high entropy people.

⚙️🦀 Build modular and scalable LLM Applications in Rust

MiroThinker is an open source deep research agent optimized for research and prediction. It achieves a 80.8% Avg@8 score on the challenging GAIA benchmark.

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

MariaDB server is a community developed fork of MySQL server. Started by core members of the original MySQL team, MariaDB actively works with outside developers to deliver the most featureful, stable, and sanely licensed open SQL server in the industry.

Awesome curated collection of images and prompts generated by GPT-4o and gpt-image-1. Explore AI generated visuals created with ChatGPT and Sora, showcasing OpenAI’s advanced image generation capabilities.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

Agent Framework For Fintech and Banks

A Datacenter Scale Distributed Inference Serving Framework

FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

This repository offers a comprehensive collection of tutorials and implementations for Prompt Engineering techniques, ranging from fundamental concepts to advanced strategies. It serves as an essential resource for mastering the art of effectively communicating with and leveraging large language models in AI applications.

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Open-source implementation of AlphaEvolve

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

The Open Source Feature Store for AI/ML

AI + Data, online. https://vespa.ai

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

Plano is an AI-native proxy server and data plane for agentic apps - centralizing orchestration, safety, observability, and smart LLM routing so you can deliver agents faster.

Memory library for building stateful agents

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

TypeScript multi-agent framework — one runTeam() call from goal to result. Auto task decomposition, parallel execution. 3 dependencies, deploys anywhere Node.js runs.

From a goal to a task DAG, automatically. TypeScript-native multi-agent orchestration with MCP and live tracing. Three runtime dependencies.

Postgres with GPUs for ML/AI apps.

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Efficient Triton Kernels for LLM Training

Open-source context retrieval layer for AI agents

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

An open and fair framework for everyone to build AI agents equipped with powerful skills. Launch your agent, improve the world, your wallet, or both!

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

SuperPrompt is an attempt to engineer prompts that might help us understand AI agents.

A framework for efficient model inference with omni-modality models

ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括335个大模型，覆盖chatgpt、gpt-5.2、o4-mini、谷歌gemini-3-pro、Claude-4.5、文心ERNIE-X1.1、ERNIE-5.0-Thinking、qwen3-max、百川、讯飞星火、商汤senseChat等商用模型， 以及kimi-k2、ernie4.5、minimax-M2、deepseek-v3.2、qwen3-2507、llama4、智谱GLM-4.6、gemma3、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大模型缺陷库！方便广大社区研究分析、改进大模型。

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

FlashInfer: Kernel Library for LLM Serving

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

Building AI agents, atomically

Building AI agents, atomically