Artificial IndexHumanity's AI Index
Infrastructure index

103 infrastructure & developer systems.

Vector stores, retrieval frameworks, gateways, sandboxes, inference runtimes, MLOps, tracing, observability and evaluation are part of the AI ecosystem too.

Glean

Glean · Enterprise, Search, Assistant, Agent

Enterprise AI platform combining search, assistant, agents, organizational context and model routing.

Rovo

Atlassian · Enterprise, Search, Assistant, Agent

Atlassian's AI layer for search, chat and context-aware agents powered by organizational work context.

Kagi Assistant

Kagi · Assistant, Search, Research

Kagi's privacy-focused multi-model assistant with optional Kagi Search access and configurable assistants.

Consensus

Consensus · Research, Search

AI-powered academic search engine that grounds generated answers in peer-reviewed scientific research.

You.com Search APIs

You.com · Search, Development, Research

Developer-facing web search and research APIs designed as a real-time web data layer for AI agents and applications.

OpenEvidence

OpenEvidence · Healthcare, Research, Search

Clinical AI and medical knowledge platform for healthcare professionals with source-grounded answers and licensed medical content.

OpenRouter

OpenRouter · Development, Inference, Aggregator

Developer platform that provides a unified interface for accessing and routing requests across many AI model providers.

Together AI

Together AI · Development, Inference

AI cloud platform for model inference, fine-tuning and developer workloads.

Fireworks AI

Fireworks AI · Development, Inference

Inference and developer platform for serving and customizing generative AI models.

GroqCloud

Groq · Development, Inference

Groq developer cloud for low-latency inference through hosted APIs.

Cerebras Inference

Cerebras Systems · Development, Inference

Hosted inference service from Cerebras for running supported generative AI models.

Replicate

Replicate · Development, Inference

Cloud platform and API for running machine-learning and generative AI models.

Hugging Face Inference Providers

Hugging Face · Development, Inference, Aggregator

Hugging Face routing layer for accessing inference providers and models through a common developer experience.

LangChain

LangChain · Framework, Agent, Development, Open Source

Open-source framework for building agentic applications with model, tool and data integrations.

LlamaIndex

LlamaIndex · Framework, Agent, Development, Open Source

Framework and platform for data-connected LLM applications, retrieval and agent workflows.

CrewAI

CrewAI · Framework, Agent, Development, Open Source

Agent orchestration framework centered on collaborative crews and structured multi-agent workflows.

Microsoft Agent Framework

Microsoft · Framework, Agent, Development, Open Source

Microsoft framework for building agents and graph-based workflows, positioned as a new foundation for Microsoft agent applications.

Semantic Kernel

Microsoft · Framework, Agent, Development, Open Source

Microsoft open-source SDK for integrating AI models, plugins, memory and agent patterns into applications.

Google Agent Development Kit

Google · Framework, Agent, Development, Open Source

Google open-source agent development framework for building and orchestrating model-powered agents.

Strands Agents

Amazon Web Services · Framework, Agent, Development, Open Source

AWS-backed open-source SDK for building model-driven agents and tool-using workflows.

Pydantic AI

Pydantic · Framework, Agent, Development, Open Source

Python agent framework from Pydantic for typed, model-agnostic AI applications.

Mastra

Mastra · Framework, Agent, Development

TypeScript framework and developer platform for building agents, workflows, memory and evaluation systems.

OpenAI Agents SDK

OpenAI · Framework, Agent, Development, Open Source

OpenAI SDK for building agentic applications with tools, handoffs, guardrails and tracing.

NVIDIA NIM

NVIDIA · Development, Inference, Enterprise

NVIDIA inference microservices for deploying optimized AI models behind standard APIs on accelerated infrastructure.

Dropbox Dash

Dropbox · Productivity, Search, Assistant, Enterprise

AI-powered universal search and knowledge workspace that connects team files, messages and work context.

Bing Chat

Microsoft · Historical, Assistant, Search

Microsoft AI chat experience in Bing before the product name transitioned to Microsoft Copilot.

OpenAI Swarm

OpenAI · Historical, Framework, Agent, Open Source

OpenAI experimental educational multi-agent orchestration framework that preceded the production Agents SDK.

Vertex AI

Google Cloud · Platform, Development, Enterprise

Google Cloud platform for building, tuning, evaluating, deploying and operating machine-learning and generative-AI systems.

Google AI Studio

Google · Platform, Development

Google browser-based developer environment for prototyping and building with Gemini models and APIs.

Microsoft Foundry

Microsoft · Platform, Development, Enterprise, Agent

Microsoft's unified platform for building, deploying, evaluating, governing and operating AI applications, models and agents.

Amazon Bedrock

Amazon Web Services · Platform, Development, Enterprise, Inference

AWS managed platform for accessing foundation models and building generative-AI applications.

Amazon Bedrock AgentCore

Amazon Web Services · Platform, Agent, Development, Enterprise

AWS platform services for building, deploying and operating production AI agents with managed runtime, memory, identity, gateways and observability.

watsonx.ai

IBM · Platform, Development, Enterprise

IBM enterprise studio and runtime for foundation models, prompt development, tuning and AI application development.

Mosaic AI

Databricks · Platform, Development, Enterprise

Databricks AI platform capabilities for building, evaluating, serving and governing generative-AI applications.

Snowflake Cortex AI

Snowflake · Platform, Enterprise, Development

Snowflake AI services for using language, search and machine-learning capabilities close to enterprise data.

Cloudflare Workers AI

Cloudflare · Platform, Inference, Development

Cloudflare serverless AI inference platform integrated with Workers and edge application development.

Baseten

Baseten · Platform, Inference, Development

AI model serving and inference platform for deploying and scaling custom and open models.

Modal

Modal · Platform, Inference, Development

Serverless compute platform commonly used for AI training, inference, batch jobs and GPU workloads.

Anyscale

Anyscale · Platform, Inference, Development

Managed Ray platform for scalable AI, data and distributed inference workloads.

BentoML

BentoML · Framework, Inference, Development, Open Source

Open-source model-serving framework and platform for packaging and operating AI inference services.

vLLM

vLLM Project · Framework, Inference, Open Source

Open-source high-throughput inference and serving engine for large language models.

SGLang

SGLang Project · Framework, Inference, Open Source

Open-source serving and programming framework for efficient large language and multimodal model execution.

TensorRT-LLM

NVIDIA · Framework, Inference, Open Source

NVIDIA open-source library for optimizing and serving large language-model inference on NVIDIA GPUs.

Triton Inference Server

NVIDIA · Platform, Inference, Open Source

NVIDIA open-source inference server for deploying models from multiple frameworks at scale.

Jina AI

Jina AI · Platform, Search, Development

Developer platform for embeddings, reranking, multimodal search and web-content processing for AI applications.

Voyage AI

Voyage AI · Platform, Search, Development

Embedding and reranking model platform for retrieval and search in AI applications.

Pinecone Assistant

Pinecone · Platform, Search, Assistant, Development

Pinecone managed assistant and retrieval layer for grounded question answering over uploaded knowledge.

Gemini Enterprise

Google Cloud · Agent, Enterprise, Assistant, Platform

Google Cloud enterprise AI environment for agent development, orchestration, governed deployment and workplace access.

LangGraph

LangChain · Framework, Agent, Development, Open Source

Graph-based agent orchestration framework for stateful, controllable and long-running AI workflows.

AutoGPT

Significant Gravitas · Framework, Agent, Open Source, Automation

Open-source autonomous-agent project and platform for assembling goal-driven AI workflows.

Browser Use

Browser Use · Framework, Agent, Automation, Open Source

Open-source framework and hosted tooling for agents that perceive and operate web browsers.

scite

Research Solutions · Research, Search

Scientific literature search and citation-analysis platform using AI to help evaluate how research is supported, contrasted or mentioned.

SciSpace

SciSpace · Research, Search, Assistant

AI research workspace for searching papers, explaining literature and assisting with academic reading.

AlphaSense

AlphaSense · Finance, Research, Enterprise, Search

Market-intelligence and enterprise research platform combining search, financial content and generative AI.

Google Agentspace

Google Cloud · Historical, Agent, Enterprise, Search

Google enterprise search and agent product whose technology is now part of Gemini Enterprise.

garak

NVIDIA · AI Safety, Evaluation, Open Source

Open-source LLM vulnerability scanner for probing model and application security weaknesses.

promptfoo

Promptfoo · Evaluation, AI Safety, Development, Open Source

Open-source evaluation and red-team framework for LLM applications and prompts.

Giskard

Giskard · Evaluation, AI Safety, Development

AI testing and evaluation platform for LLM and machine-learning application quality and risk.

Patronus AI

Patronus AI · Evaluation, AI Safety, Enterprise

Evaluation and reliability platform for testing enterprise generative-AI applications.

Lakmoos

Lakmoos AI · Evaluation, Research, Enterprise

AI evaluation and market-simulation platform using synthetic personas and agent populations.

Arize Phoenix

Arize AI · Evaluation, Observability, Open Source, Development

Open-source observability and evaluation tooling for LLM, RAG and agent applications.

Roboflow

Roboflow · Computer Vision, Development, Platform

Computer-vision platform for datasets, annotation, training, deployment and vision application development.

Recursion OS

Recursion · Biology, Drug Discovery, Research, Platform

AI-enabled drug-discovery platform combining biological datasets, computation and experimentation.

Weaviate

Weaviate · Vector Database, Search, Development

AI-native vector database and retrieval platform for semantic search and RAG applications.

Qdrant

Qdrant · Vector Database, Search, Open Source

Open-source vector database for similarity search, retrieval and AI application memory.

Milvus

Zilliz · Vector Database, Search, Open Source

Open-source vector database designed for large-scale similarity search.

Chroma

Chroma · Vector Database, Search, Open Source

Open-source embedding database and retrieval layer for AI applications.

LanceDB

LanceDB · Vector Database, Search, Open Source

Open-source multimodal vector database for AI retrieval workloads.

Redis Vector Search

Redis · Vector Database, Search, Development

Vector-search and semantic retrieval capabilities built into Redis.

Elastic AI Search

Elastic · Search, Enterprise, Development

AI search and retrieval capabilities built on Elasticsearch.

OpenSearch Vector Search

OpenSearch Project · Search, Vector Database, Open Source

Open-source vector and neural search capabilities in OpenSearch.

Haystack

deepset · Framework, RAG, Agent, Open Source

Open-source framework for RAG, search, pipelines and AI agents.

DSPy

Stanford NLP · Framework, Development, Open Source

Programming framework for optimizing language-model pipelines and modular AI systems.

LiteLLM

BerriAI · Framework, Gateway, Open Source

Open-source LLM gateway and API abstraction layer for routing across model providers.

Portkey

Portkey · Gateway, Observability, Development

AI gateway and observability platform for routing, governance and operating LLM applications.

Helicone

Helicone · Observability, Evaluation, Open Source

Open-source observability platform for tracking, debugging and evaluating LLM application calls.

Langfuse

Langfuse · Observability, Evaluation, Open Source

Open-source LLM engineering platform for tracing, evaluation, prompts and analytics.

LangSmith

LangChain · Observability, Evaluation, Development

Tracing, evaluation and deployment tooling for LLM and agent applications.

Braintrust

Braintrust · Evaluation, Observability, Development

Evaluation and observability platform for testing and improving AI applications.

Weave

Weights & Biases · Evaluation, Observability, Development

Observability and evaluation tooling for generative-AI applications from Weights & Biases.

Humanloop

Humanloop · Evaluation, Development, Enterprise

Evaluation, prompt-management and human-feedback platform for enterprise LLM applications.

Galileo

Galileo · Evaluation, Observability, Enterprise

Evaluation and observability platform for generative-AI systems.

Fiddler AI

Fiddler AI · Evaluation, Observability, Enterprise

AI observability and governance platform for predictive and generative models.

whylogs

WhyLabs · Observability, Data Quality, Open Source

Open-source data and ML logging library for monitoring AI and data pipelines.

Evidently AI

Evidently AI · Observability, Evaluation, Open Source

Open-source ML and LLM evaluation and monitoring platform.

TruLens

Snowflake · Evaluation, RAG, Open Source

Open-source evaluation and tracing framework for LLM and RAG applications.

MLflow AI Gateway & Evaluation

Databricks · MLOps, Evaluation, Open Source

Open-source ML lifecycle platform with generative-AI tracking, evaluation and model-management capabilities.

Kubeflow

Kubeflow Project · MLOps, Open Source, Platform

Open-source Kubernetes-native machine-learning workflow platform.

Ray

Anyscale · Framework, MLOps, Open Source

Open-source distributed computing framework widely used for AI training, serving and scaling.

DVC

Iterative · MLOps, Data, Open Source

Open-source data and model versioning system for machine-learning projects.

Label Studio

HumanSignal · Data Labeling, Open Source, Development

Open-source data-labeling platform for text, image, audio and multimodal machine-learning datasets.

Palantir AIP

Palantir · Enterprise, Agent, Platform

Enterprise AI platform for connecting models, data, operational systems and governed agent workflows.

Scale AI Platform

Scale AI · Enterprise, Data, Evaluation, Platform

Platform for AI data, model evaluation, enterprise generative-AI applications and government AI programs.

Dataiku Generative AI

Dataiku · Enterprise, Platform, Development

Enterprise platform for governed generative-AI, analytics and machine-learning application development.

DataRobot Generative AI

DataRobot · Enterprise, Platform, MLOps

Enterprise AI platform for building, governing and operating generative and predictive AI.

Domino Enterprise AI

Domino Data Lab · Enterprise, MLOps, Platform

Enterprise platform for data science, model development and governed AI deployment.

C3 AI Platform

C3 AI · Enterprise, Industrial AI, Platform

Enterprise AI application and development platform for industrial and business use cases.

Cue:

NAVER · Search, Assistant, Regional

NAVER generative-AI search experience connected to web and shopping information.

Scale Enterprise Generative AI Platform

Scale AI · Enterprise, Platform, Evaluation

Enterprise platform for building and evaluating generative-AI applications with governed data and model workflows.

SambaNova Cloud

SambaNova Systems · Inference, Platform, Enterprise

Enterprise AI inference and model platform built on SambaNova systems.

OctoAI

NVIDIA / OctoAI · Historical, Inference, Platform

Former AI inference platform acquired by NVIDIA and preserved as an infrastructure lifecycle record.

Modal Sandboxes

Modal · Agent, Infrastructure, Development

Isolated cloud execution environments for AI agents and code-running workflows.

E2B

E2B · Agent, Infrastructure, Development, Open Source

Secure cloud sandboxes and execution infrastructure for AI agents and code interpreters.