AI Gateways Software

The AI inference platform built for developers. Fast responses, scalable performance, and costs you can plan for. Available in public, private, or co-cloud instances.

Together AI is a research-driven AI cloud infrastructure provider that offers an end-to-end platform for training, fine-tuning, and running generative AI models. Founded in 2022 and headquartered in San Francisco, the company is a prominent advocate for open-source AI and provides access to a wide range of open-source models for text, image, and video generation

LLM Gateway is an open-source API gateway for Large Language Models (LLMs). It acts as a middleware between your applications and various LLM providers, allowing you to: Route requests to multiple LLM providers (OpenAI, Anthropic, Google AI Studio, and others) Manage API keys for different providers in one place Track token usage and costs across all your LLM interactions Analyze performance metrics to optimize your LLM usage

AI Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format.

The Helicone AI Gateway is now available in beta. Built in Rust for performance, the Helicone AI Gateway lets you switch between 100+ AI models with ease, without any new dependencies or rewriting of integrations. The AI Gateway handles failovers, rate limiting, caching, and observability.

OpenRouter is a unified, OpenAI-compatible API gateway designed for developers to access and manage over 500 different LLMs (Large Language Models) from numerous providers (e.g., Anthropic, Google, OpenAI, Meta) through a single interface. It functions as an "AI model aggregator," simplifying integration by eliminating the need for managing multiple API keys, subscriptions, and billing systems.

UnifyApps AI agents are LLM-agnostic, allowing you flexibility to leverage the most suitable model for each use case. Because not all large language models are created equal.

Portkey equips AI teams with everything they need to go to production - AI Gateway, Observability, Guardrails, Governance, and Prompt Management, all in one platform.

Simplify your GenAI stack with a single AI Gateway that integrates all major models. Connect to OpenAI, Claude, Gemini, Groq, Mistral, and 250+ LLMs through one AI Gateway API Use the AI Gateway to support chat, completion, embedding, and reranking model types Centralize API key management and team authentication in one place. Orchestrate multi-model workloads seamlessly through your infrastructure.

Powering the API world Increase developer productivity, security, and performance at scale with the unified platform for API management, AI gateways, service mesh, and ingress controller.