The Gateway to AI Innovation
Secure, observe, and control your AI applications with Gloo Gateway, the leading cloud native gateway built on Envoy
Unleash Developer Productivity. Accelerate AI Innovation
Fast Track Development
Eliminate development friction, boilerplate code, and avoidable errors in applications consuming LLM APIs with AI gateway features and guardrails across multiple LLM providers.
- Prompt templating
- Multi-LLM provider
- Prompt retries
Secure and Control
Protect applications, models, and data from inappropriate access. Ensure safe use of AI with governance controls, auditability, and visibility into consumption.
- Prompt guard & auditing
- Data exfiltration protection
- Token-weighted rate limiting
Expand and Scale
Leverage advanced AI integration patterns for data augmentation and integration with cloud-native gateway capabilities to support high-volume, zero-downtime AI connectivity.
- Retrieval Augmented Generation (RAG)
- Model fallback/failover
- Semantic caching
Start consuming LLMs across AI applications
Managing LLM credentials
Discover how to implement authentication and authorization controls across AI workloads.
Prompt Enrichment
Improve your your LLM model output with guidelines and prompts with Gloo AI Gateway.
LLM Governance and Control
Learn how to configure a JWT provider using Gloo API Gateway and enforce access control for LLMs.
Supercharge your cloud-native AI application starting with Gloo Gateway
Cloud Native From The Start
Implement the only enterprise API gateway built on Envoy. Run billions of transactions at a fraction of the cost with a programmable model that developers love.
Flexible, Multi-Tiered Architecture
Run Gloo Gateway as a central enterprise gateway and as a distributed micro-gateway. Reduce hair-pinning and eliminate single points of failure without sacrificing central governance and control.
Observe and Control Every Connection
API Traffic is now omnidirectional. Gloo Gateway seamlessly pairs with Istio – with or without sidecars – for complete North, South, East, and West connectivity and observability.
API Platform Ready for Centerstage
The next-generation of API platforms are not monoliths – they are composable. Gloo Gateway integrates with leading technologies like Backstage and Kubernetes Gateway API to provide modern platform engineering and cloud teams with the tools and solutions they want to use.
“Gloo checked all the boxes. API Gateway, advanced traffic routing, strong security controls, multi-cloud support and self-service for developers.”
T-Mobile
