Solo.io Blog

As enterprises adopt LLMs, they face challenges in cost control, security, governance, and observability. This blog explores how NVIDIA NIM microservices and Gloo AI Gateway help organizations scale LLM usage efficiently.

Hear from Solo.io's Open Source Lead, Lin Sun and Chief Architect, Yuval Kohavi on the five key lessons from seven years of building Gloo and kgateway—covering CNCF donation, API design, scalability, and control plane architecture.

The Gloo Mesh 2.7 release provides major scalability advancements with multi-cluster support for millions of pods and delivers a redesigned intuitive user experience.

Gloo Mesh’s ambient multi-cluster mode sets a new benchmark for scalability. In this test, we deploy 100 million pods across 2,000 clusters, proving it can handle extreme scale with minimal resources, near-instant updates, and no manual tuning, resulting in effortless scalability and cost efficiency for enterprises.

Solo.io joins Microsoft’s Azure MACC program, enabling enterprises to procure Gloo solutions using their committed spend. This partnership simplifies procurement, enhances Azure integration, and accelerates cloud-native adoption.

Solo.io's donation of Gloo Gateway to the CNCF as project kgateway aims to promote open cloud connectivity, expanding collaboration, improves AI traffic control, and strengthens Kubernetes Gateway API adoption.

DeepSeek R1, a new model from Chinese startup DeepSeek, rivals top reasoning models and is open source, with a distilled version for self-hosting. In this blog, we explore how enterprises can maintain tight control and audit trails when interacting with DeepSeek to protect sensitive data.

Reimagine service mesh with Istio’s ambient mode—lightweight, efficient, and scalable. Gloo Mesh now extends this innovation to multi-cluster environments, delivering unmatched reliability, simplicity, and scale.