Kgateway AI Lab: Credentials Management

In this free, on-demand technical lab, explore how the an AI Gateway like kgateway handles authorization with LLM APIs.

• Configuring LLM credentials: Learn how to securely store and manage API keys for both OpenAI and Mistral AI using Kubernetes secrets.
• Routing traffic to LLM APIs: Understand how to define and apply Backend and HTTPRoute resources to route requests to different LLM providers, including automatically attaching API keys to requests.
• Testing the AI Gateway with real-world examples: Gain hands-on experience in sending prompts to both OpenAI and Mistral AI, exploring both standard and streaming response methods.

Complete the lab and gain practical experience in managing credentials and routing traffic to multiple LLMs using kgateway.