https://fortinetcloudcse.github.io/faig-training-workshop/01_environment_setup/index.htmlInitial Environment This lab requires you have a working Kubernetes (K8s) environment in Azure. We will be using helm via the Azure Cloud Console to setup the existing nodes and pods that we will use during this session. Complete Previous Labs First This lab requires you to have completed the following sections from the “k8s01-101-workshop”: Workshop Logistics: Task 1 - Setup Azure Cloud Shell - This ensures that you have properly setup the Cloud Console and have access that you will need in the next sections. Workshop Logistics: Task 2 - Run Terraform - This task will ensure that you have a working set of VMs to use as your K8s cluster. This sets up the VMs in Azure via Terraform and ensures that they are ready for the next section. Self Managed K8s Workshop: Task 1 - K8s Installation - This will install K8s on the VMs for you and make sure that you have all the software required to complete the following sections. Confirming the Environment Let’s confirm that the environment is setup correctly and has everything we need before we get started. If any of these checks fail, please go back and confirm that you have completed the sections listed above in “Complete Previous Labs First”.Hugoen-UShttps://fortinetcloudcse.github.io/faig-training-workshop/01_environment_setup/01_setting_up_the_llm.htmlMon, 01 Jan 0001 00:00:00 +0000https://fortinetcloudcse.github.io/faig-training-workshop/01_environment_setup/01_setting_up_the_llm.htmlLLM and Chatbot Setup FortiAIGate is designed to provide visibility as well as guardrails around LLM so we will need an LLM to protect. The following steps will walk you through using helm to setup and configure the required pods (containers) to run our own LLM within our K8s cluster. Info While this demo shows FortiAIGate protecting an internal, or self-hosted LLM, it can also be used to protect external LLMs like OpenAI, Anthropic, AWS Bedrock Converse, and Azure AI Foundry. Protection of these environments allows customers to avoid unnecessary token spend on unauthorized or malicious requests. Just keep in mind anywhere you see LLM, that means it can be _any_ supported LLM. Helper Containers The FortiAIGate demo consists of three containers that allow the demo to function.