Configuring AI Chatbot

Configuring the AI Chatbot

The next steps we will configure the the AI Chatbot to talk to FortiAIGate instead of talking directly to the LLM. This is to allow FortiAIGate to proxy the requests to the LLM and perform inspection and logging of the prompt inputs and outputs.

1. Within FortiAIGate, using the left navigation menu, click on Settings > API Keys.

2. Click on the “Copy” action button to copy the current API key to your clipboard.

   

3. Navigate back to the tab with the FortiAIGate landing page titled “FortiAIGate Lab”.

4. Click on “Chatbot” in the top menu.

   

5. Click on the field named “API Key” and paste in the API key you copied from the FortiAIGate. This API key will be included in every request that is sent to the FortiAIGate. This is used to ensure that the FortiAIGate is not accessed without permission or authorization.

6. Back in the Azure Portal, use the Cloud Console to run the following command:

   echo http://$(whoami)-worker.centralus.cloudapp.azure.com/v1/hrbot

   Copy the URL generated and use it in the next step.

   Info

   Each student's environment has a unique number assigned. We use this process to ensure we have the correct endpoint URL to access the FortiAIGate. We are also using http here instead of HTTPS to avoid any issues with unsigned certificates. In a production environment you would use HTTPS.

7. Click on the field named “LLM Endpoint” and enter the URL generated in the previous step:

   

8. Click on “Save” to commit the changes to your local browser.

9. In the “Say something…” at the bottom of the chat window type hello to verify that the chatbot can talk to the FortiAIGate and that the FortiAIGate can also communicate with the backend LLM.

   

Let’s Get Started with FortiAIGate

We now have a fully operational “AI stack” to start testing FortiAIGate. Let’s get started!