Azure OpenAI Service
Coming Soon!
Last updated
Coming Soon!
Last updated
Azure OpenAI allows you to create powerful models against your own data held within your azure environment. With ChatGPT 4 you can allow users to upload files securely and use azure AI search service to query your data and documents in a controlled environment.
To set up an Azure OpenAI deployment follow the steps from Microsoft Azure OpenAI services. It is important to remember that Azure OpenAI is often in Beta mode and some features must be requested from Microsoft Azure support to unlock the full potential of Azure OpenAI.
Additionally pay attention to the region which you deploy as some features may not be available in certain regions. East US2 currently has the most availability and features along with ChatGPT 4, which allows for using azure search to query your data
Once you have created an Azure OpenAI services account and deployed your first model, we will need to grab three values to enter into our system. Navigate to your admin portal here.
Navigate to the 'edit company' tab and click Add Azure Deployment under the Azure OpenAI settings.
Here we will need to enter three values:
Your OpenAI Endpoint and Key can be found on the azure portal under the Azure OpenAI service you created and Keys and Endpoints.
Copy and paste the API Key and Endpoint into the respective fields in the AIC Risk Admin Portal.
Next click the 'Add New' button and enter the name of the deployment you created.
This can be found in the Azure AI Studio under deployments as highlighted below.
Azure search allows you to add a search query to your agent that can access your internal databases and documents. Azure AI search can not be used with assistant option and is only available when the option of assistant is unchecked on an agent.
To create an Azure AI search for your data follow the instructions on the Azure AI search documentation on getting started.
Once you have created a deployment for your model and added a search to your data through azure click 'Add Azure Search'.
You can add multiple searches but for each one we will need three values:
Search Endpoint https://{SOMETHING}.search.windows.net/
Index Name (Found under Indexes on the search service you created)
Endpoint Key (Found under Keys on the search service you created)
