Artificial Intelligence Corporate Risk
  • Welcome
  • Getting Started
    • Inviting Users
    • Adding New Large Language Models
      • Azure OpenAI Service
      • OpenAI
      • Mistral
      • Google AI
      • LLaMA AI
      • AWS Bedrock
  • Chat
    • Initiating a Chat
    • Viewing Chat History
  • Dashboards
    • Creating Dashboards
    • Dashboard Elements
      • Top N
      • Charts and Graphs
      • Totals
      • Maps
  • Monitoring
    • Adding a User to the Monitor Role
    • Setting up alerts and issues
    • Editing Issues
  • Compliance
    • Adding a User to the Compliance Role
    • Creating a Search
    • Consuming the Results
  • Admin
    • AI Agents
      • Adding a New Agent
        • General Settings
        • Agent Engine Properties
          • Azure OpenAI
          • OpenAI
          • Mistral
          • Google AI
          • LLaMA AI
          • AWS Bedrock
        • Advanced Settings
          • Usage
            • Max Messages
            • LLM Temperature
          • Scanners
            • AI Scanners
            • General Scanners
          • API Keys
          • Files
      • Editing an Agent
      • Deleting an Agent
      • Adding from a Template
    • Company
      • General Information
      • External Agent Provider Settings
    • Custom APIs
      • OAuth2 API
      • Adding a New API
        • API Information
        • API Headers
        • API Endpoint Parameters
        • API Query Parameters
        • Body Parameters
      • Editing a Custom API
      • Deleting a Custom API
    • Custom Database
    • Users
      • Inviting a New User
      • Deleting a User
      • Roles
        • Accessing User Roles
      • Assigning an Agent
      • Setting a Default Agent
    • Groups
      • Adding a New Group
      • Deleting a Group
      • Assigning a User
      • Removing a User
      • Adding an Agent
      • Removing an Agent
    • Agent Scanner Defaults
      • Toxicity
      • Personal Information
      • Topic Scanner
      • Prompt Injection Detection
      • Regex Scanner
      • Geographic Gating
      • Language Detection
      • Allowed File Types
    • Logs
      • Interpreting Logs
  • Server Admin
    • Upgrade
    • Default Agents
      • Adding a New Agent
    • Data Archive
    • API Access
      • Chat
        • List Agents
        • Create Conversation
        • List of Conversations
        • Get Conversations
        • Ask Agent
        • Chat with Agent
        • Add File to Conversation
        • Add Files to Agent
        • Deleting a File
      • OAuth2
        • OAuth2
        • OAuth2 Token
      • Users
        • List Users
        • Create User
        • Add User to Group
        • Set User Token
        • Delete User
      • How to Launch Our API Example
        • How the Code Works
    • Configure OAuth2
    • Custom Secrets
  • API Overview
    • Authentication
    • Calling the Scanner
    • Consuming the Results
    • 📃Pagination
      • Understanding API Parameters
      • Pagination Helper
      • Example Page
      • Recap
    • AIRisk API OAuth2 Authentication
      • Authorization
      • Authorization Endpoint
        • Example Authorization URL
        • Error Responses
      • Tokens
        • Error Handling
        • Generic vs. User-Specific Tokens
          • Example Usage Flow / Reasons
        • Usage of the Access Token
      • Token Endpoint
        • Example Token Request
        • Error Responses
      • Summary of OAuth2 Authorization Flow
  • Managing Your Account
    • Personal Data
  • Support
    • Onboarding Check List
  • Internal Deployment
    • Outlook Plugin
    • Firewall Rules
    • Infrastructure
    • Graph Connection Requirements
    • Zoom Transcripts
  • Example Python Application
  • Release Notes
    • V4.65
    • V4.28
    • V4.12
    • V4.0
    • V3.71
    • V3.0 Beta
    • V2.23
    • V2.22
    • V2.120 HotFix
    • V2.103 June 1
Powered by GitBook
On this page
  1. Getting Started
  2. Adding New Large Language Models

Azure OpenAI Service

Coming Soon!

PreviousAdding New Large Language ModelsNextOpenAI

Last updated 4 months ago

Azure OpenAI allows you to create powerful models against your own data held within your azure environment. With ChatGPT 4 you can allow users to upload files securely and use azure AI search service to query your data and documents in a controlled environment.

To set up an Azure OpenAI deployment follow the steps from. It is important to remember that Azure OpenAI is often in Beta mode and some features must be requested from Microsoft Azure support to unlock the full potential of Azure OpenAI.

Additionally pay attention to the region which you deploy as some features may not be available in certain regions. East US2 currently has the most availability and features along with ChatGPT 4, which allows for using azure search to query your data

Navigate to the 'edit company' tab and click Add Azure Deployment under the Azure OpenAI settings.

Here we will need to enter three values:

Copy and paste the API Key and Endpoint into the respective fields in the AIC Risk Admin Portal.

Next click the 'Add New' button and enter the name of the deployment you created.

Azure Search

Azure search allows you to add a search query to your agent that can access your internal databases and documents. Azure AI search can not be used with assistant option and is only available when the option of assistant is unchecked on an agent.

To create an Azure AI search for your data follow the instructions on the Azure AI search documentation on getting started.

Once you have created a deployment for your model and added a search to your data through azure click 'Add Azure Search'.

You can add multiple searches but for each one we will need three values:

  • Search Endpoint https://{SOMETHING}.search.windows.net/

  • Index Name (Found under Indexes on the search service you created)

  • Endpoint Key (Found under Keys on the search service you created)

Once you have created an Azure OpenAI services account and deployed your first model, we will need to grab three values to enter into our system. Navigate to your admin portal .

Your OpenAI Endpoint and Key can be found on the under the Azure OpenAI service you created and Keys and Endpoints.

This can be found in the under deployments as highlighted below.

here
azure portal
Azure AI Studio
Microsoft Azure OpenAI services
How-to: Create and deploy an Azure OpenAI Service resource - Azure OpenAIMicrosoftLearn
Logo
https://app.aicrisk.com/Adminapp.aicrisk.com
Azure Cognitive Search documentationdocsmsft
Logo