LLM connections

This folder provides documentation and instructions for adding various LLMs into SAS Retrieval Agent Manager.

Contents

• azure-openai.md: Steps to integrate the azure openai foundry resource with SAS Retrieval Agent Manager
• ollama.md: Steps to integrate an ollama deployment with SAS Retrieval Agent Manager
• amazon bedrock.md: Steps to integrate the amazon bedrock resource with SAS Retrieval Agent Manager
• openai.md: Steps to connect an openai endpoint with SAS Retrieval Agent Manager

Purpose

These documents are intended to help users:

• Connect 4 types of LLMs to their SAS Retrieval Agent Manager deployment
• Configure settings to allow for connectivity with each LLM

---

Table of contents

• Azure OpenAI
• Amazon Bedrock
• Ollama
• OpenAI