Examples

• Native Client Integrations
  • Completions
    • OpenAI
    • Google Vertex AI
    • Amazon
  • Embeddings
    • OpenAI
    • Amazon
• Langchain Integration
  • Harmonized Model Initialization
  • LLM
  • Chat model
  • Embeddings
• Using New Models Before Official SDK Support
• Streaming
  • Native SDKs
    • OpenAI - ChatGPT
    • Google - Gemini
    • Anthropic - Claude
    • Amazon - Titan
  • Langchain
• Prompt Registry
  • Prerequisite
    • Provide the credentials to authenticate the client and establish a connection with the Prompt Registry API.
    • Step 0: Initialize Client
      • Initialize the client to interact with the Prompt Registry.
    • Step 1: Create Prompt Templates
      • Define the Prompt Template configuration and post to Prompt Registry.
    • Step 2: Retrieve Prompt Templates
      • Retrieve the Prompt Template by ID.
    • Step 3: Modify the Prompt Template
      • We will add an input variable to the existing Prompt Template.
    • Step 4: Prompt Template History
      • Retrieve the history of Prompt Templates by id.
    • Step 5: Fill Prompt Template
      • Fill the variables in the Prompt Template.
• Orchestration Service
  • Prerequisite
  • Authentication
  • Basic Orchestration Pipeline
    • Step 1: Define the Template and Default Input Values
      • Referencing Templates in the Prompt Registry
      • Overview of response_format Parameter Options
    • Step 2: Define the LLM
    • Step 3: Create the Orchestration Configuration
    • Step 4: Run the Orchestration Request
  • Understanding Deployment Resolution
    • Default Behavior
    • Direct Deployment Specification
    • Config-Based Specification
  • Optional Modules
    • Data Masking
      • Masking Types
      • Configuration Options
    • Content Filtering
  • Streaming
  • Tool Calling (Function Calling)
    • Defining Tools
      • Using the Python Decorator
      • Using the FunctionTool Class
      • Using a JSON Schema Dictionary
    • Synchronous Tool Call Workflow
    • Streaming Tool Calls
  • Translation
  • Advanced Examples
    • Translation Service
    • Chatbot with Memory
    • Sentiment Analysis with Few Shot Learning
  • Async Support
• Document Grounding
  • Prerequisites
  • Configuration of the Grounding Module
    • Create the configuration
      • Grounding configuration for searching SAP Help via elastic search
      • Grounding configuration for searching a custom data repository
      • One can also show the retrieved context from the grounding module, which is added to the prompt for improving the response.
      • Data Masking of the retrieved context
• Async examples
• Async Amazon native
• Async Function to Stream Titan Model Response
• Async Function to Test Amazon Titan Embedding
• Gemini async native example:
• Async Gemini Chat Example
• Async Gemini Stream Generate Content Example
• Langchain examples
• Async Chat Streaming Example
• Chat Converse Model Example
• Async Gemini Model Invocation Example
• Async Gemini Streaming Example