GenAI Model Evaluation with LaunchDarkly and AWS: Hands-on Workshop

Workshop

November 4, 2025 - Chicago, IL

Why This Workshop Matters Now

Are you running OpenAI models in production but questioning their long-term fit? Many teams are exploring migration to AWS Bedrock’s foundation models (Claude 3.7 Sonnet, Amazon Nova Pro) to gain better cost control, stronger security, and improved data sovereignty.

This full-day workshop will equip you with the frameworks, tools, and hands-on experience to migrate confidently - without disrupting production.

Visionaries

November 4, 2025

Agenda

All times Central Time

11:30 AM-3:30 PM

GenAI Model Evaluation with LaunchDarkly and AWS: Hands-on Workshop

In this hands-on workshop, you'll learn how to implement and manage AI configurations using LaunchDarkly's powerful feature management platform integrated with Amazon Bedrock's AI capabilities.

By the end of this workshop, you will:

  • Set up a LaunchDarkly account and configure your Amazon Bedrock environment on AWS
  • Implement the LaunchDarkly SDK and LaunchDarkly AI SDK in a Python application
  • Create AI configurations in LaunchDarkly to enable dynamic control of which AI models and parameters are used without having to keep changing your application code
  • Connect your application to AI foundation models (FMs) hosted in Amazon Bedrock such as Anthropic's Claude and Amazon Nova
  • Implement tracking for user feedback and AI model metrics such as token usage, total cost and time to generate
  • Create and manage AI experiments using LaunchDarkly to compare accuracy of models from different providers


In Partnership With