← Back to changelog

June 2, 2026

Use OpenAI models on Amazon Bedrock

Tobias Wochinger

Connect Bedrock-hosted OpenAI models to Langfuse LLM Connections with OpenAI Responses API support.

Langfuse LLM Connections now support OpenAI-compatible Responses API endpoints. You can use OpenAI models hosted on Amazon Bedrock, including openai.gpt-5.5 and openai.gpt-5.4, in the Langfuse Playground, LLM-as-a-Judge evaluators, and prompt experiments.

Create an OpenAI LLM Connection, enable Use Responses API, add your Bedrock API key, configure the Bedrock Mantle endpoint for your AWS Region, and add the Bedrock model IDs you want to use.

Setup

In Project Settings > LLM Connections, add a new connection with:

• Provider: OpenAI
• API Key: your Amazon Bedrock API key
• Base URL: https://bedrock-mantle.<aws-region>.api.aws/openai/v1
• Custom model names: openai.gpt-5.5, openai.gpt-5.4, or another OpenAI model ID available in your Bedrock account
• Use Responses API: enabled

Learn more

• LLM Connections
• Amazon Bedrock API keys
• Inference using Responses API on Amazon Bedrock
• OpenAI GPT-5.5 and GPT-5.4 models on Amazon Bedrock