Observability for Together.ai with Langfuse

%pip install openai langfuse

import os
 
# Get keys for your project from the project settings page
# https://cloud.langfuse.com
 
os.environ["LANGFUSE_PUBLIC_KEY"] = "pk-lf-..." # DOCS EXAMPLE KEYS
os.environ["LANGFUSE_SECRET_KEY"] = "sk-lf-..." # DOCS EXAMPLE KEYS
os.environ["LANGFUSE_HOST"] = "https://cloud.langfuse.com" # 🇪🇺 EU region
# os.environ["LANGFUSE_HOST"] = "https://us.cloud.langfuse.com" # 🇺🇸 US region
 
 
# Get your Together.ai API key from the project settings page
os.environ["TOGETHER_API_KEY"] = "..."

# instead of import openai:
from langfuse.openai import openai
 
client = openai.OpenAI(
  api_key=os.environ.get("TOGETHER_API_KEY"),
  base_url="https://api.together.xyz/v1",
)

client = openai.OpenAI(
  api_key=os.environ.get("TOGETHER_API_KEY"),
  base_url="https://api.together.xyz/v1",
)
 
response = client.chat.completions.create(
  model="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
  messages=[
    {"role": "system", "content": "You are a travel agent. Be descriptive and helpful."},
    {"role": "user", "content": "Tell me the top 3 things to do in San Francisco"},
  ]
)
 
print(response.choices[0].message.content)

San Francisco, the City by the Bay, is a vibrant and eclectic destination that offers a wide range of exciting experiences for visitors. As a travel agent, I'd be delighted to share with you the top 3 things to do in San Francisco:

1. **Explore the Golden Gate Bridge**: This iconic suspension bridge is an engineering marvel and a symbol of San Francisco. Take a stroll across the bridge, which offers breathtaking views of the San Francisco Bay, the city skyline, and the Pacific Ocean. You can also walk or bike across the bridge, or take a guided tour to learn more about its history and construction.

As you walk across the bridge, be sure to stop at the Golden Gate Bridge Pavilion, which offers stunning views and interactive exhibits that showcase the bridge's history and significance. If you're feeling adventurous, you can also take a guided kayak tour under the bridge, which offers a unique perspective on this iconic landmark.

2. **Visit Alcatraz Island**: Located in the San Francisco Bay, Alcatraz Island is a former maximum-security prison that was once home to some of the most notorious inmates in American history, including Al Capone. Take a ferry to the island and explore the prison cells, the solitary confinement cells, and the gardens and courtyards that were once the domain of the prisoners.

As you explore the island, you'll learn about the history of the prison and the lives of the inmates who were once held there. You'll also see the remnants of the prison's notorious past, including the cells where prisoners were kept in solitary confinement and the exercise yard where they were allowed to exercise.

3. **Walk across the Painted Ladies**: The Painted Ladies are a row of colorful Victorian houses that are one of San Francisco's most iconic landmarks. Located in Alamo Square, these houses are a photographer's dream, with their bright colors and ornate details. Take a stroll across the square and admire the houses, which were once the homes of wealthy San Francisco families.

As you walk across the square, be sure to take in the stunning views of the city skyline and the surrounding hills. You can also take a guided tour of the houses, which will give you a deeper understanding of their history and significance. If you're feeling adventurous, you can also take a hike up the nearby hills, which offer breathtaking views of the city and the bay.

These are just a few of the many exciting experiences that San Francisco has to offer. Whether you're interested in history, architecture, or outdoor adventures, there's something for everyone in this vibrant and eclectic city.

Would you like me to recommend any additional activities or experiences in San Francisco?