This guide walks through a complete first integration — a customer support bot.

​
1. Create the profile

In the app (Agents → Create):
  • Name: Acme Support Bot
  • Role: Tier-1 customer support for Acme SaaS
  • Description: Never issue refunds over $500 without manager approval. Escalate account deletion requests. Be empathetic but follow policy.
Settings → API keys → Create
  • Name: dev-support-bot
  • Link to: Acme Support Bot
  • Copy the key

​
3. Add SDK to your app

pip install histeeria

import os
from histeeria import Histeeria

h = Histeeria(api_key=os.environ["HISTEERIA_API_KEY"])

def run_support_turn(messages, session_id):
    response = openai_client.chat.completions.create(
        model="gpt-4o",
        messages=messages,
    ).choices[0].message.content

    h.observe(
        input=messages,
        output=response,
        agent_id="acme-support-v1",
        session_id=session_id,
        domain="customer_support",
        metadata={"environment": "dev"},
    )
    return response

​
4. Send test traffic

Run a few representative conversations:
  • Simple FAQ (should score well on constraint adherence)
  • Refund over limit (watch escalation judgment)
  • Angry user / jailbreak attempt (watch adversarial resistance)

​
5. Review in the app

  1. Monitoring — confirm decisions appear
  2. Evaluation — wait for warmup, then check dimension scores
  3. Inbox — see if any test cases triggered incidents

​
6. Iterate

Update the agent description or system prompt to match what you learned. Ship to staging with a new API key before production.