Show HN: Simulate AI Chatbot Conversations

Open source AI agent testing and conversation simulation platform

OneRun helps you test, evaluate, and improve your AI agents through realistic conversation simulation at scale.

• Simulate realistic user conversations with your AI agents across diverse personas and scenarios
• Generate evaluation datasets with judge-labeled conversations for testing and benchmarking
• Create training data for fine-tuning with preference pairs, critique-and-revise triples, and clean JSONL exports
• Automate QA testing by running hundreds of conversations per build to catch issues before production
• Surface edge cases that manual testing misses through adversarial and varied interaction patterns

• Docker and Docker Compose
• Node.js 22+ (for local development)
• Python 3.12+ (for local development)

Copy the environment variables:

Edit .env with your configuration values.

First, start the Temporal server (required for workflow processing):

Verify Temporal is running:

• Temporal UI: http://localhost:8080
• Temporal should show as "healthy" in docker compose ps

From the main docker directory:

This will start:

• Database (PostgreSQL on port 5432)
• API (FastAPI on port 3001)
• App (Next.js on port 3000)

• Frontend: http://localhost:3000
• API: http://localhost:3001
• API Docs: http://localhost:3001/docs
• Temporal UI: http://localhost:8080