Arena Reference

Complete technical specifications and reference materials for PromptArena.

---

Quick Links

CLI Commands

Complete command-line interface reference with all flags and options.

Configuration Schema

YAML configuration file structure and all available options.

Assertions

All available assertion types for validating LLM responses.

Validators

Built-in validators for checking response quality and compliance.

Scenario Format

Test scenario file structure and specification.

Output Formats

Report generation formats (HTML, JSON, JUnit, Markdown).

Duplex Configuration

Complete duplex streaming configuration for voice testing scenarios.

---

Reference vs. How-To

This is reference documentation - dry, factual, technical specifications.

Looking for task-oriented guides? See:

• Arena How-To Guides - Accomplish specific tasks
• Arena Tutorials - Learn by building

---

Quick Reference Tables

Command Summary

Command	Purpose
promptarena run	Execute test scenarios
promptarena config-inspect	Validate configuration
promptarena debug	Debug configuration loading
promptarena prompt-debug	Test prompt rendering
promptarena render	Generate reports from results

Common Assertions

Assertion	Purpose
content_includes	Response contains specific text
content_matches	Response matches regex pattern
tools_called	Specific tools were invoked
is_valid_json	Response is valid JSON
json_schema	Response matches JSON schema
llm_judge	LLM evaluates response quality

Output Formats

Format	Use Case
JSON	Machine processing, APIs
HTML	Human-readable reports
JUnit	CI/CD integration
Markdown	Documentation, sharing

---

API Stability

Arena reference documentation follows semantic versioning:

• Stable: CLI commands, configuration schema
• Beta: Advanced assertions, custom validators
• Experimental: New features marked explicitly

---

Getting Help

• How-To Guides: Task-oriented documentation
• Tutorials: Learning-oriented guides
• Explanations: Conceptual documentation
• Issues: GitHub Issues