Arena How-To Guides
Practical guides for accomplishing specific tasks with PromptArena.
Getting Started
### [Install PromptArena](installation)
Set up PromptArena on your system and verify the installation.
### [Configure Shell Completions](shell-completions)
Enable tab completion for commands, flags, and dynamic values like scenarios and providers.
### [Use Project Templates](use-project-templates)
Quickly scaffold new test projects with the `promptarena init` command. Includes 6 built-in templates for common use cases like customer support, code generation, content creation, multimodal AI, and MCP integration.
### [Write Test Scenarios](write-scenarios)
Create and structure test scenarios for LLM testing with the PromptPack format.
### [Configure LLM Providers](configure-providers)
Set up and manage connections to OpenAI, Anthropic, Google, and other LLM providers.
Testing Strategies
### [Use Mock Providers](use-mock-providers)
Test quickly and cost-free with mock providers instead of real LLM APIs.
### [Validate Outputs](validate-outputs)
Use assertions and custom validators to verify LLM response quality.
### [Generate Mock Responses from Arena Results](generate-mock-responses-from-arena)
Turn recorded Arena runs into mock provider YAML for deterministic, cost-free replays.
Voice Testing
### [Set Up Voice Testing with Self-Play](setup-voice-testing)
Configure automated voice testing using duplex streaming and self-play with TTS.
Session Recording
### [Session Recording](session-recording)
Capture detailed session recordings for debugging, replay, and analysis. Export audio tracks, correlate events with annotations, and use recordings for deterministic test replay.
Context Management
### [Manage Context](manage-context)
Configure context management and truncation strategies for long conversations, including embedding-based relevance truncation.
Automation
### [Integrate with CI/CD](integrate-ci-cd)
Automate LLM testing in GitHub Actions, GitLab CI, Jenkins, and other pipelines.
What’s the Difference?
How-to guides are goal-oriented recipes that show you how to solve specific problems:
- ✅ “How do I install Arena?”
- ✅ “How do I configure multiple providers?”
- ✅ “How do I integrate with GitHub Actions?”
Looking for something else?
- Tutorials - Step-by-step learning paths for beginners
- Explanation - Understand concepts and design decisions
- Reference - Complete technical specifications and API docs
Was this page helpful?