yb init
Create a starter configuration file with helpful comments and sensible defaults.
yb init [--force]CLI Reference
youBencha provides a powerful command-line interface for running and managing AI agent evaluations.
Available Commands
Section titled “Available Commands”| Command | Description |
|---|---|
yb init | Initialize a new evaluation suite |
yb run | Execute an evaluation suite |
yb report | Generate evaluation reports |
yb validate | Validate suite configuration |
yb list | List available evaluators |
yb suggest-suite | AI-powered suite suggestions |
Quick Reference
Section titled “Quick Reference”yb run
Execute an evaluation suite against an AI agent.
yb run -c <config-file>yb report
Generate human-readable reports from evaluation results.
yb report --from <results-file>yb validate
Validate configuration without running.
yb validate -c <config-file>Global Options
Section titled “Global Options”These options are available for all commands:
| Option | Description |
|---|---|
--help, -h | Show help for a command |
--version, -V | Show version number |
Getting Help
Section titled “Getting Help”Get help for any command by adding --help:
yb run --helpyb report --help