Eval Converters

Supported conversion targets:

  • Inspect AI
  • HELM
  • lm-eval-harness

These are the three main general-purpose converters expected to be supported in the core package.

Example commands:

uv run python -m every_eval_ever convert inspect --log_path <path>
uv run python -m every_eval_ever convert helm --log_path <path>
uv run python -m every_eval_ever convert lm_eval --log_path <path>

Adapter source code lives under every_eval_ever/converters.

One-off adapters also exist under utils for source-specific parsing and business logic.