Tools Overview

The OpenCompass tools/ directory provides scripts for configuration discovery, prompt preview, prediction inspection, API testing, and result analysis. The configuration and directory formats consumed by these tools may change between versions. Run python tools/<script>.py --help before use.

• Discovering and Comparing Configurations

• Inspecting Predictions and Analyzing Errors

• Analyzing Repetition and Response Length

• Testing APIs and Message Formats

• Notifications and Task Monitoring

For the complete prompt preview workflow, see Prompt Preview and Debugging. For handling interrupted tasks, see Task Recovery and Reuse.