Welcome to OpenCompass’ documentation!¶
Getting started with OpenCompass¶
To help you quickly familiarized with OpenCompass, we recommend you to walk through the following documents in order:
First read the GetStarted section set up the environment, and run a mini experiment.
Then learn its basic usage through the UserGuides.
If you want to tune the prompts, refer to the Prompt.
If you want to customize some modules, like adding a new dataset or model, we have provided the AdvancedGuides.
There are more handy tools, such as prompt viewer and lark bot reporter, all presented in Tools.
We always welcome PRs and Issues for the betterment of OpenCompass.
Get Started
User Guides
Advanced Guides
- Add a dataset
- Custom Dataset Tutorial
- Add a Model
- Evaluation with LMDeploy
- Accelerate Evaluation Inference with vLLM or LMDeploy
- General Math Evaluation Guidance
- LLM as Judge Evaluation
- Code Evaluation Tutorial
- Code Evaluation Docker Tutorial
- Subjective Evaluation Guidance
- Evaluation Results Persistence
Tools
Dataset List