Welcome to OpenCompass’ documentation!¶
Getting started with OpenCompass¶
To help you quickly familiarized with OpenCompass, we recommend you to walk through the following documents in order:
First read the GetStarted section set up the environment, and run a mini experiment.
Then learn its basic usage through the UserGuides.
If you want to tune the prompts, refer to the Prompt.
If you want to customize some modules, like adding a new dataset or model, we have provided the AdvancedGuides.
There are more handy tools, such as prompt viewer and lark bot reporter, all presented in Tools.
We always welcome PRs and Issues for the betterment of OpenCompass.
Get Started
User Guides
Advanced Guides
- Add a dataset
- Custom Dataset Tutorial
- Add a Model
- Evaluation with LMDeploy
- Evaluation with Lightllm
- Code Evaluation Tutorial
- Code Evaluation Docker Tutorial
- Prompt Attack
- Long Context Evaluation Guidance
- Subjective Evaluation Guidance
- CircularEval
- Data Contamination Assessment
- Needle In A Haystack Experimental Evaluation
Tools