Technique
Self-Consistency
Sampling multiple chain-of-thought traces and voting on the majority answer.
Definition
Self-consistency improves chain-of-thought reasoning by sampling 5–40 reasoning paths at non-zero temperature and majority-voting on the final answer. It dramatically lifts GSM8K, MATH and other reasoning benchmarks at the cost of more compute.
Common use cases
- Math reasoning
- Code synthesis
- Robust QA