PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition
Published in NeurIPS 2024 Datasets and Benchmarks Track, 2024
We present PutnamBench, a new multi-language benchmark for evaluating the ability of neural theorem-provers to solve competition mathematics problems.
Recommended citation: George Tsoukalas, Jasper Lee, John Jennings, Jimmy Xin, Michelle Ding, Michael Jennings, Amitayush Thakur, and Swarat Chaudhuri. Putnambench: Evaluating neural theorem-provers on the putnam mathematical competition. In The Thirty-eighth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2024a. URL https://arxiv.org/abs/2407.11214.
Download Paper