ToRA: A Tool-Integrated Reasoning Agent

Project Page • Paper

Repo for "ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving"

Figure 1: Comparing ToRA with baselines on LLaMA-2 base models from 7B to 70B.

Tool-Integrated Reasoning Format

Figure 2: A basic example of single-round tool interaction, which interleaves rationales with program-based tool use.

ToRA Training Pipeline

Figure 3: Training ToRA contains ① Imitation Learning, and ② output space shaping.

Code & Models

🏝️ The code will be cleaned and uploaded within a few days, all ToRA models will be released.

☕️ Citation

If you find this repository helpful, please consider citing our paper:

@misc{gou2023tora,
      title={ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving}, 
      author={Zhibin Gou and Zhihong Shao and Yeyun Gong and yelong shen and Yujiu Yang and Minlie Huang and Nan Duan and Weizhu Chen},
      year={2023},
      eprint={2309.17452},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}