Program-of-Thought: A 15% Leap Over Chain-of-Thought

Large Language Models (LLMs) have overhauled how we interact with and leverage artificial intelligence, tackling complex tasks from creative writing to intricate problem-solving. A cornerstone of their enhanced reasoning abilities has been prompt engineering, specifically techniques like Chain-of-Thought (CoT) prompting. CoT fundamentally changed how LLMs approach multi-step problems by encouraging them to articulate intermediate reasoning steps, much like a human solving a math problem. However, the pursuit of even more robust and reliable AI reasoning continues. In 2022, a significant advancement emerged: Program-of-Thought (PoT) prompting, which demonstrated a remarkable 15% performance improvement over its CoT predecessor.