Tree of Thoughts

The Game of 24 gives you four numbers, say 4, 5, 6 and 10, and asks you to combine all four with addition, subtraction, multiplication and division to make 24. The 100 puzzles that Shunyu Yao and colleagues used to test Tree of Thoughts in 2023 are not easy for people, but they are not hard either: players on the 4nums.com site solved them 85.9% of the time, in about 11 seconds on average. GPT-4 with chain-of-thought prompting solved 4% of them.