Type: url
Original: https://arxiv.org/pdf/2304.05128
Status: generated
Summary
The full text of the paper proposing Self-Debugging, a few-shot prompting method that teaches a large language model to debug its own predicted code by executing it and explaining the code in natural language, in the manner of rubber duck debugging, without additional training. Evaluated on Spider (text-to-SQL), TransCoder (C++-to-Python translation) and MBPP (text-to-Python), it reports gains of 2-3% on Spider (9% on the hardest problems) and up to 12% where unit tests are available, and improved sample efficiency over reranking baselines.