Skip to main content

Spring Deadline: Sunday, March 1 @ 11:59pm PT. Click here to apply.

Back to Research
Accepted to ACL SRW 2024

Question-Analysis-Prompting Improves LLM Performance in Reasoning Tasks

Dharunish Yugeswardeenoo

Abstract

Although LLMs have the potential to transform many fields, they still underperform humans in reasoning tasks. Existing methods induce the model to produce step-by-step calculations. We propose Question Analysis Prompting (QAP), a simple zero-shot prompting strategy that induces the model to first explain the question before solving. The value of n influences the length of response generated by the model. This method is adaptable to various problem difficulties and shows promising results in math and commonsense reasoning across different model sizes. QAP is evaluated on GPT 3.5 Turbo and GPT 4 Turbo on arithmetic datasets GSM8K, AQuA, and SAT and commonsense dataset StrategyQA.

Citation

Dharunish Yugeswardeenoo. "Question-Analysis-Prompting Improves LLM Performance in Reasoning Tasks". Accepted to ACL SRW 2024.

Details

Conference
Accepted to ACL SRW 2024
Authors
1 author

Publish Your Research

Join Algoverse and work with world-class mentors to publish at top AI conferences.

Start Your Application