Document Type
Poster
Publication Date
Spring 2024
Abstract
AI language models like ChatGPT(GPT-4), Claude, Grok, PI, and Gemini Advanced have revolutionized various domains with their remarkable capabilities. However, their performance varies significantly depending on the prompting techniques and the domain of application. This research investigates the performance of these models across zero-shot, few-shot, and chain-of-thought prompting techniques in three domains: HELLASWAG (common-sense reasoning), TRUTHFULQA (popular misconceptions), and Game Theory (textbook problems). By evaluating the models using a qualitative scoring rubric and exploring a novel domain, we aim to identify the most effective prompting strategies, gain insights into their strengths and limitations, and inform future research and development efforts in this field. The insights gained will contribute to the academic discourse on AI language models and guide practitioners on effectively leveraging these tools in their respective domains.
Recommended Citation
Yeasir Fahim, Junaid, "Mastering the Art of AI Language: An In-Depth Exploration of Prompting Techniques and Their Influence on Model Performance" (2024). IPHS 484: Senior Seminar. Paper 35.
https://digital.kenyon.edu/dh_iphs_ss/35
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.