Detail Page

From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics
written by Amogh Sirnoorkar and N. Sanjay Rebello
The abilities of Generative-Artificial Intelligence (AI) to produce real-time, sophisticated responses across diverse contexts has promised a huge potential in physics education, particularly in providing customized feedback. In this study, we investigate around 1200 introductory students' preferences about AI-feedback generated from three distinct prompt types: (a) self-crafted, (b) entailing foundational prompt-engineering techniques, and (c) entailing foundational prompt-engineering techniques along with principles of effective-feedback. The results highlight an overwhelming fraction of students preferring feedback generated using structured prompts, with those entailing combined features of prompt engineering and effective feedback to be favored most. However, the popular choice also elicited stronger preferences with students either liking or disliking the feedback. Students also ranked the feedback generated using their self-crafted prompts as the least preferred choice. Students' second preferences given their first choice and implications of the results such as the need to incorporate prompt engineering in introductory courses are discussed.
Physics Education Research Conference 2025
Part of the PER Conference series
Washington, DC: August 6-7, 2025
Pages 405-410
Subjects Levels Resource Types
Education Foundations
- Assessment
= Formative Assessment
- Problem Solving
- Student Characteristics
= Affect
Education Practices
- Instructional Material Design
- Technology
= Computers
- Lower Undergraduate
- Reference Material
= Research study
Intended Users Formats Ratings
- Researchers
- application/pdf
  • Currently 0.0/5

Want to rate this material?
Login here!


Mirror:
https://doi.org/10.1119/perc.2025…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2025.pr.Sirnoorkar
Keyword:
PERC 2025
Record Creator:
Metadata instance created October 20, 2025 by Lyle Barbato
Record Updated:
October 27, 2025 by Lyle Barbato
Last Update
when Cataloged:
October 28, 2025
Other Collections:

ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
A. Sirnoorkar and N. Rebello, , presented at the Physics Education Research Conference 2025, Washington, DC, 2025, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102).
AJP/PRST-PER
A. Sirnoorkar and N. Rebello, From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics, presented at the Physics Education Research Conference 2025, Washington, DC, 2025, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102>.
APA Format
Sirnoorkar, A., & Rebello, N. (2025, August 6-7). From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics. Paper presented at Physics Education Research Conference 2025, Washington, DC. Retrieved November 7, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102
Chicago Format
Sirnoorkar, Amogh, and N. Sanjay Rebello. "From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics." Paper presented at the Physics Education Research Conference 2025, Washington, DC, August 6-7, 2025. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102 (accessed 7 November 2025).
MLA Format
Sirnoorkar, Amogh, and N. Sanjay Rebello. "From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics." Physics Education Research Conference 2025. Washington, DC: 2025. 405-410 of PER Conference. 7 Nov. 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102>.
BibTeX Export Format
@inproceedings{ Author = "Amogh Sirnoorkar and N. Sanjay Rebello", Title = {From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics}, BookTitle = {Physics Education Research Conference 2025}, Pages = {405-410}, Address = {Washington, DC}, Series = {PER Conference}, Month = {August 6-7}, Year = {2025} }
Refer Export Format

%A Amogh Sirnoorkar %A N. Sanjay Rebello %T From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics %S PER Conference %D August 6-7 2025 %P 405-410 %C Washington, DC %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102 %O Physics Education Research Conference 2025 %O August 6-7 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Sirnoorkar, Amogh %A Rebello, N. Sanjay %D August 6-7 2025 %T From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics %B Physics Education Research Conference 2025 %C Washington, DC %P 405-410 %S PER Conference %8 August 6-7 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=17174&DocID=6102


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

From Self-Crafted to Engineered Prompts: Student Evaluations of AI-Generated Feedback in Introductory Physics:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials