As a starting place, here are initial recommendations of questions to be asked when reviewing research in which an LLM was used as part of their scientific research workflow.
- Was the study pre-registered?
- Was LLM used to complement other research methods, or as the sole method?
- Were the research questions and data appropriate for LLM methods?