As a starting place, here are initial recommendations of questions to be asked when reviewing research in which an LLM was used as part of their scientific research workflow.

  • Was the study pre-registered?
  • Was LLM used to complement other research methods, or as the sole method?
  • Were the research questions and data appropriate for LLM methods?