AI-Supported Research Literacy in Introduction to Psychology
Context
Students enrolled in Introduction to Psychology often struggle with locating, evaluating, reading, and synthesizing scholarly research. Many students report feeling overwhelmed by the research process and lack confidence in their ability to engage with scientific literature.
At the same time, students are increasingly using generative AI tools independently, often without guidance regarding effective or ethical use. The goal of this project is to support research literacy while teaching students how to use AI responsibly as a learning tool.
Project Vision
The project will integrate AI literacy competencies into a scaffolded research assignment sequence in Introduction to Psychology. Students will learn not only how to complete research tasks, but also how to:
- Critically evaluate AI-generated content
- Use AI ethically and transparently
- Reflect on their learning process
- Develop metacognitive awareness
- Build confidence in scientific research skills
- Understand limitations and biases in AI systems
The ultimate goal is to move students from using AI to complete tasks to using AI to support learning.
Application
A traditional research assignment was redesigned into a four-phase scaffolded annotated research project. Students complete structured phases including topic development, source identification, annotation, and synthesis.
Generative AI, such as ChatGPT, is integrated as a learning support tool rather than a content-generation tool. Students use AI to:
- Generate and refine research topics
- Develop search terms for locating scholarly sources
- Clarify difficult psychological concepts and research terminology
- Check citations for validity, reliability, and APA formatting
- Engage in guided reflection about their learning process
Students are required to evaluate AI-generated information, verify source accuracy, and document how AI was used throughout the assignment. Reflection prompts encourage students to consider what they learned, where they struggled, and how AI supported or limited their learning.
Outcomes
Preliminary observations suggest several positive outcomes. Students appear less overwhelmed by the research process because tasks were divided into manageable phases. Source quality seems to improve, and students demonstrate stronger annotation and summarization skills. Reflection responses indicate increased confidence, or self-efficacy, in reading and understanding psychological research.
The project also highlights the importance of structured AI use, reflection, and metacognition. Students are more likely to critically evaluate AI outputs when reflection and verification activities are embedded into the assignment.
A key lesson is that AI is most effective when used as a scaffold for thinking and learning rather than as a shortcut for completing academic work.
This assignment demonstrates how AI literacy, metacognitive reflection, and disciplinary learning can be integrated into an existing course assignment to support student success and responsible AI use.
Five Discipline-Specific Use Cases
1. AI-Supported Topic Development
Problem: Students struggle narrowing research topics.
AI application: Students use AI to generate search terms, explain database results, and identify source relevance.
Psychology context: Peer-reviewed literature.
AI literacy competencies: Prompt design, critical evaluation, transparency.
Reflection: Students compare their original topic, AI suggestions, and final topic.
How did AI help refine your thinking without making the decision for you?
2. AI-Assisted Research Literacy
Problem: Students struggle finding scholarly sources.
AI application: Students use AI to brainstorm topics, generate keywords, and narrow broad concepts.
Psychology context: Psychological disorders, cognition, development, personality, and related areas.
AI literacy competencies: Prompt design, critical evaluation, transparency.
Reflection: Students evaluate what AI got right and wrong.
How did you verify the information provided by AI?
3. AI-Supported Annotation
Problem: Students have difficulty reading journal articles.
AI application: Students use AI to explain terminology, summarize sections, and clarify methods, statistics, results, and study limitations.
Psychology context: Research designs used in the study of behavior.
AI literacy competencies: Prompt design, critical evaluation, metacognition.
Reflection: Students compare their understanding of the article to what AI explained.
What concepts did AI help you understand? What concepts did you still need to interpret yourself?
4. AI-Assisted Metacognitive Reflection
Problem: Students rarely think about how they learn.
AI application: Students use AI to serve as a reflective coach.
Example questions: What was difficult? What strategies worked? What questions remain?
AI literacy competencies: Self-regulated learning, metacognition, responsible AI use.
5. AI-Assisted Fact-Checking and Verification
Problem: Students often assume AI is correct.
AI application: Students intentionally fact-check AI outputs by identifying hallucinations, verifying citations, and evaluating evidence quality.
Psychology context: Research methods and critical thinking.
Reflection: What limitations did you observe in AI-generated information?
Research Components and Research Questions
- How does scaffolded AI integration influence students’ research self-efficacy?
- How does structured reflection influence students’ metacognitive awareness when using AI?
- How do students perceive AI as a learning support tool rather than a task-completion tool?
Data Sources
1. Quantitative Data
- Pre- and post-assessments
- Research confidence measures
- AI confidence measures
- Self-efficacy surveys
- Likert-scale items
2. Qualitative Data
- Reflection prompts
- AI use logs
- Open-ended responses
- Student feedback