Have you ever had your TikTok feed flooded with those 'science explained in 60 seconds' videos (POV: You watch one science TikTok and suddenly think you're ready for a PhD). It might be that these bite-sized science videos are making you more confident about your scientific knowledge than you should be - and recently released research demonstrates this.

The study involved 179 university students who did not study psychology, who were randomly allocated into two groups. One group watched plain language animated videos about psychology studies using everyday terms, while the other watched videos with academic terminology. Half of each group also watched an educational video about the ‘easiness effect’ beforehand - a common cognitive bias where people are more likely to trust information that's easier to understand and overestimate their own understanding of it. The researchers included this pre-education video to test whether making people aware of this bias would help them avoid falling into the overconfidence trap when watching the simplified science videos.

After watching four videos, participants rated how credible they found the research, how confident they felt judging its accuracy, and how likely they were to share or comment on the content. This rating was a self-report measure on a scale of 1-7, for example: “I find this summary trustworthy” 1 (I do not agree at all) to 7 (I totally agree).

The results showed that plain language videos did help people to understand the scientific content better. However, these viewers also became overconfident in their ability to evaluate the research quality themselves - even when they had been warned about this bias beforehand. This suggests that simply knowing about the easiness effect wasn't enough to prevent it from happening. Interestingly, this overconfidence didn't translate into sharing the content more often. The findings suggest that while simplified science videos are great for making research accessible, they might inadvertently create false confidence in people's scientific evaluation skills, potentially contributing to misinformation spread.

References:

Salzmann, S., Walther, C., & Kaspar, K. (2025). A new dimension of simplified science communication: the easiness effect of science popularisation in animated video abstracts. Frontiers in Psychology, 16. https://doi.org/10.3389/fpsyg.... (accessed 15.7.25)

BPS Research Digest: TikTok science is making you overconfident https://www.bps.org.uk/researc... (accessed 15.7.25)

ANSWER THE FOLLOWING QUESTIONS!

1. What experimental design was used in this study? Justify your answer.
2. Why did the researchers specifically recruit participants who did not study psychology?
3. How did the researchers measure the dependent variables in this study?
4. Identify two key limitations of this study's methodology and explain why they matter.
5. What ethical issues could have arisen as part of this study?

Challenge:

Your task:

1. Identify the problem: Choose one major limitation from the original study (e.g., self-reported behaviour, limited sample diversity, or lack of real-world context)
2. Design a solution: Create a new experiment that addresses this limitation. Consider:
   1. What would your participants be like?
   2. How would you measure actual behaviour (not just intentions)?
   3. What new variables might you include?
   4. How would you make it more realistic?
3. Justify your choices: Explain why your design improvements would give us better insights into how people really respond to simplified science content

Example: ‘Instead of just asking people if they'd share content, I would create a fake social media platform where participants can actually share, comment, and interact with science videos, then measure their real behaviour...’

Present your design in 150-200 words, including your research question, method, and why it's an improvement.