Experimentology

An Open Science Approach to Experimental Psychology Methods

Look inside
An engaging research methods text integrating a classic approach to conducting experiments in psychology with open science practices and values.

How does a researcher run a high-quality psychology experiment? What time-tested methods should be used, and how can more robust and accurate results be achieved? A dynamic collaboration between groundbreaking cognitive scientist Michael Frank and a diverse cohort of researchers innovating in the field—Mika Braginsky, Julie Cachia, Nicholas Coles, Tom Hardwicke, Robert Hawkins, Maya Mathur, and Rondeline Williams—Experimentology introduces the art of the modern psychological experiment with an emphasis on open science values of accessibility and transparency.

Experimentology follows the timeline of an experiment, with sections covering basic foundations, planning, execution, data-gathering and analysis, and reporting. Narrative examples from a range of subdisciplines, including cognitive, developmental, and social psychology, model each component and account for the pitfalls that can undermine the reliability, validity, and replicability of results. Through an embrace of open science strategies such as data sharing and preregistration, Experimentology shows how the challenges of the replication crisis can be met constructively and collaboratively. Written for a global audience, Experimentology updates a classic research methods textbook with a new focus on ethics and the benefits of open science.
CONTENTS
PREFACE
I FOUNDATIONS
1 EXPERIMENTS
2 THEORIES
3 REPLICATION
4 ETHICS
II STATISTICS
5 ESTIMATION
6 INFERENCE
7 MODELS
III PLANNING
8 MEASUREMENT
9 DESIGN
10 SAMPLING
IV EXECUTION
11 PREREGISTRATION
12 DATA COLLECTION
13 PROJECT MANAGEMENT
V REPORTING
14 WRITING
15 VISUALIZATION
16 META-ANALYSIS
17 CONCLUSION
CONTENTS
APPENDICES
A INSTRUCTOR’S GUIDE
B GITHUB (ONLINE ONLY)
C R MARKDOWN (ONLINE ONLY)
D TIDYVERSE (ONLINE ONLY)
E GGPLOT (ONLINE ONLY)
Michael C. Frank is the Benjamin Scott Crocker Professor of Human Biology at Stanford University.

Mika Braginsky is a software developer at the Language and Cognition Lab at Stanford University.

Julie Cachia is the cofounder of Flourish Science.

Nicholas A. Coles is Assistant Professor of Psychology at the University of Florida.

Tom E. Hardwicke is a Research Fellow at the School of Psychological Sciences at the University of Melbourne.

Robert D. Hawkins is Assistant Professor of Linguistics at Stanford University.

Maya B. Mathur is Assistant Professor at the Quantitative Sciences Unit at Stanford University.

Rondeline Williams is a PhD candidate in Psychology at Stanford University.

About

An engaging research methods text integrating a classic approach to conducting experiments in psychology with open science practices and values.

How does a researcher run a high-quality psychology experiment? What time-tested methods should be used, and how can more robust and accurate results be achieved? A dynamic collaboration between groundbreaking cognitive scientist Michael Frank and a diverse cohort of researchers innovating in the field—Mika Braginsky, Julie Cachia, Nicholas Coles, Tom Hardwicke, Robert Hawkins, Maya Mathur, and Rondeline Williams—Experimentology introduces the art of the modern psychological experiment with an emphasis on open science values of accessibility and transparency.

Experimentology follows the timeline of an experiment, with sections covering basic foundations, planning, execution, data-gathering and analysis, and reporting. Narrative examples from a range of subdisciplines, including cognitive, developmental, and social psychology, model each component and account for the pitfalls that can undermine the reliability, validity, and replicability of results. Through an embrace of open science strategies such as data sharing and preregistration, Experimentology shows how the challenges of the replication crisis can be met constructively and collaboratively. Written for a global audience, Experimentology updates a classic research methods textbook with a new focus on ethics and the benefits of open science.

Table of Contents

CONTENTS
PREFACE
I FOUNDATIONS
1 EXPERIMENTS
2 THEORIES
3 REPLICATION
4 ETHICS
II STATISTICS
5 ESTIMATION
6 INFERENCE
7 MODELS
III PLANNING
8 MEASUREMENT
9 DESIGN
10 SAMPLING
IV EXECUTION
11 PREREGISTRATION
12 DATA COLLECTION
13 PROJECT MANAGEMENT
V REPORTING
14 WRITING
15 VISUALIZATION
16 META-ANALYSIS
17 CONCLUSION
CONTENTS
APPENDICES
A INSTRUCTOR’S GUIDE
B GITHUB (ONLINE ONLY)
C R MARKDOWN (ONLINE ONLY)
D TIDYVERSE (ONLINE ONLY)
E GGPLOT (ONLINE ONLY)

Author

Michael C. Frank is the Benjamin Scott Crocker Professor of Human Biology at Stanford University.

Mika Braginsky is a software developer at the Language and Cognition Lab at Stanford University.

Julie Cachia is the cofounder of Flourish Science.

Nicholas A. Coles is Assistant Professor of Psychology at the University of Florida.

Tom E. Hardwicke is a Research Fellow at the School of Psychological Sciences at the University of Melbourne.

Robert D. Hawkins is Assistant Professor of Linguistics at Stanford University.

Maya B. Mathur is Assistant Professor at the Quantitative Sciences Unit at Stanford University.

Rondeline Williams is a PhD candidate in Psychology at Stanford University.

Books for National Depression Education and Awareness Month

For National Depression Education and Awareness Month in October, we are sharing a collection of titles that educates and informs on depression, including personal stories from those who have experienced depression and topics that range from causes and symptoms of depression to how to develop coping mechanisms to battle depression.

Read more

Horror Titles for the Halloween Season

In celebration of the Halloween season, we are sharing horror books that are aligned with the themes of the holiday: the sometimes unknown and scary creatures and witches. From classic ghost stories and popular novels that are celebrated today, in literature courses and beyond, to contemporary stories about the monsters that hide in the dark, our list

Read more

Books for LGBTQIA+ History Month

For LGBTQIA+ History Month in October, we’re celebrating the shared history of individuals within the community and the importance of the activists who have fought for their rights and the rights of others. We acknowledge the varying and diverse experiences within the LGBTQIA+ community that have shaped history and have led the way for those

Read more