Experimentology

An Open Science Approach to Experimental Psychology Methods

Look inside
An engaging research methods text integrating a classic approach to conducting experiments in psychology with open science practices and values.

How does a researcher run a high-quality psychology experiment? What time-tested methods should be used, and how can more robust and accurate results be achieved? A dynamic collaboration between groundbreaking cognitive scientist Michael Frank and a diverse cohort of researchers innovating in the field—Mika Braginsky, Julie Cachia, Nicholas Coles, Tom Hardwicke, Robert Hawkins, Maya Mathur, and Rondeline Williams—Experimentology introduces the art of the modern psychological experiment with an emphasis on open science values of accessibility and transparency.

Experimentology follows the timeline of an experiment, with sections covering basic foundations, planning, execution, data-gathering and analysis, and reporting. Narrative examples from a range of subdisciplines, including cognitive, developmental, and social psychology, model each component and account for the pitfalls that can undermine the reliability, validity, and replicability of results. Through an embrace of open science strategies such as data sharing and preregistration, Experimentology shows how the challenges of the replication crisis can be met constructively and collaboratively. Written for a global audience, Experimentology updates a classic research methods textbook with a new focus on ethics and the benefits of open science.
CONTENTS
PREFACE
I FOUNDATIONS
1 EXPERIMENTS
2 THEORIES
3 REPLICATION
4 ETHICS
II STATISTICS
5 ESTIMATION
6 INFERENCE
7 MODELS
III PLANNING
8 MEASUREMENT
9 DESIGN
10 SAMPLING
IV EXECUTION
11 PREREGISTRATION
12 DATA COLLECTION
13 PROJECT MANAGEMENT
V REPORTING
14 WRITING
15 VISUALIZATION
16 META-ANALYSIS
17 CONCLUSION
CONTENTS
APPENDICES
A INSTRUCTOR’S GUIDE
B GITHUB (ONLINE ONLY)
C R MARKDOWN (ONLINE ONLY)
D TIDYVERSE (ONLINE ONLY)
E GGPLOT (ONLINE ONLY)
Michael C. Frank is the Benjamin Scott Crocker Professor of Human Biology at Stanford University.

Mika Braginsky is a software developer at the Language and Cognition Lab at Stanford University.

Julie Cachia is the cofounder of Flourish Science.

Nicholas A. Coles is Assistant Professor of Psychology at the University of Florida.

Tom E. Hardwicke is a Research Fellow at the School of Psychological Sciences at the University of Melbourne.

Robert D. Hawkins is Assistant Professor of Linguistics at Stanford University.

Maya B. Mathur is Assistant Professor at the Quantitative Sciences Unit at Stanford University.

Rondeline Williams is a PhD candidate in Psychology at Stanford University.
additional book photo
additional book photo

About

An engaging research methods text integrating a classic approach to conducting experiments in psychology with open science practices and values.

How does a researcher run a high-quality psychology experiment? What time-tested methods should be used, and how can more robust and accurate results be achieved? A dynamic collaboration between groundbreaking cognitive scientist Michael Frank and a diverse cohort of researchers innovating in the field—Mika Braginsky, Julie Cachia, Nicholas Coles, Tom Hardwicke, Robert Hawkins, Maya Mathur, and Rondeline Williams—Experimentology introduces the art of the modern psychological experiment with an emphasis on open science values of accessibility and transparency.

Experimentology follows the timeline of an experiment, with sections covering basic foundations, planning, execution, data-gathering and analysis, and reporting. Narrative examples from a range of subdisciplines, including cognitive, developmental, and social psychology, model each component and account for the pitfalls that can undermine the reliability, validity, and replicability of results. Through an embrace of open science strategies such as data sharing and preregistration, Experimentology shows how the challenges of the replication crisis can be met constructively and collaboratively. Written for a global audience, Experimentology updates a classic research methods textbook with a new focus on ethics and the benefits of open science.

Table of Contents

CONTENTS
PREFACE
I FOUNDATIONS
1 EXPERIMENTS
2 THEORIES
3 REPLICATION
4 ETHICS
II STATISTICS
5 ESTIMATION
6 INFERENCE
7 MODELS
III PLANNING
8 MEASUREMENT
9 DESIGN
10 SAMPLING
IV EXECUTION
11 PREREGISTRATION
12 DATA COLLECTION
13 PROJECT MANAGEMENT
V REPORTING
14 WRITING
15 VISUALIZATION
16 META-ANALYSIS
17 CONCLUSION
CONTENTS
APPENDICES
A INSTRUCTOR’S GUIDE
B GITHUB (ONLINE ONLY)
C R MARKDOWN (ONLINE ONLY)
D TIDYVERSE (ONLINE ONLY)
E GGPLOT (ONLINE ONLY)

Author

Michael C. Frank is the Benjamin Scott Crocker Professor of Human Biology at Stanford University.

Mika Braginsky is a software developer at the Language and Cognition Lab at Stanford University.

Julie Cachia is the cofounder of Flourish Science.

Nicholas A. Coles is Assistant Professor of Psychology at the University of Florida.

Tom E. Hardwicke is a Research Fellow at the School of Psychological Sciences at the University of Melbourne.

Robert D. Hawkins is Assistant Professor of Linguistics at Stanford University.

Maya B. Mathur is Assistant Professor at the Quantitative Sciences Unit at Stanford University.

Rondeline Williams is a PhD candidate in Psychology at Stanford University.

Photos

additional book photo
additional book photo