Impact Evaluation in Firms and Organizations

With Applications in R and Python

Look inside
A comprehensive, nontechnical guide to the methods of data-based impact evaluation in companies and organizations, with coverage of machine learning techniques.

In today's dynamic business climate, organizations face the constant challenge of making informed decisions about their interventions, from marketing campaigns and pricing strategies to employee training programs. In this practical textbook, Martin Huber provides a concise but comprehensive guide to quantitatively assessing the impact of such efforts, enabling decision-makers to make evidence-based choices.

The book introduces fundamental concepts, emphasizing the importance of causal analysis in understanding the true effects of interventions, before detailing a wide range of quantitative methods, including experimental and nonexperimental approaches. Huber then explores the integration of machine learning techniques for impact evaluation in the context of big data, sharing cutting-edge tools for data analysis. Centering real-world, global applications, this accessible text is an invaluable resource for anyone seeking to enhance their decision-making processes through data-driven insights.

  • Highlights the relevance of AI and equips readers to leverage advanced analytical techniques in the era of digital transformation
  • Is ideal for introductory courses on impact evaluation or causal analysis
  • Covers A/B testing, selection-on-observables, instrumental variables, regression discontinuity designs, and difference-in-differences
  • Features extensive examples and demonstrations in R and Python
  • Suits a wide audience, including business professionals and students with limited statistical expertise
1 Introduction
2 Basics of impact evaluation
2.1 The fundamental problem of impact evaluation
2.2 Analyzing the impact: characterization and assessment
2.3 The problem of comparing apples to oranges
3 Experiments (A/B testing)
3.1 Comparing apples to apples
3.2 Behavioral assumptions and methods for analyzing experiments
3.3 Multiple interventions
3.4 Use cases in R
3.5 Use cases in Python
4 Selection on observables: aim to compare apples with apples
4.1 Making groups comparable in observed characteristics
4.2 Behavioral assumptions
4.3 Methods for impact evaluation
4.4 Use cases in R
4.5 Use cases in Python
5 Causal machine learning
5.1 Motivating causal machine learning
5.2 Elements of causal machine learning
5.3 A brief introduction to several machine learning algorithms
5.4 Effect heterogeneity and optimal policy learning
5.5 Use cases in R
5.6 Use cases in Python
6 Instrumental variables
6.1 Instruments and complier effects
6.2 Behavioral assumptions
6.3 Use cases in R
7 Use cases in Python
8 Regression discontinuity designs
8.1 Sharp and fuzzy regression discontinuity designs
8.2 Behavioral assumptions and methods
8.3 Use cases in R
8.4 Use cases in Python
9 Difference-in-Differences
9.1 Difference-in-Differences and the impact in the treatment group
9.2 Behavioral assumptions and extensions
9.3 Use cases in R
9.4 Use cases in Python
10 Synthetic controls
10.1 Impact evaluation when a single unit receives the intervention
10.2 Behavioral assumptions and variants
10.3 Use cases in R
11 Use cases in Python
12 Conclusion
Martin Huber is Professor of Applied Econometrics at the University of Fribourg, Switzerland, where his research comprises both methodological and applied contributions in the fields of causal analysis and impact evaluation, machine learning, statistics, econometrics, empirical economics, and business analytics. He is the author of Causal Analysis: Impact Evaluation and Causal Machine Learning with Applications in R (MIT Press).

About

A comprehensive, nontechnical guide to the methods of data-based impact evaluation in companies and organizations, with coverage of machine learning techniques.

In today's dynamic business climate, organizations face the constant challenge of making informed decisions about their interventions, from marketing campaigns and pricing strategies to employee training programs. In this practical textbook, Martin Huber provides a concise but comprehensive guide to quantitatively assessing the impact of such efforts, enabling decision-makers to make evidence-based choices.

The book introduces fundamental concepts, emphasizing the importance of causal analysis in understanding the true effects of interventions, before detailing a wide range of quantitative methods, including experimental and nonexperimental approaches. Huber then explores the integration of machine learning techniques for impact evaluation in the context of big data, sharing cutting-edge tools for data analysis. Centering real-world, global applications, this accessible text is an invaluable resource for anyone seeking to enhance their decision-making processes through data-driven insights.

  • Highlights the relevance of AI and equips readers to leverage advanced analytical techniques in the era of digital transformation
  • Is ideal for introductory courses on impact evaluation or causal analysis
  • Covers A/B testing, selection-on-observables, instrumental variables, regression discontinuity designs, and difference-in-differences
  • Features extensive examples and demonstrations in R and Python
  • Suits a wide audience, including business professionals and students with limited statistical expertise

Table of Contents

1 Introduction
2 Basics of impact evaluation
2.1 The fundamental problem of impact evaluation
2.2 Analyzing the impact: characterization and assessment
2.3 The problem of comparing apples to oranges
3 Experiments (A/B testing)
3.1 Comparing apples to apples
3.2 Behavioral assumptions and methods for analyzing experiments
3.3 Multiple interventions
3.4 Use cases in R
3.5 Use cases in Python
4 Selection on observables: aim to compare apples with apples
4.1 Making groups comparable in observed characteristics
4.2 Behavioral assumptions
4.3 Methods for impact evaluation
4.4 Use cases in R
4.5 Use cases in Python
5 Causal machine learning
5.1 Motivating causal machine learning
5.2 Elements of causal machine learning
5.3 A brief introduction to several machine learning algorithms
5.4 Effect heterogeneity and optimal policy learning
5.5 Use cases in R
5.6 Use cases in Python
6 Instrumental variables
6.1 Instruments and complier effects
6.2 Behavioral assumptions
6.3 Use cases in R
7 Use cases in Python
8 Regression discontinuity designs
8.1 Sharp and fuzzy regression discontinuity designs
8.2 Behavioral assumptions and methods
8.3 Use cases in R
8.4 Use cases in Python
9 Difference-in-Differences
9.1 Difference-in-Differences and the impact in the treatment group
9.2 Behavioral assumptions and extensions
9.3 Use cases in R
9.4 Use cases in Python
10 Synthetic controls
10.1 Impact evaluation when a single unit receives the intervention
10.2 Behavioral assumptions and variants
10.3 Use cases in R
11 Use cases in Python
12 Conclusion

Author

Martin Huber is Professor of Applied Econometrics at the University of Fribourg, Switzerland, where his research comprises both methodological and applied contributions in the fields of causal analysis and impact evaluation, machine learning, statistics, econometrics, empirical economics, and business analytics. He is the author of Causal Analysis: Impact Evaluation and Causal Machine Learning with Applications in R (MIT Press).

Books for National Depression Education and Awareness Month

For National Depression Education and Awareness Month in October, we are sharing a collection of titles that educates and informs on depression, including personal stories from those who have experienced depression and topics that range from causes and symptoms of depression to how to develop coping mechanisms to battle depression.

Read more

Horror Titles for the Halloween Season

In celebration of the Halloween season, we are sharing horror books that are aligned with the themes of the holiday: the sometimes unknown and scary creatures and witches. From classic ghost stories and popular novels that are celebrated today, in literature courses and beyond, to contemporary stories about the monsters that hide in the dark, our list

Read more

Books for LGBTQIA+ History Month

For LGBTQIA+ History Month in October, we’re celebrating the shared history of individuals within the community and the importance of the activists who have fought for their rights and the rights of others. We acknowledge the varying and diverse experiences within the LGBTQIA+ community that have shaped history and have led the way for those

Read more