Recommendation Engines

Look inside
Paperback
$15.95 US
On sale Sep 01, 2020 | 296 Pages | 978-0-262-53907-4
How companies like Amazon and Netflix know what “you might also like”: the history, technology, business, and social impact of online recommendation engines.

Increasingly, our technologies are giving us better, faster, smarter, and more personal advice than our own families and best friends. Amazon already knows what kind of books and household goods you like and is more than eager to recommend more; YouTube and TikTok always have another video lined up to show you; Netflix has crunched the numbers of your viewing habits to suggest whole genres that you would enjoy. In this volume in the MIT Press's Essential Knowledge series, innovation expert Michael Schrage explains the origins, technologies, business applications, and increasing societal impact of recommendation engines, the systems that allow companies worldwide to know what products, services, and experiences “you might also like.”

Schrage offers a history of recommendation that reaches back to antiquity's oracles and astrologers; recounts the academic origins and commercial evolution of recommendation engines; explains how these systems work, discussing key mathematical insights, including the impact of machine learning and deep learning algorithms; and highlights user experience design challenges. He offers brief but incisive case studies of the digital music service Spotify; ByteDance, the owner of TikTok; and the online personal stylist Stitch Fix. Finally, Schrage considers the future of technological recommenders: Will they leave us disappointed and dependent—or will they help us discover the world and ourselves in novel and serendipitous ways?

Series Foreword vii
Introduction ix
1 What Recommenders Are/Why Recommenders Matter 1
2 On the Origins of Recommendation 35
3 A Brief History of Recommendation Engines 63
4 How Recommenders Work 109
5 Experiencing Recommendations 149
6 Recommendation Innovators 177
7 The Recommender Future 211
Acknowledgments 241
Glossary 245
Notes 251
Further Reading 261
Index 263
Recommendation engines transform human choice. Much as the steam engine energetically launched an industrial revolution, recommendation engines redefine insight and influence in an algorithmic age. Wherever choice matters, recommenders flourish. Better recommenders invariably mean better choices. Steam powers machines; recommenders empower people. They are the prime movers of their respective eras. They change how work gets done.
That’s why Amazon, Alibaba, Google, Netflix, and TikTok are more than mere engines of commerce; they’re enablers of individual agency. Their platforms provide instant insight and personalized options to every single user they serve. Their algorithms deliver data-driven suggestions explicitly designed to inspire immediate exploration. Their relentless relevance produces confident curiosity. These recommenders literally—numerically, quantitatively—predict what “people like you”—and you in particular—might want or need. That compelling value proposition has infiltrated digital interactions worldwide.
The results speak for themselves: recommender systems influence the video people watch, the books they read, the music they hear, the videogames they play, the investments they make, the friends they meet, the clothes they wear, the food they eat, the restaurants they frequent, the wine they drink, the vacations they take, the news they monitor, the exercises they do, the companions they woo, the products they buy, the cars they drive or hail, the routes they travel, the software they code, the slides they present, the email they send, the classes they take, the art they collect, the babysitters and handymen they hire, the employees they promote, the photos they share, the academic research they review, the gifts they give, the live events they attend, the ads they see, the neighborhoods they live in, the jobs they apply for, the seeds they plant, the pharmaceuticals they take, and—cumulatively—how they actually and practically choose to live their lives.
Wherever mobile devices connect—from Bangalore to Boston to Beijing to Berlin to Bogota—recommenders digitally nudge, advise, and invite more informed decision. Shopping, commerce, and consumption represent only the most obvious examples of their growing influence.
Michael Schrage is a Research Fellow at the MIT Sloan School of Management's Initiative on the Digital Economy. A sought-after expert on innovation, design, and network effects, he is the author of Serious Play: How the World's Best Companies Simulate to Innovate, The Innovator's Hypothesis: How Cheap Experiments Are Worth More than Good Ideas (MIT Press), and other books.

About

How companies like Amazon and Netflix know what “you might also like”: the history, technology, business, and social impact of online recommendation engines.

Increasingly, our technologies are giving us better, faster, smarter, and more personal advice than our own families and best friends. Amazon already knows what kind of books and household goods you like and is more than eager to recommend more; YouTube and TikTok always have another video lined up to show you; Netflix has crunched the numbers of your viewing habits to suggest whole genres that you would enjoy. In this volume in the MIT Press's Essential Knowledge series, innovation expert Michael Schrage explains the origins, technologies, business applications, and increasing societal impact of recommendation engines, the systems that allow companies worldwide to know what products, services, and experiences “you might also like.”

Schrage offers a history of recommendation that reaches back to antiquity's oracles and astrologers; recounts the academic origins and commercial evolution of recommendation engines; explains how these systems work, discussing key mathematical insights, including the impact of machine learning and deep learning algorithms; and highlights user experience design challenges. He offers brief but incisive case studies of the digital music service Spotify; ByteDance, the owner of TikTok; and the online personal stylist Stitch Fix. Finally, Schrage considers the future of technological recommenders: Will they leave us disappointed and dependent—or will they help us discover the world and ourselves in novel and serendipitous ways?

Table of Contents

Series Foreword vii
Introduction ix
1 What Recommenders Are/Why Recommenders Matter 1
2 On the Origins of Recommendation 35
3 A Brief History of Recommendation Engines 63
4 How Recommenders Work 109
5 Experiencing Recommendations 149
6 Recommendation Innovators 177
7 The Recommender Future 211
Acknowledgments 241
Glossary 245
Notes 251
Further Reading 261
Index 263

Excerpt

Recommendation engines transform human choice. Much as the steam engine energetically launched an industrial revolution, recommendation engines redefine insight and influence in an algorithmic age. Wherever choice matters, recommenders flourish. Better recommenders invariably mean better choices. Steam powers machines; recommenders empower people. They are the prime movers of their respective eras. They change how work gets done.
That’s why Amazon, Alibaba, Google, Netflix, and TikTok are more than mere engines of commerce; they’re enablers of individual agency. Their platforms provide instant insight and personalized options to every single user they serve. Their algorithms deliver data-driven suggestions explicitly designed to inspire immediate exploration. Their relentless relevance produces confident curiosity. These recommenders literally—numerically, quantitatively—predict what “people like you”—and you in particular—might want or need. That compelling value proposition has infiltrated digital interactions worldwide.
The results speak for themselves: recommender systems influence the video people watch, the books they read, the music they hear, the videogames they play, the investments they make, the friends they meet, the clothes they wear, the food they eat, the restaurants they frequent, the wine they drink, the vacations they take, the news they monitor, the exercises they do, the companions they woo, the products they buy, the cars they drive or hail, the routes they travel, the software they code, the slides they present, the email they send, the classes they take, the art they collect, the babysitters and handymen they hire, the employees they promote, the photos they share, the academic research they review, the gifts they give, the live events they attend, the ads they see, the neighborhoods they live in, the jobs they apply for, the seeds they plant, the pharmaceuticals they take, and—cumulatively—how they actually and practically choose to live their lives.
Wherever mobile devices connect—from Bangalore to Boston to Beijing to Berlin to Bogota—recommenders digitally nudge, advise, and invite more informed decision. Shopping, commerce, and consumption represent only the most obvious examples of their growing influence.

Author

Michael Schrage is a Research Fellow at the MIT Sloan School of Management's Initiative on the Digital Economy. A sought-after expert on innovation, design, and network effects, he is the author of Serious Play: How the World's Best Companies Simulate to Innovate, The Innovator's Hypothesis: How Cheap Experiments Are Worth More than Good Ideas (MIT Press), and other books.