The Credibility Gap: Evaluating and Improving Empirical Research in the Social Sciences

— —

Anna Dreber Magnus Johannesson

The Credibility Gap

Evaluating and Improving Empirical Research in the Social Sciences

Anna Dreber, Magnus Johannesson

$305

Hardback

Not in-store but you can order this
How long will it take?

Availability Information

We source books from suppliers in Australia and overseas. For books we don't currently have in stock, the time it takes to get them from our suppliers can vary widely - from a few days to a few months - so we check each book with each supplier to determine the expected time it will take to be supplied to us.

We then advise you accordingly. If the time taken to get any book is too long for you, you can let us know and we will cancel or adjust your order, and refund as required.

To find out the anticipated arrival time for specific items prior to ordering, please contact us by phone or email:

Phone +61 2 9264 3111, or 1800 4 BOOKS (1800 4 26657) if outside Sydney:
option 1 Abbey's Bookshop (Crime, History, Science, Kids & more) • info@abbeys.com.au
option 2 Language Book Centre (ESL & Foreign Languages) • language@abbeys.com.au
option 3 Galaxy Bookshop (Sci-fi, Fantasy, Romance, Graphic Novels) • sf@galaxybooks.com.au

QTY:

English

Routledge
02 April 2025

Research methods: general; Economic theory & philosophy; Econometrics; Probability & statistics; Mathematical modelling

Which scientific results can we trust? This question has been brought to the forefront of research in the social sciences in recent years with the movement towards open science practices and preregistration. Systematic replication studies of laboratory experiments in the social sciences have found that only about half of the “statistically significant” results published in top journals can be replicated in the sense that similar results are achieved with new data. This low replicability may be even lower in studies based on observational data as such studies have more degrees of freedom in the analysis of the data leading to larger possibilities to selectively report more publishable findings.

In this book, the authors provide a framework for evaluating reproducibility, replicability and generalizability of empirical research in the social sciences. They define different types of reproducibility and replicability and show how they can be measured to evaluate the credibility of published findings. Different approaches to improving the credibility of published findings, such as preregistration with detailed pre-analysis plans, Registered Report publications, and preregistered prospective meta-analysis are also outlined and discussed. Even if published results are not systematically biased, the variation in results across populations, research designs, and analyses decreases the reliability and generalizability of published findings. The book shows how such heterogeneity in results can be measured and incorporated in the analysis to more accurately represent the uncertainty and thereby generalizability of reported results.

By: Anna Dreber, Magnus Johannesson
Imprint: Routledge
Country of Publication: United Kingdom
Dimensions: Height: 234mm, Width: 156mm,
Weight: 470g
ISBN: 9781032942896
ISBN 10: 1032942894
Pages: 151
Publication Date: 02 April 2025
Audience: College/higher education , Primary
Format: Hardback
Publisher's Status: Active

1. Introduction 2. p-values, power and p-hacking 3. Pre-registration 4. A framework for evaluating reproducibility and replicability 5. Results from large-scale reproducibility studies 6. Results from large-scale replicability studies 7. Predicting replications 8. A framework for evaluating heterogeneity and generalizability 9. Empirical estimates of heterogeneity 10. Meta-analysis and aggregating research findings 11. Debugging observational data studies 12. Conclusion

Anna Dreber is Professor of economics at the Stockholm School of Economics, Sweden. Magnus Johannesson is Professor of economics at the Stockholm School of Economics, Sweden.

Reviews for The Credibility Gap: Evaluating and Improving Empirical Research in the Social Sciences

”The integrity of social science research has been challenged. This book offers a comprehensive, detective-style view of what went wrong. It also outlines ways to fix the problems and restore trust. A must-read for anyone interested in empirical work in social science!” Uri Gneezy, Rady School of Management, UC San Diego “I can think of no one better situated than these authors to lay the groundwork for improving the social sciences. This book is a must-read for anyone curious about the integrity of social science research and eager to explore new frontiers to build the stock of knowledge to change the world.” John List, Department of Economics, University of Chicago