“Nosek, Spies, & Motyl (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.” - Article summary

There is a publication bias in research. Mostly positive results – that is significant – are being published and non-significant results are often not published. This leads to researchers only trying to find significant results instead of genuine effects or non-effects. Researchers are more likely to find significant results because of flexible analysis options (1), the confirmation bias (2) and the drive to find significant results (3). It is possible to find significant results everywhere if you search hard enough. Direct replications do not occur often in research and are almost never published. There are several practices that can increase publishability but can decrease the validity of the results:Leveraging chance by running many low-powered studies instead of a few high-powered ones.Uncritically dismissing “failed” studies as pilot studies but uncritically accepting “successful” studies.Selectively reporting studies with positive results and not studies with negative results (cherry picking).Stopping data collection as soon as a reliable effect is obtained.Continuing data collection until a reliable effect is obtained.Including multiple independent and/or dependent variable and reporting the subset that “worked”.Maintaining flexibility in design and analytical models (attempt to exclude data)Reporting a discovery as if it had been the result of a confirmatory testNot doing a direct replication once a reliable effect is obtainedConceptual replication involves deliberately changing the operationalization of the key elements of the design such as the independent variable, dependent variable or both. Demonstrating the same effects with multiple operationalizations provides confidence in its conceptual interpretation. Conceptual replication is not an effective replacement for direct replication.The peer review process offers a way to detect false results. Not publishing articles without replications would also be effective in...


Access options

The full content is only visible for JoHo WorldSupporter members.

  • For information about international JoHo WorldSupporter memberships, read more here.
  • Are you already a member?
    • During the account creation you can select 'I am a JoHo WorldSupporter Member'.
    • Became a member after you've created the account, then you can change the settings of your account on your WorldSupporter user page
  • or fill out the contact form

 

For Dutch visitors

Toegang tot pagina of document:

Word JoHo donateur voor online toegang

Je bent al donateur, maar je hebt geen toegang?

  • Log in, of maak een account aan als je dat nog niet eerder hebt gedaan op worldsupporter.org.
  • Bij het aanmaken van je account kan je direct aangeven dat je JoHo WorldSupporter donateur bent, of je past dit later aan op de user page van je account
  • Kom je er niet uit, neem dan even contact op! Of check de veel gestelde vragen

Kom je er niet helemaal uit of heb je problemen met inloggen?

  • Lees de antwoorden op de meest gestelde vragen.
  • Of laat je helpen door één van de JoHo medewerkers door het online contactformulier in te vullen

-----------------------------------------------


JoHo WorldSupporter donateur worden

JoHo membership zonder extra services (donateurschap) = €5 per kalenderjaar

  • Voor steun aan de JoHo WorldSupporter en Smokey projecten en een bijdrage aan alle activiteiten op het gebied van internationale samenwerking en talentontwikkeling
  • Voor gebruik van de basisfuncties van JoHo WorldSupporter.org
  • Voor het gebruik van de kortingen en voordelen bij partners
  • Voor gebruik van de voordelen bij verzekeringen en reisverzekeringen zonder assurantiebelasting

JoHo membership met extra services (abonnee services) = €10 per kalenderjaar

€10 per kalenderjaar : Online toegang Only

  • Voor online toegang en gebruik van alle online boeksamenvattingen en studietools op WorldSupporter.org en JoHo.org
  • voor online toegang tot de tools en services voor werk in het buitenland, lange reizen, vrijwilligerswerk, stages en studie in het buitenland
  • voor online toegang tot de tools en services voor emigratie of lang verblijf in het buitenland
  • voor online toegang tot de tools en services voor competentieverbetering en kwaliteitenonderzoek
  • Voor extra steun aan JoHo, WorldSupporter en Smokey projecten

Steun JoHo en steun jezelf door JoHo WorldSupporter donateur te worden

Direct Donateur Worden

Connect & Continue
WorldSupporter Resources

Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)

Image

This bundle contains all the summaries for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains the following articles:

  • “Borsboom & Cramer (2013). Network analysis: An integrative
...

Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)

Image

This bundle contains everything you need to know for the fifth interim exam for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains both articles, book chapters and lectures. It consists of the following materials:

...
Contributions, Comments & Kudos

Add new contribution

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.
Summaries & Study Note of JesperN
Join World Supporter
Join World Supporter
Log in or create your free account

Why create an account?

  • Your WorldSupporter account gives you access to all functionalities of the platform
  • Once you are logged in, you can:
    • Save pages to your favorites
    • Give feedback or share contributions
    • participate in discussions
    • share your own contributions through the 11 WorldSupporter tools
Content
Access level of this page
  • Public
  • WorldSupporters only
  • JoHo members
  • Private
Image
Image
Statistics
13
Promotions
vacatures

JoHo kan jouw hulp goed gebruiken! Check hier de diverse bijbanen die aansluiten bij je studie, je competenties verbeteren, je cv versterken en je een bijdrage laten leveren aan een mooiere wereld