*These notes do not include the introduction to R*
HARKing: changing or creating the hypothesis after seeing the results.
P-hacking: researchers collect or select data or statistical analyses until nonsignificant results become significant.
Selective reporting: only reporting significant results, and not reporting the non-significant results.
Publication bias: only articles with significant effects are published.
So the problem is: the literature is not representative for the population.
What can we do to avoid these biases/to make ‘great results’ less important? --> Registered reports: when you use pre-registration it is on forehand clear what you’re going to do and what you’re interested in, in a manner that is verifiable by others. Four central aspects of the Registered Reports Model are:
- Researchers decide hypotheses, study procedures and main analyses before data collection
- Part of the peer review process takes place before studies are conducted
- Passing this stage of review virtually guarantees publication
- Original studies and high-value replications are welcome
Methods of pre-registration include:
- Sample (size)
- Design, variables
- Measures
- Exclusion criteria
- Analysis plan
How does it work? Authors submit the STAGE 1 manuscript, stage 1 peer review takes place and if the reviews are positive, the journal offers in-principle acceptance (IPA) regardless of the study outcome.
The advantages of Registered Reports:
--> For the scientific community:
- Rigorous review of theory and methods
- Eliminates publication bias and reporting bias
- Increases the reproducibility of science
--> For scientists
- Keeping track of what you did and why
- Peer review when it is most helpful
- Publication guaranteed regardless of the results
Common misconceptions:
1. ‘Pre-registration prevents the exploration of your data/creativity’. This is not the case. It allows for exploratory science, it simply prevents reporting exploratory analyses as confirmatory.
2. ‘Pre-registration does not allow for making changes and I cannot predict what will happen’. This is not correct. It allows for these things, as long as you report your deviation from your pre-registered plan.
Questions? Let me know in the contribution section!
Follow me for more summaries on statistics!
JoHo can really use your help! Check out the various student jobs here that match your studies, improve your competencies, strengthen your CV and contribute to a more tolerant world
Online access to all summaries, study notes en practice exams
- Check out: Register with JoHo WorldSupporter: starting page (EN)
- Check out: Aanmelden bij JoHo WorldSupporter - startpagina (NL)
- Check out: Summaries & Study Assistance - Starting page
Using and finding summaries, study notes en practice exams on JoHo WorldSupporter
There are several ways to navigate the large amount of summaries, study notes en practice exams on JoHo WorldSupporter.
- Starting Pages: for some fields of study and some university curricula editors have created (start) magazines where customised selections of summaries are put together to smoothen navigation. When you have found a magazine of your likings, add that page to your favorites so you can easily go to that starting point directly from your profile during future visits. Below you will find some start magazines per field of study
- Follow authors or (study) organizations: by following individual users, authors and your study organizations you are likely to discover more relevant study materials.
- Search tool: quick & dirty - not very elegant but the fastest way to find a specific summary of a book or study assistance with a specific course or subject. The search tool is available at the bottom of most pages or on the Search & Find page
- Tags & Taxonomy: gives you insight in the amount of summaries that are tagged by authors on specific subjects. This type of navigation can help find summaries that you could have missed when just using the search tools. Tags are organised per field of study and per study institution. Note: not all content is tagged thoroughly, so when this approach doesn't give the results you were looking for, please check the search tool as back up
Do you want to share your summaries with JoHo WorldSupporter and its visitors?
- Check out: Why and how to add a WorldSupporter contributions
- JoHo members: JoHo WorldSupporter members can share content directly and have access to all content: Join JoHo and become a JoHo member
- Non-members: When you are not a member you do not have full access, but if you want to share your own content with others you can fill out the contact form
Quicklinks to fields of study (main tags and taxonomy terms)
Field of study
- Communication & Media sciences
- Corporate & Organizational Sciences
- Cultural Studies & Humanities
- Economy & Economical sciences
- Education & Pedagogic Sciences
- Health & Medical Sciences
- IT & Exact sciences
- Law & Justice
- Nature & Environmental Sciences
- Psychology & Behavioral Sciences
- Public Administration & Social Sciences
- Science & Research
- Technical Sciences
Quick links to WorldSupporter content for universities in the Netherlands
Je vertrek voorbereiden of je verzekering afsluiten bij studie, stage of onderzoek in het buitenland
Study or work abroad? check your insurance options with The JoHo Foundation
- 1 of 48
- next ›
Add new contribution