Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
- 2998 keer gelezen
Join with a free account for more service, or become a member for full access to exclusives and extra support of WorldSupporter >>
“Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
A false positive refers to an incorrect rejection of the null hypothesis. The decisions a researcher can make during the research process is called the researcher degrees of freedom. Four common degrees of freedom are choosing sample size (1), using covariates (2), choosing among dependent variables (3) and reporting subsets of experimental conditions (4). The researcher degrees of freedom can significantly increase the false positive rate.
There are six guidelines for authors to prevent the increased rate of false positives:
- Authors must decide the rule for terminating data collection before data collection begins and report this rule in the article.
- Authors must collect at least 20 observations per cell or else provide a compelling cost-of-data collection justification.
- Authors must list all variables collected in a study.
- Authors must report all experimental conditions, including failed manipulations
- If observations are eliminated, authors must also note what the statistical results are if those observations are included.
- If an analysis includes a covariate, authors must report the statistical results of analysis without the covariate.
There are four guidelines for reviewers to prevent the increased rate of false positives:
- Reviewers should ensure that authors follow the requirements.
- Reviewers should be more tolerant of imperfection in results.
- Reviewers should require authors to demonstrate that their results do not hinge on arbitrary analytic decisions.
- If justifications of data collection or analysis are not compelling, reviewers should require the authors to conduct an exact replication.
Access:
Public
This content is related to:
Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
Check more of topic:
This content is used in:
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 12
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 13
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 14
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 15
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 16
- Discovering statistics using IBM SPSS statistics by Andy Field, fifth edition – Summary chapter 17
- Dienes (2008). Understanding psychology as a science.” – Article summary
- “Meltzoff & Cooper (2018). Critical thinking about research: Psychology and related fields.” - Article summary
- “Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
- “Nosek, Spies, & Motyl (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.” - Article summary
Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
- Borsboom & Cramer (2013). Network analysis: An integrative approach to the structure of psychopathology.
- Borsboom et al. (2016). Kinds versus continua: a review of psychometric approaches to uncover the structure of psychiatric constructs.
- "Cohen on item response theory” – Article summary
- Cohen on the science of psychological measurement” - Article summary
- Coyle (2015). Introduction to qualitative psychological research.” – Article summary
- Dienes (2008). Understanding psychology as a science.” – Article summary
- Dienes (2011). Bayesian versus orthodox statistics: Which side are you on?” – Article summary
- Eaton et al. (2014). Toward a model-based approach to the clinical assessment of personality psychopathology.” – Article summary
- Foster (2010). Causal inference and developmental psychology.” – Article summary
- “Furr & Bacharach (2014). Estimating practical effects: Binomial effect size display, Taylor-Russell tables, utility analysis and sensitivity / specificity.” – Article summary
- "Furr & Bacharach (2014). Estimating and evaluating convergent and discriminant validity evidence.” - Article summary
- “Furr & Bacharach (2014). Scaling.” - Article summary
- “Gigerenzer & Marewski (2015). Surrogate science: The idol of a universal method for scientific inference.” - Article summary
- “Halpern (2014). Thinking, an introduction.” - Article summary
- “Kievit et al. (2013). Simpson’s paradox in psychological science: A practical guide.” - Article summary
- “LeBel & Peters (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice.” - Article summary
- “Marewski & Olsson (2009). Formal modelling of psychological processes.” - Article summary
- “Meltzoff & Cooper (2018). Critical thinking about research: Psychology and related fields.” - Article summary
- “Mitchell & Tetlock (2017). Popularity as a poor proxy for utility.” - Article summary
- “Nosek, Spies, & Motyl (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.” - Article summary
- “Pearl (2018). Confounding and deconfounding: Or, slaying the lurking variable.” - Article summary
- “Schmittmann et al. (2013). Deconstructing the construct: A network perspective on psychological phenomena.” - Article summary
- “Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.” - Article summary
- “Shadish (2008). Critical thinking in quasi-experimentation.” - Article summary
- “Dennis & Kintsch (2008). Evaluating theories.” - Article summary
- “Van der Maas, Kan, & Borsboom (2014). Intelligence is what the intelligence test measures. Seriously.” – Article summary
- “Willingham (2007). Decision making an deductive reasoning.” – Article summary
Study with summaries
Work for WorldSupporter?
Volunteering: WorldSupporter moderators and Summary Supporters
Volunteering: Share your summaries or study notes
Student jobs: Part-time work as study assistant in Leiden
Contributions: posts
Help other WorldSupporters with additions, improvements and tips
Spotlight: topics
Check the related and most recent topics and summaries:
Study fields and working areas:
Institutions, jobs and organizations:
This content is also used in .....
Scientific & Statistical Reasoning – Summary interim exam 2 (UNIVERSITY OF AMSTERDAM)
This bundle contains everything you need to know for the fifth interim exam for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains both articles, book chapters and lectures. It consists of the following materials:
...Scientific & Statistical Reasoning – Article summary (UNIVERSITY OF AMSTERDAM)
This bundle contains all the summaries for the course "Scientific & Statistical Reasoning" given at the University of Amsterdam. It contains the following articles:
- “Borsboom & Cramer (2013). Network analysis: An integrative
Check how to use summaries on WorldSupporter.org
Online access to all summaries, study notes en practice exams
- Check out: Register with JoHo WorldSupporter: starting page (EN)
- Check out: Aanmelden bij JoHo WorldSupporter - startpagina (NL)
How and why use WorldSupporter.org for your summaries and study assistance?
- For free use of many of the summaries and study aids provided or collected by your fellow students.
- For free use of many of the lecture and study group notes, exam questions and practice questions.
- For use of all exclusive summaries and study assistance for those who are member with JoHo WorldSupporter with online access
- For compiling your own materials and contributions with relevant study help
- For sharing and finding relevant and interesting summaries, documents, notes, blogs, tips, videos, discussions, activities, recipes, side jobs and more.
Using and finding summaries, notes and practice exams on JoHo WorldSupporter
There are several ways to navigate the large amount of summaries, study notes en practice exams on JoHo WorldSupporter.
- Use the summaries home pages for your study or field of study
- Use the check and search pages for summaries and study aids by field of study, subject or faculty
- Use and follow your (study) organization
- by using your own student organization as a starting point, and continuing to follow it, easily discover which study materials are relevant to you
- this option is only available through partner organizations
- Check or follow authors or other WorldSupporters
- Use the menu above each page to go to the main theme pages for summaries
- Theme pages can be found for international studies as well as Dutch studies
Do you want to share your summaries with JoHo WorldSupporter and its visitors?
- Check out: Why and how to add a WorldSupporter contributions
- JoHo members: JoHo WorldSupporter members can share content directly and have access to all content: Join JoHo and become a JoHo member
- Non-members: When you are not a member you do not have full access, but if you want to share your own content with others you can fill out the contact form
Quicklinks to fields of study for summaries and study assistance
Main summaries home pages:
- Business organization and economics - Communication and marketing -International relations and international organizations - IT, logistics and technology - Law and administration - Leisure, sports and tourism - Medicine and healthcare - Pedagogy and educational science - Psychology and behavioral sciences - Society, culture and arts - Statistics and research
- Summaries: the best textbooks summarized per field of study
- Summaries: the best scientific articles summarized per field of study
- Summaries: the best definitions, descriptions and lists of terms per field of study
- Exams: home page for exams, exam tips and study tips
Main study fields:
Business organization and economics, Communication & Marketing, Education & Pedagogic Sciences, International Relations and Politics, IT and Technology, Law & Administration, Medicine & Health Care, Nature & Environmental Sciences, Psychology and behavioral sciences, Science and academic Research, Society & Culture, Tourism & Sports
Main study fields NL:
- Studies: Bedrijfskunde en economie, communicatie en marketing, geneeskunde en gezondheidszorg, internationale studies en betrekkingen, IT, Logistiek en technologie, maatschappij, cultuur en sociale studies, pedagogiek en onderwijskunde, rechten en bestuurskunde, statistiek, onderzoeksmethoden en SPSS
- Studie instellingen: Maatschappij: ISW in Utrecht - Pedagogiek: Groningen, Leiden, Utrecht - Psychologie: Amsterdam, Leiden, Nijmegen, Twente, Utrecht - Recht: Arresten en jurisprudentie, Groningen, Leiden
Submenu: Summaries & Activities
Add new contribution