The list of resources below is intended for (my) personal use. It contains primers, tutorials, guides I have used/encountered and/or want to learn more about it. These are related to producing better science, open-science, methods, statistics, visualization, R & RStudio.
Open Science
What is open science? [with Vazire, Lakens, Corker, MicNuijten, and Simons by SPSP]
Better science
Meta-science
Reproducibility
Preregistration
Preregistration template of Open Stats Lab and Project Tier
Preregistration template for existing data (secondary data analysis)
Writing
preprints
Reproducibility & Replicability Crisis
All Sciences
The Irreproducibility Crisis of Modern Science: Causes, Consequences and the Road to Reform
Scientists Self-Deception, Bias, Cognitive Fallacies in Research making
Loss of confidence project
Is science really facing a reproducibility crisis, and do we need it to? [Fanelli]
Publication Bias (file drawer problem) & Null Findings
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling [ReproducibiliTea Podcast]
Questionable research Practices
Replication, Communication, and the Population Dynamics of Scientific Discovery
Emphasis on (Rate of) Published Positive Results - per scientific field
samples
WEIRD (Western, Educated, Industrialized, Rich, and Democratic)
MTurk
Replication Rate in Social Sciences
Psychology
Evaluating replicability of laboratory experiments in economics
Variation in Replicability: A “Many Labs” Replication Project
[P-B/F-D] Quantifying Support for the Null Hypothesis in Psychology
Studies
In 72% of these cases, nonsignificant results were misinterpreted (Quantifying Support for the Null Hypothesis in Psychology
Critiques & Replies
Political Science
The Reproducibility & Replicability Crisis & Politics
Statistics
Statistical practice
Study Design
degrees of freedom
Power Analysis
Multilevel design
simr: R package for Power Analysis for Generalised Linear Mixed Models by Simulation
Power analysis at OSF from SIPS with Soderberg, Hennes, and Lane
Andrew Gelman's You need 16 times the sample size to estimate an interaction than to estimate a main effect
Sufficient Sample Sizes for Multilevel Modeling by Cora Maas & Joop Hox
Tom Snijder's summary of available software and guides on Multilevel modeling
Robust methods
Linear & Generalized Linear Models
J. Fox: Applied Regression Analysis and Generalized Linear Models with car and effect packages
Time Series
Course on Modern Methods in Time-series (in R, with code) by Kevin Kotzé
Causal Inference in graphs with Animated (GIF) Plots
Controlling for and Matching on a variable, Instrumental Variables, Fixed Effects, Difference-in-Differences, Regression Discontinuity (github repo, thread) by Nick Huntington-Klein
Survey Methodology PODCASTs
Psychometrics
Reliability
Item Response Theory [IRT]
Multidimensional Item Response Theory [MIRT]
Network Analysis
Estimating psychological networks and their accuracy: A tutorial paper
Bootstrapping edges after regularization & Power and Robustness of Networks [both R tutorials]
R & oPEN sCIENCE
Reproducible Research
Intros, Courses, & Examples:
Tools for Reproducible Research (Karl Broman, Spring, 2016)
r Resources
R-Intros
R for psychologists with piping [Nick Michalak]
R-Series: Complete COurses
Data Science Methods for Psychology - University of Oregon (HardSci)
Data Science for Social Sciences
Nifty Tricks & Tips
Data Visualization
Intro
R-packages
ggplot2: is a system for declaratively creating graphics, based on The Grammar of Graphics.
Publication geared
ggally: the ally of ggplot2 (display of multiple regression coefficients and its diagnostics, networks, time-series, distributions, etc.).
ggstatsplot: Plots with Statistical Details (most common types of statistical tests (parametric, non-parametric, and robust versions of t-tets, anova, correlation, and contingency tables)
ggpubr: ggplot2 based publication ready plots [tutorial at sthda]
cowplot: publication-ready theme for ggplot2 (e.g., easy add panels A, B, C). Here's code for adding panels to non-ggplot2 R-base graphs.
Guides
Colors and Pallets
miscellaneous
Per type of data
Distributions
Group differences
Time Series
CGPfunctions: Slopegraphs
Strings
Blogdown
Intro to blogdown via Twitter thread [Dan Quintana]
Bookdown
[Scholarly]Social Media
Philosophy of Science
Primer on Philosophy of Science
On Karl Popper
Pot-pourri
Logical fallacies - list thereof (youtube video -> great resource)
Bias - list thereof with examples.
Everything else
Economics (Behavioral)
Gelman already explains why economists get paid more back in 2014: economists come up with ideas that rich people like.
Evaluating replicability of laboratory experiments in economics
Representativeness of women and URM in Economics [link; link2]
Course on Econometrics
Writing
R Journalism - Reproducible Journalism by Washington Post Investigative Data Reporter
Logical fallacies - list thereof (youtube video -> great resource)
Bias - list thereof with examples.