The list of resources below is intended for (my) personal use. It contains primers, tutorials, guides I have used/encountered and/or want to learn more about it. These are related to producing better science, open-science, methods, statistics, visualization, R & RStudio.

# Open Science

- Open science manual
- What is open science? [with Vazire, Lakens, Corker, MicNuijten, and Simons by SPSP]

### Better science

- Minimizing Mistakes In Psychological Science
- OSF Guides
- Manual of Best Practices in Transparent Social Science Research (BITSS)
- The BITSS Working Paper Series
- F1000 Guide

### Meta-science

### Reproducibility

### Preregistration

- Preregistration template [pdf file]
- Preregistration template of Open Stats Lab and Project Tier
- Preregistration template for existing data (secondary data analysis)
- Comparison of Registered Reports

### Writing

### preprints

# Reproducibility & Replicability Crisis

### All Sciences

- Most published research findings are false (Ioannidis 2005)
- Introduction to the replicability crisis
- The Irreproducibility Crisis of Modern Science: Causes, Consequences and the Road to Reform
- 1,500 scientists lift the lid on reproducibility
- Wiki Primer (Good!)
- Reality check on reproducibility
- Statistical literacy
- Quality Control
- Peer-review role & Science self-correction myth
- On Sample Quality
- Scientists Self-Deception, Bias, Cognitive Fallacies in Research making
- Misunderstanding P-values
- Loss of confidence project

- Is ‘Reproducibility Crisis’ Overblown?
- Is science really facing a reproducibility crisis, and do we need it to? [Fanelli]

### Publication Bias (file drawer problem) & Null Findings

- Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling [ReproducibiliTea Podcast]
- Questionable Research Practices Revisited
- Coursera Video on QRP by Zand Scholten

### Questionable research Practices

- Publication bias and the canonization of false facts
- Coursera Video
- Replication, Communication, and the Population Dynamics of Scientific Discovery
- Emphasis on (Rate of) Published Positive Results - per scientific field

### samples

**WEIRD (Western, Educated, Industrialized, Rich, and Democratic) **

- 99% of all published studies rely on WEIRD samples
- WEIRD samples and external validity
- Attracting representative samples requires thought

**MTurk**

### Psychology

- Estimating the Reproducibility of Psychological Science
- Variation in Replicability: A “Many Labs” Replication Project
- [P-B/F-D] Quantifying Support for the Null Hypothesis in Psychology
- Primer, timeline, & future

**Studies**- In 72% of these cases, nonsignificant results were misinterpreted (Quantifying Support for the Null Hypothesis in Psychology

**Critiques & Replies**

**Political Science**

- Summary of open-science initiatives in Pol-Sci
- Take from Editors of Journal of Experimental Political Science
- Vignette Experiment

### The Reproducibility & Replicability Crisis & Politics

# Statistics

### Statistical practice

### Study Design

### degrees of freedom

- Illustrating degrees of freedom in terms of sample size and dimensionality
- Degrees of freedom tutorial
- Degrees of freedom in inferential statistics
- Twitter thread with discussions and references

### Power Analysis

**Multilevel design**

- simr: R package for Power Analysis for Generalised Linear Mixed Models by Simulation
- Power analysis at OSF from SIPS with Soderberg, Hennes, and Lane
- Power analysis through Monte Carlo simulation
- Andrew Gelman's You need 16 times the sample size to estimate an interaction than to estimate a main effect
- Sufficient Sample Sizes for Multilevel Modeling by Cora Maas & Joop Hox
- Tom Snijder's summary of available software and guides on Multilevel modeling
- MLPowSim Guide and Software

**Robust methods**

- Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research
- Discussion
- Regression estimation with MM-estimator (vs. OLS) -> resistance to outliers

**Linear & Generalized Linear Models**

J. Fox: Applied Regression Analysis and Generalized Linear Models with car and effect packages

### Time Series

**Psychometrics**

**Reliability**

**Item Response Theory [IRT]**

**Multidimensional Item Response Theory [MIRT]**

**Network Analysis**

- R Tutorial
- ggnetwork
- Estimating psychological networks and their accuracy: A tutorial paper
- Bootstrapping edges after regularization & Power and Robustness of Networks [both R tutorials]

- ggnetwork

# R & oPEN sCIENCE

### Reproducible Research

- Reproducible Research with R and R Studio [GitHub Repo]
- Implementing Reproducible Research
- Dynamic Documents with R and Knitr

- Intros, Courses, & Examples:
- Tools for Reproducible Research (Karl Broman, Spring, 2016)
- Marian Schimdt

# r Resources

### R-Intros

- R for psychologists with piping [Nick Michalak]

### R-Series: Complete COurses

**Data Science Methods for Psychology - University of Oregon (HardSci)**

- General Programming in R
- Data Wrangling
- Data Visualization
- Text Processing
- Web Scraping
- Machine Learning
- Network Analysis
- Package Creation
- Website Building in R

**Data Science for Social Sciences**

### Nifty Tricks & Tips

- Copy & Paste data from Web, Text [Twitter]
- Highlight parts of plots (lines, groups, etc) with gghighlight [1,2]

## Data Visualization

### Intro

### R-packages

- ggplot2: is a system for declaratively creating graphics, based on The Grammar of Graphics.

### Publication geared

**ggally**: the*ally*of ggplot2 (display of multiple regression coefficients and its diagnostics, networks, time-series, distributions, etc.).**ggstatsplot**: Plots with Statistical Details (most common types of statistical tests (parametric, non-parametric, and robust versions of t-tets, anova, correlation, and contingency tables)**ggpubr**:*ggplot2*based publication ready plots [tutorial at sthda]**cowplot**: publication-ready theme for ggplot2 (e.g., easy add panels A, B, C). Here's code for adding panels to**non-**ggplot2 R-base graphs.

### Guides

### Colors and Pallets

### miscellaneous

### Per type of data

### Distributions

### Group differences

### Time Series

**CGPfunctions:**Slopegraphs

### Strings

## Blogdown

- Intro to blogdown via Twitter thread [Dan Quintana]

## Bookdown

# [Scholarly]Social Media

# Philosophy of Science

### Primer on Philosophy of Science

**On Karl Popper**

# Everything else

### Economics (Behavioral)

R Journalism - Reproducible Journalism by Washington Post Investigative Data Reporter