The list of resources below is intended for (my) personal use. It contains primers, tutorials, guides I have used/encountered and/or want to learn more about it. These are related to producing better science, open-science, methods, statistics, visualization, R & RStudio.

# Open Science

What is open science? [with Vazire, Lakens, Corker, MicNuijten, and Simons by SPSP]

### Better science

### Meta-science

### Reproducibility

### Preregistration

Preregistration template of Open Stats Lab and Project Tier

Preregistration template for existing data (secondary data analysis)

### Writing

### preprints

# Reproducibility & Replicability Crisis

### All Sciences

The Irreproducibility Crisis of Modern Science: Causes, Consequences and the Road to Reform

Scientists Self-Deception, Bias, Cognitive Fallacies in Research making

Loss of confidence project

Is science really facing a reproducibility crisis, and do we need it to? [Fanelli]

### Publication Bias (file drawer problem) & Null Findings

Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling [ReproducibiliTea Podcast]

### Questionable research Practices

Replication, Communication, and the Population Dynamics of Scientific Discovery

Emphasis on (Rate of) Published Positive Results - per scientific field

### samples

**WEIRD (Western, Educated, Industrialized, Rich, and Democratic) **

**MTurk**

### Replication Rate in Social Sciences

### Psychology

Evaluating replicability of laboratory experiments in economics

Variation in Replicability: A “Many Labs” Replication Project

[P-B/F-D] Quantifying Support for the Null Hypothesis in Psychology

**Studies**In 72% of these cases, nonsignificant results were misinterpreted (Quantifying Support for the Null Hypothesis in Psychology

**Critiques & Replies**

**Political Science**

### The Reproducibility & Replicability Crisis & Politics

# Statistics

### Statistical practice

### Study Design

### degrees of freedom

### Power Analysis

**Multilevel design**

simr: R package for Power Analysis for Generalised Linear Mixed Models by Simulation

Power analysis at OSF from SIPS with Soderberg, Hennes, and Lane

Andrew Gelman's You need 16 times the sample size to estimate an interaction than to estimate a main effect

Sufficient Sample Sizes for Multilevel Modeling by Cora Maas & Joop Hox

Tom Snijder's summary of available software and guides on Multilevel modeling

**Robust methods**

**Linear & Generalized Linear Models**

J. Fox: Applied Regression Analysis and Generalized Linear Models with car and effect packages

### Time Series

Course on Modern Methods in Time-series (in R, with code) by Kevin Kotzé

### Causal Inference in graphs with Animated (GIF) Plots

Controlling for and Matching on a variable, Instrumental Variables, Fixed Effects, Difference-in-Differences, Regression Discontinuity (github repo, thread) by Nick Huntington-Klein

**Psychometrics**

**Reliability**

**Item Response Theory [IRT]**

**Multidimensional Item Response Theory [MIRT]**

**Network Analysis**

Estimating psychological networks and their accuracy: A tutorial paper

Bootstrapping edges after regularization & Power and Robustness of Networks [both R tutorials]

# R & oPEN sCIENCE

### Reproducible Research

Intros, Courses, & Examples:

Tools for Reproducible Research (Karl Broman, Spring, 2016)

# r Resources

### R-Intros

R for psychologists with piping [Nick Michalak]

### R-Series: Complete COurses

**Data Science Methods for Psychology - University of Oregon (HardSci)**

**Data Science for Social Sciences**

### Nifty Tricks & Tips

## Data Visualization

### Intro

### R-packages

ggplot2: is a system for declaratively creating graphics, based on The Grammar of Graphics.

### Publication geared

**ggally**: the*ally*of ggplot2 (display of multiple regression coefficients and its diagnostics, networks, time-series, distributions, etc.).**ggstatsplot**: Plots with Statistical Details (most common types of statistical tests (parametric, non-parametric, and robust versions of t-tets, anova, correlation, and contingency tables)**ggpubr**:*ggplot2*based publication ready plots [tutorial at sthda]**cowplot**: publication-ready theme for ggplot2 (e.g., easy add panels A, B, C). Here's code for adding panels to**non-**ggplot2 R-base graphs.

### Guides

### Colors and Pallets

### miscellaneous

### Per type of data

### Distributions

### Group differences

### Time Series

**CGPfunctions****:**Slopegraphs

### Strings

## Blogdown

Intro to blogdown via Twitter thread [Dan Quintana]

## Bookdown

# [Scholarly]Social Media

# Philosophy of Science

### Primer on Philosophy of Science

**On Karl Popper**

**Pot-pourri**

Logical fallacies - list thereof (youtube video -> great resource)

Bias - list thereof with examples.

# Everything else

### Economics (Behavioral)

Evaluating replicability of laboratory experiments in economics

Course on Econometrics

### Writing

R Journalism - Reproducible Journalism by Washington Post Investigative Data Reporter

Logical fallacies - list thereof (youtube video -> great resource)

Bias - list thereof with examples.