Course Materials

University of Wisconsin-Madison

After successfully finishing the course, students will be able to

1. find, read, and understand scientific articles and synthesize scientific results;

2. effectively communicate ideas, critical evaluation, and research through analytic writing and engaging

narrated presentations;

3. think critically, examine links between method and results, consider alternative explanations, and

knowledgeably consume research;

4. generate testable hypotheses and design psychological research using different methods, data

collection tools, and analysis techniques;

5. correctly interpret and convey statistical results via text, tables, and graphs;

6. use key principles of science, including use of evidence, scientific reliability and validity, and fair

and thorough evaluation of research inside and outside the classroom;

7. understand that ethical principles, behavior, and decision-making pertain to all aspects of the research

process

8. identify how psychological science can inform societal practices policies, review, and apply what you learn.

Course content is available here.

Download course documents

California State University, Fresno

This course introduces students to the basic principles of statistical data analysis in economics. Students learn how economic data are used with economic and statistical models as a basis for estimating key economic parameters, testing economic hypotheses and understanding economic outcomes.

Download course documents

University of Wisconsin-Madison

At the end of this course, students will be able to

• Explain why data beat anecdotes.
• Understand why association is not causation.
• Explain the fundamental concepts and apply the basic procedures that underlie descriptive and inferential statistics.
• Interpret and draw conclusions from graphical displays and standard output from statistical software packages.
• Understand why statistical significance does not necessarily imply practical importance.
• Demonstrate an awareness of ethical issues associated with sound statistical practice.

Course content is available here.

Download course documents

Duke University

In this course students will learn to

• analyze real-world data to answer questions about multivariable relationships.
• fit and evaluate linear and logistic regression models.
• assess whether a proposed model is appropriate and describe its limitations.
• use R Markdown to write reproducible reports and GitHub for version control and collaboration.
• communicate results from statistical analyses to a general audience.

Download course documents

Vrije Universiteit Amsterdam

The course provides a safe space to discuss research integrity dilemmas and violations, ethics review guidelines in faculty, national and European laws and regulations. Students will explore the terrain of scientific integrity and research quality, and discuss violations of integrity, sloppy science and questionable research practices. Students will learn about proper data collection and storage; handling and analysis of data; reliable and verifiable research practices, open science, impartiality, independence and norms on co-authorship. Students will discuss standards of good practice in interaction with societal stakeholders.

Download course documents

University of Washington

This course is an introduction to basic methods of archaeology and data science. Students will learn some of the key data science tools used in day-to-day archaeological and cultural heritage work, which are also becoming increasingly valued and popular in a wide variety of other research areas and professions. Students will use these data science tools to tackle fascinating archaeological questions with contemporary relevance. This class will give students hands-on experience and prepare them for quantitative work in many other fields.

Download course documents

University of Rhode Island

To study problems in modern society, we need to understand how to use the vast amounts of data available in the world today. Modern literate citizens need to understand how we interpret data by considering how data are generated and analyzed. In this course, students gain experience using data to answer questions about the world. Students will learn to obtain, explore, visualize, and analyze data across an array of fields, including physical, natural and social sciences. Real data will be used to address real, pressing, social questions. This course will focus on the R computing language.

Download course documents

Union College

Econometrics uses data to analyze economic questions. The objective of this course is to familiarize students with basic methods of econometrics and with the mechanics of writing a research paper that uses these methods. We will learn how to describe and compare economic variables and how to examine relationships among them. This course is a key part of the economics major. It will enable students to understand quantitative analyses which are used in upper level courses, and to perform such analyses on their own.

Download course documents

Eindhoven University of Technology

This course is taught by the library and designed for Ph.D. students. It is a component of a larger section on Open Science required as part of the university’s general training program for Ph.D. students. In this course, the TIER Documentation Protocol is taught as an organizational principle for research data and affiliated objects. Course participants find the Protocol structure helpful for their work.

Download course documents

University of Hong Kong

The purpose of this course is for students to gain an in-depth understanding of the recent developments in psychological science through the lens of social psychology.

After taking this course, students will:

1. Understand the recent developments in psychological science and the so-called “replication/reproducibility crisis”.

2. Gain an academic overview of main research themes in social-psychology.

3. Summarize, analyze, reflect, and apply classic experiments and findings in social-psychology.

4. Articulate process and findings, both orally and in writing, with discussion of evidence and its implications for the academic field and in everyday life.

5. Experience and lead, hands-on, high-quality academic research using the most recent methodological advances in psychological science conducting a pre-registered replication and extension of a classic study in social-psychology .

• In-depth analysis of a published academic article
• Assessment of experimental scientific methods and evidence (effect-size, confidence-intervals, power, and p-values
• Pre-registration plan
• Data analysis
• Pre-registered replication report (as an academic submission)

Course materials are available on the OSF.

Download course documents

Smith College

I separate learning goals into goals with different verbs: know, understand, comprehend, analyze, synthesize, do, etc.

• Know the virtues and limitations of the rational actor model and its application to choice theory and the behavioral sciences.
• Understand the role of economics as a discipline in the behavioral sciences
• Ask meaningful questions with important potential answers
• Analyze data from experiments and surveys to answer questions relevant to the behavioral sciences
• Synthesize different ideas, theories and empirics within the behavioral sciences
• Design well conceived experiments and surveys to answer important questions
• Find ways to wrangle data and play around with computing to derive useful insights
• Recognize the benefits of teaching yourself to do new things.

Download course documents

George Mason University

This is a second year Master of Public Health elective in statistics. Students are already familiar with regression modeling, and spend this course applying statistical methods. The course aims to introduce some advanced topics (e.g. longitudinal data analysis and survival analysis), while giving students hands-on data analysis experience. This course involves a semester-long data analysis project that uses the Project TIER protocol. The students have previously applied statistical methods in the classroom, but have not seen a data analysis project from start to finish, e.g. identifying the dataset through writing up the final project.

Download course documents

Agnes Scott College

In this course, students: 1) develop familiarity with major theories about and research on global competence, 2) examine the practical, ethical, and scholarly considerations for completing research domestically and abroad, 3) build skills in accessing, comprehending, and critiquing research articles, 4) apply critical thinking skills to your own work and research, 5) explore post-college professional and personal goals, and 6) demonstrate the ability to develop, write, and share research.

Download course documents

Federal University of Pernambuco

[English abstract; syllabus is in Portuguese] The main objective of the course is to provide an introduction to the analysis of quantitative data, based on the transparency and replicability of scientific productions in Political Science. Students will be trained to create a database, build tables and graphs, in addition to conducting descriptive and inferential statistical analysis. The emphasis rests on the intuitive understanding of the techniques and their practical application. We will seek to develop the following objectives:

• Understand the underlying logic of statistical techniques;
• Interpret statistical results and assess the quality of inferences produced;
• Disseminate the concepts of transparency and replicability in Political Science;
• Conduct statistical analysis using specific software.

Download course documents

Clark University

An important part of a successful research project is documenting the process well enough that others can reproduce your results (it also makes it much easier for you to extend your own research at some future date). Students will follow the TIER (Teaching Integrity in Empirical Research) Protocol developed by Richard Ball and others at Haverford College (see http://projecttier.org for more background information). The documentation students prepare covers three stages of the research process: the original data source(s) accessed, the steps needed to develop the final analysis dataset(s), and the statistical analyses presented in the paper.

Download course documents

Dickinson College

This course is a rigorous introduction to econometrics in which the tools of economic theory, mathematics, and statistical inference are applied to the analysis of economic data. We will study and apply multiple regression analysis to both cross-sectional and longitudinal (panel) data in order to familiarize students with the concepts of econometric modeling, estimation, prediction, and hypothesis testing. Students will conduct empirical research projects using Stata to enable students to understand and apply the conventions of empirical research in economics, including: technical writing, reviewing existing literature, data collection and organization, and file management for complete transparency and reproducibility. Throughout the semester students will:

• Learn the econometric methodology, including how to construct econometric models, estimate relevant economic parameters, predict economic outcomes, and test economic hypotheses using quantitative data.
• Do regression analysis. They will be able to choose a topic conducive to regression analysis, specify a regression equation, collect data, run descriptive statistics, run regressions, interpret and evaluate the results, and demonstrate the necessary components of a well-written empirical research paper and the economics discipline formatting and style conventions.
• Learn the basic assumptions of the classical linear regression model and identify and correct (if possible) any violations of these assumptions, such as serial correlation and heteroskedasticity.
• Evaluate regression results, determining whether the regression coefficients have the expected sign and magnitude, whether the regression coefficients are statistically significant, whether the equation includes irrelevant variables or omits theoretically relevant variables, and whether the goodness of fit of the equation appears adequate.
• Demonstrate an understanding of Stata syntax, data management skills, and best coding and documentation practices for reproducibility.
• Demonstrate the ability to place a research question in the context of existing scholarly discourse through an effective literature review.

Download course documents

Willamette University

In this course students will apply theory and methodological skills learned in previous course work to their own original quantitative research project. The objective of this course is to train sociology majors to plan and carryout research using: systematic procedures; quantitative data collection methods, strategies, and instruments used in the social sciences (and sociology, in particular); and quantitative data analysis and modeling techniques. Students will learn the core elements of the research process: the scientific method; variables, relationships, and hypotheses; definition and measurement of variables; data validity and reliability; determination of where data will come from (sampling); and issues related to ethics, perspectives, and strategic approaches to social science research, among others. The course will start with a recap of fundamental elements of quantitative methods. Students will then review contemporary sociological research to gain a better understanding of the structure of empirical papers and the art of writing. The course will then shift to an overview of various techniques for analyzing and interpreting quantitative data, and data management using SAS. This course is designed to fulfill the Willamette University writing-centered course designation. Toward this end, students will engage in regular writing, peer-review, and revising exercises.

Download course documents

Smith College

An application-oriented introduction to modern statistical modeling and inference: study design, descriptive statistics, data visualization, random variables, probability and sampling distributions, point and interval estimates, hypothesis tests, resampling procedures, and multiple regression. A wide variety of applications from the natural and social sciences will be used. Classes meet for lecture/discussion with activities and exercises that emphasize analysis of real data.

Students complete weekly lab assignments in R and RMarkdown, and a final data analysis project. The final project is worth 25% of the course grade, and must be reproducible. Students work in groups to complete the project on a topic of their choice. Students have a number of milestone assignments along the way, including an initial proposal, revised proposal, data file submission, data appendix, and a final technical report. The technical report includes all the code needed to complete the analysis.

Students worked through labs introducing R and RStudio (http://www.science.smith.edu/~amcnamara/sds220/labs/intro_to_r.html) and introducing data analysis (http://www.science.smith.edu/~amcnamara/sds220/labs/intro_to_data.html). Both labs were developed by the OpenIntro Statistics group, and include expository videos explaining some of the topics. The OpenIntro team has created an R package called oilabs, which includes a lab report template that can be accessed through RStudio.

Download course documents

Union College

This is the first year Tomas has taught a new course entitled Business Analytics. The key learning objective is for students to be able to manipulate and analyze business data. The course is very hands-on with students programming in R Markdown from the first day. The emphasis is on data manipulation: students need to load in data, summarize, reshape, merge and append the data in multiple ways to get insights. In this course students realize that data preparation and manipulation is 90% of the work of an empirical researcher or an analyst. Running a regression or a sophisticated algorithm is the last and fairly straightforward step. The value of any analysis lies mostly in the quality and organization of the data. Using R Markdown forces students to integrate data manipulation and analysis with text. Their final project is always reproducible because it is a knitted R Markdown document. Even if they don't end up using R Markdown in the future (e.g. their thesis), the course gives them programming skills that are essential to reproducible research.

Download course documents

Smith College

A majority of the world’s population lives on less than $2.50/day. Health status, educational attainment, government quality, and many other indicators are substantially lower in developing countries than in developed countries. Why are so many people so poor and what stop them from catching up? What strategies help alleviate poverty? What policies or institutions cause economies to grow and develop? We begin the class by understanding how to define and measure development, studying income, poverty, inequality, human development and health. We proceed to look at economic theories of growth as a tool to understand how agriculture, institutions and transformation have affected and conTnue to affect developing countries. Toward the end of the course we complicate our understanding of development by looking at the role of market failures and externalities, globalization and world trade, and credit and risk.

Download course documents

Smith College

There are many approaches to development economics. First, there are many attempts to explain international differences in economic development – the ‘macro’ development problem. Second, there are many differences between the ways in which individuals, firms and states can respond to the challenges of development – the ‘micro’ development problem. The microeconomics of development informs the macroeconomics of development. From micro work we may gain insight into the specific individual-, family-, village- and firm-level institutions and constraints that shape decisions. As we try to understand how micro-level results permeate through an economy, that is, we try to understand the general equilibrium effects of a policy, so may we gain insight into macrolevel differences. Micro and macro tie together closely.

Download course documents

Carleton College

These labs were developed as part of ECON 395: Advanced Topics in the Economics of Housing. This course is typically taken during the fall term by senior economics majors at Carleton College as part one of the two term senior Comprehensive Exercise. During the senior seminar 10-15 students read and discuss primary literature related to the seminar topic and ultimately propose an individual empirical research project to be completed in the subsequent term.

The primary goal of the seminar is to help students write a research prospectus containing:

• a tractible research question,
• a description of an appropriate and accessible dataset,
• a proposed analysis methodology and identification strategy,
• and, a knowledge of how the proposed work fits within the scholarly literature.

This is the first course in the major in which Econometrics is a prerequisite. Therefore, this is typically the first course for which students can apply their econometric tools to the task of reading primary literature. As such, they often struggle understanding the myriad steps involved “behind the scenes” that are necessary to construct the dataset described in the paper (for instance, merging datasets from multiple sources). They commonly struggle to understand what is feasible as they propose their own projects and often find themselves in more challenging circumstances than expected.

Download course documents

Federal University of Pernambuco

This course is an introduction to replication and transparency in Political Science empirical research. The course is organized in three sections. The first one provides an overview of basic mathematical notation and statistical reasoning. The second part will introduce the main features of reproducible research using Stata and other tools. The third section will cover linear regression applications and diagnostics using both simulation and replication.

Download course documents

Smith College

Theory and applications of regression techniques; linear and nonlinear multiple regression models, residual and influence analysis, correlation, covariance analysis, indicator variables and time series analysis. This course includes methods for choosing, fitting, evaluating and comparing statistical models and analyzes data sets taken from the natural, physical and social sciences.

Students worked in small groups to produce a data analysis on a topic of their choice. The project is 25% of the final course grade. Students had to work in R and RMarkdown, turn in a data appendix, and document all their data cleaning and analysis in their final report.

Download course documents

Union College

All economics majors at Union College must write a senior thesis. Most theses use data and regression analysis, though theses that are more narrative or include a business plan are not uncommon. It has always been common practice for faculty to require submission of data and programs with thesis. More and more students use Stata or R to manipulate and analyze their data. However, some students use the software interactively (point and click), and even if they write programs they are rarely organized in a fashion that promotes reproducibility. At the beginning of this year, Tomas held a workshop for senior thesis students to explain the importance of reproducibility and organization of documents and programs along the the lines of TIER protocol.

The first crop of thesis students that were exposed to the TIER protocol just finished. It remains to be seen how many theses are reproducible. Tomas' own students followed the protocol but ran into a number of challenges. For example, one student used confidential data and thus is not able to post the data; another student used very large data and is still working on organizing all of his programs and data. Tomas plans to survey his colleagues on the extent to which their advisees' theses are reproducible. The first year of using the TIER protocol for senior thesis was harder than anticipated. This is largely because the students' priority is to get results rather than documenting and organizing the way they got to the results.

Download course documents

Colgate University

Course Objectives and Structure:This course is your capstone course in the economics curriculum. The focus is on producing a research paper of publication quality. To accomplish this, you should be able to:

• state and motivate a cogent research question
• produce a credible literature review
• exhibit knowledge of basic economic theory as it relates to environmental and natural resource issues
• exhibit competence of statistical and econometric techniques if the work is of the empirical/statistical type
• produce clear, well reasoned arguments with a high standard of writing skill.
• provide all documentation as required by the TIER protocol of Ball and Medeiros (2012)

A seminar course is very different in tone and structure from other instructional courses in the curriculum. A seminar is a collaborative learning effort by all those involved. It is not the professor teaching the students, but rather the professor and students all learning together from each other. This means that there is far more responsibility on the part of the students to contribute to each other’s learning.Research project:

• You are required to write an independent research paper examining an aspect of a topic in environmental, resource, or ecological economics. Specific details will be forthcoming, but you should begin examining topics immediately!
• The research project could be (1) applied, empirical and statistical; (2) theoretical. It must be of academic interest, and ideally should be of practical interest (at least to someone).
• I expect the paper to be professionally written and in an economics journal style. Details of this will be discussed.
• We will adhere to the criterion that the paper must be fully documented so that its results can be fully replicated by a reader. This means that all data, code, and metadata must be supplied following the TIER protocol described in Ball and Medeiros (2012) which we will discuss in class.
• In the last few weeks of class, each of you will present your findings to the class.

Download course documents

Haverford College

This is an introductory course in applied statistics that serves as a pre-requisite for an econometrics course that all economics majors are required to take. The course consists of three hours or class per week, plus a weekly two-hour computer lab devoted to an original research project. Working in small groups, students choose a topic; review the relevant literature; find appropriate statistical data; clean and organize the data; and conduct analyses to see what they can learn about the questions they set out to investigate. At the end of the semester they present their study and findings in a complete research paper, accompanied by comprehensive replication documentation that meets the specifications of the TIER Protocol.

This research project is carried out in several installments: a pre-proposal, a full proposal, a data report, and the final paper. Instructions for each of these installments, including detailed instructions for the replication documentation, are provided in the course materials available for download below.

A course syllabus is also included in the materials available for download.

Download course documents

Colgate University

This applied econometrics course is a requirement for all economics majors at Colgate University. Students in this section of the course were required to write an original empirical research paper, with complete replication documentation constructed according to the guidelines of the TIER Protocol.

Detailed instructions for the research paper can be found in the document available for download below.

Download course documents

Williams College

For this project, students use the Project TIER Research Protocol. This protocol, developed at Haverford College, improves transparency, replicability, and self-discipline in the research process. The final paper is submitted with the raw data files (in the original file format and converted to Stata or other format) and all do files necessary to implement the analysis in the project. The students' do files are archived and made available to anyone who wishes to replicate the results.

Download course documents

Williams College

The purpose of the group empirical project is to allow students to practice the tools they learn in class, and to expose them to the challenges and joys of empirical research. In groups of 1-3 people, they write a 15-page empirical paper on a topic of their choice. They give a 10-15 minute presentation to the class at the end of the semester explaining their project and highlighting their findings. They then submit their paper, raw data, and Stata programs, as described by a research protocol.

Download course documents