Past events
Educating for Reproducibility: Pathways to Research Integrity
The 2020 round of this annual two-day event, originally scheduled to take place in-person in March, was instead conducted virtually in December.
TIER Co-director Richard Ball participated in a panel on "Learning Across Disciplines: Approaches to Develop Reproducibility Education for Post-Graduates/Professionals."
View the panel here.
Workshop on Reproducible Research in Epidemiology
This workshop was organized by Sam Harper, a 2019-20 TIER Fellow. It provided: 1) an introductory, high-level overview of what it means to engage in reproducible research; 2) guidance on how to create a management plan for a research project and a structured workspace for the project that facilitates a reproducible workflow; 3) a discussion of pre-registration and pre-analysis plans for both experimental and observational research designs; 4) an introduction to version control and dynamic documents; and 5) tools and guidance for how to ethically and responsible share the outputs of a research project, including data, code, and research reports.
TIER Network Conversation: What is new in TIER Protocol version 4.0?
Version 3.0 of the TIER Protocol--Project TIER's flagship guidance for conducting and documenting reproducible research--has been posted since October 2016. We are now nearing completion of a thoroughly revised version 4.0, which will be posted late 2020 or early 2021.
Project TIER co-director Richard Ball gave a presentation on what is new in TIER Protocol 4.0--such as automated saving of output, emphasis on relative directory paths to make research compendia portable, and a design that allows more content to be delivered in a streamlined format.
Council on Undergraduate Research, Biennial Meeting
This workshop was cancelled because of the COVID-19 pandemic.
2019-20 TIER Fellow Megan Becker and TIER co-director Richard Ball presented a workshop on "Promoting Transparency, Reproducibility, and Replication in Undergraduate Research."
Society for the Improvement of Psychological Science: Workshop and Hack-a-thon at SIPS Annual Meeting
Because of the coronavirus pandemic, all of the SIPS 2020 Annual Meeting, including these events, were conducted virtually.
2019-20 TIER Fellow Kara Moore and TIER workshop alumni Jordan Wagge and Jack Arnal convened a Project TIER faculty development workshop and soups-to-nuts exercise writing hack-a-thon.
All of the SIPS 2020 annual meeting, including these events, were conducted virtually.
SAA 2020 Workshop: Teaching integrity in empirical archaeology
Because of the coronavirus pandemic, the 2020 SAA Annual Meetings, including this workshop, were cancelled.
Ben Marwick (Professor of Archaeology at the University of Washington and 2019-20 TIER Fellow) and Li-Ying Wang (Doctoral Student in Archaeology at the University of Washington) presented a workshop for educators interested in integrating principles of transparency and reproducibility into teaching archaeology. It introduced protocols for conducting and documenting empirical research that ensure the reproducibility of all computational results, and then presented a range of pedagogical strategies and curricular resources for teaching these methods to students in a variety of educational settings.
Curating for Reproducibility: How to make your thesis, dissertation, or scientific paper transparent and reproducible
Because of the coronavirus pandemic, the 2020 PAA Annual Meetings, including this workshop, were cancelled.
This half day workshop introduced participants to practical strategies for publication-ready and independently understandable research materials for reproducibility. The workshop was based on the data quality review, a framework for helping ensure that research data are usable, that code executes properly and reproduces analytic results, and that all digital scholarly objects are well documented. The workshop introduced models for putting this framework into practice developed by the co-founders of the Curating for Reproducibility (CURE) consortium composed of the Institution for Social and Policy Studies (ISPS) at Yale University, the Cornell Institute for Social and Economic Research (CISER) at Cornell University, and the Odum Institute for Research in Social Science at the University of North Carolina at Chapel Hill.
Reproducible Social Science Research: Why and How
Because of the coronavirus pandemic, the 2020 PAA Annual Meetings, including this workshop, were cancelled.
This workshop was organized bySam Harper, a 2019-20 TIER Fellow. The objective was to provide participants with an overview of the rationale for why funders, investigators, students, and practitioners of social science research should aim to make their research transparent. Participants left the workshop with a strong grasp of why adopting transparent and reproducible research practices is important, and with some hands-on experience with the tools to do so.
Promoting Research Transparency and Reproducibility Through Capacity-Building Trainings Across Sub Saharan Africa and Europe: Lessons Learned and Way Forward
Elise Wang Sonne
The Importance of Reproducibility in High-Throughput Biology: Case Studies in Forensic Bioinformatics
Keith Baggerly
Replication and Reproducibility in Social Sciences and Statistics: Context, Concerns, and Concrete Measures
Lars Vilhuber
Why scientific reasoning is hard: The role of cognitive constraints in biasing our reasoning
Dorothy Bishop
A Computing Workflow for Reproducible Results
Scott Long
Falsifying Predictions in Practice
Daniel Lakens
Checking Robustness in 4 Steps
Michele Nuijten
Statistically Valid Inferences from Privacy Protected Data
Gary King
2020 Spring Symposium
Presenting: Leaders in Research Transparency
Community Efforts Advancing Reproducibility and Transparency in Data- and Computationally-enabled Research
Victoria Stodden
Curriculum Writing Retreat
Participants at this retreat worked in a collegial and supportive atmosphere to write original soup-to-nuts exercises for use in their own classes, and to share with others by contributing them to an open access archive of curricular resources.
Faculty Development Workshop-Fall 2019
This workshop introduced participants to the TIER Protocol for replicable empirical research and other tools for research transparency. It was designed for faculty members and librarians interested in teaching students at their own institutions to adopt transparent and reproducible methods in the statistical work they do for senior theses, other independent research projects, class papers, and exercises.