Upcoming events
Teaching Reproducible Research
This workshop will introduce attendees to Project TIER’s principles and practices of integrating reproducible methods into teaching and research. The workshop will feature examples in the R programming language. Attendees should already be familiar with R or another statistical scripting language (e.g., Stata, SPSS, SAS, etc.). Attendees should also have some experience teaching courses involving applied data analysis and/or supervising data-based student research projects and expect to teach such a course again in the near future. During the workshop, attendees will create an output (such as a lab exercise or instructions for a reproducible research project) based on principles they learn in the workshop that they can use in their own teaching in the upcoming academic year. Attendees will have the option of a follow-up meeting in the summer of 2023 to discuss their experiences integrating reproducibility into their classes or personal research practices.
Southern Economic Association
Richard Ball will give a talk on "Teaching Reproducibility: Principles and Flexibility" at an Economic Education Presidential Session on Pedagogy and Economic Education.
Past events
Roundtable on Teaching Undergraduate Research Methods
Richard Ball participated in a roundtable discussion on Teaching Undergraduate Research Methods.
2020 Toronto Workshop on Reproducibility
Aneta Piekut, TIER Executive Committee member, delivered a presentation entitled " Integrating reproducibility into the curriculum of an undergraduate social sciences degree" at the 2020 Toronto Workshop on Reproducibility.
Reproducibility in Health Research
Richard Ball, Jenna Krall, and Norm Medeiros conducted a workshop for American University of Beirut faculty, researchers, instructors, graduate students, and clinical researchers in computational reproducibility of statistical data analysis. Attendees were taught to apply TIER Protocol principles and practices in constructing documentation for teaching and research purposes.
Streamlining Workflow in Quantitative Methods Instruction and Research Supervision [webinar]: January 19
A free webinar for faculty and staff at HBCUs about how to increase efficiency by incorporating transparency and reproducibility in quantitative methods instruction.
Streamlining Workflow in Quantitative Methods Instruction and Research Supervision [webinar]: January 11
A free webinar for faculty and staff at HBCUs about how to increase efficiency by incorporating transparency and reproducibility in quantitative methods instruction.
Streamlining Workflow in Quantitative Methods Instruction and Research Supervision [webinar]: January 6
A free webinar for faculty and staff at HBCUs about how to increase efficiency by incorporating transparency and reproducibility in quantitative methods instruction.
CURE-TIER Curating for Reproducibility Workshop
The CURE-TIER Workshop was designed for librarians, archivists, and information professionals who are interested in integrating principles of transparency and reproducibility into data curation activities. Participants were introduced to opportunities to collaborate with Project TIER in the development and dissemination of curricular resources for practicing and teaching transparent research methods, and with CURE on sharing practices and developing standards for curating for reproducibility. The ultimate goal was to foster the development of a community of educators and information professionals committed to the idea that transparency and reproducibility should be integrated into all aspects of research training and support in quantitative fields.
Faculty Development Workshop @ Atlanta University Center Consortium
This workshop introduced participants to protocols for conducting and documenting empirical research that ensure the reproducibility of all computational results. Attendees were presented with pedagogical strategies and curricular resources for teaching these methods to students in a variety of educational settings. The objective was to help instructors develop plans for teaching reproducible research practices that will be feasible and effective in their particular contexts, so that they are fully prepared to implement the methods presented at the workshops when they return to their home institutions.
Symposium on Instruction in Reproducible Research
The 2021 TIER Spring Symposium was an eight-part virtual event exploring the educational purposes of teaching students transparent and reproducible methods of quantitative data analysis. Taking a step back from the nuts and bolts of code and software, the Symposium focused on the diverse ways in which teaching reproducible research methods can reinforce principles that are fundamental to higher education (e.g., the importance of reasoned argument based on verifiable evidence), and contribute to students' broad intellectual development (e.g., gaining confidence in their ability to independently generate meaningful insights into real and important issues).
Educating for Reproducibility: Pathways to Research Integrity
The 2020 round of this annual two-day event, originally scheduled to take place in-person in March, was instead conducted virtually in December.
TIER Co-director Richard Ball participated in a panel on "Learning Across Disciplines: Approaches to Develop Reproducibility Education for Post-Graduates/Professionals."
View the panel here.
Workshop on Reproducible Research in Epidemiology
This workshop was organized by Sam Harper, a 2019-20 TIER Fellow. It provided: 1) an introductory, high-level overview of what it means to engage in reproducible research; 2) guidance on how to create a management plan for a research project and a structured workspace for the project that facilitates a reproducible workflow; 3) a discussion of pre-registration and pre-analysis plans for both experimental and observational research designs; 4) an introduction to version control and dynamic documents; and 5) tools and guidance for how to ethically and responsible share the outputs of a research project, including data, code, and research reports.
TIER Network Conversation: What is new in TIER Protocol version 4.0?
Version 3.0 of the TIER Protocol--Project TIER's flagship guidance for conducting and documenting reproducible research--has been posted since October 2016. We are now nearing completion of a thoroughly revised version 4.0, which will be posted late 2020 or early 2021.
Project TIER co-director Richard Ball gave a presentation on what is new in TIER Protocol 4.0--such as automated saving of output, emphasis on relative directory paths to make research compendia portable, and a design that allows more content to be delivered in a streamlined format.
Council on Undergraduate Research, Biennial Meeting
This workshop was cancelled because of the COVID-19 pandemic.
2019-20 TIER Fellow Megan Becker and TIER co-director Richard Ball presented a workshop on "Promoting Transparency, Reproducibility, and Replication in Undergraduate Research."
Society for the Improvement of Psychological Science: Workshop and Hack-a-thon at SIPS Annual Meeting
Because of the coronavirus pandemic, all of the SIPS 2020 Annual Meeting, including these events, were conducted virtually.
2019-20 TIER Fellow Kara Moore and TIER workshop alumni Jordan Wagge and Jack Arnal convened a Project TIER faculty development workshop and soups-to-nuts exercise writing hack-a-thon.
All of the SIPS 2020 annual meeting, including these events, were conducted virtually.
SAA 2020 Workshop: Teaching integrity in empirical archaeology
Because of the coronavirus pandemic, the 2020 SAA Annual Meetings, including this workshop, were cancelled.
Ben Marwick (Professor of Archaeology at the University of Washington and 2019-20 TIER Fellow) and Li-Ying Wang (Doctoral Student in Archaeology at the University of Washington) presented a workshop for educators interested in integrating principles of transparency and reproducibility into teaching archaeology. It introduced protocols for conducting and documenting empirical research that ensure the reproducibility of all computational results, and then presented a range of pedagogical strategies and curricular resources for teaching these methods to students in a variety of educational settings.
Curating for Reproducibility: How to make your thesis, dissertation, or scientific paper transparent and reproducible
Because of the coronavirus pandemic, the 2020 PAA Annual Meetings, including this workshop, were cancelled.
This half day workshop introduced participants to practical strategies for publication-ready and independently understandable research materials for reproducibility. The workshop was based on the data quality review, a framework for helping ensure that research data are usable, that code executes properly and reproduces analytic results, and that all digital scholarly objects are well documented. The workshop introduced models for putting this framework into practice developed by the co-founders of the Curating for Reproducibility (CURE) consortium composed of the Institution for Social and Policy Studies (ISPS) at Yale University, the Cornell Institute for Social and Economic Research (CISER) at Cornell University, and the Odum Institute for Research in Social Science at the University of North Carolina at Chapel Hill.
Reproducible Social Science Research: Why and How
Because of the coronavirus pandemic, the 2020 PAA Annual Meetings, including this workshop, were cancelled.
This workshop was organized bySam Harper, a 2019-20 TIER Fellow. The objective was to provide participants with an overview of the rationale for why funders, investigators, students, and practitioners of social science research should aim to make their research transparent. Participants left the workshop with a strong grasp of why adopting transparent and reproducible research practices is important, and with some hands-on experience with the tools to do so.
Curriculum Writing Retreat
Participants at this retreat worked in a collegial and supportive atmosphere to write original soup-to-nuts exercises for use in their own classes, and to share with others by contributing them to an open access archive of curricular resources.
Faculty Development Workshop-Fall 2019
This workshop introduced participants to the TIER Protocol for replicable empirical research and other tools for research transparency. It was designed for faculty members and librarians interested in teaching students at their own institutions to adopt transparent and reproducible methods in the statistical work they do for senior theses, other independent research projects, class papers, and exercises.
Teaching Reproducible Research
TIER Director Richard Ball gave this talk in the Advances in Higher Education Research seminar series, hosted by the Center for Teaching and Learning at the University of Washington.