This event is the third in an annual series of day-long conferences on research reproducibility. TIER Director Richard Ball will participate in a panel discussion on "Learning Across Disciplines: Approaches to Develop Reproducibility Education: Post-Graduate and Professional Education."
The CURE-TIER Workshop is designed for librarians, archivists, and information professionals who are interested in integrating principles of transparency and reproducibility into data curation activities. Participants will be introduced to opportunities to collaborate with Project TIER in the development and dissemination of curricular resources for practicing and teaching transparent research methods, and with CURE on sharing practices and developing standards for curating for reproducibility. The ultimate goal is to foster the development of a community of educators and information professionals committed to the idea that transparency and reproducibility should be integrated into all aspects of research training and support in quantitative fields.
This workshop is being organized by Sam Harper, a 2019-20 TIER Fellow. The objective is to provide participants with an overview of the rationale for why funders, investigators, students, and practitioners of social science research should aim to make their research transparent. Participants will leave the workshop with a strong grasp of why adopting transparent and reproducible research practices is important, and with some hands-on experience with the tools to do so.
This half day workshop will introduce participants to practical strategies for publication-ready and independently understandable research materials for reproducibility. The workshop will be based on the data quality review, a framework for helping ensure that research data are usable, that code executes properly and reproduces analytic results, and that all digital scholarly objects are well documented. The workshop will introduce models for putting this framework into practice developed by the co-founders of the Curating for Reproducibility (CURE) consortium composed of the Institution for Social and Policy Studies (ISPS) at Yale University, the Cornell Institute for Social and Economic Research (CISER) at Cornell University, and the Odum Institute for Research in Social Science at the University of North Carolina at Chapel Hill.
Ben Marwick (Professor of Archaeology at the University of Washington and 2019-20 TIER Fellow) and Li-Ying Wang (Doctoral Student in Archaeology at the University of Washington) will present a workshop for educators interested in integrating principles of transparency and reproducibility into teaching archaeology. It will introduce protocols for conducting and documenting empirical research that ensure the reproducibility of all computational results, and then present a range of pedagogical strategies and curricular resources for teaching these methods to students in a variety of educational settings.
This workshop is being organized by Sam Harper, a 2019-20 TIER Fellow. It will provide: 1) an introductory, high-level overview of what it means to engage in reproducible research; 2) guidance on how to create a management plan for a research project and a structured workspace for the project that facilitates a reproducible workflow; 3) a discussion of pre-registration and pre-analysis plans for both experimental and observational research designs; 4) an introduction to version control and dynamic documents; and 5) tools and guidance for how to ethically and responsible share the outputs of a research project, including data, code, and research reports.
2019-20 TIER Fellow Kara Moore and TIER workshop alumni Jordan Wagge and Jack Arnal will be convening a Project TIER faculty development workshop and soups-to-nuts exercise writing hack-a-thon.
Participants at this retreat worked in a collegial and supportive atmosphere to write original soup-to-nuts exercises for use in their own classes, and to share with others by contributing them to an open access archive of curricular resources.
This workshop introduced participants to the TIER Protocol for replicable empirical research and other tools for research transparency. It was designed for faculty members and librarians interested in teaching students at their own institutions to adopt transparent and reproducible methods in the statistical work they do for senior theses, other independent research projects, class papers, and exercises.
TIER Director Richard Ball gave this talk in the Advances in Higher Education Research seminar series, hosted by the Center for Teaching and Learning at the University of Washington.
TIER Directors Richard Ball and Norm Medeiros gave a presentation and workshop on TIER principles and practices as part of Open Access Week.
TIER Director Richard Ball was a guest speaker at this workshop, which initiated a process aimed at developing a suite of research training activities for promoting rigor, reproducibility, and transparency (RRT) in science.
2019-20 TIER Faculty Fellow Megan Becker chaired a session on "Dealing with the Replication Crisis," at which she presented a paper titled Replicating the Resource Curse: Ross (2004) and Qualitative Replication (co-authored with Jonathan Markowitz).
The outgoing 2018-19 TIER Fellows and the incoming 2019-20 cohort gathered to discuss strategies for implementing transparent teaching methods at their home institutions, and to promote such work to colleagues in the greater academic community.
TIER Director Richard Ball presented a poster on Project TIER's resources and programs.
A two-day conference/workshop on research transparency in political science.
Project TIER Director Norm Medeiros contributed to the closing session via video-conference. Slides from his talk, entitled "Teaching Students Transparent and Reproducible Research Methods with the TIER Protocol," are available here.
In collaboration with 2018-19 TIER Fellows Nicole Janz and Laura Fortunato, Project TIER held a faculty development workshop at St. Anne's College, Oxford. The workshop was co-sponsored with the UK Reproducibility Network.
TIER Director Norm Medeiros participated in a panel describing innovative undergraduate research initiatives and the role librarians can serve therein.
This workshop introduced participants to the TIER Protocol for replicable empirical research and other tools for research transparency. It was designed for faculty members interested in teaching students at their own institutions to adopt transparent and reproducible methods in the statistical work they do for senior theses, other independent research projects, class papers, and exercises.
TIER Director Norm Medeiros presented at the ICPSR webinar, "Joining Forces to Promote Research Transparency," which was held on October 2, 2018. Norm was joined by Florio Arguillas, a 2017-18 TIER Fellow and Research Associate at the Cornell Institute for Social and Economic Research (CISER), and Harrison Dekker, Data Services Librarian at the University of Rhode Island.
A session titled "Openness and Integrity in Methods Teaching and Research," featuring four talks by friends and associates of Project TIER: Caroline Curvale and Gustavo Pérez (FLACSO Ecuador), Richard Ball (Haverford College), Jan Höffler (ReplicationWiki) and Matt Ingram (SUNY Albany).
This workshop, presented by Project TIER Advisor Scott Long, University of Indiana, considered the entire process of research from and presented a workflow that is guided by the demands of producing reproducible and accurate results while working as quickly and efficiently as possible. Using this approach, your work goes faster, your findings are more trustworthy, and your results are reproducible. The course focused on strategies and rules that work with Stata, R, SPSS, SAS or any statistical package.
The outgoing 2017-18 TIER Fellows and the incoming 2018-19 cohort gathered to discuss strategies for implementing transparent teaching methods at their home institutions, and to promote such work to colleagues in the greater academic community.
This session featured four talks by friends and associates of Project TIER: Emily Marshall and Tony Underwood (Dickinson College), David Vera (Cal State Fresno), Elise Wang Sonne (United Nations University, the Netherlands), and Richard Ball (Haverford College).
Project TIER Director Norm Medeiros participated in a panel presentation on collaborations to promote research transparency. Slides from his talk, entitled "Trickle Up Transparency," are available here.
This full-day workshop presented several workflows and tools for conducting and documenting quantitative research to ensure transparency and reproducibility of the data processing and analysis that underlie reported statistical results. There was particular emphasis on strategies instructors can use to integrate these methods into their classes and advising, so that students are immersed in principles and practices of transparency early in their research training.
Florio Orocio Arguillas, 2017-18 TIER Faculty Fellow, was a presenter at "Curating for Reproducibility: Producing High Quality Data and Code for Transparent and Reproducible Research," a half-day workshop that taught participants practical strategies for curating research materials for reproducibility. The workshop was based on the data quality review, a framework for helping ensure that research data are well documented and usable and that code executes properly and reproduces analytic results.