Potential future topics and activities
We simply did not have enough time to cover many important topics in the area! If you have suggestions for what you need to succeed in your research, we are all ears. Here are a few potential future topics and activities:
- A Special Issue on Reproducible Research in Transportation: We are doing this! See our call for papers for European Transport Research Review (ETRR).
- A Special Issue on Datasets and Benchmarks: Explicitly reward creation of datasets and benchmarks that enable comparable and reproducible research in transportation.
- Focus groups to identify unique reproducibility barriers for subareas within transportation (e.g., travel demand, traffic flow theory, etc.).
- A reproducibility checklist for transportation research, such as for NeurIPS and AAAI.
- Data sharing and management for RR: What are best practices for storing data? How to choose a data format, and does it matter? How to participate in RR inspite of data with sensitive information?
- Reproducible Analysis: Our analysis pipeline are getting more and more sophisticated. What are best practices for leveraging Jupyter or Google Colab notebooks to perform and share interactive analysis?
- Reproducible Reporting: What are dynamic documents? Reproducible reports? How does someone create one?
- Best Practices for Peer Review and Publication: What role do reviewers and publication policies play in reproducible research? How can we move the needle forward? What are open science checklists? How well are they working?
- Reproducibility in Machine Learning and AI: How can we standardize and manage ML experiments for reproducibility?
- Addressing non-technical barriers to reproducible research: The elephant in the room is the pressure to ‘publish or perish’; researchers simply respond to the incentive structure. What or who can make a difference in RR?
- Case Studies in ITS: Do we understand the extent of the RR issue in the field of ITS? How can we find out? What are the success stories of RR in ITS? What are the horror stories?
- Hands-on RR workshop: Participants bring a research project and work on making it reproducible (lectures, work sessions, collaborative sessions, discussion).