YouthMappers Validation Hub
What is the YouthMappers Validation Hub?
The YouthMappers Validation Hub is a group of experienced student mappers whose purpose is to ensure a high standard of data quality in the collaborative mapping platform OpenStreetMap (OSM). Formed in May 2019, the Validation Hub was organized and implemented by faculty and students at The George Washington University in Washington, D.C. Our primary focus is to validate the work of OSM contributors and guarantee that all YouthMappers projects have the highest quality data. We are also interested in the behavior of new and current mappers and understand that the only way to enhance contributions is to improve the technique, habits, and conduct of mappers:
Technique - Are mappers properly outlining buildings and roads, adjusting the imagery to match the map geometry, tagging features using update-to-date labels, etc.?
Habits - Do mappers consistently map and tag all identifiable features, leave feedback about their edits, make edits without deleting the work of others, etc.?
Conduct - Are mappers respecting official OSM rules and regulations, leaving appropriate changeset comments, averting vandalising map data, etc.?
Overall, YouthMappers Hub members, commonly referred to as Hub, strive to strengthen the confidence and talents of mappers, the OSM community and volunteers from YouthMapper chapters around the globe. With our efforts, we don’t plan on building just maps or mappers, we also build validators.
From YouthMapper’s 3rd Quarterly Newsletter: GWU Geography launches the YouthMappers Validation Hub!
In June 2019, a small cohort of validators began reviewing projects and edits made by YouthMappers on OpenStreetMap (OSM). The primary focus of the validation hub is to retroactively validate mapping activities and create a strategic workflow for monitoring #YouthMappers tasks moving forward. Through this effort, we aim to ensure that data produced by our chapters IS of high quality.
What, Where, and Why Do We Validate?
Hub members access OSM data through Humanitarian OpenStreetMap Team’s (HOT) Tasking Manager, a tool that divides mapping projects into smaller tasks so multiple contributors can map and validate areas simultaneously. Projects in the HOT Tasking Manager indicate which areas are: ready to map, mapped, and validated. HOT’s system is designed to provide updated map data in the event of a disaster and/or humanitarian emergency scenario, measure project completion and user contributions, and improve the consistency of mapping (e.g. entities to map, proper feature tagging, etc.).
The YouthMappers Validation Hub executes the validation step in HOT’s Tasking Manager workflow. Hub members review the areas mapped by users, making sure that they trace and tag all map features required in the project instructions. When users do not follow the guidelines, our validators mark the area as ‘invalidated’, tag the user, and leave instructional friendly feedback in the comments section. The premise of this action is to encourage mappers to return to the task, fix their mapping oversights, and feel empowered to contribute to OSM in the future.
When validating, our team look for three main things:
Spatial accuracy - are features in the correct place, are there overlapping buildings, are the corners of the buildings square, etc.?
Tagging accuracy - are features tagged appropriately?
Completeness - are all the features mapped as described in the HOT Tasking Manager project instructions?
Our validators pay close attention to these common mapping mistakes. To make sure YouthMappers edits adhere to OSM’s established guidelines on tracing and tagging, Hub members use a special software called Java OpenStreetMap (JOSM).
Blog Post: Happy #ValidationFriday From the YouthMappers Validation Hub!
On October 25th, 2019, the Validation Hub hosted a validation party on The George Washington University’s campus. In honor of MissingMap’s #ValidationFriday, a reminder to validators to contribute to the data control and quality assurance of OSM data, the Hub gathered together to teach students and professionals on validation procedures using JOSM.
The Validation Process Using JOSM
Hub members prefer to validate using the advanced editing software JOSM. JOSM streamlines the geometry and tagging functions included in iD editor, coupled with built-in validation tools that automatically identify errors overlooked by the validator. However, these software tools alone are not the answer to validation. These tools need to be used by trained individuals who will assess the quality of the contributions made to OSM projects. Mappers that wish to become validators must have experience with tracing and tagging complex features in OSM, outstanding image interpretation skills, a positive attitude and manner towards other users, and a willingness to learn new software.
If you possess an interest in learning to validate, please take a glance at our training document on validating using JOSM. JOSM is an open-source application that anyone can download and use without any cost. To download and read more about the software, click here.
Validation Training Sessions
We believe that training with experienced validators, whether online or in-person, is essential to becoming a better mapper. Complementary to our instructional text and walk-throughs, we host validation training sessions to reinforce OSM’s code of conduct and work one-on-one with individuals to download, navigate, and validate using JOSM. This way, YouthMappers members with different levels of experience and interests can interact, learn from and help one another, and ask Hub members for assistance or questions.
Interactive / Active Validation Using HOT Tasking Manager and OpenStreetMap Changeset Analyser (OSMCha)
One of the goals of the Hub is to actively examine map edits, and correct errors and contact mappers if needed. This process, referred to as interactive/active validation, is applied to on-going projects. Our methodology is based on research which demonstrates that giving real-time feedback, both positive and corrective, yields higher quality edits and mappers. We perform interactive validation using either OSMCha or HOT Tasking Manager.
OSMCha is an online tool with visual and analysis functions that support the standardization of OSM edits. As previously stated, HOT Tasking Manager is a tool that divides mapping projects into smaller tasks so multiple contributors can map and validate areas simultaneously. Whereas projects in HOT Tasking Manager pre-define the mapping region, OSMCha has the advantage of filtering options which enables individuals to refine changesets based on tags and attributes. The Hub has developed a walkthrough using OSMCha to review data by date range, location, and OSM username. You can follow our documentation here.
Mapping Project Creation Form
Have an area that needs to be mapped? Let us help! Typically, projects in HOT Tasking Manager focus on vulnerable regions that lack spatial data. At-risk areas include communities prone to natural disasters, armed conflict and displaced persons, insufficient food and water supply, inequitable distribution of modern medicine, education, and/or infrastructure, etc. If your idea is similar to the above examples, you can submit a project proposal using our form here. This questionnaire requires information such as the name and description of the project, instructions on objects to map and specific tags, bounding geometry for the area of interest, and other components necessary for project creation. In addition, we provide an instructional cheat sheet that gives written and visual examples on how to map different kinds of features (e.g. buildings, roads, waterways, etc.).
What Tasks Have We Completed?
Our team has completed validating several YouthMappers-projects since May 2019. Our goal is to finalize tasks new and old to make certain that all data associated with YouthMappers is of excellent caliber and useful to the project creator and benefactors, and OSM users. Due to the size of projects, the complexity of map features and the quality of mapping by contributors, it takes varying amounts of time for our members to validate a project in the HOT Tasking Manager. Some tasks, such as #2742, required several months to complete due to its sheer scope. Others, like #990, necessitated less than a month because there were less features to map in the area.
HOT Tasking Manager’s recent website redesign features a new graphic located on individual project pages labeled the ‘Contributions Timeline,’ which contrasts the amount of time to map tasks versus the amount of time to validate tasks. This graphic is supplementary to HOT Tasking Manager’s other maps and interactive displays, helping users to understand the completion rate of projects.
Attendees of the Hub’s #ValidationFriday event posing with The George Washington University Geography alien mascot, Geoid.
This graphic belongs to HOT Project #2742: PEPFAR KENYA: SIAYA (BONDO), a task validated by the Hub. This project was completely mapped from April 2017 to January 2019, and validated between April 2019 to December 2019.
The Hub is made up of a group of experienced OSM student mappers and faculty from the George Washington University in Washington, D.C.
Noelle Dwyer, Team Member: Noelle joined the Hub in October 2020 as a Junior at the George Washington University. Originally from Delray Beach, FL, she is pursuing a B.A. in Applied Science with a concentration in Environmental Engineering and a minor in Geographic Information Systems. Noelle first became interested in humanitarian mapping through a Mapathon she attended her Sophomore year at GW. Her background in coding and Environmental Engineering drew her to GIS technology and spatial analysis, which has been further enforced through her Intermediate GIS course. She hopes to pursue a career using GIS technologies to elevate underrepresented communities through better resource allocation and sustainable land-use planning. Noelle has experience interning for companies that focus on International Development and promoting women’s health and equality. Outside of the Hub, Noelle is a member of the GWU Women’s Volleyball team, is an avid painter, and loves road bicycling.
Kate O'Byrne, Team Member: Kate joined the team in June 2020. Originally from New Rochelle, New York, Kate is a rising senior at George Washington University, who will graduate in the spring with her B.A. in Environmental Studies and minors in Sustainability and Geographic Information Systems. The interest in GIS came from the introductory course that Kate took during her sophomore year. In that class she learned just how powerful and effective mapping can be towards making real changes around the world. The ability to provide humanitarian support to people across the globe really inspired Kate to pursue a future in mapping and GIS. To get her foot in the door of all things mapping, Kate has attended mapathons which demonstrated the strong community that OSM has. As a member of the Hub team Kate validates data that others have contributed to certain projects. From this she has been able to learn first-hand how to properly utilize data to have a greater impact on each project. One interesting fact about Kate is that she was part of two national champion crew teams, serving as the coxswain in both male and female championship races.
Natalie O'Dell, Team Member: Natalie joined the Hub in June 2020. Originally from Long Island, NY, she is a rising senior at The George Washington University where she is pursuing a BS in International Affairs and Geography with a concentration in Global Public Health and a minor in Geographic Information Systems. Natalie first became interested in OSM and humanitarian mapping while attending a Mapathon at GW when she was enrolled in an Intro to GIS course. Afterward, she became involved in the school’s YouthMappers chapter, the Humanitarian Mapping Society at GW (HMSGW) serving as the chapter’s Outreach Coordinator during her Junior year and the chapter’s President for her Senior year. As a member of the Hub and from her involvement with HMSGW, Natalie has gained valuable knowledge on how real-time and valid data can impact communities around the world. Natalie is interested in Public Health and Urban Planning so her time with YouthMappers has helped to teach and better inform her as to how open data and mapping can have valuable and important impacts on issues related to these two areas around the world. Outside of the Hub, Natalie loves making coffee and enjoys finding new music, she also has her own show as a part of the school’s radio station, WRGW. She also previously was a GIS Intern at Central Park and loves exploring different parks in cities around the world.
Benjamin Heidloff, Team Member: Ben joined the team in September 2020. Originally from Grayslake, Illinois, Ben is a senior at the George Washington University who is earning his B.S. in International Affairs with a concentration in Security Policy and a minor in Geographic Information Systems. Ben first discovered humanitarian mapping through his Intro to GIS course, where he participated in the Fall 2018 mapathon, helping chart roads in Afghanistan to aid a World Bank project. He is inspired by how much impact a small group of university students can generate through humanitarian mapping, and is excited to be working for the Validation Hub to further this impact! Outside of YouthMappers, Ben is a GW tour guide and plays the saxophone with the band.
Amy Mackinnon, Team Member: Amy joined the Validation Hub in September 2020. She is originally from Pennsylvania, but is currently in DC as a senior at The George Washington University pursuing a B.S in International affairs and Geography, with minors in Geographic Information Systems and German. Amy first learned about OpenStreetMap her sophomore year in an introductory GIS class and has been attending mapathons hosted by GW’s Humanitarian Mapping Society (HMS) ever since. She currently serves as its Vice President and enjoys attending events around DC and working with the global OSM community. Through HMS, she has become further interested in international development issues and understands the importance of working with open source data to solve important policy issues and provide humanitarian assistance. Knowledge of open source data and a background in humanitarian mapping proved to be helpful in finding other professional positions. Throughout internships dealing with GIS and data analysis, Amy has worked on various projects, with topics from analyzing urban design to mapping global internet prices. Her ideal job would be working with GIS and combining her overlapping interests of international development and human geography. She also hopes that her career will allow her to continue traveling and doing research around the world.
Richard Hinton, Hub Manager: Richard has been a part of YouthMappers since its inception and is a member of the steering committee as part of the George Washington University (GWU) team. He is also the associated faculty for GWU’s YouthMappers chapter, the Humanitarian Mapping Society at GW (HMSGW). During his regular job at GWU, he manages the Department of Geography’s Spatial Analysis Lab, teaches GIS classes, and assists students, faculty and researchers with their geospatial projects. Richard has been working in the geospatial industry for over twenty years and has long been interested in the application of open source technologies in humanitarian/disaster preparedness and response. In working with HMSGW and YouthMappers he enjoys helping students realize the potential of OS technologies in this sector.
We strive to inform and encourage students at YouthMappers to advance their mapping techniques and image interpretation abilities by learning to validate using advanced editing tools. This guide includes detailed instructions, workflows, and other tips and tricks on validating in JOSM.
Hub members focus on ensuring YouthMappers projects have the highest quality data. We believe one way to achieve this goal is for mappers to use the JOSM editor. Considering this, we created a step-by-step document to download and set up JOSM and included keyboard shortcuts to easily use JOSM.
To improve mapping conduct, we engineered a methodology that enables us to give live feedback to OSM contributors. Using an online tool called OSMCha, our procedure utilizes the application’s filtering capabilities to review the behavior of mappers as they add map data.
To streamline requests for tasks, we developed a project creation form where YouthMappers chapters can provide information needed to establish projects in HOT Tasking Manager. Our form requires information such as project description, location, instructions on mapping and tagging, and other necessary components.
Our tasking manager project creation instructions are intended for those who desire to create YouthMappers projects in HOT Tasking Manager. This document contains example project instructions, GIFs showing how to map features, and links to completed tasks that have excellent project descriptions and guidelines.
In order to make sure mappers generate data of the highest quality, our validators communicate with users in HOT to provide praise and corrective feedback on their work. To help those interested in validating, we have prepared a document of validation messages, exemplifying the proper ways for validators to engage with mappers. This resource highlights key responses to small and large corrections and recommendations to interact kindly with users. With this, we provide room for mappers to understand and fix their errors, and promote confidence and comfort to keep contributing to OSM in the future.
Additional Validation Resources available on the YouthMappers Resource Library