YouthMappers Validation Hub
What is the YouthMappers Validation Hub?
The YouthMappers Validation Hub is a group of experienced student mappers whose purpose is to ensure a high standard of data quality in the collaborative mapping platform OpenStreetMap (OSM). Formed in May 2019, the Validation Hub was organized and implemented by faculty and students at The George Washington University in Washington, D.C. Our primary focus is to validate the work of OSM contributors and guarantee that all YouthMappers projects have the highest quality data. We are also interested in the behavior of new and current mappers and understand that the only way to enhance contributions is to improve the technique, habits, and conduct of mappers:
Technique - Are mappers properly outlining buildings and roads, adjusting the imagery to match the map geometry, tagging features using update-to-date labels, etc.?
Habits - Do mappers consistently map and tag all identifiable features, leave feedback about their edits, make edits without deleting the work of others, etc.?
Conduct - Are mappers respecting official OSM rules and regulations, leaving appropriate changeset comments, averting vandalising map data, etc.?
Overall, YouthMappers Hub members, commonly referred to as Hub, strive to strengthen the confidence and talents of mappers, the OSM community and volunteers from YouthMapper chapters around the globe. With our efforts, we don’t plan on building just maps or mappers, we also build validators.
From YouthMapper’s 3rd Quarterly Newsletter: GWU Geography launches the YouthMappers Validation Hub!
In June 2019, a small cohort of validators began reviewing projects and edits made by YouthMappers on OpenStreetMap (OSM). The primary focus of the validation hub is to retroactively validate mapping activities and create a strategic workflow for monitoring #YouthMappers tasks moving forward. Through this effort, we aim to ensure that data produced by our chapters IS of high quality.
What, Where, and Why Do We Validate?
Hub members access OSM data through Humanitarian OpenStreetMap Team’s (HOT) Tasking Manager, a tool that divides mapping projects into smaller tasks so multiple contributors can map and validate areas simultaneously. Projects in the HOT Tasking Manager indicate which areas are: ready to map, mapped, and validated. HOT’s system is designed to provide updated map data in the event of a disaster and/or humanitarian emergency scenario, measure project completion and user contributions, and improve the consistency of mapping (e.g. entities to map, proper feature tagging, etc.).
The YouthMappers Validation Hub executes the validation step in HOT’s Tasking Manager workflow. Hub members review the areas mapped by users, making sure that they trace and tag all map features required in the project instructions. When users do not follow the guidelines, our validators mark the area as ‘invalidated’, tag the user, and leave instructional friendly feedback in the comments section. The premise of this action is to encourage mappers to return to the task, fix their mapping oversights, and feel empowered to contribute to OSM in the future.
When validating, our team look for three main things:
Spatial accuracy - are features in the correct place, are there overlapping buildings, are the corners of the buildings square, etc.?
Tagging accuracy - are features tagged appropriately?
Completeness - are all the features mapped as described in the HOT Tasking Manager project instructions?
Our validators pay close attention to these common mapping mistakes. To make sure YouthMappers edits adhere to OSM’s established guidelines on tracing and tagging, Hub members use a special software called Java OpenStreetMap (JOSM).
Blog Post: Happy #ValidationFriday From the YouthMappers Validation Hub!
On October 25th, 2019, the Validation Hub hosted a validation party on The George Washington University’s campus. In honor of MissingMap’s #ValidationFriday, a reminder to validators to contribute to the data control and quality assurance of OSM data, the Hub gathered together to teach students and professionals on validation procedures using JOSM.
The Validation Process Using JOSM
Hub members prefer to validate using the advanced editing software JOSM. JOSM streamlines the geometry and tagging functions included in iD editor, coupled with built-in validation tools that automatically identify errors overlooked by the validator. However, these software tools alone are not the answer to validation. These tools need to be used by trained individuals who will assess the quality of the contributions made to OSM projects. Mappers that wish to become validators must have experience with tracing and tagging complex features in OSM, outstanding image interpretation skills, a positive attitude and manner towards other users, and a willingness to learn new software.
If you possess an interest in learning to validate, please take a glance at our training document on validating using JOSM. JOSM is an open-source application that anyone can download and use without any cost. To download and read more about the software, click here.
Validation Training Sessions
We believe that training with experienced validators, whether online or in-person, is essential to becoming a better mapper. Complementary to our instructional text and walk-throughs, we host validation training sessions to reinforce OSM’s code of conduct and work one-on-one with individuals to download, navigate, and validate using JOSM. This way, YouthMappers members with different levels of experience and interests can interact, learn from and help one another, and ask Hub members for assistance or questions.
Interactive / Active Validation Using HOT Tasking Manager and OpenStreetMap Changeset Analyser (OSMCha)
One of the goals of the Hub is to actively examine map edits, and correct errors and contact mappers if needed. This process, referred to as interactive/active validation, is applied to on-going projects. Our methodology is based on research which demonstrates that giving real-time feedback, both positive and corrective, yields higher quality edits and mappers. We perform interactive validation using either OSMCha or HOT Tasking Manager.
OSMCha is an online tool with visual and analysis functions that support the standardization of OSM edits. As previously stated, HOT Tasking Manager is a tool that divides mapping projects into smaller tasks so multiple contributors can map and validate areas simultaneously. Whereas projects in HOT Tasking Manager pre-define the mapping region, OSMCha has the advantage of filtering options which enables individuals to refine changesets based on tags and attributes. The Hub has developed a walkthrough using OSMCha to review data by date range, location, and OSM username. You can follow our documentation here.
Mapping Project Creation Form
Have an area that needs to be mapped? Let us help! Typically, projects in HOT Tasking Manager focus on vulnerable regions that lack spatial data. At-risk areas include communities prone to natural disasters, armed conflict and displaced persons, insufficient food and water supply, inequitable distribution of modern medicine, education, and/or infrastructure, etc. If your idea is similar to the above examples, you can submit a project proposal using our form here. This questionnaire requires information such as the name and description of the project, instructions on objects to map and specific tags, bounding geometry for the area of interest, and other components necessary for project creation. In addition, we provide an instructional cheat sheet that gives written and visual examples on how to map different kinds of features (e.g. buildings, roads, waterways, etc.).
What Tasks Have We Completed?
Our team has completed validating several YouthMappers-projects since May 2019. Our goal is to finalize tasks new and old to make certain that all data associated with YouthMappers is of excellent caliber and useful to the project creator and benefactors, and OSM users. Due to the size of projects, the complexity of map features and the quality of mapping by contributors, it takes varying amounts of time for our members to validate a project in the HOT Tasking Manager. Some tasks, such as #2742, required several months to complete due to its sheer scope. Others, like #990, necessitated less than a month because there were less features to map in the area.
HOT Tasking Manager’s recent website redesign features a new graphic located on individual project pages labeled the ‘Contributions Timeline,’ which contrasts the amount of time to map tasks versus the amount of time to validate tasks. This graphic is supplementary to HOT Tasking Manager’s other maps and interactive displays, helping users to understand the completion rate of projects.
Attendees of the Hub’s #ValidationFriday event posing with The George Washington University Geography alien mascot, Geoid.
This graphic belongs to HOT Project #2742: PEPFAR KENYA: SIAYA (BONDO), a task validated by the Hub. This project was completely mapped from April 2017 to January 2019, and validated between April 2019 to December 2019.
The Hub is made up of a group of experienced OSM student mappers and faculty from the George Washington University in Washington, D.C.
Kate O'Byrne, Team Member: Kate joined the team in June 2020. Originally from New Rochelle, New York, Kate is a rising senior at George Washington University, who will graduate in the spring with her B.A. in Environmental Studies and minors in Sustainability and Geographic Information Systems. The interest in GIS came from the introductory course that Kate took during her sophomore year. In that class she learned just how powerful and effective mapping can be towards making real changes around the world. The ability to provide humanitarian support to people across the globe really inspired Kate to pursue a future in mapping and GIS. To get her foot in the door of all things mapping, Kate has attended mapathons which demonstrated the strong community that OSM has. As a member of the Hub team Kate validates data that others have contributed to certain projects. From this she has been able to learn first-hand how to properly utilize data to have a greater impact on each project. One interesting fact about Kate is that she was part of two national champion crew teams, serving as the coxswain in both male and female championship races.
Natalie O'Dell, Team Member:Natalie joined the Hub in June 2020. Originally from Long Island, NY, she is a rising senior at The George Washington University where she is pursuing a BS in International Affairs and Geography with a concentration in Global Public Health and a minor in Geographic Information Systems. Natalie first became interested in OSM and humanitarian mapping while attending a Mapathon at GW when she was enrolled in an Intro to GIS course. Afterward, she became involved in the school’s YouthMappers chapter, the Humanitarian Mapping Society at GW (HMSGW) serving as the chapter’s Outreach Coordinator during her Junior year and the chapter’s President for her Senior year. As a member of the Hub and from her involvement with HMSGW, Natalie has gained valuable knowledge on how real-time and valid data can impact communities around the world. Natalie is interested in Public Health and Urban Planning so her time with YouthMappers has helped to teach and better inform her as to how open data and mapping can have valuable and important impacts on issues related to these two areas around the world. Outside of the Hub, Natalie loves making coffee and enjoys finding new music, she also has her own show as a part of the school’s radio station, WRGW. She also previously was a GIS Intern at Central Park and loves exploring different parks in cities around the world.
Chris Harden, Team Member: Chris joined the Hub in May 2019. Currently, he is a recent graduate at the George Washington University (GWU) in Washington D.C. but he originally hails from St. Louis, Missouri. Chris first discovered humanitarian mapping through a friend who lured him to a mapathon hosted by GWU’s Humanitarian Mapping Society, promising him there would be free pizza. Once there, he discovered a passion for mapping in OSM and later decided to take a course on Geographic Information Systems (GIS) which furthered his exposure to humanitarian mapping. At GWU, Chris studied International Affairs where he developed an interest in the overlap between his major and human geography. He also has experience interning for organizations that perform public policy research, consulting and journalism. Through these opportunities, he has observed the persistent need for map data around the globe. A fun fact about Chris is that he speaks both Spanish and Portuguese, and he has lived abroad in Lima, Peru and Rio de Janeiro, Brazil on semester exchange programs.
Ryan Kleissler, Team Member: Ryan joined the team in September of 2019 as a Senior at the George Washington University (GWU) in Washington DC. He graduated in May of 2020 with a bachelor's degree in International Affairs concentrating in Security Policy and minoring in GIS. Ryan first encountered YouthMappers through the Humanitarian Mapping Society at GW, of which he served as Vice President and Training Coordinator. His background in computer science and coding attracted him to the technical and software development side of GIS which he pursued by taking python and satellite courses at GW. He hopes to pursue a career bringing both his interest in international security and GIS together. With the Validation Hub, Ryan works within the geospatial community to ensure the highest quality data available and coordinate between producers and consumers to effectively understand and use geographic data. Outside of YouthMappers, he works as a GIS and risk analyst helping companies and individuals incorporate geographic analysis, satellite image processing, and cartographic representation in their work.
Lucy Meyer, Team Member: Lucy became part of the team when it was founded in May of 2019. Born and raised in the suburbs of northern New Jersey, she adapted to city life while pursuing a degree at The George Washington University in Washington D.C. She graduated in December 2019 with a B.A. in Geography and Environmental Studies and minor in GIS. Lucy first encountered her passion for humanitarian mapping while interning at SkyTruth, an environmental non-profit that utilizes open-source data and GIS software to analyze anthropogenic threats to the environment and public health. At YouthMappers Validation Hub, Lucy has gained insight to the impact that accessible, real-time imagery and network data has on communities around the globe. Intending to hone her geospatial and remote sensing capabilities, she is driven to increase the accessibility and inclusivity to technology and map data, believing that the distribution of knowledge has the power to make people more equal, educated, healthy, and successful. As a member of the Validation Hub, she reviews and standardizes OSM edits, coordinates with members of the YouthMappers community, and produces training materials and content for the organization’s website. Outside of the Validation Hub, she enjoys sketching, watching anime, and cooking with her friends.
Richard Hinton, Hub Manager: Richard has been a part of YouthMappers since its inception and is a member of the steering committee as part of the George Washington University (GWU) team. He is also the associated faculty for GWU’s YouthMappers chapter, the Humanitarian Mapping Society at GW (HMSGW). During his regular job at GWU, he manages the Department of Geography’s Spatial Analysis Lab, teaches GIS classes, and assists students, faculty and researchers with their geospatial projects. Richard has been working in the geospatial industry for over twenty years and has long been interested in the application of open source technologies in humanitarian/disaster preparedness and response. In working with HMSGW and YouthMappers he enjoys helping students realize the potential of OS technologies in this sector.
We strive to inform and encourage students at YouthMappers to advance their mapping techniques and image interpretation abilities by learning to validate using advanced editing tools. This guide includes detailed instructions, workflows, and other tips and tricks on validating in JOSM.
Hub members focus on ensuring YouthMappers projects have the highest quality data. We believe one way to achieve this goal is for mappers to use the JOSM editor. Considering this, we created a step-by-step document to download and set up JOSM and included keyboard shortcuts to easily use JOSM.
To improve mapping conduct, we engineered a methodology that enables us to give live feedback to OSM contributors. Using an online tool called OSMCha, our procedure utilizes the application’s filtering capabilities to review the behavior of mappers as they add map data.
To streamline requests for tasks, we developed a project creation form where YouthMappers chapters can provide information needed to establish projects in HOT Tasking Manager. Our form requires information such as project description, location, instructions on mapping and tagging, and other necessary components.
Our tasking manager project creation instructions are intended for those who desire to create YouthMappers projects in HOT Tasking Manager. This document contains example project instructions, GIFs showing how to map features, and links to completed tasks that have excellent project descriptions and guidelines.
In order to make sure mappers generate data of the highest quality, our validators communicate with users in HOT to provide praise and corrective feedback on their work. To help those interested in validating, we have prepared a document of validation messages, exemplifying the proper ways for validators to engage with mappers. This resource highlights key responses to small and large corrections and recommendations to interact kindly with users. With this, we provide room for mappers to understand and fix their errors, and promote confidence and comfort to keep contributing to OSM in the future.
Additional Validation Resources available on the YouthMappers Resource Library