The Institute for Health Metrics and Evaluation (IHME) makes visualizations of global health data. Professionals using one of these visualizations, the LBD Tool, struggle to get value from the tool because they don't understand what goes into visualizations.
A streamlined path from the LBD Tool to a new page displaying the source data that makes up the visualizations, filterable by country and health indicatorVideo Summary (2 Minutes)
The Institute for Health Metrics and Evaluation (IHME) is a research center that measures health problems around the world and creates visualizations of global health data that policymakers can use to inform decisions and target treatment.
The Local Burden of Disease Tool helps users explore health trends at a very precise level (5-kilometer radius). It's a powerful interactive visualization, but it wasn't widely used by target users like global health organizations, directors at research foundations, students and policymakers. They wanted to increase uptake by better supporting global health workers at the Washington Global Health Alliance (WGHA) and the BMGF (Bill and Melinda Gates Foundation)
We zoomed out to focus on how potential users of this tool currently use health data. During each of 2 focus groups, we had participants recall specific experiences they had using global health data in their work. We asked them to map out these experiences step-by-step, and then discuss these experiences as a group.
We analyzed themes that came from these conversations, and used those to make Personas that captured 2 distinct types of users, and Journey Maps that helped us make sense of their process.
We visually grouped observations from our focus groups to get meaningful insights from hours of audio data.
As we grouped our findings (see visualizations below), we realized we were dealing with two types of people who each used data in different ways; we designated these use cases as data as process, and data as output.
We organized comments from the focus group in terms of where they fell in the process of using health data for some purpose. We were able to separated quotes and concepts into distinct stages.
Data as Process
"Where do I make an intervention?"
"I doubt the validity of this data, and [my client would have] questions about uncertainty interval"
Compare two countries or districts to see if there has been a change
Data as Output
"How can I tell stories about how things are changing?"
"Is the data a triangulation of sources?"
Talk with a Minister of Health about piecing together a new data system
"Think, Feel, Do" framework helped us unpack the underlying motivations behind the tangible worklflows they described
Understand what data the LBD visualizations are representing, so they can confidently use insights in a grant report, presentation, or
Use data from the LBD Tool as part of a broader research process, which includes validating data sources and using insights from visualizations to generate more research questions
Easily find and start using the LBD Tool on the IHME website
Communicate information learned from LBD visualizations to stakeholders around the globe, including NGOs, a range of nonprofit organizations, research foundations, and the general public
We brainstormed a list of 12 directions. We ideated within these directions, discussing how valuable it would be in addressing the needs of our personas (see Analysis). IHME also prioritized our list based on their own business concerns. It was clear to us that validating source data was a key step in each of our personas' workflows, fit well within the scope of our project, and was a key issue for IHME.
The local burden of disease landing page (leftmost box) could link directly to information about the source data. A filterable source data page would let global health workers find sources related to specific locations.
Make the "story" behind the data more clear by framing the visualization as a narrative and showing connections between health indicators
Support comparing two regions side-by-side
Help users see value in the tool and interpret data (e.g. giving example questions that could be answered with the tool, framing output to make conclusions more clear)
We set out to make source data behind the LBD Visualization more transparent. We knew we needed to provide the option to explore sources behind visualizations in a place where users would already be looking!
We individually created wireframes of the LBD landing page, a new "Source Data" page, and the map page. These helped us solidify the overall solution we wanted to propose to IHME.
In critique sessions, we discussed how well our designs addressed the needs of our personas. Iterating individually gave us a breadth of ideas to discuss in sections, so we could narrow in on the most effective elements of our wireframes and mockups.
To test our decisions, we had 5 global health professionals from various organizations/foundations use our interactive prototype within a task-based scenario (pulling use cases from our focus groups)
Potential Users of the LBD Tool wanted to know how source visualizations are created. We designed a workflow (shown below) that brought pathways to source information closer to the surface of the tool to make it more accessible and more transparent. We proposed changes that IHME could embed within their current Website.
A dynamic link from the 'Map Page' to a 'Source Data' Page populated with sources used to create estimates within a given country
Rationale - Each of our personas needed to be able to access the underlying data behind LBD visualizations; when they used the visualizations to recommend treatment plans to stakeholders like ministers of health, or to frame a problem in a grant or report, they always fielded questions about the validity of the visualizations. (E.g. "Does this visualization include our district's most recent survey?")
Participants wanted access to Source Data while exploring the map, but the Map Page was already pretty crowded with other functionality. We decided to design a new page designated to source data. This gave us more control over how we could display sources.
Rationale - All our participants jumped into the actual LBD Visualizations without looking for info about Source Data. As they explored the tool, they were concerned with source data associated with specific locations they were interested in (e.g. "we have a hospital there"). A link that updates with the state of the map gives users power to explore Source Data information at any point during their research process
Rationale - Users struggled to find the Local Burden of Disease Visualizations on the site and were confused about the relationship between the Tool and the Visualizations.
Rationale - Participants in usability testing said these were most critical. Provider indicates validity, and year of data collection tells them how relevant the data is for current work.
Rationale - Most participants in usability tests either said they were confused by a term or made an incorrect assumption about a term that effected their interpretation of the data (e.g. "I'll just exclude sources labeled "Neonatal" in my research since those aren't being used to visualize "Under-5 Mortality")
Our persona, Taylor, is using the LBD Tool as one step in a larger research process. She would be looking to dig deeper into the data sources so she could validate them on her own. She would want to link to the original source of the data. One Usability Study participant, a data scientist, was most interested in downloading raw datasets, which IHME makes available on the GHDx.
Since the potential user defined in our persona needs to communicate sources to a variety of stakeholders, an automatically generated citation for sources would streamline their workflow. Some participants told us that they have their own citation methods specific to their organization or report, but for more casual usage, this would help.
Working with a real organization is hard. Working with IHME, who is relatively new to applying a user-centered process, definitely helped me improve how I explain the value of defining your target user and how research informs design decisions.
The focus groups were not what we expected. We thought our participants had experience with Local Burden of Disease tool prior to the meeting. It turned out that almost none of them had experience with the tool. But this was okay; it helped us learn more about potential users who don't currently find the tool useful.
Also, it takes a surprising amount of time and energy to keep a client looped into your process! Keeping IHME updated on our progress was a project in and of itself, and we struggled with this in the initial stages. Luckily, our sponsor was able to gently nudge us when they wanted information, so we found a rhythm of keeping them updated about the most important information.