Evaluative Research

We used a variety of research and ideation techniques to further narrow and validate our problem scope.

Down Arrow

Validating user needs

We created a variety of storyboards that were used to conduct speed-dating testing to validate our user needs.

Knowledge access


Knwowledge Access Storyboard

Context-aware tools


Context-aware tools Storyboard

Configuration management


Configuration management Storyboard

Prioritization alignment


Prioritization alignment Storyboard

Based on our speed-dating exercises, we narrowed down to the top 2 ideas tha participants identified as more salient and impactful issues:

1. Prioritization Alignment

How can we better align different engineers' priorities and missions? Currently, Level 3 engineers refine their work to a level that can cause delays, frustrating Level 2 engineers who manage higher level processes.

2. Configuration Management

Closing the loop: how can we improve the CM process so it is easier to track and follow a change as it is proposed, sent, received, acted upon, and ultimately resolved. This is currently a very manual process, which leads to gaps and detials slipping through the cracks.

After evaluating our remaining ideas to consider what resources our team would realistically have easy access to for later user testing, we were able to pinpoint our final project focus: Prioritization Alignment.

Ideation and Further Narrowing

To encourage further divergent thinking, we conducted a creative matrix ideation exercise. This exercise allowed us to explore possible solutions to our design opportunities across a variety of platforms.

Creative Matrix

This exercise enabled us to further identify narrowed design opportunities within the overall problem area of prioritization alignment.

Proactively align assumptions

Different teams' incompatible design approaches often aren't discovered until milestone reviews. Incompatible platforms prevent intergration and force completed work to be redone.

Enhance data consolidation

Data consolidation takes immense time and effort, given that data is spread throughout teams. This makes it difficult to communicate the story of design decisions and justifications to other discipline teams.

Calibrate Priorities across levels

When interdependent teams’ priorities are not aligned, seemingly small schedule delays can create a chain impact that cause overall larger delays.

From here, we created 3 measures of criteria for further narrowing:

  1. Is this focus a rich opportunity that can be best solved through user-centered design?
  2. Will this have a strong, positive impact on improving work processes?
  3. Is this an actionable opportunity?

With these criteria in mind, we unanimously decided to move forward with the following refined focus: How can we ensure design assumptions are shared between teams leading up to milestone reviews?

We further validated this focus by conducting follow-up interviews with questions that focused on milestone reviews to best understand the specific processes and challenges associated with these events.

Quote Level 2 Safety Engineer
Quote Level 2 Systems Engineer
GENERATIVE RESEARCH
Medium Logo