Rocket Pro Navigate: Conducting Rapid Research to Uncover AI Use Cases for Mortgage Brokers
Rocket Mortgage | UX Research Intern
May 2025 - August 2025 • 8 week timeline • UX Researcher
Problem
Mortgage brokers use LLMs inconsistently and often outside Rocket’s ecosystem. Rocket needed to understand how brokers currently use AI tools, and whether a Rocket-branded LLM could genuinely assist their workflows.
Goal
Test a working prototype with brokers to learn if and how they would adopt a Rocket-built LLM, what tasks they would trust it with, and what improvements were needed before wider rollout.
Tools:
Figma
dScout
Azure DevOps
Methods:
User Interviews
Surveys
Diary Study
Lean Agile
Project Impact
Insights informed the broader strategy for chat-based AI tools, challenging how the team delineates tools with similar users and goals
Pro Navigate is a first-of-its-kind LLM meant to assist mortgage brokers in their workflows by being trained on the processes and software they engage with everyday
Flexible research shortened release timeline by adapting to changing requirements from legal and information security, ensuring the capture of user insights
Lead to the development of 2 more targeted apps in Pro Navigate following user interviews about the product’s utility
Research Deep Dive
Background
Rocket Pro Navigate was a fast, scrappy product pilot developed over 12 weeks. The idea of building an LLM to assist in mortgage broker workflows surfaced in week 3, I joined the project in week 4, and by week 8 we had a working experience ready for user testing.
The idea for Pro Navigate was introduced during a team meeting by the product manager as a potential pilot.
Joined the project after a coffee chat and began helping shape research direction, eventually leading research
Launched an MVP experience to validate broker interest. I conducted follow-up interviews to gather insights.
The core question was, if provided a Rocket-branded LLM to enhance mortgage brokers' workflows, would they use it and how? As the product rapidly evolved, research, design, and development shifted in parallel, making this an exercise in lean product management under real constraints. When the lead researcher went on PTO mid-project, I stepped in as the research point of contact, taking ownership of study planning, pivots, and stakeholder alignment to keep the pilot moving forward.
User Research Process and Plan
Research for Pro Navigate did not follow a textbook UX flow. We began with an evaluative mindset, largely because the product was mostly already built; it just needed tweaks to become external-facing and targeted towards mortgage brokers. We adapted our methods mid-project due to legal and security constraints, and shared insights continuously across teams to support rapid decision-making.
Evaluative First
Started with an existing product that needed tweaks before testing, minimizing early research, design, and development timelines
Mid-Project Pivot
Original diary study rapidly shifted to post-use interviews with a smaller testing sample due to legal and infosec limitations
Always-on Research
Research insights were shared live and during cross-functional meetings regularly to efficiently guide product decisions
Research Questions
Because this project was such a great collaborative effort between the product manager, engineering team, design team, and research team, it took multiple meetings to define the roadmap and kick off the project. We knew the research needed to be both rapid and informative. As discussions continued, we realized that we were running into the same questions that eventually became our research questions:
1.
Would mortgage brokers use a Rocket-branded LLM trained to assist them in their daily workflows?
2.
What would mortgage brokers do with an LLM specifically designed to assist them?
3.
After using Pro Navigate, what do mortgage brokers wish it could do for them?
Soon, our meeting discussions went from the team discussing what Pro Navigate would be, to all of the things Pro Navigate needed to do, to the team deciding on a baseline functionality. This allowed us as researchers to jump on the opportunity to get real user insights as soon as possible with an MVP and then begin making informed decisions for iterations, rather than blindly building on a product that still needs validation.
Evolving the Research Approach
Legal and Infosec constraints required us to pivot away from our initial research plan: a diary study with ideally 30 participants, recruited by sales and from our broker panel. For now, we could have no more than 5 to prevent issues with intellectual property or data breaches. These users would also be from firms we had an established research relationship with.
Click to enlarge image
We simplified the approach to follow-up interviews after participants were granted access to Pro Navigate for a week and encouraged to integrate it into their workflows. Since this project was operating on a tight timeline, we could not afford the participant drop-off often associated with non-incentivized diary studies, nor the added legal and security exposure.This approach shortened the timeline and increased the likelihood of collecting usable data, even if it meant sacrificing some depth.
AI Experience Survey Sample Questions
As research participants were onboarded, we asked them to complete a survey to establish their background with AI. The survey was not anonymous, allowing us to connect responses directly to interview data. This helped us understand how varying levels of AI experience and sentiment might influence adoption of a new AI tool. If both frequent AI users and expected AI detractors reported negative experiences, it would signal a need to revisit the product’s foundational assumptions.
For about how long have you been using AI tools?
What AI tools have you used before?
Have you paid for a subscription to any of these tools?
On a scale from 1 - 5, where 1 = very negative and 5 = very positive, how would you rate your overall experience using AI tools?
1 Week Follow-up Interview Sample Questions
After participants had a week of access to Pro Navigate, we met with them to gather their impressions of the tool. We intentionally provided no guidance, allowing us to observe whether and how they chose to engage with it on their own. This helped us identify gaps in the experience, assess performance, and understand whether the tool fit into their existing workflows at all.
What was your workload like this week? Was it typical, busier than usual, or slower?
How would you describe your overall experience using Pro Navigate?
How did you learn to use Pro Navigate during the week?
What specific tasks or questions did you use Pro Navigate for this week?
User Research Results
Study Participation Totals:
Survey Results
Interview Findings
At this point, we had to rely solely on the data gathered from the study's participants. We now knew that, regarding this particular study, the three survey respondents had at least some AI experience, mostly with ChatGPT. We also knew they had neutral sentiments about AI, with some concerns for accuracy and accountability.
After 1 week of having access to Rocket Pro Navigate, we received the following major insights from 4 users we were able to schedule interviews with.
3 out of 4
Felt this tool would be best suited for newer mortgage brokers
This was largely because it could help answer questions about guidelines, craft emails, and assist with cold calling, not so much with specific time-intensive tasks.
4 out of 4
Recommended more specific use cases for the average mortgage broker
Identifying paths forward for Navigator was a major goal of this research. By gathering commonalities in the suggestions, we could iterate for the next round of testing.
2 out of 4
Reported response inaccuracies, another reported privacy concerns
This revealed to us that we needed to refine the knowledge base. We also realized we needed clearer data storage info and settings for companies to control.
Recommendations
Recommendation 1: Increase Upfront Utility Through Custom Apps
Research revealed that users had varying levels of trust and patience with AI. LLM-based tools require effort. Users must prompt, review, and refine, and if unsure of a tool’s capabilities or reliability, they may abandon it.
While suggested prompts and a small set of apps helped orient users, findings highlighted the value of custom apps designed for clear, targeted tasks that deliver immediate utility. Examples surfaced by users included lead scanning and cross-client note tracking.
Recommendation 2: Define Automation Goals as We Expand AI-Powered Experiences
One of our next steps should be defining what automation should accomplish for Rocket Pro users. By anchoring AI efforts to brokers’ real pain points, teams can explore building differentiated, task-focused AI experiences. These capabilities could be surfaced through tools like Pro Navigate or Assist, using chat as an entry point rather than the end experience.
LLMs are already the most familiar AI tool for many brokers, making them a strong starting point. However, by leveraging the extensive data we already have on broker workflows and pain points, we can move beyond what users know to ask for and deliver solutions that meaningfully reduce effort.
Recommendation 3: Evaluate Unifying Rocket Pro’s Chat Experiences
While Rocket Pro Navigate and Rocket Pro Assist serve different purposes, user feedback on what to add to Navigate closely mirrored what we had previously heard for Assist. Because the two experiences are nearly identical in both interface and content, we identified a risk that users would struggle to understand when to use each tool, largely because we as a team struggled to consistently define the difference. With the user experiences being so similar, we worried users would carry negative perceptions from one product into the other.
This raised the question of whether unifying chat experiences across the Rocket Pro ecosystem could reduce confusion.
