Turning market noise into structured design direction for automotive HMI
Project type
- B2B2C
- Automotive HMI
Team
- 1 Product Manager
- 1 UI/UX Designer
- 1 Engineer
- 2 UI/UX Design Interns
Role
UI/UX Design Intern
Timeline
July - Sept 2024
OVERVIEW
Project
What I Did
Result
MY RESEARCH & DESIGN PROCESS
- What is out there?
- How can structure evolve into experience?
- What do drivers/copilots really need?
Market Competitor Analysis
Understanding industry patterns & major paradigms
Driving Tests
Observing real-world behaviors and needs
PRD
Synthesizing findings into requirements
Wireframing
Structuring and testing flows
High-Fidelity Optimization
Delivering driver-centered solutions
PHASE #1: BENCHMARKING - UNDERSTANDING COMPETITORS’ SOLUTIONS
Looking outward: market design trends
To understand the current design space and gap, I analyzed 6 leading EV infotainment solutions from performance (i.e. colors, typography, icons, etc.), framework (i.e. layout), and structure (i.e. using flows upon hierarchy, scroll logic, app switching, etc.).
Layout
IM L6

Vertical card stack
- Top status bar
- Dock
- Main display: A/C, ADAS, apps, music
Customization
- Add, delete, & change position of cards
XPeng G6


Triple stack
- Top status bar
- Main display: Map / Body control via 3D model
- Dock
Split-screen display
- Swipe to adjust layout ratio (100% / 30%+70%)
AITO M7


Triple stack
- Top status bar
- Main display: Desktop background + horizontal function car stack
- Dock
Customization
- Add, delete, & change position of cards
Split-screen display (50%+50%)
Xiaomi SU7


Triple stack
- Top status bar
- Main display: 3-card stack
- Dock
Customization
- Add, delete, & change position of cards
Split-screen display
Jiyue 01
35.6” integrated display
- Instrument cluster
- Central control screen
- Top status bar
- SR / Body control
- Segmented Dock
- Front passenger entertainment
Coherent gesture control
- 3-finger swipe to move content across screen sections
Li L7


Triple stack
- Top status bar
- Main display: 3-card stack
- Dock: Driving-related features / In-cabin control
Split-screen display
HierarchyArrangement
IM L6
Depth
- Driving-related features: L0-L2
- Entertainment features: L0-L3
Spatial arrangement
- L0 display
L1 display - Top status bar and L1 menu: stay fixed
- L1 display
L2 display - L2 display: full screen
XPeng G6
Depth
- Driving-related features: L0-L3
- Entertainment features: L0-L3
Spatial arrangement
- L0
L1: Top bar + L1 menu fixed - L1
L2: Top bar + L1 + vertical L2 menu fixed - L2
L3: Top bar + L1 + L2 menus fixed
AITO M7
Depth
- Driving-related features: L0-L3
- Entertainment features: L0-L3
Spatial arrangement
- L0
L1: Top bar, L1 menu fixed - L1
L2: Top bar, L1, L2 menus fixed; apps = full screen - L2
L3: Top bar, menus fixed - ADAS: display = pop-up
- Apps: display = full screen
Xiaomi SU7
Depth
- Driving-related features: L0-L4
- Entertainment features: L0-L2
Spatial arrangement
- L0
L1: Top bar, L1 menu fixed; some core L1 embedded in L0 - Apps: translucent blur bg
Jiyue 01
Depth
- Driving-related features: L0-L2
- Entertainment features: L0-L5
Spatial arrangement
- L0
L1: Top bar, L1 menu fixed - L1
L2: Top bar, L1/2 menus fixed - L2
L3: Lounge: Full screen; Other apps: Top bar, L1 fixed; full in other screens - L4–L5: Lounge full screen
Li L7
Depth
- Driving-related features: L0-L3
- Entertainment features: L0-L3
Spatial arrangement
- L0
L1/L2: Top bar + Dock fixed - Main section
specific app
Scroll Logic
IM L6
Gesture direction
- Vertical scrolling
Edge feedback
- Rubber banding
Swipe
- Single-finger swipe
XPeng G6
Gesture direction
- Horizontal scrolling
Swipe
- Single-finger swipe
- 3-finger swipe
swaps panel positions
AITO M7
Gesture direction
- Vertical scrolling
Edge feedback
- Rubber banding
Swipe
- Single-finger swipe
- 3-finger swipe/ 1-finger click the control bar in the middle of split-screen
swaps screen positions
Xiaomi SU7
Gesture direction
- Horizontal & Vertical scrolling
Edge feedback
- Rubber banding
Swipe
- 1-finger drag divider bar (horizontal)
Adjust card ratio - 1-finger tap overflow icon (top-center of card)
Full screen - 1-finger long press + drag overflow icon
Reorder cards
Jiyue 01
Gesture direction
- Mainly vertical scrolling
Swipe
- 3-finger swipe
Rearrange layout areas - e.g., Swipe media left from central screen
move to passenger entertainment screen
- e.g., Swipe media left from central screen
Li L7
Gesture direction
- Horizontal & Vertical scrolling
Swipe
1-finger
- Long press + drag
Reposition - Horizontal swipe
Scroll between cards - Tap/drag card
Swap cards
3-finger
- Downward swipe
Return to home screen
App Switching
IM L6
- Dock access
- Apps access
- Core cards access
- Safety-focused feedback
XPeng G6
- Dock access
- Apps access
- Safety-focused feedback
AITO M7
- Dock + widgets access
- Apps access
- Safety-focused feedback
Xiaomi SU7
- Dock + card dual access
- Smart contextual suggestion
- Efficiency-focused
Jiyue 01
- Dock access
- Apps access
- Smart contextual suggestion
- Efficiency-and-safety-focused
Li L7
- Dock + card dual access
- Smart contextual suggestion
- Efficiency-focused
Space-integrated

Personalization
Intelligence
Immersion
Strengths
Strong immersive experience
Multi-screen linkage with expansive visual flow
Scenario-based customization
Weaknesses
Risk of information overload
Longer interaction paths, higher misoperation risk
Complex gestures with higher learning cost
Scenario-based

Customization
ContextAwareness
Strengths
Card-based layout with flexible arrangement
Dual entry (dock + cards) for efficient access
Strong adaptability across driving contexts
Weaknesses
Higher information density
Gesture-based interactions may cause distraction
Inconsistent rules can lead to confusion
Mobile-like

Familiarity
Stability
DigitalEcosystem
Strengths
Card-based layout with flexible arrangement
Dual entry (dock + cards) for efficient access
Strong adaptability across driving contexts
Weaknesses
Higher information density
Gesture-based interactions may cause distraction
Inconsistent rules can lead to confusion
PHASE #1: BENCHMARKING - DRIVING TESTS
Stepping beyond desk research into real contexts
To see how these paradigms perform in actual driving situations, our team conducted 4 tests per paradigm in both city and highway scenarios, focusing on drivers’ experiences with information access, navigation, gestures, and app switching.
I designed the test protocol end to end.
- a screening survey to recruit participants
- routes covering city and highway
- observation on how drivers interact with each system
- interview guide
- 5 one-on-one interviews (to capture reactions without group influence)
- a focus group with the other 3 participants (to see how drivers inspire and challenge each other)



PHASE #1: BENCHMARKING - INSIGHTS
Clarity and predictability build confidence
User efficiency and confidence are closely tied to clear visual hierarchy, consistent interaction patterns, and easy access for key tasks.
Context changes what matters
Drivers’ needs are not fixed. Charging status, communication, route changes, etc. bring different functions to the front.
Both driver and passenger want more entertainment
With automation handling more of driving, both driver and passenger expect the cabin to offer more entertainment and comfort.
Card-based layout for clarity & simplicity

Context-aware suggestions for predictability

Integrated screen for balanced safety & fun

PHASE #1: BENCHMARKING - PRODUCT REQUIREMENTS
Making the findings actionable
I mapped insights to the requirements it implies, then to concrete features — so every feature traces back to something we saw on the road.
User Needs
Product Requirements
Detailed Features
Integrated driving assistance for driving efficiency and safety
- 4032×756 Resolution
- Central-to-passenger display
- Primary cockpit information/functions on driver’s side and secondary controls on passenger’s side
Access to key driving related information and functions with minimal cognitive load
- Vehicle body controls in high visibility area
- Key driving information (i.e. battery, ADAS status, simplified navigation, etc) widgets in high visibility area
- Key driving functions (i.e. map, media, etc.) cards in medium visibility area
- Vertical Dock in leftmost area with highest clickability
- Cards with secondary information in area with medium clickability
- Highly readable and understandable linear icons
- ADAS icons that align with industrial standards
- Customization of card orders via single-finger pressing and dragging
- Editable widget and card content
Effortless orientation without distraction or misoperations
- Core function reachable within 1-3 steps
- Flat, single-layer displays with reasonable chunking
- Same pop-up, page-closing effects, etc. across modules
- Predictable “back” behavior: always return to last screen in the same hierarchy level
- Large tap targets for driving context
- “One-step back to home” button
- “Undo” button for key driving-related actions
Consistent and intuitive ways of interactions across functions
- Mobile-like gestures that users are familiar with
- Gesture guide accessible in vehicle infotainment system user manual in settings
- “Snap-to-grid” animated transitions when dragging cards
- Cards shrinking when selected to rearrange positions
- Single-finger tap
primary actions such as open apps, play/pause, toggle functions, etc - Long press and drag
rearrange card on home screen - Long press (Dock icon)
enter edit mode to call out “delete” button - Downward edge swipe
call out quick setting panel
Efficient switching between high-frequency functions
- Customizable function icon placement in the driver-side Dock for quick access
- Compact mini widgets for global accessibility such as navigation panel showing next turn and ETA
- Movable floating windows
- Highway detected
prioritize navigation card on home screen - Quick pop-up with answer/ignore
- Low battery level
one-tap shortcut to nearby charging station
PHASE #2: EARLY DESIGN CONCEPT
From requirements to a working concept
My internship ended after the benchmarking phase. I kept going on my own to see how my findings could lead to something concrete.
Access to key driving related information and functions with minimal cognitive load

Optimal touch access to driver’s Dock
Tap vertically arranged Dock icons placed in the most accessible zone, evenly spaced for easy reach.
Self-explanatory visuals and icons
Understand visuals that are intuitive and align with industry standards.
Card-style layout of information
View information and functions in modular units with quick recognition on the road.
Display based on usage patterns
Customize horizontal card flow and card based on personal preference.
Lower the risk of mis-taps with segmented Dock that isolate each touch zone.
Effortless orientation without distraction or misoperations

Access detailed body control options.
Instantly see the result of your action.

Shallow, modular information architecture
- Control core driving-related settings within 1-3 steps (i.e. Settings
Driver Assistance specific control) - See secondary menu, corresponding secondary display, and tertiary menu displayed with clear hierarchy.
Error prevention and shortcuts
Locate and tap large-surface buttons for easy adjustment while driving.

Shallow, modular information architecture
Access apps with reasonable chunking, including apps used most frequently, driving related systems, and media.
Consistent transition patterns
Consistent display pattern with other secondary screens such as Settings
Consistent and intuitive ways of interactions across functions



Instant feedback on users’ actions
- When an user tries to customize the card flow by pressing a card, the card shrinks to show that it is selected.
- A blue notification banner written “Navigation Card Selected” also shows that the user’s action is active.
- When the user starts to drag the card while pressing, the “snap-to-grid” animated transition appears.
1Customize Card Flow

2Customize Card Content

Low learning curve with in-context assistance
- To change card content, the user taps the overflow menu and selects “Customize Card” to open the customization menu.
- They can add or remove cards with ‘+’/‘–’ and use the standard press-and-drag gesture to adjust positions.
Consistent pop-up patterns.
3Customize Dock Access


Standard, minimal gesture set
- After the user 1-finger tap “+” icon, available function window pops up.
- With clear categorization, users can simply tap a function with one finger to add it to the Dock.


Efficient switching between high-frequency functions

Context-aware smart recommendations
- When the system detects low battery during driving, it automatically prompts the user to add a charging stop along the current route.
- The user can decide whether to find a charging station or dismiss the suggestion.
Easily learn about current battery level, specific percentage, and quick-access options to solve the issue.

Review and confirm the suggested charging station with one tap. Distance, availability, and price are shown for more efficient decision.
Instantly view all charging stations along the entire route.

Check estimated arrival time, remaining range, and battery level upon arrival.
View the updated route along with real-time traffic conditions.

Context-aware smart recommendations
- When there is an incoming call, the user can quickly respond with clear options to answer or decline, without leaving the main driving interface. This minimizes distraction while driving and following the route.

Call status
Mute
End call anytime

Customize Dock icon placement for efficient switching.
After declining a call, the user can choose to send an auto-reply message or set a reminder to call back after parking.
REFLECTION
Be aware of my biases when I can be one of the users
Being a driver myself helps me understand what users are trying to say, but it can also be a blind spot that makes me gravitate towards what I already believed. So before analyzing our interview data, I defined a coding structure to strengthen objectivity.
Coding Structure
Layer 1 - type of statement
Strongest evidence
Weakest evidence
- Observed behaviorswhat they actually did
- Reported behaviorswhat they say they do
- Facts & constraintsverifiable conditions
- Evaluationspositive/negative feedback
- Requeststheir solutions, not their problems
Layer 2 - functional domain
- Navigation
- Media
- Calls
- Entertainment
- Advanced driver-assistance systems
- Charging
If I had more time for testing the design concept...
Discoverability & reachtask-based testing
Self-reported ease doesn’t show where people looked or how long they searched. I need to observe the search itself.
Learnability & recoverycold-start sessions
A first encounter happens once. Explain the system and that person can no longer tell you what they'd try on their own.
Timing & attention costsimulator runs
A prompt can be useful and still disruptive at the wrong moment. That cost only appears in a driving context.