Industrial HMI / Autonomous Mining

Autonomous Mining Fleet Operations System

A tablet-based system for dispatching autonomous vehicles, monitoring operations, handling exceptions, and completing equipment inspections in an active mining environment.

Role
Sole UI/UX Designer
Timeline
April to July 2024
Team
8-person cross-functional team
Delivery
Deployed and put into use
Tablet home interface for the autonomous mining fleet operations system

One interface for fleet operations in the field

The product brought fleet dispatch, individual vehicle control, alerts, and equipment inspection into a tablet interface used by dispatch and safety personnel.

Context

The internal product and engineering team built the system for the company’s own autonomous mining operations. The interface had to work with real vehicles, live operational data, and established field workflows.

Challenge

Core functions were fragmented, operational feedback lacked a clear visual structure, and the previous interface had not been designed for the target tablet or bright field conditions.

My ownership

I joined field visits, contributed to requirements synthesis, designed most prototypes, completed all high-fidelity UI and 3D assets, validated the work on the target tablet, and supported engineering delivery.

Field Research

I visited the operating environment with the product manager and spoke with people involved in dispatch, safety checks, inspection, and remote takeover. We translated what we learned into interface tasks that could be reviewed with the wider team.

01

Find critical information quickly

Operational status, vehicle selection, and task feedback needed a clearer hierarchy than the previous template-based interface.

02

Design for the target environment

Type size, information density, touch areas, and contrast had to remain usable beyond a desktop design canvas.

03

Make risky actions explicit

Remote takeover, task termination, and exception handling required clear state changes, confirmation, and feedback.

Three operational tasks, one consistent interaction language

Fleet dispatch

  1. Review fleet status
  2. Select a vehicle
  3. Assign a transport task
  4. Handle an exception

Vehicle control

  1. Check vehicle status
  2. Confirm location and route
  3. Start remote takeover
  4. Use emergency stop when required

Equipment inspection

  1. Filter vehicles for inspection
  2. Complete manual or drive-by-wire checks
  3. Mark abnormal items
  4. Submit the inspection result
Prototype review board covering fleet dispatch, inspection, and vehicle control flows
Most prototypes were reviewed with product, project management, frontend, backend, and testing before high-fidelity design.

Highlights

From field tasks to an end-to-end tablet workflow, reliable, clear, and actionable interfaces support autonomous haulage operations.

Selected interfaces for fleet dispatch, equipment inspection, remote control, mapping, and tablet operations

Structure dense inspection work without hiding progress

The inspection flow separates manual and drive-by-wire checks, keeps vehicle and completion status visible, and uses grouped items to control density.

Equipment inspection overview with vehicle filters and inspection status
Vehicle filtering and inspection status
Equipment inspection detail with grouped manual and drive-by-wire checks
Grouped checks, progress, and abnormal states

Checking the design on the target tablet

I requested a real project tablet and repeatedly viewed the high-fidelity work on the device. This exposed issues that were less obvious on a desktop canvas and informed further adjustment before implementation.

Vehicle Dispatch and Exception Handling

Core workflow: select a vehicle, confirm status, dispatch a haulage task, monitor feedback, and intervene when exceptions occur. Dispatchers work on one screen, using repeated status feedback and confirmation to stop a task or take remote control in time.

  1. Select Target Vehicle Dispatcher
  2. Check Location & Status Dispatcher
  3. Dispatch Haulage Task Dispatcher
  4. Monitor Operational Feedback System & Dispatcher
  5. Stop or Intervene Remotely Dispatcher
View Prototype

Readability

Type size, hierarchy, and information density at the intended viewing distance.

Touch targets

Control size and spacing for common and high-impact actions.

Operational feedback

Visibility of status changes, warnings, confirmation, and task results.

A consistent interface supported by production-ready assets

I defined reusable interface rules, produced the map and vehicle assets used by the product, prepared exports, and worked with frontend engineering through implementation.

Buttons, controls, icons, and interface standards for the tablet HMI
Interface rules for buttons, controls, state, spacing, and icon use
Wireframe view of the mining vehicle and environment assets in Blender
Model construction and camera control
Rendered mining vehicle and environment assets
Consistent vehicle, material, lighting, and viewing direction

From field context to a deployed tablet system

4 months

Fieldwork through deployment

The project moved through requirements, prototypes, high-fidelity UI, development, testing, and deployment from April to July 2024.

3 task families

One operational language

Fleet dispatch, individual vehicle control, and equipment inspection use a shared hierarchy and feedback model.

Reflection

Testing on the target tablet reinforced that an interface that looks clear on a desktop canvas is not automatically usable in the field. If I continued the work, I would simplify several dense screens and validate more task flows directly with operators earlier.

Get in touch

Feel free to reach out if you want to have a chat, or have any questions

Phone LinkedIn