Where human potential meets the power of extended reality and generative intelligence.
Services
Client
Year
Website
Challenge
The Netherlands faces a critical shortage of skilled maintenance workers, with outdated, analogue training methods unable to keep up
The challenge was to design a practical demonstration tool showing how Extended Reality (XR) and Generative AI (GenAI) can accelerate on-the-job training for untrained workers repairing complex machinery.
The Approach
Working within Accenture Industry X, I developed a demonstrator that merges AI-driven instruction and immersive XR environments to showcase future-ready training.
The process began with field research at Hahn Automation in Germany, interviews with service managers, and deep analysis of worker pain points.
From there, I moved through co-creation workshops with AI/XR experts, story-driven concept design, and hands-on prototyping in Unreal Engine 5 with integrated GPT-4 Vision API assistance.
Process Overview
Research & Target Definition – Identified “Service & Maintenance Technicians for Complex Machinery” as the primary audience through UWV labor analysis and field interviews.
Ideation & Story Mapping – Developed three narrative prototypes (“Mitsumi,” “Xera,” “Penfan”) blending different aesthetics and interaction models, later merged into a single cohesive experience.
Rapid Prototyping – Created 400+ element variations using Morphological Chart × Lotus Blossom and evaluated them via Harris Profiles and A/B testing.
XR & AI Integration – Built the demonstrator in Unreal Engine with GPT-4-powered contextual guidance and speech-based interaction.
User Testing & Optimization – Conducted tests with untrained participants to refine usability, accessibility, and immersion.
Result
The interactive demonstrator bridged the gap between human learning and machine complexity, transforming training from static manuals into a living, intelligent experience.
Built entirely in Unreal Engine 5, the system combines immersive XR with adaptive AI feedback, creating a hands-on learning journey that mirrors real factory scenarios.
The prototype delivers:
Contextual guidance through a generative AI assistant, that instantly trains itself on manuals and other supporting materials.+
Immersive, interactive repair environments designed for Meta Quest Pro
Adaptive learning that responds to user actions in real time
Seamless usability for users with little to no prior technical experience
The demonstrator became a proof of concept for Accenture Industry X, illustrating the real-world potential of XR and AI to transform industrial training. It now serves as a showcase tool for internal presentations and client discussions exploring the future of workforce development.
