Type
Research Project / Interaction Design / Augmented Reality
Year
2023–2024
Role
Research /
Concept Development / Game Design/
AR Design
Focus
Rehabilitation/ Accessibility/
Children/
Healthcare /
UX
Project -
Rehabilitation Games
with Augmented Reality
Accessible AR-Based Training for Children’s
Motor and Facial Rehabilitation
A research-driven AR project exploring how playful digital interfaces can support children’s rehabilitation, motivation, and emotional well-being.
Summary Box｜Key Highlights
Playful AR rehabilitation grounded in research
This project explores how augmented reality and game design can transform repetitive rehabilitation exercises into engaging, child-friendly experiences that support motivation, emotional well-being, and sustained participation.
AR as an accessible therapeutic interface
By translating physical movements and facial expressions into real-time visual feedback, the system reframes therapy as play—making rehabilitation more intuitive, less intimidating, and adaptable to diverse physical and cognitive abilities.
Designing for engagement beyond recovery
The project demonstrates how interaction design and gamification can reduce resistance to therapy, build confidence, and support long-term rehabilitation—bridging healthcare needs with human-centered digital experiences.
Background & Motivation
With the rapid development of immersive technologies, Augmented Reality (AR) has become a powerful interface between the physical and digital world.
In healthcare, especially in rehabilitation, patients often face repetitive, painful, and emotionally exhausting training processes. For children, this can lead to low motivation, frustration, and resistance to therapy.
This project explores how AR-based game design can transform rehabilitation exercises into engaging, playful experiences.
The goal is not only to support physical recovery, but also to improve emotional well-being, motivation, and long-term participation.
Design Thinking & Concept
Design Goals
-
Reduce discomfort during rehabilitation through playful interaction
-
Increase motivation and engagement for young patients
-
Provide visual feedback to support confidence and progress
-
Enable flexible, location-independent training
-
Create an accessible system using everyday devices (smartphones)
Target Groups
The project focuses on children and young patients with:
-
Autism
-
Facial nerve disorders
-
Cerebral palsy
-
Stroke recovery
-
Parkinson’s disease
-
Post-surgical facial rehabilitation
-
ADHD
-
Limited mobility (e.g., eye-only movement)
The test team included patients, family members, and rehabilitation therapists.
Concept: AR as a Therapeutic Interface
Augmented Reality is used as an interactive interface that translates rehabilitation movements into playful digital feedback.
Instead of traditional repetitive exercises, users interact with virtual elements through:
-
Hand movements (palm detection)
-
Mouth and facial expressions
-
Nose and head movement
-
Visual tracking and coordination
The system turns physical training into simple puzzle and labyrinth-style games, making therapy feel more like play than treatment.
Game Design Principles
-
Adaptive Difficulty: Easy / Medium / Hard levels
-
Short Sessions: Frequent, low-pressure training
-
Strong Visual Feedback: Immediate responses and rewards
-
Customizable Design: Colors, speed, and visual elements adapted to user needs
-
Sensory Awareness: Avoiding overstimulation for autistic users
-
Clear Interfaces: High contrast, simple 2D navigation
Creation Process
-
Research on rehabilitation needs and AR possibilities
-
User analysis and target group definition
-
Concept development for AR-based games
-
Prototyping with Meta Spark
-
Testing with patients and therapists
-
Feedback collection
-
Iterative improvements and simplification
The design process balanced creative ideas with technical limitations of mobile AR platforms.
Technical Framework
-
Platform: Meta Spark (mobile AR)
-
Devices: Smartphones
-
Interaction Tracking: Palm, face, mouth, nose
-
Game Type: Puzzle & Labyrinth Training
-
Focus: Visual–muscular coordination
Some limitations included:
-
No finger tracking (only palm detection)
-
Device compatibility issues
-
Software constraints
Outcomes & Reflection
The AR rehabilitation game successfully enhanced children's engagement and emotional responsiveness, making the recovery process more accessible, supportive, and interactive.
This project demonstrates the potential of Augmented Reality within healthcare design and accessibility, illustrating how gamification serves as a vital bridge between technology and human experience.
At the same time, the project reflects the inherent uncertainties in the long-term viability of digital platforms and development tools. Future design efforts in this field must place greater emphasis on technical flexibility and sustainability.