Research & Innovation Project

Making Rehab
Accessible Through
Interactive Technology

NeuronFRAMES is an AI-assisted rehabilitation platform that combines computer vision, sensor-based input, and gamified therapy to make recovery more accessible, engaging, and measurable.

Learn More Get In Touch
4
Therapy Modes
Web-Based
Platform
Open
Research Project
NeuronFRAMES
Pose Detection
MediaPipe Vision
Arduino Sensors
📷

Computer Vision Pose Detection

Uses MediaPipe to track body landmarks through a standard webcam, enabling movement analysis without specialized equipment.

🎮

Gamified Therapy Exercises

Interactive browser-based games transform repetitive exercises into engaging activities that increase patient motivation and adherence.

🔌

Sensor-Based Input Devices

Arduino-powered sensors such as force-sensitive resistors connect physical rehabilitation tools to the digital therapy platform.

What Is NeuronFRAMES

Accessible Rehabilitation
Through Technology

NeuronFRAMES is a research and innovation project developing a web-based AI-assisted rehabilitation system. It combines computer vision pose detection, sensor-based input devices, gamified therapy exercises, speech therapy tools, and progress tracking into a single accessible platform.

Globally, millions of patients cannot access consistent rehabilitation therapy due to cost, geographic distance, or limited clinical resources. NeuronFRAMES aims to address these challenges by delivering therapy tools through a standard web browser, requiring only a webcam and internet connection.

Built with HTML, CSS, JavaScript, MediaPipe, and Arduino sensors, the platform is designed to be affordable and deployable in diverse settings — from clinical facilities to patients' homes.

🌐

Web-Based Access

Runs in any modern browser — no software installation or expensive hardware required.

📊

Progress Tracking

Data-driven session records help clinicians and patients monitor improvement over time.

🎯

Motivation Through Gamification

Game mechanics keep patients engaged and encourage consistent practice between sessions.

💡

Low-Cost Design

Open web technologies and affordable sensors make the system accessible in resource-limited settings.

Therapy Modes

Four Integrated Rehabilitation Modules

Each mode addresses a specific rehabilitation need, from physical movement to speech recovery, using accessible web-based technology.

01
🏃
Pose Detection

Enhanced Physical Therapy (EPT)

A pose-detection rehabilitation mode that tracks patient movement using camera-based body landmark detection. It provides visual guidance through pose overlays and automatically counts repetitions and evaluates movement accuracy — giving patients real-time feedback during exercise sessions.

  • Camera-based body landmark tracking via MediaPipe
  • Visual pose overlay guiding correct movement form
  • Automatic repetition counting and accuracy scoring
  • Session-by-session progress recording
  • No specialized equipment — works with a standard webcam
02
🎮
Gamification

Gamified Physical Therapy (GPT)

A game-based therapy mode where patients perform rehabilitation movements through interactive browser games — including reaction tasks, card matching, and motion-based challenges. Designed to increase motivation and adherence by making repetitive exercises feel engaging and rewarding.

  • Interactive rehabilitation games in the browser
  • Reaction-time tasks and card-matching exercises
  • Motion-based game mechanics tied to therapy goals
  • Score tracking and achievement progression
  • Designed to encourage consistent practice
03
🧩
Sensor Integration

Interactive Therapeutic System (ITS)

A sensor-integrated rehabilitation system that connects hardware devices — such as grip sensors using force-sensitive resistors and Arduino microcontrollers — to interactive therapy games. Patients interact with therapy exercises using physical input devices, bridging the gap between tangible rehabilitation tools and digital feedback.

  • Arduino-based sensor input devices
  • Force-sensitive resistor (FSR) grip measurement
  • Real-time sensor data visualization
  • Hardware-connected therapy games
  • Affordable, buildable sensor kits
04
🗣️
Speech Therapy

Speech Improvement Therapy (SIT)

A speech rehabilitation module that uses browser-based speech recognition to support pronunciation practice, vocabulary exercises, and communication training. Patients receive immediate feedback on their speech accuracy through the Web Speech API, making speech therapy more accessible outside clinical settings.

  • Browser-based speech recognition (Web Speech API)
  • Pronunciation practice with instant feedback
  • Vocabulary building and word exercises
  • Communication training activities
  • Session progress logs for review
Research & Development

Built Through Research & Collaboration

NeuronFRAMES is developed through academic research, innovation competitions, and collaboration with rehabilitation professionals who inform every design decision.

🔬

Academic Research

The project is grounded in research on computer vision for movement analysis, gamification in healthcare, and accessible rehabilitation technology. Each module is informed by existing evidence on effective therapy delivery.

👨‍⚕️

Clinical Feedback

Physiotherapists, occupational therapists, and speech-language professionals provide ongoing guidance to ensure the system's exercises, metrics, and interfaces align with real clinical workflows and patient needs.

🏗️

Innovation & Prototyping

NeuronFRAMES has been developed through iterative prototyping cycles, incorporating user testing, hardware integration experiments, and software architecture improvements at each stage.

💻 Web Technologies (HTML/CSS/JS)
📷 MediaPipe Pose Detection
🔌 Arduino Microcontrollers
🎙️ Web Speech API
📊 Data Visualization
🎮 Browser-Based Games
Project Milestones

Development Progress & Key Achievements

NeuronFRAMES continues to evolve through research activities, innovation competitions, and technical development milestones.

🎯
Milestone

Four Therapy Modules Developed

EPT, GPT, ITS, and SIT modules fully prototyped with working web-based interfaces and real-time feedback systems.

📷
Milestone

MediaPipe Pose Integration

Successfully integrated camera-based body landmark detection for real-time movement tracking and accuracy evaluation.

🔌
Milestone

Arduino Sensor Hardware

Designed and built custom sensor input devices using force-sensitive resistors and Arduino microcontrollers for the ITS module.

🏆
2025 · Award

People's Choice Award — ACM/IEEE HRI 2025

Received the People's Choice Award at the 20th ACM/IEEE International Conference on Human-Robot Interaction.

🎮
Milestone

Gamified Exercise Library

Developed multiple interactive therapy games including reaction tasks, card matching, and motion-based challenges.

🗣️
Milestone

Speech Recognition Integration

Implemented browser-based speech recognition for pronunciation practice and vocabulary training using the Web Speech API.

Published Research

Peer-Reviewed
2025

Interactive Therapeutic Systems: A Gamified Approach to Physical Rehabilitation and Data Collection

Chacharin Lertyosbordin, Maythus Tangprapa, Nuntipat Jiwasurat — Presented at ACM/IEEE HRI 2025 and awarded People's Choice Award.

20th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2025) · IEEE Xplore
2025

Interactive Therapeutic Systems: A Gamified Approach to Hand Rehabilitation and AI-driven Support

Chacharin Lertyosbordin, Maythus Tangprapa, Nuntipat Jiwasurat — IEEE Xplore listing of the HRI 2025 conference paper.

2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · IEEE Xplore
In Press

A Hybrid Mirror Therapy and Gamified Rehabilitation System for Stroke Patients Using a Force-Sensitive Flappy Bird Interface

Nuntipat Jiwasurat, Maythus Tangprapa, Filippo Sanfilippo — Presents a gamified rehabilitation system combining mirror therapy with FSR-based input for stroke recovery.

Proceedings of the 1st International Symposium on Biomechatronics and Robotics in Healthcare (BioMRH 2025) · Lecture Notes in Networks and Systems, Springer · Forthcoming
Get In Touch

Interested in NeuronFRAMES?

Whether you are a rehabilitation professional, researcher, educator, or student interested in accessible therapy technology — we welcome your questions, feedback, and collaboration ideas.

📧
Email
admin@neuronframes.com
🔬
Project Focus
Research & Innovation in Rehabilitation
🛠️
Technology Stack
HTML · CSS · JS · MediaPipe · Arduino
🤝
Open To
Academic collaboration & clinical feedback

Send Us a Message