top of page
Be With You
About
Restrictive ICU visiting policies disrupt family connections, leading to increased delirium in patients and heightened anxiety in families.
Utilizing ultrasound technology to offer multi-sensory connections, bypassing ICU restrictions and enhancing companionship.
Solution
Team Project: Jiahua Zhu, Hongyan Lin, Mengting Li
Project Duration: 9 Weeks
Medical Device
Multi-Sensory
HCI
My Responsibility: Research / Concept / User Experience / Product Design / Prototyping With Arduino / Video
Teammates Responsibility: Research / Concept / User Experience / Interface / TouchDesigner
Challenge
Lonely Patients & Anxious Families...
Product Design
Cocoon - Patient End Product
Cocoon uses advanced ultrasound technology for acoustic and haptic sensation
(0 interference with ICU machines) and folds against the bed's guardrail when not in use.
Pebble - Family End Product
Pebble conveys patient information to families through visual and haptic sensory avenues with the assistance of LSTM AI deep learning network
Product Exploded View
Cocoon In ICU
Interaction Diagram
The game's exercises are based on professional rehabilitation therapies, with one exercise dedicated to each muscle group. Future development will expand to include more varied exercises targeting specific muscle groups
Interaction Demo Video
User Interface Design
Vital Sign Visualization
Patients' vital signs are converted into an easily understandable dynamic background, accessible without medical expertise
Patient's condition display
Schedule Call & Music Therapy
To optimize ICU conditions and patient care, calls and music therapy should be scheduled in advance for medical staff review and potential adjustments
Families can select or upload music for Cocoon to play during patients' scheduled music therapy sessions
Adjust prearranged schedule or add new ones manually as needed
Weekly schedules are auto-arranged for user convenience, with option of flexible personal adjustments
Call Via App
While closest family member might use Pebble, up to three other persons can connect with the patient through App, only without haptic feedback.
Emergency Alert
App will alert families with for emergency situation upon medical staff agreement. In end-of-life situations with a 'Do Not Resuscitate' order, families can connect with patients through Pebble or the App.
Should fate take the patient away, a memoir will be generated, documenting moments shared through Cocoon and Pebble.
Memoir
Total call time
Moment when breathing rate resonate
Positive impact families had on patient's emotion
Excerpt of families' words to patient
Scenes patient experienced through music therapy
Medical staff may cancel family call appointments incase of emergency or medical operation
if condition permits it, Doctors can give access to patients-families two-way calls
The backend empowers medical staff to adjust and monitor family-patient interactions, safeguarding ICU conditions and patient wellbeing
ICU Backend
Manufacturing Process
Cocoon Prototyping
Arduino & Processing: Directional Speaker Test
Pebble Prototyping
Thank You!
bottom of page