Image Alt

Escape Me

Escape Me video player and tablet application

We took part in working on this project for the Vimelio. The purpose of the main application is to reduce stress in patients undergoing medical or dental procedure. The patient wears the headset and watches interactive content, while the doctor conducts the procedure.

What were our tasks

  1. Create 360 content for the application;
  2. Allow the doctor to monitor what the patients sees while wearing the headset, during the procedure;
  3. Convert the application for the Vive Flow headset;

What we did.

While working on the first task we prepared 5 environments and rendered the camera fly-through for each environment. Resulting videos were mixed with sound effects and prepared for playback on the headset. Environment scenes were produced using Unity engine, based on the environmental asset packages. The camera was animated to fly through the scene and the camera output were captured and composed into high-resolution 4k 360 videos. Rendering was done using powerful cloud-based GeForce RTX 3090 GPU to reduce rendering time.

Second task was completed also using Unity engine while utilizing a number of native Android plugins to access Android system-level features. It was important to make connection robust and not to rely on existing network connection to establish video stream from the headset to android tablet. Also it was important to reduce latency and CPU usage while encoding the video stream on the headset. The connection process was established using ad-hoc wireless connection with the usage of Bluetooth for initial phase of connection and wi-fi access point connection for the video stream. Capturing and encoding was enabled on the headset in such a way not to exceed the performance limits of the VR application for the patient.

Third task was completed using the Unity engine. Initially the project was done for the Pico VR headsets, utilizing native Pico VR SDK. Now, the Vive Flow works on a different SDK, which also had Unity XR package available. We needed to convert the VR rig in engine to XR rig, update all interactions to work with XR framework and to test the resulting application with new device platform.

All tasks were successfully completed and the client has accepted the work.

Date:
Tags: