HoloPatient Software Overview (VR)

 

University students, faculty, and staff

 

Overview

This document will provide an overview of all end-user features that the VR version of the software HoloPatient offers.

 

What is HoloPatient? 

HoloPatient is a software aimed at exploring the visual symptoms of different pathologies in AR, VR, and mobile applications. This document will provide an overview into the VR application only, as VR and AR/Mobile have slightly different feature sets.

Note: While this software supports gesture controls, they are currently in beta and extremely buggy. We strongly recommend using controllers to operate the software.

 

Signing In and Setup

Sign In

Upon first boot of the software, you will be greeted with a sign-in screen. Compared to other software the ETL has (e.g. 3D Organon), HH+ provisions access per-account instead of per-device. As such, users must sign in with "kiosk" accounts we've created. The screen that will display is shown below:

Uploaded Image (Thumbnail)

Select Sign In with email. On the next page, input the following credentials:

  • Username: etlq[device #]@pitt.edu
    • Note: [device #] is the nonzero portion of the number on your headset. For example, if you are using headset HSIT-VR-0011, your username will be etlq11@pitt.edu.
  • Password: Panther1
    • Note: Password is CaSe SeNsItIvE

Placing the Anchor

Once signed in, the software will prompt you to place an anchor and confirm its location. This anchor will correspond to where the bottom center of the model will be situated, where the arrow points where the model will be pointing. 

Uploaded Image (Thumbnail)

To adjust position of this anchor, point at the box and hold GT (gesture: pinch and hold) to grab it and move it to the desired location.

To rotate the anchor, grab the circles on the edges of the anchor and move your arm. Note: This movement is mirrored from what you may expect.

After you are happy with the anchor location, look at the menu and confirm it.

 

Starting a New Session

Finally, you will need to start a new session. To do so, select the New Session option on the next available menu:

Uploaded Image (Thumbnail)

The software will then prompt you to select a patient and disease severity level (if applicable). Once selected, a 3d model of the SP will appear, where you can grab with GT (gesture: pinch and hold) to move to the desired location. The full list of prerecorded SPs and their corresponding pathologies are listed at the bottom of this section.

  • Note: Some SPs may need to be downloaded. This will be done automatically upon selection, but may increase the time it takes to start a new session.

Uploaded Image (Thumbnail)

Patient Pathology
Jerry Reeves Anaphylaxis/Anaphylactic Shock
Sandra Burke Asthma
Susan Ferguson Burn
Darrell Jones COPD
Harry Benson COVID-19
Jenny Li Sexual Assault (SANE Training)
Maya Roberts Dementia/Delirium
Katie Livingston Diabetes
Lydia Johnson Domestic Violence
Samuel Lee Heart Failure
Doreen Siegel Hip Fracture
Marjory Anders Myocardial Infarction (Heart Attack)
Marc Snyder Parkinson's Disease
Rose Kamaka Sepsis/Septic Shock
Isobel Smoth Stroke
Todd Mansfield Trauma

Customizing your SP

Vital Sign Adjustment

Point at the vital sign you want to change/adjust, and press LT or RT (gesture: pinch) to select it. All vital signs are customizable, and you may switch between imperial and metric units.

Uploaded Image (Thumbnail)

Adding Labels

To add labels to the scene, navigate to the Label tab on the action bar. From there, you can add custom labels which you can point to wherever you need on the SP.

Uploaded Image (Thumbnail)

Changing SPs and Animations

To change which SP you are watching, navigate to the Patients tab on the action bar, and select the SP or severity level you would like to change to. You may also select the forward button to advance severity states, the restart button to restart the animation of the current severity, and the pause button to pause animations all together.

Uploaded Image (Thumbnail)

Moving SPs

To change where an SP is located, open the movement menu by pressing on the left controller (gesture: hold palm upward). From there, you can choose to move the model where desired.

Uploaded Image (Thumbnail)

Session Tab

The session tab will allow you to see who is in your session, as well as save the session (with labels) for future use.

Uploaded Image (Thumbnail)

 

Feedback and Concerns:

Our articles are continuously improving, and your feedback helps us make them even better. If you have any comments or suggestions about this article, please email hsitkb@pitt.edu or use the "Was this helpful?" section below to leave a response.