Audience
University students, faculty, and staff
Overview
This document will provide an overview of all end-user features that the software 3D Organon offers.
Lobby
The Lobby is where you first load in, and where you get directed after exiting a feature
The lobby allows end-users to select from multiple features to use in the software. Notably:
- Ultrasound - Simulates a digital Ultrasound transducer on a model in VR
- Anatomy - Provides a playground for end-users to explore gross human anatomy, fine structures, and kinesiology
- XR Imaging* - Allows users to look at and manipulate DICOM files in 3D, including changing coloring, filtering, and more. Note: This feature is only available on the HTC Vive Pro 2 due to processing limitations.
- Quiz - A way for users to take practice quizzes based on thousands of in-house anatomical identification and practical application questions
- Examverse - Not currently available.
- Medverse - Multi-user feature that allows users to create or join group sessions
- Asset Management* - Allows faculty to manage content to be shown in courses and share DICOM files across all VR devices.
- Vision Trainer* - An in-house tool to create 3D VR content for classroom purposes.
*For more information about this feature, please book a consult with an ETL staff member.
To begin, select one of the available options from above in the headset, and proceed to its contents below.
Ultrasound
This feature is to simulate performing ultrasounds on patients.
Upon loading in, you will be met with the following scene:
Directly in front of you will be a nude male model with an ultrasound transducer pointed at his chest. Behind him will be a very large screen that displays two different views of the transducer, as well as options to customize the scan.
Using the Transducer
To use the transducer:
- Customize the view you'd like using the on-panel settings
- You may choose between curved, linear, and cardiac probes
- You may also adjust the scan depth, noise opacity, and attenuation
- Hover near the transducer with either controller and hold GT to move it.
- Utilize the guide/slice image on the right to determine what you're seeing in the Ultrasound image on the left. The dotted region will determine what the probe is seeing.
Additional Features
- Gender - Changes the model from male to female, or vice versa
- Screenshot - Takes a screenshot of the software to be offloaded later
- Reset - Resets the probe position back to default
- Probe Positions - Allows users to save probe positions to load later
- Network - Allows multiple users to see the same Ultrasound session through Medverse
- Environment - Changes the background between a clinical environment, and passthrough
Exiting
To return to the lobby, select the house icon on the right of the panel.
Anatomy
The most robust feature that 3D Organon offers
Upon loading into Anatomy, you will be met with nothing. Look left, and you will see the following menu:
This menu is how you change what models and animations you are looking at. On the right are several options to customize your experience, including:
- Snapping the menu to one of your controllers
- Loading "scenes" created by other users
- Changing the background environment you are in between a space station, a clinical environment, an office, a black void, and passthrough
- Changing the language options in the headset
- Returning to the Lobby
To look at models, select one of the following options from the menu:
- Diagram - An "Atlas" that allows you to drill down into organ systems to look at individual structures
Systems - Option to look at full-body views of entire organ systems at the same time
Regional - Areas of the body with multiple preset organ systems enabled
- Actions - Tab for kinesiology. Includes animations for most joint and muscle groups in the human body
Microscopic - Fine structures and microscopy models
Topographic - Customize different organ systems to be enabled/disabled based on body region
Controls
- Point at organs to show their names. Pull the trigger to select it. Upon selection, a menu like the one below will show up:
This menu allows for a large multitude of functions, including:
- Hearing pronunciation of structures
- Hiding and fading structures
- Enabling or disabling name flags
- Cadaveric prosection images corresponding to the region of the body the selected structure is in
- Clinical pathologies of the organ system the selected structure is in
- Definition and description of the selected structure
- I/O of muscles (if a muscle is selected)
- Topological highlighting (if the selected structure supports it)
- Looking at the controllers will provide you with controls for rotation and resizing:
Following the controls shown above,
- Tilt the left controller joystick left/right to make the model smaller/larger
- Tilt the left controller joystick down/up to move the model down/up
- Tilt the right controller joystick left/right to rotate the model left/right
- Tilt the right controller joystick down/up to pitch the model back/forward
- There are two additional icons on the left controller. The wrench icon opens an additional menu with extra features:
In order:
- Multiselect - Allows you to select more than one structure at the same time
- Growth - Enables the placement of tumors on soft tissue using GT. You can customize size and intensity using the sliders.
- Spurs - Enables the placement of bone spurs on bone using GT. You can customize size and intensity using the sliders.
- Pain - Enables the placement of radial orbs to simulate pain points using GT. You can customize size, intensity, and color using the sliders and color selectors.
- Draw - Enables a drawing tool using GT, with the tip of the pen being the tip of the controller. You can customize size and color using the sliders and color selectors.
- Screenshot - Takes a screenshot of whatever you are looking at
- Explode - "blows out" the model to make individual structures more isolated and pronounced
- Record - Takes a video recording from within the software
- Web - Opens a web browser behind the model for search use and to pull up presentations and images in-headset
- Share - Allows you to share the current state of your model with a sharing code
- AI - Opens an AI assistant on the left menu, which you may ask anatomy questions. The assistant will provide answers to your questions and automatically pull up the relevant structure on your model.
- Search - Opens a search window to search for specific anatomical structures
- The other button on the screenshot above will change which hand the tool menu and left menu is on, if you snapped the left menu to the controller.
Quiz
Allows you to practice your knowledge using in-house questions
Upon opening Quiz for the first time, you will be met with a configuration screen:
Here, you can customize the following:
- The organ system(s) to quiz on
- The amount of questions
- How much time you have for the quiz
- Whether you want multiple choice questions (on by default; dark blue bubble) or free selection (white bubble) under "Show answer options"
- Question difficulty
Upon starting a quiz, you will be tasked to read the question and select the relevant anatomical structure associated with what the question is asking:
Once a structure is selected, it will highlight green (bone/soft tissue) or blue (ligaments). You then confirm your answer, and select "next" to proceed to the next question. When all questions are completed, or at any point, you may select "submit" to submit your quiz and see your results. There, it will show a list of questions and which ones are correct and incorrect. The incorrect questions will show you what the correct answer is, as well as rationale as to why it is correct:
Feedback and Concerns:
Our articles are continuously improving, and your feedback helps us make them even better. If you have any comments or suggestions about this article, please email hsitkb@pitt.edu or use the "Was this helpful?" section below to leave a response.