Augmented reality improves novice users' ultrasound skills
Researchers are developing a new augmented reality system that could offer providers more detailed visualization of ultrasound images.
Using a virtual reality headset, the system, dubbed AR-VIU (augmented real-time volumetric imaging in ultrasound), creates a 3D rendering of anatomy based on 2D ultrasound images. This allows users to visualize an area in its entirety from routine images acquired in standard passes. Researchers with MIT, where the technology is being developed, believe the technique could help users to more thoroughly analyze areas of interest, aiding with both education and care delivery.
“For training, this could make ultrasound more intuitive and more understandable. On the clinical side, it could be less time-consuming, more accurate, and also give healthcare providers more peace of mind," senior study author Canan Dagdeviren, an associate professor of media arts and sciences at MIT, said in a news release.
The system includes a small probe that houses an ultrasound array arranged in the shape of an empty square, which is needed to acquire 3D images. It transmits imaging information using a chirped data acquisition system. This data is then compressed and streamed through a graphics module known as an Unreal Engine, which takes voxel data from the medical images and converts them into a 3D rendering. When programmed to transmit this data in real-time to a VR headset, it enables users to visualize an area of interest in 3D and adjust their view as needed.
The team tested the system with a group of 18 users, half of whom were physicians and sonographers with ultrasound experience and half who had never used the system before. Participants were given multiple tasks to complete using either the AR-VIU system, 2D system, 3D system or a 2D augmented reality system. For each task, participants demonstrated stronger performance while utilizing AR-VIU, with novice imagers seeing the greatest improvements. Those users performed on par with experts when aided by AR-VIU system. Participants also reported preference for the scanner over the other options tested.
Ultrasound systems capable of 3D imaging are not new and are routinely used in cardiac and some prenatal settings. However, such scanners are not the standard of care when it comes to ultrasound, as they are expensive and require specific training to be utilized appropriately. AR-VIU does not require the same elements as 3D systems, making it less expensive to build, experts note.
Learn more about the team’s work here.
In addition to her background in journalism, Hannah also has patient-facing experience in clinical settings, having spent more than 12 years working as a registered rad tech. She began covering the medical imaging industry for Innovate Healthcare in 2021.