Ultra-Low Latency Streamer in Surgery and Medical Imaging Applications

Real-time communication and data transfer have become indispensable in healthcare, especially within surgeries and medical imaging applications. The capability to capture, share, and analyze high-resolution, live images during procedures such as endoscopy has transformed how medical professionals diagnose diseases, plan surgeries, and train upcoming specialists. Recent technological breakthroughs now allow ultra-low latency streaming, enabling high-quality, interactive, and immersive live data exchange with unmatched immediacy, creating significant advancements in patient care.

In line with these advancements, iWave has introduced the ultra-low latency (ULL) Streamer and Recorder, a cutting-edge solution that integrates real-time communication and data transfer with minimal delay. Engineered to handle the increasing need for instant data flow, the ULL Streamer allows video streaming with an exceptionally low “glass-to-glass” latency, enabling healthcare providers to monitor, evaluate, and collaborate with seamless synchronization throughout complex medical procedures.

(Image source: iWave)

Traditional imaging methods, including X-rays, computed tomography (CT), positron emission tomography (PET), and magnetic resonance imaging (MRI), typically experience a delay of several hundred milliseconds during video streaming. This latency can be a critical barrier in procedures requiring split-second decision-making. By contrast, iWave’s ULL Streamer reduces end-to-end latency to a mere 66 milliseconds over Wi-Fi 5, making it ideal for interactive applications. High-definition (HD) video can now be transmitted in real-time, allowing specialists at both local and remote locations to monitor and make immediate decisions. For visualization and analysis, the ULL Streamer integrates with the Apple Vision Pro, a mixed-reality headset that combines augmented reality (AR) and virtual reality (VR) functionalities, offering users a fully immersive experience and enhancing collaboration across multiple medical teams.

Key features of the ULL Streamer and recorder

• Ultra-high-resolution video: Supports 4K UHD video at 60 Hz, with simultaneous compression and decompression to maintain high quality
• Versatile input and output: Equipped with 12G-SDI and HDMI 2.0 inputs/outputs, allowing flexible integration with various imaging devices
• Efficient real-time encoding: Video from 12G-SDI/HDMI 2.0 input is encoded for live streaming or direct recording to M.2 SSD or USB storage, ensuring both real-time viewing and efficient storage
• Wi-Fi 5 streaming capabilities: Allows reliable, low latency streaming over Wi-Fi networks, reducing dependency on wired connections and enhancing mobility
• Secure data transmission: Incorporates AES encryption to safeguard sensitive medical data, providing a secure pipeline for video streaming
• Zero latency pass-through: Supports a loop mode with zero latency, making it suitable for both streaming and real-time display on local devices

The ULL Streamer is powered by a high-performance FPGA that includes HDMI receive (RX) and transmit (TX) functionality, as well as Wi-Fi 5 capabilities, making it ideal for handling simultaneous data reception and transmission. At its core, the ULL Streamer utilizes the Zynq UltraScale+ MPSoC, which includes an integrated H.264/H.265 video codec unit. This feature ensures hardware-accelerated video encoding and decoding, optimizing performance for high-definition video streaming applications and minimizing the impact on system resources.

Advanced video codec integration in medical environments

The ULL Streamer’s advanced codec integration brings significant benefits in medical environments by enabling a more efficient and effective video processing pipeline, starting directly from the imaging device. Once raw video is captured from devices like endoscopes, it is processed within the FPGA’s programmable logic, where essential image enhancements are applied. Enhancements such as noise reduction ensure a clear, high-resolution image, while color correction and image stabilization provide a more accurate and consistent view. These optimizations are essential, as they improve the clarity of the live stream, enabling surgeons and medical professionals to view precise, real-time imagery crucial for procedures. The integrated H.264/H.265 codec efficiently compresses these high-quality video streams, preserving visual fidelity while reducing bandwidth requirements, allowing for seamless data transmission across complex healthcare networks.

The ULL Streamer is optimized to maintain video quality at very low latencies, ensuring that video is processed and transmitted in real time to displays, remote systems, or storage without delays. This streamlined workflow not only improves operational efficiency within medical settings but also allows healthcare professionals to view, analyze, and act upon live video feeds from multiple sources concurrently. Additionally, the compressed video can be transmitted to remote experts or consultants without lag, providing seamless collaboration and decision-making in high-stakes medical scenarios. This real-time capability, combined with low latency and high-quality imaging, ensures the ULL Streamer meets the stringent demands of modern medical imaging and procedural support, where precision and timing are paramount.

ULL Streamer workflow in medical applications

The ULL Streamer’s encoding process begins with capturing high-quality video from 12G-SDI or HDMI 2.0 sources at up to 4K resolution and 60 frames per second (fps). During a surgical procedure, the video feed is encoded into smaller, efficient data packets and streamed over Wi-Fi 5. Supported protocols like UDP, SRP, RTMP, and RTSP facilitate compatibility with a range of streaming platforms. The encoded data is received by a decoder, where it is displayed on high-speed monitors and devices such as the Apple Vision Pro. For enhanced flexibility, the video can also be streamed to web-based platforms like YouTube and Wowza and customized to meet specific end-user needs. To ensure data security, the ULL Streamer provides encryption and decryption for video and audio data captured from 12G-SDI or HDMI 2.0 sources, preserving patient confidentiality during medical streaming.

Use cases of the ULL Streamer in healthcare

1. Real-Time Data Integration in Surgery: The ULL Streamer enables seamless real-time data integration, providing surgeons with immediate access to vital information, improving situational awareness, and supporting decision-making.
2. Telemedicine and Remote Surgery: Remote specialists can join surgeries through ultra-low latency streaming, achieving synchronized communication between on-site and remote teams, essential in complex and specialized procedures.
3. Medical Training and Simulation: Live streaming of surgical procedures or medical simulations to students or trainees offers an immersive, interactive learning environment, enabling immediate feedback and greater insight into techniques.
4. ICU Monitoring: The ULL Streamer transmits real-time video and essential data from Intensive Care Units (ICUs) to remote monitoring centers, supporting quick, informed decisions on patient care.
5. Live Diagnostics: Real-time transmission of diagnostic imaging—such as ultrasounds or endoscopic footage—enables rapid consultation with specialists who can interpret results and offer guidance instantly, reducing diagnosis time.
6. Emergency Response Coordination: During critical care situations, the ULL Streamer can provide live video feeds from emergency scenes to response teams or hospitals, facilitating well-coordinated, immediate medical intervention.

With the successful deployment of ultra-low latency streaming over Wi-Fi, the ULL Streamer offers the potential to significantly improve surgical outcomes, enhance training, and expand access to life-saving procedures globally.

iWave: Innovation in Embedded Systems

With decades of experience, iWave's engineering team is proficient in designing solutions that meet the most stringent mechanical, environmental, and regulatory requirements, delivering certified, scalable products tailored for performance, reliability, and long-term deployment. By partnering with iWave, businesses benefit from flexible, customized solutions, early access to the latest i.MX technologies, and the ability to lead in their markets with next-generation products.

For more information or to discuss custom requirements, please reach out to us at [email protected].