Hybrid Interactive Virtual Environment System and Method of Use Thereof

A Hybrid Interactive Virtual Environment (HiVE) system and a method of use thereof are provided, said system and method are configured for clinical education and training. Said system comprising: an immersive room, which is 6-sided Cave Automatic Virtual Environment (CAVE) platform and is configured to a fully immersive interactive hybrid classroom; an image generator, which is configured to process input contents and render the input contents in either two dimensional (2D) mode or three dimensional (3D) mode to generate interactive contents for clinical education and training; a projection warping system to perform a process of projection warping and blending to generate a projection warped display image; and a video processing system to process the projection warped display image to generate a frame-synchronized display output; wherein the immersive room comprises a surround sound system to produce audio output to the interactive contents, a motion capture system to produce tracking information of the users inside the immersive room and send the tracking information to the interactive contents, and projectors to project the frame-synchronized display output from the video processing system to generate a 3D interactive image within the immersive room for clinical education and training, such that users in the immersive room may watch and listen to the 3D image and interact with the 3D image and/or with each other for clinical education and training.