Integrating Haptic Feedback with Mixed Reality for Seamless Virtual Object Interaction in Real Environments

Jan 20, 2025·
Jafar Hamad

Abstract:

Advancements in surgical research have witnessed remarkable integration of cutting-edge technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR). My research aims to equip surgeons with innovative tools to enhance the accuracy, efficiency, and precision of surgical procedures within the operating room. Leveraging the capabilities of mixed reality and HoloLens 2. My work Focus on:

  • Enabling visualization and projection of virtual objects into the physical environment,
  • Allowing for seamless interaction tailored to specific surgical objectives.
  • Incorporating haptic feedback into these interactions enriches the sensory experience, providing a more intuitive understanding of object shapes and physics, thereby enhancing the realism and effectiveness of virtual simulations.

About Jafar:

Jafar Hamad is a PhD candidate at the University of Pisa in Italy, working within the EndoCAS Laboratory. He holds a master’s degree in biomedical engineering from Marche Polytechnic University, Italy. Jafar’s research focuses on developing applications utilizing augmented and mixed reality technologies, as well as simulators, for the training and optimal planning of surgical interventions. His work also emphasizes the integration of these applications with advanced haptic feedback gloves to enhance the realism and effectiveness of surgical training and planning processes.