Towards mobile augmented reality for on-patient visualization of medical images (bibtex)
by Lena Maier-Hein, A.M. Franz, M. Fangerau, Mirko Schmidt, Alexander Seitel, Sven Mersmann, T. Kilgus, A. Groch, K. Yung, Thiago R. dos Santos, and Hans-Peter Meinzer
Abstract:
Despite considerable technical and algorithmic developments related to the fields of medical image acquisition and processing in the past decade, the devices used for visualization of medical images have undergone rather minor changes. As anatomical information is typically shown on monitors provided by a radiological work station, the physician has to mentally transfer internal structures shown on the screen to the patient. In this work, we present a new approach to on-patient visualization of 3D medical images, which combines the concept of augmented reality (AR) with an intuitive interaction scheme. The method requires mounting a Time-of-Flight (ToF) camera to a portable display (e.g., a tablet PC). During the visualization process, the pose of the camera and thus the viewing direction of the user is continuously determined with a surface matching algorithm. By moving the device along the body of the patient, the physician gets the impression of being able to look directly into the human body. The concept can be used for intervention planning, anatomy teaching and various other applications that require intuitive visualization of 3D data.
Reference:
Towards mobile augmented reality for on-patient visualization of medical images (Lena Maier-Hein, A.M. Franz, M. Fangerau, Mirko Schmidt, Alexander Seitel, Sven Mersmann, T. Kilgus, A. Groch, K. Yung, Thiago R. dos Santos, and Hans-Peter Meinzer), In Bildverarbeitung für die Medizin (2011) (H. Handels, J. Ehrhardt, T. M. Deserno, H-P. Meinzer, T. Tolxdorff, eds.), Springer, 2011.
Bibtex Entry:
@InProceedings{maier-hein2011,
  Title                    = {Towards mobile augmented reality for on-patient visualization of medical images},
  Author                   = {Lena Maier-Hein and A.M. Franz and M. Fangerau and Mirko Schmidt and Alexander Seitel and Sven Mersmann and T. Kilgus and A. Groch and K. Yung and {Thiago R.} {dos Santos} and and Hans-Peter Meinzer},
  Booktitle                = {Bildverarbeitung für die Medizin (2011)},
  Year                     = {2011},
  Editor                   = {H. Handels and J. Ehrhardt and T. M. Deserno and H-P. Meinzer and T. Tolxdorff},
  Pages                    = {389--393},
  Publisher                = {Springer},

  Abstract                 = {Despite considerable technical and algorithmic developments related to the fields of medical image acquisition and processing in the past decade, the devices used for visualization of medical images have undergone rather minor changes. As anatomical information is typically shown on monitors provided by a radiological work station, the physician has to mentally transfer internal structures shown on the screen to the patient. In this work, we present a new approach to on-patient visualization of 3D medical images, which combines the concept of augmented reality (AR) with an intuitive interaction scheme. The method requires mounting a Time-of-Flight (ToF) camera to a portable display (e.g., a tablet PC). During the visualization process, the pose of the camera and thus the viewing direction of the user is continuously determined with a surface matching algorithm. By moving the device along the body of the patient, the physician gets the impression of being able to look directly into the human body. The concept can be used for intervention planning, anatomy teaching and various other applications that require intuitive visualization of 3D data.},
  Access                   = {2},
  Doi                      = {10.1007/978-3-642-19335-4_80},
  File                     = {http:http\://hci.iwr.uni-heidelberg.de/publications/dip/2011/Maier-Hein_BVM2011.pdf:PDF},
  Groupid                  = {dip},
  Owner                    = {mischmidt},
  Timestamp                = {2010.12.09}
}