3D reconstruction and evaluation of tissues by using CT, MR slices and digital images

Abstract

In this project, it is provided to reconstruct 3D models of human body by using CT, MR slices and digital images and precisely finding locations of pathological formations such as tumours. For this purpose, within this project we developed a software, which we called as “Medical Image Processing and Analysis System (MIPAS)” and it is still under development for multipurpose medical applications. In this paper, we introduce the abilities of MIPAS briefly and also give a sample application on finding location and visualization of a brain tumour. MIPAS uses volume and surface rendering techniques for 3D modelling of the tissues and provides both volume and surface models at the same time on the screen when required. MIPAS gives many editing and analysis functionalities to medical doctors. For pre-processing of CT and MR images, there are wide range of image processing functionalities. It is possible to register CT and MR images by using both anatomical landmarks and artificial (external) markers. MIPAS also provides surface registration functions with both rigid body and non-rigid body transformation with the variants of ICP algorithm. For photo-realistic visualization of the external human body like face of the patient, it provides a photogrammetric module. This module consists of self calibration with bundle adjustment by using additional lens parameters, automatic image coordinate measurement with ALSM matching technique and texture mapping functions with both colinearity equations and 3D affine transformation. We are still studying to progress the photogrammetric module for plastic surgery. Up to now, we could not still test the MIPAS on the real patients. But we have just started a new project with medical doctors, in order to test the MIPAS on real patients. During this new project, we will see the actual reliability of the system. © 2014 ISPRS. All Rights Reserved.