Introduction
Nowadays the best treatment of primary and secondary hepatic tumors is surgical resection, but only 5–15% of all patients with hepatocellular carcinoma and 20–25% of all patients with liver metastases are indicated for resection [1, 2]. In these cases some kind of ablation and other technique could be used: cryoablation (CA), radiofrequency ablation (RFA) [3], microwave ablation, percutaneous ethanol injection therapy (PEIT), high-intensity focused ultrasound (HIFU) and laser [4]. The major task of this procedure is needle placement in a desirable position achieved from pre-operative planning data. The goal is complete removal of the tumor and minimizing damage of the surrounding tissue. Conventionally ultrasound imaging is used for guiding needle placement, but due to a small size of tumor and quality of ultrasound image it is often difficult to identify it clearly [5]. Imprecise treatment of tumors causes complication and recurrence rates of 1.7–3.2% and 14–15% in PEIT, and 5.8–12% and 3.6–5% in RFA [6]. In order to improve results of tumor treatment, image-guided intervention (IGI) systems are used popularly in neurosurgery, otolaryngology, and orthopedic surgery, where rigid parts of the skeleton are used as reference points to register preoperative data and the position of surgical tools in the operating room (OR). The main advantage of IGI systems is presenting a model of the operation field including tumors and positions of surgical tools on an extra medical monitor, which shortens the intervention and improve safety in general [7] and for liver ablation [8]. Tracking points of the liver is a complex process, whose accuracy is also influenced by parameters of the stereo camera, which was set up by two laparoscopic monocular cameras and the calibration procedure [9]. Previous work has shown that mobility of the individual points of the liver reaches millimeters due to respiratory motion or even centimeters under pressure of laparoscopic tools [10].
Aim
The paper presents the methodology of preparing the anatomical model for ablation of unresectable liver tumor.
Material and methods
The presented approach can be divided into five steps: 1) preparing anatomical images, 2) anatomical structures segmentation, 3) creating models of anatomical structures, 4) presentation of the anatomical model and 5) verification.
Preparing anatomical images
In order to prepare a 3D anatomical model of the patient some anatomical images should be used. As regards liver metastases diagnosis, computed tomography (CT) is the most popular imaging mode, because it is cheap and relatively easy to apply – little collaboration with the patient is needed. The aim of the examination is to detect and determine resectability of the metastases. Usually a few series both with and without a contrast agent are performed [11]. The CT examinations are archived and stored in Digital Imaging and Communications in Medicine (DICOM) format.
Anatomical structures segmentation
For liver volume segmentation the semi-automatic method proposed by Juszczyk is applied [12]. The method requires one to indicate a single point within the spleen and one point inside the liver. The points indicated by the user are treated as the beginning of the rolling vector by which finding a common area in the liver and spleen in two-dimensional cross-section is performed. After assigning the labels of the object on the current cross-section, the shape of the image is transferred to the adjacent images. The stopping condition is to find the layer without the labeling of the object. Once you find the volume of the spleen, you remove it from the initial volume and the resulting volume is the correct volume of the liver. Photo 1 presents visualization of the liver surface model based on B-spline curves.
Vascular structure segmentation applies the modification of vascular Frangi filter [13], based on the analysis of the eigenvalues of the Hessian matrix. The method consists of two stages. At the first stage the method determines the intensity characteristic of liver tissue, removes the “hard” structures (e.g. high-density structures) and smoothes the image using anisotropic filtering. Then the modified filter proposed by Rudzki is used, which is a modification of the vascular Frangi filter, and introduces sigmoidal response functions gaining better sensitivity and higher immunity to noise. Comparing the proposed approach with different methods of vessel detection [14–16] which detect all hyperintense cylindrical structures, irrespective of their intensity based on evaluation of Hessian eigenvalues, Rudzki uses an intensity range rescaling function together with the liver as the region of interest and in this way the problem of other hyperintense structure such as bones is eliminated [17].
Multiscale analysis is carried out on the basis of the theory of linear space scales for discrete values of the scale corresponding to the rays of the hepatic vascular structures. Based on the filter response image vascular voxels are determined to start the segmentation process. The segmentation algorithm uses Fuzzy Connectedness, in which the fuzzy affinity relations are modified to take into account the result of the vascular response filter [18]. Central lines of received blood volume are created for presentation purposes. These central lines are interpolated by uniform cubic B-spline curves. Photo 2 presents an example of interpolated central lines of finding main branches of liver vessels. The presented method was tested on 40 abdomen CT in the portal phase with liver vessels contrast from 35 Hounsfield units [HU] to 150 [HU] [19]. The evaluation took into account the number of bifurcations from the portal vein. In 1 case the vessel tree could not be detected. In 4 cases segmentation was of a poor quality and in the remaining 35 cases the vessel tree was segmented above the 1st bifurcation (2 cases), 2nd bifurcation (11 cases) and 3rd bifurcation (22 cases).
The segmentation of lesions in the liver CT study raises a number of problems well known and described in the literature [20, 21]. The changes, depending on the type, size, and stage of malignancy, are characterized by different levels of intensity. In this work the semi-automated method proposed by Badura is used. The data series is first interpolated to provide a specific voxel size. The size is selected by weighing time and the quality of the segmentation process and the best results can be obtained for a cubic voxel size of approximately 1 mm3. Other resampling techniques such as downsampling to unify voxel sizes to the largest of them all have also been tested. Downsampling technique returns reasonable liver nodule segmentation results for a voxel size ≤ 2.5 mm.
An anisotropic diffusion filter is applied to the three-dimensional region of interest (volume of interest – VOI). For these results in the image data areas of uniform intensity are smoothed while maintaining selectivity and a clear edge at a good level. Each tumor must be indicated by the starting point of the system which starts with the segmentation procedure of the growth area. The above-mentioned problems associated with the twofold nature of the changes and low contrast in the liver require the use of segmentation with adaptive criteria selection. For this purpose fuzzy expert system inference, monitoring the shape, size and nature of the intensity of the tumor region, is used [22]. The method has been evaluated on 30 nodules of various types in terms of density, size and shape, described and outlined by the radiologist. The method produced 77% (23/30) correct results, which means that the distance did not exceed 2 mm. In 7 cases the algorithm produced under-segmentation results. Photo 3 presents an example of a liver nodule based on B-spline curves.
Creating models of anatomical structures
The 3D models of anatomical structures supply a comprehensive description of anatomical features and are used for creating anatomical atlases [23] and physiological models (e.g. breathing model of lungs) [24]. The model should be represented as point clouds, polygonal mesh, implicit surface equation or parametric equations [25]. The parametric representation was selected due to a few advantages [26]:
• the parametric method on the plane can be easily extended to represent an arbitrary curve in three-dimensional space,
• the parametric curves feature a natural direction of traversal – an ordered sequence of points along a parametric curve can be generated and the cross-sectional area of the surface can be presented,
• the parametric form is more natural for designing and representing, because curves factors have a direct visual interpretation,
• the parametric form can represent a surface by introduction of a second parameter.
The tensor product surface is used. A B-spline surface S(u, v) is obtained by taking a bidirectional net of control points Pi,j, two knot vectors u and v, and the products of univariate B-spline functions [27]:
where Ni,p(u) = Ni,4, Nj,q(v) = Ni,4 denotes cubic B-spline function. As regards the surface fitting algorithm there are two approaches: approximation and interpolation [27]. In the interpolation case, which is used here, a surface which passes directly through the given points is constructed. To find unknown spline curve coefficients a global surface interpolation algorithm [28] is calculated, assuming a uniform distribution of control points.
Presenting the anatomical model and verification
The goal of using the patient’s anatomical model is to highlight most important structures to simplify the planning phase. Usually the selected structures are presented in color against DICOM data presented in a grayscale map. Before an anatomical model of the patient is used for planning interventions it should be reviewed by the radiologist. In general, the model verification process is complex. All selected and segmented structures should be validated separately. To simplify this process the advantages of the model representation of space in the form of B-spline curves and surfaces are used. As mentioned earlier, in the equation surface splines of the 4th row and the local control property are used. Moving the control point of a portion of the curve will only affect three local segments. Control points are presented in the user interface as small cubes which can be directly moved by mouse movements (Photo 4).
Results
The proposed approach was tested on 20 abdominal CT obtained from the Department of Clinical Radiology of the Silesian Medical University. The lack of a “gold standard” provides for the correction of the results. The individual segments of the vascular structures were represented in the form of spline segments. The verification of the results takes place in the volumetric mode, due to the variation in the direction of the vessels. It is also possible to insert an additional control point into the curve if the radiologist considers it necessary (Photo 5). After the verification the results are recorded as the patient’s anatomy model for further use.
Discussion
Preparation of the anatomical model is one of the important early stages of the use of image-based navigation systems. This process could not take place in a fully automatic manner and verification of the results obtained is made by the radiologist. The proposed method of processing data on the basis of image segmentation creates surface models, vascular structures and lesions. Selected methods of presentation allow one to interact with the presented model for the possible correction of the results.
In the process of computer-aided surgical intervention a pre-operative anatomical model should be registered based on medical diagnosis images of the position of the patient in the operating room. The registration process is to find the correspondence between points in the anatomical model and the corresponding physical positions in the patient. Usually this process can be divided into two steps. The first step implements rigid correspondence, based on the assumption that there is no difference in shape [7]. The permissible operations to fit data include shift, rotation and finding a scale factor. Opposite to the deformable registrations, the initial rigid registration has the advantage that it may find clear correspondence points. It is also worth emphasizing that if the proposed approach does not modify the existing medical procedures, it is easier to implement in clinical practice. The presented approach takes into account the successive stages of processing. To prepare an anatomical model no modification in CT examination is applied, but due to easier registration of an anatomical model during the procedure a few radiological markers can be attached to the patient’s abdomen. These markers are highly visible in CT images and can also be found on the abdominal surface. The minimum number of markers is three to allow use of a rigid registration algorithm (e.g. rigid Horn algorithm) [29]. To obtain comparable results markers can be attached to the patient’s abdomen in a similar anatomical position. Then, one should also take into account the factors that cause discrepancies between a pre-operative anatomical model and the actual situation in the operating field during intervention, such as breathing movements or displacement and deformation of bodies under the pressure of laparoscopic instruments [7]. The future work will be the evaluation of a rigid registration preoperative CT-based anatomical model and the patient’s position during intervention.
Conclusions
The patient’s specific anatomical model is useful in the planning phase. Progress in medical image processing, data visualization and inexpensive graphics hardware allows a closer cooperation between the radiologist and the surgeon to choose the data presentation suitable for the surgeon’s needs. Selected segmented anatomical structures are presented in color against DICOM layered 3D images presented in a grayscale map. The entry point, the target and the surgical trajectory may be selected, so that critical anatomical structures are not affected. The 3D model used in the planning phase and during the procedure allows a better perception of challenging intervention for a specific patient’s anatomy [30].
Acknowledgments
The authors would like to acknowledge the financial support from the Polish National Centre for Research and Development (NCBiR), grant no. LIDER/03/47/L-1/NCBiR/2010 “Development of planning system and computer aided minimally invasive surgery for hepatic and metastatic liver carcinoma localization, diagnosis and destruction”. The author would like to thank the Department of Clinical Radiology of the Silesian Medical University for access to the anonymous abdomen CT data set.
References
1. Curley S, Izzo F, Delrio P, et al. Radiofrequency ablation of unresectable primary and metastatic hepatic malignancies: results in 123 patients. Ann Surg 1999; 230: 1-8.
2. Scheele J, Stang R, Altendorf-Hofmann A, Paul M. Resection of colorectal liver metastases. World J Surg 1995; 19: 59-71.
3. Pereira P. Actual role of radiofrequency ablation of liver metastases. Eur Radiol 2007; 17: 2062-70.
4. Vauthey J, Hoff P, Audisio R, Poston G. (eds.) Liver metastases. Springer, Germany 2009.
5. Soo Jay P, Kai Y. Interventional navigation systems for treatment of unresectable liver tumor Med Biol Eng Comput 2010; 48: 103-11.
6. Hong J, Nakashima H, Konishi K, et al. Interventional navigation for abdominal therapy based on simultaneous use of MRI and ultrasound. Med Biol Eng Comput 2006; 44: 1127-34.
7. Peters T, Cleary K. Image-guided interventions: technology and applications. Springer, London, UK 2008.
8. Head J, Elliott R. Stereotactic radiofrequency ablation: a minimally invasive technique for nonpalpable breast cancer in postmenopausal patients. Cancer Epidemiol 2009; 33: 300-5.
9. Spinczyk D, Karwan A, Żyłkowski J, Wroblewski T. In-vitro evaluation of stereoscopic liver surface reconstruction. Videosurgery Miniinv 2013; 8: 80-5.
10. Spinczyk D, Karwan A, Rudnicki J, Wroblewski T. Stereoscopic liver surface reconstruction. Videosurgery Miniinv 2012; 7: 181-7.
11. Gołębiowski M, Małkowski P, Zieniewicz K. Diagnostyka obrazowa guzów wątroby. Rozpoznanie i kwalifikacja do leczenia. Kompendium [Polish]. Wydawnictwo Naukowe PWN, Warsaw 2011.
12. Juszczyk J. Sekwencyjna segmentacja wybranych struktur anatomicznych w serii obrazów tomograficznych. Rozprawa doktorska [Polish]. Politechnika Śląska, Gliwice 2012.
13. Frangi A, et al.: Multiscale vessel enhancement filtering. In: Medical image computing and computer-assisted intervention (MICCAI). Wells WM, Colchester A, Delp S (eds). Vol. 1496. Lecture Notes in Computer Science 1998; 130-7.
14. Couinaud C. Liver anatomy: portal (and suprahepatic) or biliary segmentation. Dig Surg 1999; 16: 459-67.
15. Prokop M, Galanski M, Van Der Molen AJ, Schaefer-Prokop C. Spiral and multislice computed tomography of the body. Thieme Medical Publishers 2003.
16. Sato Y, Nakajima S, Atsumi H, et al. 3D Multi-scale line filter for segmentation and visualization of curvilinear structures in medical images in CVRMed-MRCAS ’97: Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medial Robotics and Computer-Assisted Surgery. Springer-Verlag, London, UK 1997; 213-22.
17. Rudzki M. Automatic image contrast enhancement method for liver vasculature detection. Proceedings of 18th International Conference Mixed Design of Integrated Circuits and Systems MIXDES 2011; 35-38.
18. Rudzki M. Filtr wieloskalowy w detekcji struktur naczyniowych wątroby z obrazów tomografii komputerowej [Polish]. Politechnika Śląska, Gliwice 2011.
19. Rudzki M. Automatic liver vasculature segmentation method using a modified multiscale vesselness filter. Proceedings of XIII International PhD Workshop. Conference Archives PTETiS 2011; 29: 300-5.
20. Xing Z, Jie T, Dehui X, et al. Interactive liver tumor segmentation from ct scans using support vector classification with watershed. Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE, 2011 Aug. 30-Sept. 3: 6005-8.
21. Häme Y. Liver tumor segmentation using implicit surface evolution. The Midas Journal 2008.
22. Badura P, Piętka E. 3D Fuzzy liver tumor segmentation, information technologies in biomedicine. Lecture Notes in Computer Science 2012; 7339: 47-57.
23. Samei G, Tanner C, Székely G. Predicting liver motion using exemplar models. Proceedings of the 4th international conference on abdominal imaging: computational and clinical applications. Springer-Verlag 2012.
24. Santhanam A, Pattanaik S, Rolland J, et al. Physiologically-based modeling and visualization of deformable lungs. Computer Graphics and Applications, 11th Pacific Conference, 2003; 507-11.
25. Foley J, Phillips R, Hughes J, et al. Introduction to computer graphics. Addison-Wesley Inc., Boston 1994.
26. Piegl L, Tiller W, Larobina M, et al. The NURBS Book. Springer-Verlag 1995.
27. Dierckx P. Curve and surface fitting with splines. Clarendon Press 1993
28. Surface Global Interpolation http://www.cs.mtu.edu
29. Horn B. Closed form solution of absolute orientation using unit quaternions. J Opt Soc Am A 1987; 4: 629-42.
30. Seitel A, Maier-Hein L, Schawo S, et al. In-vitro evaluation of different visualization approaches for computer assisted targeting in soft tissue Computer-Assisted Radiology and Surgery 2007; 2 (1 Suppl.): S188-90.
Received: 16.04.2013, accepted: 23.01.2014.
Copyright: © 2014 Fundacja Videochirurgii This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) License (http://creativecommons.org/licenses/by-nc-sa/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, provided the original work is properly cited and states its license.