• Top
• Abstract
• Introduction
• Materials and methods
• Results
• Conclusion
• Acknowledgements
• References

This article is part of the supplement: New trends in digital pathology: Proceedings of the 9th European Congress on Telepathology and 3rd International Congress on Virtual Microscopy

Proceedings

Automated region of interest retrieval and classification using spectral analysis

Myriam Oger^1,2,3,5 , Philippe Belhomme³, Jacques Klossa¹, Jean-Jacques Michels^3,4 and Abderrahim Elmoataz⁵

¹TRIBVN, 39 rue Louveau, 92320 Châtillon, France

²EPF Ecole d'ingénieurs, 3 bis rue Lakanal, 92330 Sceaux, France

³Histo-imagerie quantitative, GRECAN (EA 1772, IFR 146 ICORE University of Caen Basse-Normandie), F. Baclesse Cancer Centre, Bd Général Harris, F 14076 Caen, France

⁴Service d'Anatomie pathologique, F. Baclesse Cancer Centre, Bd Général Harris, F 14076 Caen, France

⁵GREYC, UMR 6072, University of Caen Basse-Normandie, 6 Boulevard du Maréchal Juin, 14050 Caen Cedex, France

author email corresponding author email

Diagnostic Pathology 2008, 3(Suppl 1):S17doi:10.1186/1746-1596-3-S1-S17

The electronic version of this article is the complete one and can be found online at: http://www.diagnosticpathology.org/content/3/S1/S17

Published:

15 July 2008

© 2008 Oger et al; licensee BioMed Central Ltd.
This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Efficient use of whole slide imaging in pathology needs automated region of interest (ROI) retrieval and classification, through the use of image analysis and data sorting tools. One possible method for data sorting uses Spectral Analysis for Dimensionality Reduction. We present some interesting results in the field of histopathology and cytohematology.

In histopathology, we developed a Computer-Aided Diagnosis system applied to low-resolution images representing the totality of histological breast tumour sections. The images can be digitized directly at low resolution or be obtained from sub-sampled high-resolution virtual slides. Spectral Analysis is used (1) for image segmentation (stroma, tumour epithelium), by determining a «distance» between all the images of the database, (2) for choosing representative images and characteristic patterns of each histological type in order to index them, and (3) for visualizing images or features similar to a sample provided by the pathologist.

In cytohematology, we studied a blood smear virtual slide acquired through high resolution oil scanning and Spectral Analysis is used to sort selected nucleated blood cell classes so that the pathologist may easily focus on specific classes whose morphology could then be studied more carefully or which can be analyzed through complementary instruments, like Multispectral Imaging or Raman MicroSpectroscopy.

Introduction

Efficient use of whole slide imaging (WSI) in Pathology needs an automated region of interest (ROI), retrieval and classification; this can be achieved through the use of image segmentation and data sorting tools. The present paper aims at illustrating, through two examples, the power of spectral analysis, which can be used alone or in addition to image segmentation for data reduction, feature classification as well as image visualisation.

Materials and methods

Material

The first application concerns 73 WSI of HES stained histological sections of breast tumours recorded at a resolution of 6.3 μm/pixel. The second one concerns a WSI of MG stained blood smear recorded at a resolution of 0.17 μm/pixel using an Aperio slide scanner.

A minimal segmentation was performed to isolate breast tumour tissue or to eliminate erythrocytes from blood smear.

Principle of spectral analysis

The main point of this technique is to introduce a useful metric on data set based on the connectivity of points within the graph of data, and also provide coordinates on the data set that reorganize the points according to this metric [1,2]. Let X = {x₁,x₂,...,x_N} be N data points (images), each data x_iϵRⁿ where n is the dimension of the space data (measures). The first step is to represent the dataset X = {x₁,x₂,...,x_N} by a weighted symetric graph G = (V, E) where each data point x_i corresponds to a node. Two nodes x_i and x_j are connected by an edge with weight w(x_i,x_j) = w(x_j,x_i), reflecting the degree of similarity (or affinity) between these two points. The weight w(.,.) describes the first-order interaction between the data points and its choice is application-driven. For instance, in applications where a distance d(.,.) already exists on the data, it is custom to weight the edge between x_i and x_j by:

w(x_i, x_j) = exp(-d(x_i, x_j)²/ε)

where ε > 0 is a scale parameter, while other weighting functions can be also used.

Following a classical construction in spectral graph theory and manifold learning, we now create a random walk on the data set X by forming the kernel:

Where:

is the degree of node x_i.

As we have that p(x_i, x_j) ≥ 0 and

the quantity p(x_i, x_j) ≥ 0 can be interpreted as the probability of random walker to jump from x_i to x_j in single time step.

From spectral theory and harmonic analysis we know that the eigenfunctions can be interpreted as a generalization of the Fourier harmonics on the manifold defined by the data points. In our problem, smaller eigenvalues correspond to higher frequency eigenfunctions, and larger eigenvalues correspond to lowers ones.

The eigenvalues and eigenvectors provide embedding coordinates for the set X. The data points can be mapped into Euclidean space via embedding:

Ψ_t → (ψ₁(x), ψ₂(x),..., ψ_m(t)(x)).

The second eigenvector ψ₂ is known as the Fiedler vector and can be used to order the underlying dataset X (segmentation and data reduction). When it is associated with the third eigenvector ψ₃, it allows a visualization of the base.

Results

Breast cancer

In this case, the ψ₂ eigenvector was used to segment tumour tissue into two classes: stroma and epithelial zones (Figure 1). The method has been applied to all the images of the database. Then spectral analysis was used to select the most representative epithelial zone patches of each histological type (Figure 2). Finally, ψ₂ and ψ₃ allow a data sorting and a visualization of each patch and its neighbourhood in order to present the most similar patches (Figure 3).

Blood smears

For this application, spectral analysis was used to "segment", by data sorting, the image base of isolated blood cells into two classes: polymorphonuclear cells and lymphocytes (Figure 4).

Conclusion

Spectral Analysis is a promising approach for computer aided diagnosis of cancers (automated global analysis of histological tumour sections) as well as for automated sorting of isolated cells. The resulting concentration of objects of interest allows the pathologist to focus on specific regions whose morphology can be further studied more carefully or analyzed through complementary instruments, like Multispectral Imaging or Raman spectroscopy.

Acknowledgements

The authors gratefully acknowledge Dr Paulette Herlin, Dr Benoît Plancoulaine, Dr Jacques Chasle, Dr Georges Flandrin, the Regional Council of Lower Normandy, the "Comité départemental du Calvados de la Ligue de Lutte Contre le Cancer" and the General Council of "Hauts-de-Seine".

This article has been published as part of Diagnostic Pathology Volume 3 Supplement 1, 2008: New trends in digital pathology: Proceedings of the 9th European Congress on Telepathology and 3rd International Congress on Virtual Microscopy. The full contents of the supplement are available online at http://www.diagnosticpathology.org/supplements/3/S1

References

1. Xiaofei He, Wei-Ying Ma, Hongjiang Zhang: Imagerank: spectral techniques for structural analysis of image database.

   Multimedia and Expo, 2003. ICME'03. Proceedings. 2003 International Conference on, 6–9 July 2003 1:25-8.

2. Lafon S, et al.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps.

   PNAS 102(21):7426-7431. PubMed Abstract | Publisher Full Text | PubMed Central Full Text

   May 24, 2005;

Have something to say? Post a comment on this article!