|Evaluation of the diagnostic power of thermography in breast cancer using bayesian network classifiers.|
|Jump to Full Text|
|PMID: 23762182 Owner: NLM Status: In-Data-Review|
|Breast cancer is one of the leading causes of death among women worldwide. There are a number of techniques used for diagnosing this disease: mammography, ultrasound, and biopsy, among others. Each of these has well-known advantages and disadvantages. A relatively new method, based on the temperature a tumor may produce, has recently been explored: thermography. In this paper, we will evaluate the diagnostic power of thermography in breast cancer using Bayesian network classifiers. We will show how the information provided by the thermal image can be used in order to characterize patients suspected of having cancer. Our main contribution is the proposal of a score, based on the aforementioned information, that could help distinguish sick patients from healthy ones. Our main results suggest the potential of this technique in such a goal but also show its main limitations that have to be overcome to consider it as an effective diagnosis complementary tool.|
|Cruz-Ramírez Nicandro; Mezura-Montes Efrén; Ameca-Alducin María Yaneli; Martín-Del-Campo-Mena Enrique; Acosta-Mesa Héctor Gabriel; Pérez-Castro Nancy; Guerra-Hernández Alejandro; Hoyos-Rivera Guillermo de Jesús; Barrientos-Martínez Rocío Erandi|
|Type: Journal Article Date: 2013-05-22|
|Title: Computational and mathematical methods in medicine Volume: 2013 ISSN: 1748-6718 ISO Abbreviation: Comput Math Methods Med Publication Date: 2013|
|Created Date: 2013-06-13 Completed Date: - Revised Date: -|
Medline Journal Info:
|Nlm Unique ID: 101277751 Medline TA: Comput Math Methods Med Country: United States|
|Languages: eng Pagination: 264246 Citation Subset: IM|
|Departamento de Inteligencia Artificial, Universidad Veracruzana, Sebastián Camacho 5, Centro, 91000 Xalapa, VZ, Mexico.|
|APA/MLA Format Download EndNote Download BibTex|
Journal ID (nlm-ta): Comput Math Methods Med
Journal ID (iso-abbrev): Comput Math Methods Med
Journal ID (publisher-id): CMMM
Publisher: Hindawi Publishing Corporation
Copyright © 2013 Cruz-Ramírez Nicandro et al.
Received Day: 25 Month: 10 Year: 2012
Revision Received Day: 4 Month: 4 Year: 2013
Accepted Day: 22 Month: 4 Year: 2013
Print publication date: Year: 2013
Electronic publication date: Day: 22 Month: 5 Year: 2013
Volume: 2013E-location ID: 264246
PubMed Id: 23762182
|Evaluation of the Diagnostic Power of Thermography in Breast Cancer Using Bayesian Network Classifiers|
|Ameca-Alducin María Yaneli1|
|Acosta-Mesa Héctor Gabriel1|
|Hoyos-Rivera Guillermo de Jesús1|
|Barrientos-Martínez Rocío Erandi1|
1Departamento de Inteligencia Artificial, Universidad Veracruzana, Sebastián Camacho 5, Centro, 91000 Xalapa, VZ, Mexico
2Centro Estatal de Cancerología: Miguel Dorantes Mesa,
Aguascalientes 100, Progreso Macuiltepetl, 91130 Xalapa, VZ, Mexico
3Laboratorio Nacional de Informática Avanzada (LANIA) A.C. Rébsamen 80, Centro, 91000 Xalapa, VZ, Mexico
|Correspondence: *Cruz-Ramírez Nicandro: email@example.com
[other] Academic Editor: Alejandro Rodríguez González
Breast cancer is one of the main causes of death among women worldwide . Moreover, a specificity is required in the diagnosis of such a disease given that an incorrect classification of a sample as a false positive may lead to the surgical removal of the breast . Nowadays, there are different techniques for carrying out the diagnosis: mammography, ultrasound, MRI, biopsies, and, more recently, thermography [3–6]. In fact, thermography started in 1956  but was discarded some years later because of the poor quality of the thermal images  and the low specificity values it achieved. However, with the development of new thermal imaging technology, thermography has reappeared and is being seriously considered as a complementary tool for the diagnosis of breast cancer . Because of specificity required, it is compulsory to have as many available tools as possible to reduce, on the one hand, the number of false positives and, on the other hand, to achieve high sensitivity. Although open biopsy is regarded as the gold standard technique for diagnosing breast cancer, it is practically the last diagnostic resource used since it is an invasive procedure that represents not only significant health implications but also psychological and economic ones also . Other techniques, which are not necessarily invasive, have implicit risks or limitations such as X-ray exposure, interobserver interpretability and difficult access to high-tech expensive equipment [11, 12]. Thermography is also noninvasive, but it has the advantage of using a cheaper device (an infrared camera), which is far more portable than those used in mammography, MRI, and ultrasound. Furthermore, it can be argued that some of the variables considered by thermography may be more easily interpreted than those of some of the aforementioned techniques. As a matter of fact, in this paper we will explore and assess this argument in order to measure the potential of such a technique as a diagnostic tool for breast cancer. Moreover, our main contribution is the proposal of a score, based not only on thermographic variables but also on variables that portray more information than temperature alone, that might help differentiate sick patients from healthy ones. We will also explore the potential of thermography in diagnosing women below the age of 50, which would allow the detection of the disease in its early stages, thus reducing the percentage of mortality.
The rest of the paper is divided as follows. In Section 2, we will present some related research that places our research in context and thus appreciates our contribution. In Section 3, we explain the materials and methods used in our experiments. In Section 4, we will present the methodology and the experimental results. In Section 5, we will discuss these results and, finally, in Section 6, we will conclude our paper and give directions regarding future research.
In our review of the related literature, we divided these into three categories: introductory, image-based, and data-based works [13–17]. The introductory research mainly points out the potential of thermography as an alternative diagnostic tool for breast cancer comparing its performance to other diagnostic methods such as mammography and biopsy [18, 19]. Unfortunately, because this research is intended as an introduction to the topic, it lacks some important details about the data used in these studies as well as the analyses carried out.
The image-based works mainly range from cluster analyses applied to thermal images (to differentiate healthy from sick breasts)  to fractal analyses (to characterize the geometry of the malignant lesions)  to the camera calibration for capturing thermal images [3, 22].
The data-based investigations present statistical analyses of patient databases (healthy and sick) such as nonparametric tests, correlation, and analysis of variance; artificial intelligence analyses such as artificial neural networks and Bayesian analysis; and numerical models such as physical and simulation models (bioheat equations) [8, 9, 23–26]. Only a small number of papers propose a score formed from thermographic data [27, 28] but they only propose a maximum of 5 variables to form such a score. In our research, we propose 14 variables to calculate this score: this is the main contribution of the paper alongside the analysis of the diagnostic power of the proposed variables. In Section 3, we will present those variables in more detail and, in Section 4, we will evaluate how informative these variables are in the diagnosis of breast cancer. To end this section, it is important to mention that although the research in this category is very interesting, in some of them the methodology is not clear. This prevents one from easily reproducing the experiments carried out there. We have done our best to present a clear methodology so that our results can be reproduced.
For our experiments, we used a real-world database which was provided by an oncologist who has specialized in the study of thermography since 2008, consisting of 98 cases: 77 cases are patients with breast cancer (78.57%) and 21 cases are healthy patients (21.43%). All the results (either sick or healthy) were confirmed by an open biopsy, which is considered the gold standard diagnostic method for breast cancer . We include in this study 14 explanatory variables (attributes): 8 of them form our score (proposed by the expert), 6 are obtained from the thermal image, one variable is the score itself, and the final variable is age which was discretized in three categories as this is recommended for the selected algorithms [30–32]. In Table 1, we give details of the name, definitions, and values of each of these variables. The dependent variable (class) is the outcome (cancer or no cancer).
A Bayesian network (BN) [33, 34] is a graphical model that represents relationships of a probabilistic nature among variables of interest. Such networks consist of a qualitative part (structural model), which provides a visual representation of the interactions amid variables, and a quantitative part (set of local probability distributions), which permits probabilistic inference and numerically measures the impact of a variable or sets of variables on others. Both the qualitative and quantitative parts determine a unique joint probability distribution over the variables in a specific problem [33–35]. In other words, a Bayesian network is a directed acyclic graph consisting of : (a) nodes (circles), which represent random variables; arcs (arrows), which represent probabilistic relationships among these variables and (b) for each node, there is a local probability distribution attached to it, which depends on the state of its parents.
Figures 3 and 4 (see Section 4) show examples of a BN. One of the great advantages of this model is that it allows the representation of a joint probability distribution in a compact and economical way by making extensive use of conditional independence, as shown in (1):
|P(X1,X2,…,Xn)=∏i=1nP(Xi ∣ Pa(Xi)),|
Classification refers to the task of assigning class labels to unlabeled instances. In such a task, given a set of unlabeled cases on the one hand and a set of labels on the other, the problem to solve lies in finding a function that suitably matches each unlabeled instance to its corresponding label (class). As can be inferred, the central research interest in this specific area is the design of automatic classifiers that can estimate this function from data (in our case, we are using Bayesian networks). This kind of learning is known as supervised learning [37–39]. For the sake of brevity and the lack of space, we have not written here the code of the 2 procedures used in the tests carried out in this research. We have only briefly described them and refer the reader to their original sources. The procedures used in these tests are (a) the Naïve Bayes classifier, (b) Hill-Climber, and (c) Repeated Hill-Climber [38, 40, 41].
- The Naïve Bayes classifier (NB) is one of the most effective classifiers  and the benchmark against which state-of-the-art classifiers have to be compared. Its main appeals lie in its simplicity and accuracy: although its structure is always fixed (the class variable has an arc pointing to every attribute), it has been shown that this classifier has a high classification accuracy and optimal Bayes's error (see Figure 3, Section 4). In simple terms, the NB learns, from a training data sample, the conditional probability of each attribute given the class. Then, once a new case arrives, the NB uses Bayes's rule to compute the conditional probability of the class given the set of attributes selecting the value of the class with the highest posterior probability.
- Hill-Climber is a Weka's  implementation of a search and scoring algorithm, which uses greedy-hill-climbing  for the search part and different metrics for the scoring part, such as Bayesian information criterion (BIC), Bayesian Dirichlet (BD), Akaike information criterion (AIC), and minimum description length (MDL) . For the experiments reported here, we selected the MDL metric. This procedure takes an empty graph and a database as input and applies different operators for building a Bayesian network: addition, deletion, or reversal of an arc. In every search step, it looks for a structure that minimizes the MDL score. In every step, the MDL is calculated and procedure Hill-Climber keeps the structure with the best (minimum) score. It finishes searching when no new structure improves the MDL score of the previous network.
- Repeated Hill-Climber is a Weka's  implementation of a search and scoring algorithm, which uses repeated runs of greedy hill-climbing  for the search part and different metrics for the scoring part, such as BIC, BD, AIC, and MDL. For the experiments reported here, we selected the MDL metric. In contrast to the simple Hill-Climber algorithm, Repeated Hill-Climber takes as input a randomly generated graph. It also takes a database and applies different operators (addition, deletion, or reversal of an arc) and returns the best structure of the repeated runs of the Hill-Climber procedure. With this repetition of runs, it is possible to reduce the problem of getting stuck in a local minimum .
We followed the definition of the crossvalidation method given by Kohavi . In k-fold crossvalidation, we split the database D in k mutually exclusive random samples called the folds: D1, D2,…, Dk, where said folds have approximately the same size. We trained this classifier each time i ∈ 1,2,…, k using D∖Di and testing it on Di (again, the symbol denotes set difference). The crossvalidation accuracy estimation is the total number of correct classifications divided by the sample size (total number of instances in D). Thus, the k-fold crossvalidation estimate is as follows:
Accuracy: the overall number of correct classifications divided by the size of the corresponding test set:
[Formula ID: EEq3]where cc represents the number of cases correctly classified and n is the total number of cases in the test set.
Sensitivity: the ability to correctly identify those patients who actually have the disease:
[Formula ID: EEq4]where TP represents true positive cases and FN is false negative cases.
Specificity: the ability to correctly identify those patients who do not have the disease:
[Formula ID: EEq5]where TN represents true negative cases and FP is false positive cases.
We used stratified 10-fold crossvalidation on the 98-case database described in Section 3.1. All the algorithms described in Section 3.2.1 used this data in order to learn a classification model. Once we have this model, we then evaluate its performance in terms of accuracy, sensitivity, and specificity. We used Weka  for the tests carried out here (see their parameter set in Table 2). For comparison purposes other classifiers were included: a multilayer perceptron (MLP) neural network and decision trees (ID3 and C4.5) with default parameters. The fundamental goal of this experiment was to assess the diagnostic power of the thermographic variables that form the score and the interactions among these variables. To illustrate how the variable values are obtained, we cite one example.
- In Figure 1 we show the type of images obtained by the thermal imager; in this case, the front of the breast thermography. Using ThermaCAM Researcher Professional 2.9  software, we detect the hottest areas of the breast that pass from red to gray. The breast whose furrow displays the largest gray area is assigned a positive value and the other a negative one.
In Figure 2 we show a general overview of the procedure of breast thermography, from thermal image acquisition to the formation of the score.
Tables 3, 4, 5, 6, 7, 8, 9, and 10 show the numerical results of this experiment. Figures 3 and 4 show the structures resulting from running Hill-Climber and Repeated Hill-Climber classifiers and Figure 5 shows the decision tree (C4.5). We do not present the structure of the Naïve Bayes classifier since it is always fixed: there is an arc pointing to every attribute from the class. For the accuracy test, the standard deviation is shown next to the accuracy result. For the remaining tests, their respective 95% confidence intervals (CI) are shown in parentheses.
The main objective of this paper is to assess the diagnostic power of thermography in breast cancer using Bayesian network classifiers. As can be seen from Table 3, the overall accuracy is still far from a desirable value. We chose Bayesian networks for the analyses because this model does not only carry out a classification task but it is also able to show interactions between the attributes and the class as well as interactions among the attributes themselves. This ability of Bayesian networks allows us to visually identify which attributes have a direct influence over the outcome and how they are related to one another. The MLP shows a comparable performance but lacks the power of explanation: it is not possible to query this network to know how it reached a specific decision. On the other hand, decision trees do have this explanation capability but lack the power to represent interactions among attributes (explanatory variables). Figures 3 and 4 depict that only 5 variables (out of 16) are directly related to the score: 1C, f_unique, thermovascular, curve_pattern, and asymmetry_t. Hence we can see that the score influence on the class outcome is null and the variable furrow (this variable is part of the score) is the only one that affects the class. Figure 5 shows that procedure C4.5 also identifies 2 of those 5 variables as being the most informative ones for making a decision: f_unique and asymmetry_t. In fact, if we only consider these attributes, we get the same classification performance as that when taking into account all thermographic variables. Other models, such as artificial neural networks, cannot easily identify this situation. As seen in Section 3.2, the extensive use of conditional independence allows Bayesian networks to potentially disregard spurious causes and to easily identify direct influences from indirect ones. In other words, once these variables are known, they render the rest of the variables independent from the outcome. Another surprising result is that of variable age: some other tests consider this to be an important observation for the diagnosis of breast cancer [30–32]. However, our analyses suggest that, at least with the database used in our experiments, age is not important in a diagnosis when using thermography. As can be seen from Figures 3 and 4, age is disconnected from the rest of the variables. This may imply that thermography shows potential for diagnosing breast cancer in women younger than 50 years of age.
Regarding the sensitivity performance of our models (see Table 3), Hill-Climber and Repeated Hill-Climber achieve a perfect value of 100%. This means that, at least with our database, thermography is excellent for identifying sick patients. Naïve Bayes classifier shows a significantly worse performance; it can be argued that this performance is due to the noise that the rest of the variables may add. Once again, if we only considered the 5 variables mentioned above, we would get the same results as those using Hill-Climber and Repeated Hill-Climber. Other models would not be capable of revealing this situation. Of course, it is mandatory to get more data in order to confirm such results.
It is important to point out that the Hill-Climber and Repeated Hill-Climber procedures identify the same 5 variables as directly influencing the outcome.
Regarding the specificity performance of our models (see Table 3), Hill-Climber and Repeated Hill-Climber achieve the worst possible value of 0%. This means these 5 variables, while being informative when detecting the presence of the disease, are not useful for detecting the absence of such disease (see Tables 5–10). On the other hand, the noise that the rest of the attributes produce when detecting the disease seems to work the other way around: it is not noise but information that makes Naïve Bayes achieve a specificity of 33%. Of course, such a value is far from desirable, but this result makes us think of proposing two different scores (one for sensitivity and one for specificity) with two different sets of variables. But our proposal of a score is a first approximation to combine thermographic variables in such a way as to allow us to tell sick patients from healthy ones. Our results show that such a score needs to be refined in order to more easily identify these types of patients.
Although the results may be discouraging, we strongly believe that they are a step forward in order to more deeply comprehend the phenomenon under investigation: breast cancer. In fact, we have proposed a score that takes into account more information than just that of temperature. Until now, few areas of research have considered other variables apart from that of temperature [27, 28]. Those papers include in their analyses a total of 5 variables that can be extracted from the information a thermogram provides. Our score includes 16 variables and our work, to the best of our knowledge, presents the first analysis of this kind of data using Bayesian networks. What this analysis suggests is a refinement of the score, probably in the sense of proposing a more complex function to represent it beyond the simple addition of the values of each attribute. Intuitively, we thought that other variables, such as hyperthermia or thermovascular network, would be more significant in differentiating sick patients from healthy ones.
In the case of the database, we are aware of the limitations regarding the number of cases and the imbalance of the number of classes. Thus, we would need to collect more data so that more exhaustive tests can be carried out.
Thermography has been used as an alternative method for the diagnosis of breast cancer since 2005. The basic principle is that lesions in the breasts are hotter than healthy regions. In our experience, only taking into account temperature is not enough to diagnose breast cancer. That is why we proposed a score that considers more information than only temperature alone. We have found that only 5 attributes that are part of this score are the unique direct influence needed to determine if a patient has cancer.
Although some other research projects show better performance than ours, their methodology to carry out the experiments is not clear; thus these experiments cannot be reproduced. Therefore, we need to more closely explore the details of these models and the nature of their data. In this paper we have done our best to present the methodology used in our experiments as clear as possible so that they indeed can be reproduced. It is true that we do not give details about how the database was formed (since this is not the primary goal of the paper). However, we believe that if we make this database available, researchers who want to reproduce our experiments should be able to do so without much trouble.
We have found that the framework of Bayesian networks provides a good model for analyzing this kind of data: it can visually show the interactions between attributes and outcome as well as the interactions among attributes and numerically measure the impact of each attribute on the class.
Although we obtained excellent sensitivity results, we also obtained very poor specificity results. The sensitivity values are consistent with the expectations of the expert, and a discussion about the helpfulness of the Bayesian network is already underway in order to better understand the disease. Given that breast cancer has a special requirement of specificity values, we have to more deeply investigate the causes of those poor results. One possible direction for future research is to collect more balanced data using techniques such as SMOTE , ADASYN , AdaC1 , and GSVM-RU . Another possible direction is to design a more complex score that includes a more complex function compared to that of a simple sum. A third direction we can detect is reviewing how the variables are collected and try to reduce subjectivity in them. Finally, we have also detected that medical doctors usually take into account more information than that supplied to the models for diagnosing breast cancer. Thus, we can also work more in the area of knowledge elicitation.
The authors declare that they have no conflict of interests.
|1.||Jemal A,Bray F,Center MM,Ferlay J,Ward E,Forman D. Global cancer statisticsA Cancer Journal for CliniciansYear: 201161269902-s2.0-79952232216|
|2.||Gnerlich J,Jeffe DB,Deshpande AD,Beers C,Zander C,Margenthaler JA. Surgical removal of the primary tumor increases overall survival in patients with metastatic breast cancer: analysis of the 1988–2003 SEER dataAnnals of Surgical OncologyYear: 2007148218721942-s2.0-3454710712717522944|
|3.||Ng EYK. A review of thermography as promising non-invasive detection modality for breast tumorInternational Journal of Thermal SciencesYear: 20094858498592-s2.0-60549118149|
|4.||Bonnema J,Van Geel AN,Van Ooijen B,et al. Ultrasound-guided aspiration biopsy for detection of nonpalpable axillary node metastases in breast cancer patients: new diagnostic methodWorld Journal of SurgeryYear: 19972132702742-s2.0-00310385729015169|
|5.||Schnall MD,Blume J,Bluemke DA,et al. MRI detection of distinct incidental cancer in women with primary breast cancer studied in IBMC 6883Journal of Surgical OncologyYear: 200592132382-s2.0-2624445236816180227|
|6.||Geller BM,Kerlikowske K,Carney PA,et al. Mammography surveillance following breast cancerBreast Cancer Research and TreatmentYear: 20038121071152-s2.0-1074422333014572153|
|7.||Foster KR. Thermographic detection of breast cancerIEEE Engineering in Medicine and Biology MagazineYear: 1998176p. 102-s2.0-3643123955|
|8.||Wishart GC,Campisi M,Boswell M,et al. The accuracy of digital infrared imaging for breast cancer detection in women undergoing breast biopsyEuropean Journal of Surgical OncologyYear: 20103665355402-s2.0-7795312143420452740|
|9.||Arora N,Martins D,Ruggerio D,et al. Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancerAmerican Journal of SurgeryYear: 200819645235262-s2.0-5204910714518809055|
|10.||Verkooijen HM,Peeters PHM,Buskens E,et al. Diagnostic accuracy of large core needle biopsy for nonpalpable breast disease: a meta-analysisBritish Journal of CancerYear: 2000825101710212-s2.0-003401103810737383|
|11.||Kuhl CK,Schrading S,Leutner CC,et al. Mammography, breast ultrasound, and magnetic resonance imaging for surveillance of women at high familial risk for breast cancerJournal of Clinical OncologyYear: 20052333846984762-s2.0-3364468716316293877|
|12.||Kriege M,Brekelmans CTM,Boetes C,et al. Efficacy of MRI and mammography for breast-cancer screening in women with a familial or genetic predispositionNew England Journal of MedicineYear: 200435154275192-s2.0-334301415315282350|
|13.||Gutierrez F,Vazquez J,Venegas L,et al. Feasibility of thermal infrared imaging screening for breast cancer in rural communities of southern mexico: the experience of the centro de estudios y prevencion del cancer (ceprec)Proceedings of the 2009 ASCO Annual Meeting2009American Society of Clinical Oncologyp. 1521|
|14.||Hairong Q,Phani TK,Zhongqi L. Early detection of breast cancer using thermal texture mapsProceedings of the IEEE International Symposium on Biomedical Imaging2002309312|
|15.||Ohsumi S,Takashima S,Aogi K,Usuki H. Prognostic value of thermographical findings in patients with primary breast cancerBreast Cancer Research and TreatmentYear: 20027432132202-s2.0-003599097312206513|
|16.||Ng EYK,Chen Y,Ung LN. Computerized breast thermography: study of image segmentation and temperature cyclic variationsJournal of Medical Engineering and TechnologyYear: 200125112162-s2.0-003505866711345095|
|17.||Ng EYK,Sudharsan NM. Parametric optimization for tumour identification: bioheat equation using ANOVA and the Taguchi methodJournal of Engineering in MedicineYear: 200021455055122-s2.0-003450758311109858|
|18.||Sterns EE,Zee B. Thermography as a predictor of prognosis in cancer of the breastCancerYear: 1991676167816802-s2.0-00258452512001557|
|19.||Ng EYK,Ung LN,Ng FC,Sim LSJ. Statistical analysis of healthy and malignant breast thermographyJournal of Medical Engineering and TechnologyYear: 20012562532632-s2.0-003569256211780767|
|20.||EtehadTavakol M,Sadri S,Ng EYK. Application of K- and fuzzy c-means for color segmentation of thermal infrared breast imagesJournal of Medical SystemsYear: 201034135422-s2.0-7794926962720192053|
|21.||EtehadTavakol M,Lucas C,Sadri S,Ng EYK. Analysis of breast thermography using fractal dimension to establish possible difference between malignant and benign patternsJournal of Healthcare EngineeringYear: 2010112744|
|22.||Damnjanović Z,Petrović D,Pantović R,Smiljanić Z. Infra red digital imaging in medicineInternational Journal of Collaborative Research on Internal Medicine and Public HealthYear: 20102124254342-s2.0-78650587966|
|23.||Ng EYK,Fok SC. A framework for early discovery of breast tumor using thermography with artificial neural networkBreast JournalYear: 2003943413432-s2.0-004266687612846879|
|24.||Ng EYK,Sudharsan NM. Effect of blood flow, tumour and cold stress in a female breast: a novel time-accurate computer simulationJournal of Engineering in MedicineYear: 200121543934042-s2.0-003522459511521762|
|25.||Ng EYK,Sudharsan NM. Numerical computation as a tool to aid thermographic interpretationJournal of Medical Engineering and TechnologyYear: 200125253602-s2.0-003496142411452633|
|26.||Ng EYK,Fok SC,Peh YC,Ng FC,Sim LSJ. Computerized detection of breast cancer with artificial intelligence and thermogramsJournal of Medical Engineering and TechnologyYear: 20022641521572-s2.0-003666090612396330|
|27.||Wang J,Chang KJ,Chen CY,et al. Evaluation of the diagnostic performance of infrared imaging of the breast: a preliminary studyBioMedical EngineeringYear: 20109p. 32-s2.0-76749149537|
|28.||Wang J,Shih TTF,Yen RF,et al. The Association of Infrared Imaging Findings of the Breast with Hormone Receptor and Human Epidermal Growth Factor Receptor 2 Status of Breast CancerAcademic RadiologyYear: 20111822122192-s2.0-7865110814521126889|
|29.||Sardanelli F,Giuseppetti GM,Panizza P,et al. Sensitivity of MRI versus mammography for detecting foci of multifocal, multicentric breast cancer in fatty and dense breasts using the whole-breast pathologic examination as a gold standardAmerican Journal of RoentgenologyYear: 20041834114911572-s2.0-794423882615385322|
|30.||Cross SS,Stephenson TJ,Mohammed T,Harrison RF. Validation of a decision support system for the cytodiagnosis of fine needle aspirates of the breast using a prospectively collected dataset from multiple observers in a working clinical environmentCytopathologyYear: 20001165035122-s2.0-003451960111194082|
|31.||Cross SS,Dubé AK,Johnson JS,et al. Evaluation of a statistically derived decision tree for the cytodiagnosis of fine needle aspirates of the breast (FNAB)CytopathologyYear: 1998931781872-s2.0-00318373949638379|
|32.||Walker AJ,Cross SS,Harrison RF. Visualisation of biomedical datasets by use of growing cell structure networks: a novel diagnostic classification techniqueThe LancetYear: 19993549189151815212-s2.0-0033619476|
|33.||Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible InferenceYear: 1988Burlington, Mass, USAMorgan Kaufmann Publishers (Morgan Kaufmann series in representation and reasoning).|
|34.||Neuberg LG. Causality: models, reasoning, and inference, by judea pearl, cambridge university press, 2000Econometric TheoryYear: 200319675685|
|35.||Friedman N,Goldszmidt M. Learning Bayesian Networks from DataYear: 1998Menlo Park, Calif, USAUniversity of California, Berkeley, Calif, USA; Stanford Research Institute|
|36.||Cooper G. An overview of the representation and discovery of causal relationships using bayesian networksComputation Causation DiscoveryYear: 1999|
|37.||Kohavi R. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model SelectionYear: 1995Boston, Mass, USAMorgan Kauffmann|
|38.||Friedman N,Geiger D,Goldszmidt M. Bayesian Network ClassifiersMachine LearningYear: 1997292-31311632-s2.0-0031276011|
|39.||Han J,Kamber M. Data Mining: Concepts and TechniquesYear: 2006New York, NY, USAElsevier (The Morgan Kaufmann Series in Data Management Systems).|
|40.||Duda RO,Hart PE,Stork DG. Pattern ClassificationYear: 20012nd editionNew York, NY, USAJohn Wiley & Sons|
|41.||Witten IH,Frank E. Data Mining: Practical Machine Learning Tools and TechniquesYear: 20052nd editionBoston, Mass, USAMorgan Kauffmann (Morgan Kaufmann Series in Data Management Systems).|
|42.||Russell SJ,Norvig P. Artificial Intelligence: A Modern ApproachYear: 20093rd editionUpper Saddle River, NJ, USAPrentice Hall|
|43.||Tsamardinos I,Brown LE,Aliferis CF. The max-min hill-climbing Bayesian network structure learning algorithmMachine LearningYear: 200665131782-s2.0-33746035971|
|44.||Lavrač N. Selected techniques for data mining in medicineArtificial Intelligence in MedicineYear: 19991613232-s2.0-003289511110225344|
|45.||Cross SS,Dubé AK,Johnson JS,et al. Evaluation of a statistically derived decision tree for the cytodiagnosis of fine needle aspirates of the breast (FNAB)CytopathologyYear: 1998931781872-s2.0-00318373949638379|
|46.||Cross SS,Stephenson TJ,Mohammed T,Harrison RF. Validation of a decision support system for the cytodiagnosis of fine needle aspirates of the breast using a prospectively collected dataset from multiple observers in a working clinical environmentCytopathologyYear: 20001165035122-s2.0-003451960111194082|
|47.||Cross SS,Downs J,Drezet P,Ma Z,Harrison RF. Which Decision Support Technologies are Appropriate for the Cytodiagnosis of Breast Cancer?Year: 2000Hackensack, NJ, USAWorld Scientific|
|48.||Inc FLIR SystemThermacam researcher professional 2.9Year: 2009 http://support.flir.com/DocDownload/Assets/47/English/T5590091387.|
|49.||Bowyer KW,Chawla NV,Hall LO,Kegelmeyer WP. Smote: synthetic minority over-sampling techniqueJournal of Artificial Intelligence ResearchYear: 2002163213572-s2.0-0346586663|
|50.||He H,Bai Y,Garcia EA,Li S. Adasyn: adaptive synthetic sampling approach for imbalanced learningProceedings of the IEEE International Joint Conference on Neural Networks (IJCNN '08)June 2008132213282-s2.0-56349089205|
|51.||Sun Y,Kamel MS,Wong AKC,Wang Y. Cost-sensitive boosting for classification of imbalanced dataPattern RecognitionYear: 20074012335833782-s2.0-34547673383|
|52.||Tang Y,Zhang YQ. Granular SVM with repetitive undersampling for highly imbalanced protein homology predictionProceedings of the IEEE International Conference on Granular ComputingMay 20064574602-s2.0-33751098785|
Previous Document: Modiolus-hugging intracochlear electrode array with shape memory alloy.
Next Document: Fractal analysis of elastographic images for automatic detection of diffuse diseases of salivary gla...