Steve Lenier

home

authors

steve-lenier

Artificial intelligence can provide a knowledge base that can be a foundation for the interpretation of data. The importance of the humanistic elements of medicine remain vital.

Artificial intelligence (AI) is a technology in which machines and equipment can “

” from experience and adjust accordingly. It is a technology that has 

the potential to have a significant impact

There are three categories of algorithms for AI and machine learning:

Unsupervised learning, which groups data that has not been labeled and includes methods such as clustering,
		 

Supervised learning, which infers a function from labeled training data and maps an input to an output based on example input-output pairs, includes linear regression analysis, support vector machine analysis, decision trees and random forests, and convoluted neural networks and deep learning, relying heavily on labeled data,
		 

Semi-supervised learning, which uses mostly unlabeled data with a small amount of labeled data.

In ophthalmology, the neural network approach, deep learning, has surpassed other methods in recent years. It requires a level of computing that wasn’t available to most researchers in the past, so other approaches were more likely to be used. With today’s increased access to big data and analytics, there has been a plateau in the traditional methods, and deep learning has surpassed it simply because it requires more analytical abilities.

Dimitri Azar, MD, MBA, senior director of Ophthalmic Innovations and Clinical Lead of Ophthalmology at Alphabet Verily Life Sciences, and Distinguished University Professor and B.A. Field Chair of Ophthalmologic Research, and former Dean of the College of Medicine at the University of Illinois, said, “One thing about these learning networks that I was impressed with is that as the training commences, neural networks start off without any fine tuning, and return random results. The neural network progressively learns the combinations and permutations of important features.”

Dr. Azar added that a difference between neural networks, and human beings, is that humans have trouble letting go of inaccurate information that was thought to be useful in the past. The convoluted neural networks, as they progressively learn combinations and permutations of the important features, learn to ignore the unimportant features in order to make better algorithms.

The process for the networks features a weight given to particular features. The features the network finds most important are given the most weight. As the network learns more, these weightings shift, so a feature that early on was thought to be very important will be given less weight, as other features are given more weight. This allows the networks to make more accurate predictions.

The algorithm generation process begins with an input layer. Before there is any output, there are several hidden layers. While the applications operate like black boxes, the results are not always given with an explanation. This makes detection of inappropriate outcomes difficult. As the algorithms become more powerful, the methods for troubleshooting them may lag behind. This can be a potential limitation of this approach, and may have implications in obtaining approval.

Dr. Azar did a literature search on the use of AI in ophthalmology, in the topics of AMD, diabetic retinopathy, retinopathy of prematurity, dry eye, keratoconus and corneal topography, and glaucoma and visual fields. He found that the numbers have been growing steadily. The search showed that from 2016 through the first half of 2018, a period of 30 months, there were approximately twice as many publications as in the 60 months from 2006 through 2010.

 were the most frequent topics found in the search. He pointed out there are AI applications in corneal topography (some of which stem from his early work with Dr. Paul Lu), and dry eye as well. He proposes future studies using AI that could simplify the diagnosis and classification of different types of dry eye, and their severity, potentially replacing the current methods that are based on the DEWS II report.

In glaucoma there are several studies utilizing deep learning. Some look at the nerve fiber layer, and others focus on the optic nerve. Future studies will include using OCT-A to examine blood flow in the retina, adjacent to the nerve.

When it comes to AI, a major problem in glaucoma is that the data comes from multiple sources, which frequently don’t connect with each other. There may be billing data, patient information, imaging data, etc., all coming from different sources. While it would seem easy to connect these sources, doing so in a HIPAA-compliant way is not always easy.

A group at the University of Illinois has developed a machine learning method to collect the data that comes from various diagnostic tools and records, under one name or one eye, staying within HIPAA regulations. Currently most doctors look at data from multiple sources to make a diagnosis. The time-consuming visual field test is probably the most reliable way of detecting whether or not someone is progressing. By linking this data together, Dr. Azar says with AI applications it should become easier to find shortcuts that can predict what will happen in glaucoma, like current trends in diabetic retinopathy.

Fundus photography is a big area of AI applications in ophthalmology. The Google group has published articles on the use of AI in several areas, including refractive error prediction, cardiovascular risk detection, identification of retinal lesions, and diabetic retinopathy.

An article published in IOVS in 2018, using data from the UK biobank and the AREDS study, looked at attention maps that predicted refractive error, and the refractive error prediction was good.

 One of the figures in the article shows attention maps for myopic, emmetropic (neutral), or hyperopic patients.

Even with the computer pointing out the areas it used to make a diagnosis, it can still be difficult for an ophthalmologist to make a diagnosis. The computer is able to do so.

In a landmark article published in Nature Medicine in 2017 the researchers used deep learning architecture to make referral recommendations in a group of OCT scans, done with multiple devices.

By using tissue segmentation they were able to give a probability of a diagnosis, and accordingly make an urgent, semi-urgent, routine, or observation only referral suggestion.

If “trained” properly, the machine was able to have an error rate in the patient referral decisions of only 5.5%. This was better than 80% of the retina specialists and all of the optometrists, who were given not only the OCT data, but also fundus data and notes.

He discussed the article he called “transformational.” It was published in JAMA 2016 and focused on using deep learning for diagnosing DR.

 The study results showed very high sensitivity and specificity, and showed diagnoses were as good or better than those of the retina specialists who were convened there.

The area receiving the most attention in retinal AI applications is OCT. One study looked at the severity, characterization and estimation of 5-year risk of AMD progression using AI and found that the machine did very well.

Another group studied the prediction of individual disease conversion in early AMD.

 The authors found the most critical quantitative features for progression were retinal thickness, hyper-reflective foci, and drusen areas. Dr. Azar said, “The interesting part here is this is not only predicting a disease, but also includes discovery.”

There are great applications of AI in ophthalmology, and the uses will continue to expand. But there are several limitations, including:

• The quality and diversity of training sets
	• Problems with image quality
	• Because the statistics are very good, people may erroneously conclude that the system is not making errors
	• The black box effect of convoluted neural networks

Dr. Azar pointed out that over 100 years ago, the famous Flexner report established the biomedical model of education, training, and research as an enduring basis of medical education.

He described this as a cross-disciplinary convergence in ophthalmology, but said there are caveats when it comes to the education of ophthalmology fellows, residents, and students.

There needs to be an understanding that the knowledge base these machines can provide should only be a foundation to facilitate interpretation of data. And he emphasized the importance of the humanistic elements of medicine-professionalism, communication, empathy, compassion, and respect. Dr. Azar said these important topics should now be included in the curriculum of all medical students, because much of the information doctors previously needed to learn will be easily obtained through AI.

“With this information readily available at our fingertips, what we need to be focusing on is what brought us to medicine in the very beginning, which is the humanistic aspects of medicine,” he concluded.

This article was adapted from Dr. Azar’s presentation at the 2018 Johns Hopkins Wilmer Eye Institute’s Current Concepts in Ophthalmology meeting in Baltimore. At the time of the presentation, Dr. Azar was on the Board of Directors of Novartis, and the Board of Directors of Verb Surgical, and received NIH funding including an RO1 grant. He is currently an employee of Alphabet Verily.

1. Varadarajan AV, Poplin R, Blumer K, et al. Deep Learning for Predicting Refractive Error From Retinal Fundus Images.

. 2018 Jun 1;59(7):2861-2868. doi: 10.1167/iovs.18-23887.

2. De Fauw J, Ledsam JR, Romera-Paredes B, et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. 

. 2018 Sep;24(9):1342-1350. doi: 10.1038/s41591-018-0107-6. Epub 2018 Aug 13.

3. Gulshan V, Peng L, Coram M, et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. 

. 2016 Dec 13;316(22):2402-2410. doi: 10.1001/jama.2016.17216.

4. Schmidt-Erfurth U, Waldstein SM, Klimscha S, et al. Prediction of Individual Disease Conversion in Early AMD Using Artificial Intelligence.

. 2018 Jul 2;59(8):3199-3208. doi: 10.1167/iovs.18-24106.

5. Burlina PM, Joshi N, Pacheco KD, et al. Use of Deep Learning for Detailed Severity Characterization and Estimation of 5-Year Risk Among Patients With Age-Related Macular Degeneration. 

. 2018 Dec 1;136(12):1359-1366. doi: 10.1001/jamaophthalmol.2018.4118.

6. Flexner A. Medical Education in the United Sates and Canada. 

Washington, DC: Science and Health Publications, Inc

Articles

Deep learning approach is driving growth of AI

Author | Steve Lenier

Articles

The future: Artificial intelligence gains acceptance in ophthalmology