Enhancing Modern Microscopes With Artificial Intelligence Makes Smart Microscopes.
Devices of all kinds are being connected to the internet while being enhanced by artificial intelligence routines. There is nothing routine about A.I. but it is amazing to watch all of the tools and devices that we have used for so many years suddenly coming to life if you will.
The first change is to make the devices communicate to be able to collect data and then to use A.I. science to make sense of the huge piles of collected data. Piles is probably not the right word as computer scientists like to call it Big Data or data lakes.Either way is there any device that we cannot enhance using A.I? How about microscopes?
I have to wonder if we will ever really finish the internet of things and making devices smarter before A.I. science and robotics engineers simply give us a thinking machine that can use existing devices in a more intelligent way.
Maybe Instead of making smart devices we just need intelligent androids – Smart Microscopes with artificial intelligence
Anyways lets look at A.I, enhanced smart microscopes shall we?
Microscopes with artificial intelligence (AI) could help clinical microbiologists diagnose potentially deadly blood infections and improve patients’ odds of survival, according to microbiologists at Beth Israel Deaconess Medical Center (BIDMC). In a paper published in the Journal of Clinical Microbiology, the scientists demonstrated that an automated AI-enhanced microscope system is “highly adept” at identifying images of bacteria quickly and accurately. The automated system could help alleviate the current lack of highly trained microbiologists, expected to worsen as 20 percent of technologists reach retirement age in the next five years.
Microscopes have become smarter than the students?
Senior author James Kirby, MD, Director of the Clinical Microbiology Laboratory at BIDMC and Associate Professor of Pathology at Harvard Medical School commented:
This marks the first demonstration of machine learning in the diagnostic area. With further development, we believe this technology could form the basis of a future diagnostic platform that augments the capabilities of clinical laboratories, ultimately speeding the delivery of patient care.
Kirby’s team used an automated microscope designed to collect high-resolution image data from microscopic slides. In this case, blood samples taken from patients with suspected bloodstream infections were incubated to increase bacterial numbers. Then, slides were prepared by placing a drop of blood on a glass slide and stained with dye to make the bacterial cell structures more visible.
Next, they trained a convolutional neural network (CNN) – a class of artificial intelligence modeled on the mammalian visual cortex and used to analyze visual data – to categorize bacteria based on their shape and distribution. These characteristics were selected to represent bacteria that most often cause bloodstream infections; the rod-shaped bacteria including E. coli; the round clusters of Staphylococcus species; and the pairs or chains of Streptococcus species.
“Like a child, the system needed training,” said Kirby. “Learning to recognize bacteria required a lot of practice, making mistakes and learning from those errors.”
To train it, the scientists fed their unschooled neural network more than 25,000 images from blood samples prepared during routine clinical workups. By cropping these images – in which the bacteria had already been identified by human clinical microbiologists – the researchers generated more than 100,000 training images. The machine intelligence learned how to sort the images into the three categories of bacteria (rod-shaped, round clusters, and round chains or pairs), ultimately achieving nearly 95 percent accuracy.
Next, the team challenged the algorithm to sort new images from 189 slides without human intervention. Overall, the algorithm achieved more than 93 percent accuracy in all three categories. With further development and training, Kirby and colleagues suggest the AI-enhanced platform could be used as fully automated classification system in the future.
In the meantime, Kirby suggests automated classification can ameliorate the shortage of human technologists by helping them work more efficiently, “conceivably reducing technologist read time from minutes to seconds,” he said.
While human technologists routinely provide highly accurate diagnoses, demand for these highly skilled workers exceeds supply in the United States. Nine percent of lab technologists remain unfilled, and that number is expected to dramatically increase as technologists of the Baby Boomer generation begin to retire in droves, according to a 2014 survey from the American Society for Clinical Pathology.
The Advantages Of A Microscope with Artificial Intelligence.
What’s more, these images can be sent remotely, bringing the highest level expertise anywhere the internet reaches. That’s critical, as rapid identification and delivery of antibiotic medications is the key to treating bloodstream infections, which can kill up to 40 percent of patients who develop them. Each day a patient goes untreated is linked with an increased risk of mortality.
Here is another example of the Artificial Intelligence Microscope in action.
In addition to its clinical uses, the new tool could also have applications in microbiology training and research, Kirby noted.
“The tool becomes a living data repository as we use it,” he said. “And could be used to train new staff and ensure competency. It can provide unprecedented level of detail as a research tool.”