Session: Remote Sensing And Image Analysis - LB 19
Identification of snails and Schistosoma of medical importance via convolutional neural networks: A proof-of-concept application for human schistosomiasis
Thursday, August 5, 2021
Link To Share This Poster: https://cdmcd.co/abyvm4
Krti Tallam, Zac Yung-Chun Liu and Pretom Shome, Stanford University, Andrew J. Chamberlin and Isabel J. Jones, Hopkins Marine Station, Stanford University, Pacific Grove, CA, Gilles Riveau and Nicolas Jouanard, Laboratoire de Recherches Médicales, Centre Espoir pour la Santé, St Louis, Senegal, Raphael A. Ndione and Lydie Bandagny, Centre de Recherche Biomédicale Espoir pour la Santé, Paul Van Eck and Ton Ngo, IBM, Susanne H. Sokolow, Woods Institute for the Environment, Stanford University, Stanford, CA, Giulio A. De Leo, Department of Biology, Stanford University, Stanford, CA
Presenting Author(s)
Krti Tallam
Stanford University
Background/Question/Methods In recent decades, computer vision has proven remarkably effective in addressing diverse issues in public health, from determining the diagnosis, prognosis, and treatment of diseases in humans to predicting infectious disease outbreaks. Here, we investigate whether convolutional neural networks (CNNs) can also demonstrate effectiveness in classifying the environmental stages of parasites of public health importance and their invertebrate hosts. We used schistosomiasis as a reference model. Schistosomiasis is a debilitating parasitic disease transmitted to humans via snail intermediate hosts. The parasite affects more than 200 million people in tropical and subtropical regions. We trained our CNN, a feed-forward neural network, on a limited dataset of 5,500 images of snails and 5,100 images of cercariae obtained from schistosomiasis transmission sites in the Senegal River Basin, a region in western Africa that is hyper-endemic for the disease. The image set included both images of two snail genera that are relevant to schistosomiasis transmission – that is, Bulinus spp. and Biomphalaria pfeifferi – as well as snail images that are non-component hosts for human schistosomiasis. Cercariae shed from Bi. pfeifferi and Bulinus spp. snails were classified into 11 categories, of which only two, S. haematobium and S. mansoni, are major etiological agents of human schistosomiasis. Results/Conclusions The algorithms, trained on 80% of the snail and parasite dataset, achieved 99% and 91% accuracy for snail and parasite classification respectively, when used on the hold-out validation dataset – a performance comparable to that of experienced parasitologists. The promising results of this proof-of-concept study suggests that this CNN model, and potentially similar replicable models, have the potential to support the classification of snails and parasite of medical importance. In remote field settings where machine learning algorithms can be deployed on cost-effective and widely used mobile devices, such as smartphones, these models can be a valuable complement to laboratory identification by trained technicians. Future efforts must be dedicated to increasing dataset sizes for model training and validation, as well as testing these algorithms in diverse transmission settings and geographies.