A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image

Abstract

Morphological atlases are an important tool in organismal studies, and modern high-throughput Computed Tomography (CT) facilities can produce hundreds of full-body high-resolution volumetric images of organisms. However, creating an atlas from these volumes requires accurate organ segmentation. In the last decade, machine learning approaches have achieved incredible results in image segmentation tasks, but they require large amounts of annotated data for training. In this paper, we propose a self-training framework for multi-organ segmentation in tomographic images of Medaka fish. We utilize the pseudo-labeled data from a pretrained Teacher model and adopt a Quality Classifier to refine the pseudo-labeled data. Then, we introduce a pixel-wise knowledge distillation method to prevent overfitting to the pseudo-labeled data and improve the segmentation performance. The experimental results demonstrate that our method improves mean Intersection over Union (IoU) by 5.9% on the full dataset and enables keeping the quality while using three times less markup.

Dr. Sungho Suh

Senior Researcher

Human Activity Recognition, Safe and Trusted Human Centric Artificial Intelligence in Future Manufacturing Lines

Prof. Dr. rer. nat. Paul (Pawel) Lukowicz

Professor (W3) “Embedded Intelligence”

Paul Lukowicz is Full Professor of AI at the Technical University of Kaiserslautern in Germany where he is heading the Embedded Intelligence group at DFKI. From 2006 till 2011 he has been full Professor (W3) of Computer Science at the University of Passau. He has also been a senior researcher (“Oberassistent”) at the Electronics Laboratory at the Department of Information Technology and Electrical Engineering of ETH Zurich Paul Lukowicz has MSc. (Dipl. Inf.) and a Ph.D. (Dr. rer nat.) in Computer Science a MSc. in Physics (Dipl. Phys.). His research focus are context aware ubiquitous and wearable systems including sensing, pattern recognition, system architectures, models of large scale self-organized systems, and applications. Paul Lukowicz coordinates the FP7-FET SOCIONICAL projects, is Associate Editor in Chief of IEEE Pervasive Computing Magazine, and has been serving as TPC Chair of a number of international events in the area