RSNA machine learning challenge to focus on detecting pneumonia in chest x-rays
The Radiological Society of North America (RSNA) announced the launch of its second annual machine learning challenge on Monday, Aug. 27. Teams will be invited to develop algorithms to identify and localize pneumonia in chest x-rays.
The competition will be open to artificial intelligence (AI) researchers who create applications to perform a task according to specified metrics.
“The expectation that artificial intelligence will soon provide valuable tools for radiology continues to grow,” Luciano Prevedello, MD, MPH, chief of the division of medical imaging informatics at the Ohio State University and chair of the Machine Learning Steering Subcommittee of the RSNA Radiology Informatics Committee (RIC), said in a prepared statement. “By organizing machine learning data challenges, RSNA is playing an important role in fostering and demonstrating these capabilities.”
This year’s challenge will be based on a public data from the National Institutes of Health that have been annotated by multiple expert reviewers.
“A successful machine learning challenge needs to begin with a data set accurate and large enough to provide ‘ground truth,’” said Safwan Halabi, MD, medical director of radiology informatics at Stanford University and chair of the Machine Learning Data Standards Subcommittee of the RIC. “Developers build their applications by training them on the dataset and challenge organizers use a segment of the dataset to measure their performance.”
This year’s competition will take place on a Kaggle platform, with winners vying for $30,000 in prize money. The competition will have training and evaluation phases. Training, which will run through Oct. 17, will allow participants to train portion of the dataset to develop algorithms. Participants can then run their algorithms on the testing portion of the dataset during the evaluation phase, which will take place Oct. 18-24.
Winners will be announced in November, and top submissions will be recognized Nov. 26 at the RSNA 2018 annual meeting at McCormick Place in Chicago.
Click here for more information about the challenge.