Blog

IIIT-H Study On Medical AI Models Cautions Against Blindly Trusting Their Output

The Shape of Data! How computational topology is fine-tuning scientific insights

Life on Campus

In the news

Medical AI tools are increasingly being used in medical imaging, where radiologists rely on them as a second pair of eyes to flag possible abnormalities in scans. However, a study by International Institute of Information Technology (IIIT) – Hyderabad researchers cautioned against blindly trusting output from such medical AI models. The research team led by Prof. Parameswari Krishnamurthy, with Dr. Syed Faizan as principal investigator, at the Language Technologies Research Centre (LTRC), audited four vision-language models — MAIRA-2, MedGemma-4B, LLaVA-Med-1.5 and LLaVA-1.5 — on thousands of publicly available chest X-rays. The team also conducted a reader study in which two radiologists assessed anonymised overlays, providing a human reference for the models’ localisation.
IIIT Hyderabad has launched BrainLab, an advanced human electroencephalography (EEG) research facility to enable cutting-edge research into how the human brain processes information, attention, perception and behaviour. The new facility has been established with support from the Department of Science and Technology (DST), Government of India, under the Fund for Improvement of S&T Infrastructure (DST-FIST) programme. The Cognitive Science Lab (CSL) received the grant in 2024 under the Life Sciences FIST (FIST-LS) programme. The grant-winning team comprised Prof. Bapi Raju, Dr. Vishnu Sreekumar, Dr. Bhaktee Dongaonkar, Dr. Vinoo Alluri, Dr. Priyanka Srivastava, and Dr. Kavita Vemuri.
Hyderabad’s Applied AI Research Centre (INAI), low-cost cameras mounted on police and towing vehicles are being paired with artificial intelligence and computer vision to turn road footage into actionable traffic-enforcement data. The system can identify violations such as wrong-side driving, helmetless riding and triple riding, read licence plates and feed verified evidence into the e-challan system. CE spoke to Govind Krishnan, head of engineering, Mobility, INAI, to understand how the technology works, the challenges of deploying AI on the road and what lies ahead. “INAI’s objective is to take research in areas such as artificial intelligence and computer vision and translate it into solutions for real-world problems,” he said.