A Multimodal Fusion Framework for Moyamoya Disease Diagnosis, Severity Staging, and Evidence-Grounded Report Generation
编号:136 访问权限:仅限参会人 更新:2026-11-10 16:52:23 浏览:8次 Online

报告开始:2026年11月20日 17:30(Asia/Kolkata)

报告时间:15min

所在会场:[S4] Artificial Intelligence and Intelligent Computing [S4-5] Artificial Intelligence and Intelligent Computing

演示文件

提示:该报告下的文件权限为仅限参会人,您尚未登录,暂时无法查看。

摘要
Moyamoya disease (MMD) is a rare, progressive cerebrovascular steno-occlusive disorder requiring angiographic confirmation and Suzuki staging. We present the Omni-Agent Cerebrovascular framework, an end-to-end multimodal system that integrates retinal fundus images, magnetic resonance angiography (MRA) volumes, and clinical variables through gated cross-modal attention fusion for simultaneous MMD diagnosis, severity staging, and evidence-grounded report generation. Three perception branches—ResNeXt-50 for bilateral fundus images, 3D ResNet-18 for MRA, and an MLP for clinical data—produce modality-specific embeddings that are fused via learned gating weights. The fused representation feeds a binary MMD classifier and an ordinal Suzuki staging head using cumulative probabilities. An instruction-tuned Qwen2.5-VL-7B-Instruct model with Low-Rank Adaptation (LoRA) generates evidence-grounded clinical reports strictly from structured upstream predictions. Evaluated on 263 patients (127 MMD, 136 controls), the full multimodal system achieved an AUROC of 0.961 (95% CI: 0.934–0.988) for MMD detection, a weighted Cohen's κ of 0.741 for Suzuki staging, and a report generation hallucination rate of 3.8% with 91.3% clinical factuality.
关键词
Moyamoya disease,multimodal fusion,gated cross-modal attention,ordinal regression,medical report generation,retinal fundus imaging,deep learning
报告人
ANIRUDH M R
Student Karunya Institute of Technology and Sciences

稿件作者
ANIRUDH M R Karunya Institute of Technology and Sciences
Shirley C P Karunya Institute of Technology and Sciences
发表评论
验证码 看不清楚,更换一张
全部评论
重要日期
  • 会议日期

    11月20日

    2026

    至

    11月22日

    2026

  • 10月31日 2026

    初稿截稿日期

  • 11月07日 2026

    提前注册日期

  • 11月22日 2026

    注册截止日期

主办单位
United Societies of Science
承办单位
Pondicherry University
协办单位
IEEE Section
IEEE Madras Section
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询