DeepFake Sentinel: An Explainable Vision Transformer Framework for Deepfake Detection and Attention-Based Evidence Localization
编号:69 访问权限:仅限参会人 更新:2026-11-10 16:36:27 浏览:7次 Online

报告开始:2026年11月21日 14:15(Asia/Kolkata)

报告时间:15min

所在会场:[S4] Artificial Intelligence and Intelligent Computing [S4-8] Artificial Intelligence and Intelligent Computing

暂无文件

摘要
The increasing realism of synthetic media has made it difficult to reliably distinguish authentic images and videos from manipulated content using manual inspection alone. This paper presents DeepFake Sentinel, an explainable Vision Transformer (ViT)-based framework for deepfake detection and attention-based evidence visualization. The proposed system supports image and short-video uploads, validates media by decoding its actual content, and performs input-quality assessment using resolution, blur, brightness, contrast, and face-availability signals. A configurable ViT-based classifier estimates the probability of manipulated content and applies threshold-based decision logic to categorize results as likely authentic, likely manipulated, or inconclusive. For interpretability, the framework employs attention rollout to generate grayscale attention maps, heatmaps, and visual overlays that indicate image regions influencing the model's prediction. These visualizations are explicitly distinguished from ground-truth forgery segmentation. For video analysis, representative frames are sampled and their predictions are aggregated using a deterministic trimmed-mean strategy, while insufficient evidence results in an inconclusive outcome. The system integrates a React and TypeScript frontend, a FastAPI backend, and PostgreSQL-based persistence to maintain analysis history, model metadata, thresholds, evidence records, reviewer decisions, and audit information. An optional large language model provides explanations based on structured detector outputs but cannot modify classification results. Prototype validation demonstrates the implementation of the system workflow and attention-evidence visualization; however, comprehensive quantitative detection performance remains subject to evaluation on licensed, diverse, labeled datasets. DeepFake Sentinel provides a traceable, human-in-the-loop framework for visual authenticity screening while explicitly representing uncertainty and the limitations of model-generated evidence.
关键词
Deepfake Detection, Vision Transformer (ViT), Deep Learning, Computer Vision, Image Forgery Detection
报告人
Shaik Khaleel aazad
Undergraduate Studen Kalasalingam academy of research and education

稿件作者
Shaik Khaleel aazad Kalasalingam academy of research and education
Shaik Mahammad sahul Kalasalingam academy of research and education
Nanduri Surya prakash Kalasalingam academy of research and education
发表评论
验证码 看不清楚,更换一张
全部评论
重要日期
  • 会议日期

    11月20日

    2026

    至

    11月22日

    2026

  • 10月31日 2026

    初稿截稿日期

  • 11月07日 2026

    提前注册日期

  • 11月22日 2026

    注册截止日期

主办单位
United Societies of Science
承办单位
Pondicherry University
协办单位
IEEE Section
IEEE Madras Section
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询