Fusion Based Video Summarization: Integrating Transcripts and Keyframes for YouTube Content Analysis
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 18.03.2026 · 10 (03) · 1-9
DOI: 10.55041/ijsrem57860 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 18.03.2026. Verfasst von VASIREDDY SWATHI und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Abstract— In addition, the fastest growth of video-sharing platforms has produced an onslaught of long-form multimedia content. Long videos are commonly used in educational and technical domains, but users often find it difficult to efficiently extract relevant information from them. Most of the existing transcript-based summarization approaches mainly make use of textual features and tend to neglect viewer engagement cues that indicate significance of video segments. This work presents a novel fusion-based multimodal YouTube video summarization pipeline leveraging transcript, engagement analysis, and generative AI insights. Our framework utilizes TextRank algorithm along with TF–IDF based similarity measure to rank sentences of transcript of the video. The user Engagement Signals like retention rates, engagement, and sentiment scores are used along with sentence rank scores to identify important sentences in the video using an engagement fusion model. Since there are multiple engagement signals, we perform dimensionality reduction using PCA to reduce computational complexity. We use generative AI models to generate summaries to benchmark against our extractive summary models. We designed a UI using Streamlit where a user can enter the URL of the YouTube video and view the summary of the video along with other details. Our results show that adding engagement aware signals help generate better summaries with more context as opposed to traditional methods that only take into consideration the transcript of the video. Keywords— Video Summarization, TextRank, Engagement Fusion, Natural Language Processing, YouTube Analytics, Generative AI
Zitieren
APA
SWATHI, V., VARDHAN, N. H., KOWSAR, S. R., NEHA, S., & SAI, P. P. N. (2026). Fusion Based Video Summarization: Integrating Transcripts and Keyframes for YouTube Content Analysis. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(03), 1-9. https://doi.org/10.55041/ijsrem57860
Vancouver
SWATHI V, VARDHAN NH, KOWSAR SR, NEHA S, SAI PPN. Fusion Based Video Summarization: Integrating Transcripts and Keyframes for YouTube Content Analysis. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(03):1-9. doi:10.55041/ijsrem57860
BibTeX
@article{SWATHI2026,
author = {SWATHI, VASIREDDY and VARDHAN, NADENDLA HARSHA and KOWSAR, SHAIK REENA and NEHA, SHAIK and SAI, PAMUJULA PAVAN NAGA},
title = {Fusion Based Video Summarization: Integrating Transcripts and Keyframes for YouTube Content Analysis},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2026},
volume = {10},
number = {03},
pages = {1--9},
doi = {10.55041/ijsrem57860}
}
EUVIMED