Multimodal Framework for Video Summarization Using Transformers and Deep Learning: Integrating Visual, Audio, and Textual Data – Paperback

Description

Author(s): Suryakanthi Tangirala | Jinaga Neeraja
Publisher: Grin Verlag
Publisher Imprint: Grin Verlag
BISAC: Networking – General

This text aims to develop a multimodal deep learning framework for automatically generating concise and meaningful summaries of lengthy video content. The proposed approach combines visual, audio, and textual information to identify relevant video segments while preserving essential context and reducing redundancy. The framework integrates pretrained models such as Vision Transformers (ViT) for visual feature extraction, Whisper for speech recognition, and BART or DistilBERT for textual and contextual processing. Transformer-based architectures combine these representations to assess segment relevance and generate coherent summaries. The approach can support applications in education, entertainment, surveillance, news analysis, sports, and multimedia information retrieval.