Text Scene Synthesis: A Two-Phase Framework Using Diffusion Models and CLIP-Guided Video Generation
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 24.04.2026 · 10 (04) · 1-9
DOI: 10.55041/ijsrem60639 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 24.04.2026. Verfasst von Bolli Akshaya und 3 weiteren Autor:innen.
Abstract (Originalsprache)
Abstract — The automatic generation of visual scenes from natural language descriptions represents a frontier challenge in artificial intelligence, bridging the gap between linguistic understanding and photorealistic visual synthesis. This paper presents a comprehensive two-phase framework for Text Scene Synthesis. In Phase 1, we leverage a state-of-the-art denoising diffusion probabilistic model (DDPM) conditioned on text embeddings to produce high-fidelity, semantically accurate images from arbitrary textual prompts. In Phase 2, we extend the framework to temporal visual synthesis by employing Contrastive Language-Image Pretraining (CLIP) alongside a video generation pipeline to produce coherent short-form video sequences directly from text. Experimental evaluation demonstrates that the proposed system significantly outperforms prior GAN-based, VAE-based, and standalone diffusion approaches in terms of image fidelity, semantic consistency, and temporal coherence. The system achieves a Fréchet Inception Distance (FID) of 12.4 on COCO-captions and a CLIPSIM score of 0.312 for video generation, representing meaningful improvements over prior methods. This work demonstrates the promise of unified text-to-scene pipelines for applications spanning entertainment, education, game development, and assistive technologies. Keywords — text-to-image synthesis, diffusion models, CLIP, video generation, scene synthesis, generative AI, denoising diffusion probabilistic model, natural language processing.
Zitieren
APA
Akshaya, B., Pranathi, B., Srinidhi, A., & Buddanagari, L. (2026). Text Scene Synthesis: A Two-Phase Framework Using Diffusion Models and CLIP-Guided Video Generation. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(04), 1-9. https://doi.org/10.55041/ijsrem60639
Vancouver
Akshaya B, Pranathi B, Srinidhi A, Buddanagari L. Text Scene Synthesis: A Two-Phase Framework Using Diffusion Models and CLIP-Guided Video Generation. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(04):1-9. doi:10.55041/ijsrem60639
BibTeX
@article{Akshaya2026,
author = {Akshaya, Bolli and Pranathi, Bombothula and Srinidhi, Avadhutha and Buddanagari, Latha},
title = {Text Scene Synthesis: A Two-Phase Framework Using Diffusion Models and CLIP-Guided Video Generation},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2026},
volume = {10},
number = {04},
pages = {1--9},
doi = {10.55041/ijsrem60639}
}
EUVIMED