A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation
International Journal of Research and Development in Engineering Sciences · 06.03.2026 · 8 (2) · 21
DOI: 10.63328/ijrdes-v8ri2p3 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Research and Development in Engineering Sciences, online erschienen am 06.03.2026. Verfasst von Ramakrishna Kolikipogu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).
Abstract (Originalsprache)
We propose a unified multimodal framework, Universal Multi-Modal Generation Enabling Any-to-Any Transformation, that enables seamless transformation between text, audio, and image inputs and outputs. The system integrates three core capabilities: speech understanding using Whisper, visual understanding through LLaVA, and speech synthesis via PyTorch-based text-to-speech models. All modules are deployed on-premise using Docker, providing a privacy-centric execution environment and reducing operational overhead associated with cloud processing. The framework supports advanced workflows including document/PDF-to-text extraction, text-to-speech conversion, and image-driven description generation, thereby enabling accessible and interactive multimodal content pipelines. The implementation emphasizes efficient orchestration and inference to meet real-time constraints. Experimental results across multiple cross-modal tasks demonstrate robust accuracy and consistently low latency, suggesting that local, containerized multimodal systems can deliver scalable performance for practical applications. The proposed approach is particularly relevant to accessibility, education, and content creation, where rapid modality conversion and data privacy are essential.
Zitieren
APA
Kolikipogu, R., Devarakonda, A., & Palamakula, S. (2026). A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation. International Journal of Research and Development in Engineering Sciences, 8(2), 21. https://doi.org/10.63328/ijrdes-v8ri2p3
Vancouver
Kolikipogu R, Devarakonda A, Palamakula S. A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation. International Journal of Research and Development in Engineering Sciences. 2026;8(2):21. doi:10.63328/ijrdes-v8ri2p3
BibTeX
@article{Kolikipogu2026,
author = {Kolikipogu, Ramakrishna and Devarakonda, Aruna and Palamakula, Swathi},
title = {A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation},
journal = {International Journal of Research and Development in Engineering Sciences},
year = {2026},
volume = {8},
number = {2},
pages = {21},
doi = {10.63328/ijrdes-v8ri2p3}
}
EUVIMED