EUVIMEDEUVIMED entdecken
Crossref

A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation

Ramakrishna Kolikipogu, Aruna Devarakonda, Swathi Palamakula

International Journal of Research and Development in Engineering Sciences · 06.03.2026 · 8 (2) · 21

DOI: 10.63328/ijrdes-v8ri2p3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Research and Development in Engineering Sciences, online erschienen am 06.03.2026. Verfasst von Ramakrishna Kolikipogu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose a unified multimodal framework, Universal Multi-Modal Generation Enabling Any-to-Any Transformation, that enables seamless transformation between text, audio, and image inputs and outputs. The system integrates three core capabilities: speech understanding using Whisper, visual understanding through LLaVA, and speech synthesis via PyTorch-based text-to-speech models. All modules are deployed on-premise using Docker, providing a privacy-centric execution environment and reducing operational overhead associated with cloud processing. The framework supports advanced workflows including document/PDF-to-text extraction, text-to-speech conversion, and image-driven description generation, thereby enabling accessible and interactive multimodal content pipelines. The implementation emphasizes efficient orchestration and inference to meet real-time constraints. Experimental results across multiple cross-modal tasks demonstrate robust accuracy and consistently low latency, suggesting that local, containerized multimodal systems can deliver scalable performance for practical applications. The proposed approach is particularly relevant to accessibility, education, and content creation, where rapid modality conversion and data privacy are essential.

Zitieren

APA

Kolikipogu, R., Devarakonda, A., & Palamakula, S. (2026). A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation. International Journal of Research and Development in Engineering Sciences, 8(2), 21. https://doi.org/10.63328/ijrdes-v8ri2p3

Vancouver

Kolikipogu R, Devarakonda A, Palamakula S. A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation. International Journal of Research and Development in Engineering Sciences. 2026;8(2):21. doi:10.63328/ijrdes-v8ri2p3

BibTeX
@article{Kolikipogu2026,
  author = {Kolikipogu, Ramakrishna and Devarakonda, Aruna and Palamakula, Swathi},
  title = {A Privacy-Preserving Universal Multimodal Framework for Real-Time Any-to-Any Transformation},
  journal = {International Journal of Research and Development in Engineering Sciences},
  year = {2026},
  volume = {8},
  number = {2},
  pages = {21},
  doi = {10.63328/ijrdes-v8ri2p3}
}
Kostenlos starten →