Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment
Sensors · 06.08.2026 · 26 (15) · 4992
DOI: 10.3390/s26154992 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 06.08.2026. Verfasst von Zijian Jing und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Urban and Architectural Heritage Conservation, School of Architecture, Southeast University, Nanjing 210096, China. Hauptthemen laut MEDLINE: Artificial Intelligence, Safety. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NUSRI-SZ.
Abstract (Originalsprache)
Aging residential buildings constructed under outdated design standards create an urgent need for scalable, evidence-based indoor safety assessment methods. Conventional manual inspections rely on subjective checklists, lack audit trails, and are impractical for widespread deployment. This study presents a vision-based digital twin and AI agent framework that converts a single continuous smartphone video into an explainable, evidence-constrained safety assessment. The pipeline employs MASt3R-SLAM to reconstruct a metric-scale 3D point cloud from monocular video, calibrated with AprilTag fiducials for absolute scale. SpatialLM parses the geometry to extract semantic entities and spatial relationships. Risk guidelines are formalized into a computable Risk Prototype structure, unified within a hierarchical SceneState data structure that binds geometric measurements, semantic labels, image observations, and regulatory knowledge. A LangGraph-based AI agent conducts a dual-pathway assessment: an initial whole-dwelling scan followed by iterative follow-up queries invoking tool calls for measurement, knowledge retrieval, or visual cross-checking. In a pilot validation across five heterogeneous residences, with detailed manual comparison in two representative cases, the framework achieved risk recall rates of 77.8–100% and precision rates of 45.0–70.0% against the single-assessor manual reference. The average judgment closure rate was 71.7%, with spatial granularity enhancement of up to 2.2× in complex environments. These results suggest that the framework can achieve risk coverage comparable to manual checklist inspection while offering enhanced granularity in complex environments and quantitative precision in well-defined spaces.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Urban and Architectural Heritage Conservation, School of Architecture, Southeast University, Nanjing 210096, China.
- Group of Architects Co., Ltd. (GOA), 398 Tianmushan Road, Xihu District, Hangzhou 310058, China.
- Institute of Technology in Architecture (ITA), 8093 Zurich, Switzerland.
ORCID-Profile: Tianyi Chen
Förderung
- NUSRI-SZ
Zitieren
APA
Jing, Z., Zhu, L., Chen, T., Hovestadt, L., & Li, L. (2026). Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment. Sensors, 26(15), 4992. https://doi.org/10.3390/s26154992
Vancouver
Jing Z, Zhu L, Chen T, Hovestadt L, Li L. Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment. Sensors. 2026;26(15):4992. doi:10.3390/s26154992
BibTeX
@article{Jing2026,
author = {Jing, Zijian and Zhu, Liyi and Chen, Tianyi and Hovestadt, Ludger and Li, Li},
title = {Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment},
journal = {Sensors},
year = {2026},
volume = {26},
number = {15},
pages = {4992},
doi = {10.3390/s26154992}
}
EUVIMED