EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment

Zijian Jing, Liyi Zhu, Tianyi Chen iD, Ludger Hovestadt, Li Li

Sensors · 06.08.2026 · 26 (15) · 4992

DOI: 10.3390/s26154992 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 06.08.2026. Verfasst von Zijian Jing und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Urban and Architectural Heritage Conservation, School of Architecture, Southeast University, Nanjing 210096, China. Hauptthemen laut MEDLINE: Artificial Intelligence, Safety. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NUSRI-SZ.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aging residential buildings constructed under outdated design standards create an urgent need for scalable, evidence-based indoor safety assessment methods. Conventional manual inspections rely on subjective checklists, lack audit trails, and are impractical for widespread deployment. This study presents a vision-based digital twin and AI agent framework that converts a single continuous smartphone video into an explainable, evidence-constrained safety assessment. The pipeline employs MASt3R-SLAM to reconstruct a metric-scale 3D point cloud from monocular video, calibrated with AprilTag fiducials for absolute scale. SpatialLM parses the geometry to extract semantic entities and spatial relationships. Risk guidelines are formalized into a computable Risk Prototype structure, unified within a hierarchical SceneState data structure that binds geometric measurements, semantic labels, image observations, and regulatory knowledge. A LangGraph-based AI agent conducts a dual-pathway assessment: an initial whole-dwelling scan followed by iterative follow-up queries invoking tool calls for measurement, knowledge retrieval, or visual cross-checking. In a pilot validation across five heterogeneous residences, with detailed manual comparison in two representative cases, the framework achieved risk recall rates of 77.8–100% and precision rates of 45.0–70.0% against the single-assessor manual reference. The average judgment closure rate was 71.7%, with spatial granularity enhancement of up to 2.2× in complex environments. These results suggest that the framework can achieve risk coverage comparable to manual checklist inspection while offering enhanced granularity in complex environments and quantitative precision in well-defined spaces.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceSafetyHumansSmartphone

Stichwörter der Autor:innen

3D reconstructionAI agentage-friendly environmentdigital twinexisting housing stockresidential safety assessment

Autor:innen und Institutionen

  • Key Laboratory of Urban and Architectural Heritage Conservation, School of Architecture, Southeast University, Nanjing 210096, China.
  • Group of Architects Co., Ltd. (GOA), 398 Tianmushan Road, Xihu District, Hangzhou 310058, China.
  • Institute of Technology in Architecture (ITA), 8093 Zurich, Switzerland.

ORCID-Profile: Tianyi Chen

Förderung

  • NUSRI-SZ

Zitieren

APA

Jing, Z., Zhu, L., Chen, T., Hovestadt, L., & Li, L. (2026). Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment. Sensors, 26(15), 4992. https://doi.org/10.3390/s26154992

Vancouver

Jing Z, Zhu L, Chen T, Hovestadt L, Li L. Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment. Sensors. 2026;26(15):4992. doi:10.3390/s26154992

BibTeX
@article{Jing2026,
  author = {Jing, Zijian and Zhu, Liyi and Chen, Tianyi and Hovestadt, Ludger and Li, Li},
  title = {Vision-Based Digital Twin and AI Agent Framework for Low-Cost, Explainable Indoor Building Inspection and Safety Assessment},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {15},
  pages = {4992},
  doi = {10.3390/s26154992}
}
Kostenlos starten →