EUVIMEDEUVIMED entdecken
Crossref

Discovering Urban Functional Zones using Training-Free Large Multi-Modal Models

Heng Lian, Daniel M. Runfola, Xingquan Zhu, Yi He

ACM Transactions on Intelligent Systems and Technology · 13.05.2026

DOI: 10.1145/3815173 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 13.05.2026. Verfasst von Heng Lian und 3 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Discovering urban functional zones (UFZs) is critical for understanding city spatial structures and supporting effective urban planning. Existing approaches to UFZ discovery typically rely on one of three costly strategies: (1) training large vision models directly on satellite imagery, which demands substantial computational resources; (2) leveraging crowdsourced data such as Points of Interest (POIs) from platforms like OpenStreetMap, which may be incomplete, inconsistent, or unavailable in many regions; or (3) collecting custom labeled data, which requires significant time, expense, and expert effort. Recently, large multi-modal models (LMMs) emerged as a promising alternative, offering strong capabilities in interpreting visual content without requiring extensive data labeling. However, their performance remains limited when applied to the UFZ discovery task, often struggling to capture the complex spatial and functional details and interactions of urban regions. To address this challenge, we propose a new approach that enhances LMMs’ reasoning capability to recognize urban functional zones by keeping LMM encoders frozen while training only lightweight graph-based models, eliminating the need for LMM fine-tuning or additional pre-training. Specifically, our approach first partitions the target area into small regions by road network, where an LMM is used for each region to generate visual and textual embeddings independently using its image and text encoders. Then, two graphs are constructed in which nodes represent regions with features defined by their respective embeddings, and edges encode their spatial adjacency. Message-passing on the two graphs hence captures spatial correlation between the visual and textual modalities. After that, graph clustering will suggest the prototypes representing nearby zones with similar urban functions, where contrastive learning is further leveraged to encourage cross-modal consistency. Evaluation on four city districts, namely Philadelphia (PA, USA), Pudong (Shanghai, China), San Francisco (CA, USA), and Seattle (WA, USA), substantiates the effectiveness of our proposal and that its performance is on par with supervised competitors.

Zitieren

APA

Lian, H., Runfola, D. M., Zhu, X., & He, Y. (2026). Discovering Urban Functional Zones using Training-Free Large Multi-Modal Models. ACM Transactions on Intelligent Systems and Technology. https://doi.org/10.1145/3815173

Vancouver

Lian H, Runfola DM, Zhu X, He Y. Discovering Urban Functional Zones using Training-Free Large Multi-Modal Models. ACM Transactions on Intelligent Systems and Technology. 2026. doi:10.1145/3815173

BibTeX
@article{Lian2026,
  author = {Lian, Heng and Runfola, Daniel M. and Zhu, Xingquan and He, Yi},
  title = {Discovering Urban Functional Zones using Training-Free Large Multi-Modal Models},
  journal = {ACM Transactions on Intelligent Systems and Technology},
  year = {2026},
  doi = {10.1145/3815173}
}
Kostenlos starten →