EUVIMEDEUVIMED entdecken
Crossref

Immersive human-machine teleoperation framework for precision agriculture: Integrating UAV-based digital mapping and virtual reality control

Tao Liu, Baohua Zhang, Qianqiu Tan, Jun Zhou, Shuwan Yu, Qingzhen Zhu, Yifan Bian

Computers and Electronics in Agriculture · 2024-11 · 226 · 109444

DOI: 10.1016/j.compag.2024.109444 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2024-11. Verfasst von Tao Liu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: Natural Science Foundation of Jiangsu Province, National Natural Science Foundation of China, Jiangsu Agricultural Science and Technology Innovation Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In agricultural settings, the unstructured nature of certain production environments, along with the high complexity and inherent risks of production tasks, poses significant challenges to achieving full automation and effective on-site machine control. Remote control technology, which leverages human intelligence and precise machine movements, ensures operator safety and boosts productivity. Recently, virtual reality (VR) has shown promise in remote control applications by overcoming single-view limitations and providing three-dimensional information, yet most studies have not focused on agricultural settings. Therefore, to bridge the gap, this study proposes a large-scale digital mapping and immersive human-machine teleoperation framework specifically designed for precision agriculture. In this research, a DJI unmanned aerial vehicle (UAV) was utilized for data collection, and a novel video segmentation approach based on feature points was introduced. To accommodate the variability of complex textures, this method proposes an enhanced Structure from Motion (SfM) approach. It integrates the open Multiple View Geometry (OpenMVG) framework with Local Features from Transformers (LoFTR). The enhanced SfM produces a point cloud map, which is further processed through Multi-View Stereo (MVS) to generate a complete map model. For control, a closed-loop system utilizing TCP/IP for VR control and positioning of agricultural machinery was introduced. This system offers a fully visual-based method for immersive control, allowing operators to utilize VR technology for remote operations. The experimental results demonstrate that the user-friendly remote control method also showcases its advantages over traditional video streaming-based remote operations, providing operators with a more comprehensive and immersive experience and a higher level of situational awareness.

Förderung

  • Natural Science Foundation of Jiangsu Province
  • National Natural Science Foundation of China
  • Jiangsu Agricultural Science and Technology Innovation Fund

Zitieren

APA

Liu, T., Zhang, B., Tan, Q., Zhou, J., Yu, S., Zhu, Q., & Bian, Y. (2024). Immersive human-machine teleoperation framework for precision agriculture: Integrating UAV-based digital mapping and virtual reality control. Computers and Electronics in Agriculture, 226, 109444. https://doi.org/10.1016/j.compag.2024.109444

Vancouver

Liu T, Zhang B, Tan Q, Zhou J, Yu S, Zhu Q, et al. Immersive human-machine teleoperation framework for precision agriculture: Integrating UAV-based digital mapping and virtual reality control. Computers and Electronics in Agriculture. 2024;226:109444. doi:10.1016/j.compag.2024.109444

BibTeX
@article{Liu2024,
  author = {Liu, Tao and Zhang, Baohua and Tan, Qianqiu and Zhou, Jun and Yu, Shuwan and Zhu, Qingzhen and Bian, Yifan},
  title = {Immersive human-machine teleoperation framework for precision agriculture: Integrating UAV-based digital mapping and virtual reality control},
  journal = {Computers and Electronics in Agriculture},
  year = {2024},
  volume = {226},
  pages = {109444},
  doi = {10.1016/j.compag.2024.109444}
}
Kostenlos starten →