EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AltGosling: automatic generation of text descriptions for accessible genomics data visualization

Thomas C Smits iD, Sehi L'Yi iD, Andrew P Mar, Nils Gehlenborg iD

Bioinformatics · 28.11.2024 · 40 (12)

DOI: 10.1093/bioinformatics/btae670 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioinformatics, online erschienen am 14.11.2024. Verfasst von Thomas C Smits und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States. Hauptthemen laut MEDLINE: Genomics, Software, Algorithms. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NHGRI NIH HHS, NIH HHS, National Institutes of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Motivation Biomedical visualizations are key to accessing biomedical knowledge and detecting new patterns in large datasets. Interactive visualizations are essential for biomedical data scientists and are omnipresent in data analysis software and data portals. Without appropriate descriptions, these visualizations are not accessible to all people with blindness and low vision, who often rely on screen reader accessibility technologies to access visual information on digital devices. Screen readers require descriptions to convey image content. However, many images lack informative descriptions due to unawareness and difficulty writing such descriptions. Describing complex and interactive visualizations, like genomics data visualizations, is even more challenging. Automatic generation of descriptions could be beneficial, yet current alt text generating models are limited to basic visualizations and cannot be used for genomics. Results We present AltGosling, an automated description generation tool focused on interactive data visualizations of genome-mapped data, created with the grammar-based genomics toolkit Gosling. The logic-based algorithm of AltGosling creates various descriptions including a tree-structured navigable panel. We co-designed AltGosling with a blind screen reader user (co-author). We show that AltGosling outperforms state-of-the-art large language models and common image-based neural networks for alt text generation of genomics data visualizations. As a first of its kind in genomic research, we lay the groundwork to increase accessibility in the field. Availability and implementation The source code, examples, and interactive demo are accessible under the MIT License at https://github.com/gosling-lang/altgosling. The package is available at https://www.npmjs.com/package/altgosling.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

GenomicsSoftwareAlgorithmsHumansData Visualization

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States.
  • Department of English, University of California, Berkeley, CA 94720, United States.

ORCID-Profile: Thomas C Smits, Sehi L'Yi, Nils Gehlenborg

Förderung

  • NHGRI NIH HHS
  • NIH HHS
  • National Institutes of Health

Zitieren

APA

Smits, T. C., L'Yi, S., Mar, A. P., & Gehlenborg, N. (2024). AltGosling: automatic generation of text descriptions for accessible genomics data visualization. Bioinformatics, 40(12). https://doi.org/10.1093/bioinformatics/btae670

Vancouver

Smits TC, L'Yi S, Mar AP, Gehlenborg N. AltGosling: automatic generation of text descriptions for accessible genomics data visualization. Bioinformatics. 2024;40(12). doi:10.1093/bioinformatics/btae670

BibTeX
@article{Smits2024,
  author = {Smits, Thomas C and L'Yi, Sehi and Mar, Andrew P and Gehlenborg, Nils},
  title = {AltGosling: automatic generation of text descriptions for accessible genomics data visualization},
  journal = {Bioinformatics},
  year = {2024},
  volume = {40},
  number = {12},
  doi = {10.1093/bioinformatics/btae670}
}
Kostenlos starten →