EUVIMEDEUVIMED entdecken
Crossref

MAFA: A Multi-Agent Framework for Enterprise-Scale Annotation with Configurable Task Adaptation

Mahmood Hegazy, Aaron Rodrigues, Azzam Naeem

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (47) · 39968-39977

DOI: 10.1609/aaai.v40i47.41431 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Mahmood Hegazy und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present MAFA (Multi-Agent Framework for Annotation), a production-deployed system that transforms enterprise-scale annotation workflows through configurable multi-agent collaboration. Addressing the critical challenge of annotation backlogs in financial services, where millions of customer utterances require accurate categorization, MAFA combines specialized agents with structured reasoning and a judge-based consensus mechanism. Our framework uniquely supports dynamic task adaptation, allowing organizations to define custom annotation types (FAQs, intents, entities, or domain-specific categories) through configuration rather than code changes. Deployed at JP Morgan Chase, MAFA has eliminated a 1 million utterance backlog while achieving, on average, 86% agreement with human annotators, annually saving over 5,000 hours of manual annotation work. The system processes utterances with annotation confidence classifications, which are typically 85% high, 10% medium, and 5% low across all datasets we tested. This enables human annotators to focus exclusively on ambiguous and low-coverage cases. We demonstrate MAFA's effectiveness across multiple datasets and languages, showing consistent improvements over traditional and single-agent annotation baselines: 13.8% higher Top-1 accuracy, 15.1% improvement in Top-5 accuracy, and 16.9% better F1 in our internal intent classification dataset and similar gains on public benchmarks. This work bridges the gap between theoretical multi-agent systems and practical enterprise deployment, providing a blueprint for organizations facing similar annotation challenges.

Zitieren

APA

Hegazy, M., Rodrigues, A., & Naeem, A. (2026). MAFA: A Multi-Agent Framework for Enterprise-Scale Annotation with Configurable Task Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(47), 39968-39977. https://doi.org/10.1609/aaai.v40i47.41431

Vancouver

Hegazy M, Rodrigues A, Naeem A. MAFA: A Multi-Agent Framework for Enterprise-Scale Annotation with Configurable Task Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(47):39968-39977. doi:10.1609/aaai.v40i47.41431

BibTeX
@article{Hegazy2026,
  author = {Hegazy, Mahmood and Rodrigues, Aaron and Naeem, Azzam},
  title = {MAFA: A Multi-Agent Framework for Enterprise-Scale Annotation with Configurable Task Adaptation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {47},
  pages = {39968--39977},
  doi = {10.1609/aaai.v40i47.41431}
}
Kostenlos starten →