EUVIMEDScopri EUVIMED
Open access

Detecting Perceived Unfair Treatment Among US College Students Using Mobile Sensing: Pilot Machine Learning Study

Yiyi Ren iD, Raghu Mulukutla iD, Jennifer Mankoff iD, Anind K Dey iD

JMIR Formative Research · 2025-10-31 · 9 · e78657

DOI: 10.2196/78657 ↗

At a glance

Journal article in JMIR Formative Research, published online on 2025-10-31. Written by Yiyi Ren and 3 co-authors. Institution: Information School, University of Washington, Seattle, WA, United States. Major MEDLINE topics: Students, Machine Learning. Cited 1 times so far (Crossref); 159 references. The full text is freely available in PubMed Central. Funded by: National Science Foundation.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Experiences of unfair treatment on college campuses are linked to adverse mental and physical health outcomes, highlighting the need for interventions. However, detecting such experiences relies mainly on self-reports. No prior research has examined the feasibility of using mobile sensing via smartphones and wearables for the passive detection of these experiences.

Objective

This pilot study explores the potential of using passive sensing to detect daily experiences of perceived unfair treatment (PUT) after they occur. It aims to develop and evaluate machine learning models against naive baselines and establish a benchmark for future research.

Methods

We analyzed data from 201 undergraduate students collected over two 10-week academic terms in 2018. PUT was self-reported at the daily level via ecological momentary assessment (EMA) surveys, with 413 of 9629 (4.3%) total responses indicating unfair treatment. We implemented two modeling approaches with distinct training schemes: (1) supervised classification models trained in a user-independent manner using data from different individuals, and (2) anomaly detection models trained in a user-dependent manner using historical data from the same individuals. Classification performance was assessed using stratified group 5-fold cross-validation for user-independent models and a chronological train-test split for user-dependent models.

Results

Of the 201 study participants, 110 reported experiencing unfair treatment at least once. On average, participants reported unfair treatment in 4.66% of their EMA responses (95% CI 3.13% to 6.19%). User-independent classification models showed mixed performance (AUC-ROC [area under the receiver operating characteristic curve]: 0.546-0.640, AUC-PR [area under the precision-recall curve]: 0.047-0.093, F1-score: 0.070-0.121). Tree-based models, particularly light gradient boosting machine (LightGBM) and Random Forest, outperformed all 3 baselines in AUC-ROC and AUC-PR; LightGBM also improved the F1-score. In comparison, user-dependent anomaly detection models performed better, with the multiday long short-term memory-AE model (50 features, 7-day window) achieving the highest recall (0.830, +73.3%, P

Subjects

MeSH terms (MEDLINE)

StudentsMachine LearningHumansPilot ProjectsFemaleMaleUniversitiesYoung AdultEcological Momentary AssessmentUnited StatesAdultSmartphoneAdolescent

Author keywords

anomaly detectiondigital phenotypingmental healthmobile healthpassive sensingperceived discrimination

Authors and institutions

  • Information School, University of Washington, Seattle, WA, United States.
  • College of Computing, Georgia Institute of Technology, Atlanta, GA, United States.
  • Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle, WA, United States.

ORCID profiles: Yiyi Ren, Raghu Mulukutla, Jennifer Mankoff, Anind K Dey

Funding

  • National Science Foundation

Cite

APA

Ren, Y., Mulukutla, R., Mankoff, J., & Dey, A. K. (2025). Detecting Perceived Unfair Treatment Among US College Students Using Mobile Sensing: Pilot Machine Learning Study. JMIR Formative Research, 9, e78657. https://doi.org/10.2196/78657

Vancouver

Ren Y, Mulukutla R, Mankoff J, Dey AK. Detecting Perceived Unfair Treatment Among US College Students Using Mobile Sensing: Pilot Machine Learning Study. JMIR Formative Research. 2025;9:e78657. doi:10.2196/78657

BibTeX
@article{Ren2025,
  author = {Ren, Yiyi and Mulukutla, Raghu and Mankoff, Jennifer and Dey, Anind K},
  title = {Detecting Perceived Unfair Treatment Among US College Students Using Mobile Sensing: Pilot Machine Learning Study},
  journal = {JMIR Formative Research},
  year = {2025},
  volume = {9},
  pages = {e78657},
  doi = {10.2196/78657}
}
Start for free →