EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation capacity building in a rural Victorian community service organisation: A formative evaluation

Bianca E Kavanagh iD, Vincent L Versace, Hannah Beks, Carly Dennis, Marley J Binder, Andrea L Hernan, Kevin Mc Namara

PLOS One · 2025

DOI: 10.1371/journal.pone.0322906 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Bianca E Kavanagh und 6 weiteren Autor:innen. Beteiligte Einrichtung: Deakin University, Deakin Rural Health, School of Medicine, Warrnambool, Victoria, Australia. Hauptthemen laut MEDLINE: Capacity Building, Rural Health Services, Program Evaluation, Community Health Services. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Rural Health Multidisciplinary Training (RHMT) program, Brophy Family & Youth Services.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Community service organisations are increasingly required to report on outcomes and evaluate program delivery. While commonplace in clinical health settings, such work is novel to the community sector and can be challenging to undertake given resourcing and evaluation capacity constraints. These constraints are exacerbated for rural community service organisations that face additional resource pressures and lack organisational systems to support such work. This formative evaluation reports on an evaluation capacity building program within a rural place-based community service organisation in southwest Victoria, Australia. As part of the program, monitoring, evaluation, and learning pilots were implemented to support selected teams (N = 4 teams, N = 12 individuals) to increase confidence in outcomes measurement and reporting. Implementation strategies included training, creation of measurement frameworks, implementation of data collection tools, academic support, and emergence of evaluation champions. Evaluation data included administrative records and a staff survey. The Reach Effectiveness Adoption Implementation Maintenance framework guided evaluation. Results indicated that participants reported high awareness, beliefs, attitudes, knowledge, and skills in relation to monitoring, evaluation, and learning at the post-training/refinement period timepoint. However, several barriers limited implementation: reduced workforce capacity, prioritisation of client-driven or other work, leave or staff changes, additional responsibilities, waxing and waning engagement, wider program teams being unclear on the process and value of evaluation, and organisational barriers. These barriers led to a divergence from the planned outcome measures. Enablers to this work included physical presence to facilitate informal discussion, flexibility and openness to change, and communication to support staff. Learnings include the need to strengthen organisational evaluation culture, scaling-back the number of outcomes/data collection sources, and greater involvement with the wider staff cohort. These learnings provide a valuable foundation for other place-based community service organisations to implement evaluation capacity building strategies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Capacity BuildingRural Health ServicesProgram EvaluationCommunity Health ServicesVictoriaHumansRural Population

Autor:innen und Institutionen

  • Deakin University, Deakin Rural Health, School of Medicine, Warrnambool, Victoria, Australia.
  • Brophy Family and Youth Services, Warrnambool, Victoria, Australia.

ORCID-Profile: Bianca E Kavanagh

Förderung

  • Rural Health Multidisciplinary Training (RHMT) program
  • Brophy Family & Youth Services

Zitieren

APA

Kavanagh, B. E., Versace, V. L., Beks, H., Dennis, C., Binder, M. J., Hernan, A. L., & Namara, K. M. (2025). Evaluation capacity building in a rural Victorian community service organisation: A formative evaluation. PLOS One. https://doi.org/10.1371/journal.pone.0322906

Vancouver

Kavanagh BE, Versace VL, Beks H, Dennis C, Binder MJ, Hernan AL, et al. Evaluation capacity building in a rural Victorian community service organisation: A formative evaluation. PLOS One. 2025. doi:10.1371/journal.pone.0322906

BibTeX
@article{Kavanagh2025,
  author = {Kavanagh, Bianca E and Versace, Vincent L and Beks, Hannah and Dennis, Carly and Binder, Marley J and Hernan, Andrea L and Namara, Kevin Mc},
  title = {Evaluation capacity building in a rural Victorian community service organisation: A formative evaluation},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0322906}
}
Kostenlos starten →