Measuring What Matters: A Rigorous Approach to Sports Programme Impact Assessment
How do we determine whether a programme is actually driving change? This case study explores Forion's mixed-method approach to assessing a 90-day sports science intervention for young competitive swimmers, combining baseline and control-group comparisons, statistical analysis and qualitative insights to move beyond simple before-and-after measurement and generate credible evidence of programme impact.
Overview
The Challenge
Demonstrating the impact of a programme requires more than comparing participants before and after an intervention. Changes may also reflect natural variation, differences between participants or external factors.
For a 90-day sports science intervention for young competitive swimmers, the challenge was to measure whether observed changes could be attributed to the intervention itself across physical performance, psychological readiness and lifestyle outcomes.
Forions' Role
Forion Analytics conducted an impact assessment of a 90-day intervention introduced by the Indian Sports Physical Activity Network (iSPAN) in collaboration with Basavanagudi Aquatic Centre (BAC). The programme integrated strength and conditioning, physiotherapy, mental skills training and nutritional support to enhance the physical, mental and emotional well-being of young competitive swimmers. The assessment combined quantitative performance measures with qualitative perspectives from swimmers, coaches and sports science professionals.
Our Approach
- Establishing a Baseline: Assessing participants across physical, psychological and lifestyle indicators before the intervention, while establishing comparability between treatment and control groups.
- Creating a Comparison: Comparing participants receiving the intervention with a control group continuing standard training to distinguish intervention-related changes from changes occurring over the same period.
- Measuring Change: Applying a Difference-in-Differences (DiD) framework to assess changes between the two groups while accounting for baseline differences.
- Capturing Multiple Dimensions of Impact: Measuring outcomes across physical performance, psychological readiness, lifestyle and behavioural indicators, rather than relying on performance metrics alone.
- Adding Qualitative Context: Using perspectives from swimmers, coaches and sports science professionals to complement quantitative findings and contextualise the observed changes.
From Measurement to Evidence
The assessment was designed not simply to identify whether participants improved, but to establish a stronger basis for understanding whether and how the intervention contributed to that change.
By combining baseline assessment, control-group comparison, statistical analysis and qualitative evidence, Forion's approach provides a rigorous framework for evaluating programme effectiveness and generating evidence that can inform future programme design.
Broader Takeaway
Effective impact assessment goes beyond measuring outputs or comparing before-and-after results. It requires a structured evaluation design that can establish credible links between an intervention and observed outcomes.
This engagement demonstrates Forion's ability to design mixed-method impact assessments that combine quantitative rigour with contextual insights to support programme learning, accountability and decision-making.