How can we demonstrate our impact to funders and commissioners? #
To demonstrate impact to funders and commissioners using Outcomes Star data, organisations should combine clear reporting with contextual narrative. The goal is to show not just change, but why it matters and how the service contributes to it.
Top Tips
- Use a combination of reports to show the full journey
- Snapshot of first Stars to show where people started
- Distance-travelled to show the progress people made
- Snapshot of last Star to show where people got to
- Compare results to expectations
- Where did the reports meet expectations
- Where didn’t they, and why?
- Add narrative and qualitative evidence, including;
- Practitioner insights
- Case studies
- External context
- Highlight learning
- What you learned from the data
- What changes you are making to services
- How this will improve outcomes going forward
For more information see using Star data in evaluations.
Can we benchmark our data with other organisations?
Comparing Star data across organisations is difficult as different contexts can make comparisons unreliable. Different organisations using the same Star version may differ in:
- The type of people they are supporting
- The kind of support they are providing
- The length or intensity of that support
- What they are supporting people to achieve
This means that any differences in data may reflect the context of the different organisations, rather than performance.
Instead, it is recommended that organisation focus on internal benchmarking (comparing different services or people with different needs or demographics within the organisation) or report against the services expectations.
What is good practice for using the data internally for learning and development?
Good practice for using Outcomes Star data internally is about creating a structured, organisation-wide learning process. This includes regular reporting (implementation, snapshot, distance travelled), using data at multiple levels, adding narrative, and linking insights to action.
Top tips
- Use all three types of reporting together to ensure the data is reliable and an understanding of both need and progress
- Implementation reporting – to monitor Star use and check data quality
- Snapshot reporting – to show the needs of the people being supported
- Distance-travelled reporting – to show the progress being made
- Embed regular and structured use of data to strengthen data quality and provide continuous learning loops
- Supervision sessions
- Team meetings
- Service reviews
- Use data at multiple levels of an organisation
- Practitioners – inform support and next steps
- Managers – reflection, supervision, service improvement
- Senior leaders – identify patterns and guide strategy
- Implementation/data teams – ensure consistency
- Always include narrative and context
- Share data insights across the organisation
For more information please see Using Star data for improvement, learning and reporting.
How can we quality assure the Stars completed in the organisation?
Quality assurance (QA) of Outcomes Star data is achieved through a combination of structured reporting (especially implementation reporting), regular review at multiple levels, and active manager oversight. The aim is to ensure Stars are completed consistently, accurately, and at the right time, and that issues are identified and addressed early.
Top Tips
- Use Implementation Reporting to monitor Star use
- Regularly review data at team and manager level
- Check Star completion against service guidelines
- Use Caseload reporting to check whether Stars are accurate and actions fit Journey of Change stages
- Encourage shared use of data across the organisation
How can we evidence the needs of the people we support?
The needs of people being supported can be evidenced via Snapshot reporting. This type of reporting looks at how readings are distributed across the Journey of Change in each Outcome Area. A Snapshot report can be run on people’s first Stars (to show their needs when starting support), latest/current Stars (to show where people are currently at on the JOC) and last Stars (to show their needs when support ends).
How can we show who benefits most from our service?
To show who benefits most from your service using Outcomes Star data, compare cohorts in your reporting to identify which groups experience the greatest change, in which areas. You can combine this with narrative context to help explain why this might be.