IMPACT METRICS
________________________
ADDITIONALITY
HEALTH IMPACT
The impact of an organization’s services is an important component of understanding how to improve service delivery and the overall health of patients.
Metrics for Management, in collaboration with the Metrics Working Group, is focusing on Additionality and Health Impact.
METRIC: ADDITIONALITY
Health service programs seek to ensure that they contribute to the overall growth of the market — in the case of family planning (FP) this translates to increases in modern contraceptive prevalence rates (mCPR) or increases in the total number of women using contraception (additional to a baseline). Measuring an increase in volume of FP services provided, or total or first-time FP clients seen, is not enough to capture additionality. Rather, a comprehensive picture must be taken that looks at overall increases in the number of women using a contraceptive method provided by a health program, and, where these increases are coming from (e.g. substitution versus non-users).
In collaboration with the Metrics Working Group, Metrics for Management is measuring the aggregate concept of additional users, which looks at increases in the total number of users from an agreed baseline, (adjusting for substitution and replacement of users who discontinue contraception) to ensure there is a net increase in users. Both replacement of any users who drop out, and further increase, must be adopters to ensure these increases are contributing to national growth.
Enable programs to estimate their annual contribution to the increase in national contraception users after adjusting for substitution and loss of existing users.
Please visit our resources page to access documentation to help you measure, interpret, and present additionality results. Select Metric: Additionality to find information.
Metrics for Management, in conjunction with the Metrics Working Group, has developed supporting documents to provide context, background, and assistance in the use of Impact 2. Please visit our publications page to access documentation to help you measure, interpret, and present additionality results.
For access to Impact 2 and extended guidance documentation visit MSI’s website.
- Impact 2 was developed by Marie Stopes International. It is an Excel-based tool that, among a variety of other reproductive health impact calculations, includes an option to estimate a franchise’s contribution to national additional users. Impact 2 converts service provision and commodity distribution data into estimated family planning users for short-term, long-term and permanent family planning methods.
- To use Impact 2, visit https://mariestopes.org/what-we-do/our-approach/our-technical-expertise/impact-2/
METRIC: HEALTH IMPACT
In collaboration with the Metrics Working Group, we have supported a method to measure health impact. This metric makes it possible for a program to know if it has achieved what it set out to do: improve population health. Outputs like clients served and services used are often measured and tracked by programs. However, clients served does not tell the broader story of how many clients completed services; just as services used does not account for the varying degrees of health benefits provided by various health services and commodities. Health impact measurement estimates the public health value of a program, and it is an important precursor for understanding the cost-effectiveness of a program.
Use Disability-Adjusted Life Years (DALYs) averted to calculate the overall health impact of a program in a given year.
Most programs maintain records of how many health services (including referrals and diagnostic tests) and commodities they provide each year. These statistics can be run through a mathematical model created by Population Services International. The PSI Impact Calculatoris a tool to estimate and compare the potential impact of health interventions. The tool works by attaching a country-specific coefficient (or estimate of health impact per unit of intervention) to each item. Results are expressed inthe form of disability-adjusted life years (DALYs) averted. One DALY averted means that the services provided by a program resulted in a year of healthy life saved.
Population Services International (PSI) has developed a health impact calculator to estimate and compare the potential impact of health interventions, which has been reviewed and endorsed by the members of the Metrics Working Group. The tool allows you to calculate health impact by country, as well as how to communicate this information to your stakeholder.
To use the calculator, visit http://impactcalculator.psi.org
