IFC Against AIDS

Protecting People and Profitability

Monitoring and Evaluation (M&E)

What is monitoring?

Day-to-day follow up of activities during implementation to measure progress and identify deviations Routine follow up to ensure activities are proceeding as planned and are on schedule Routine assessment of activities and results Answers the question, what are we doing?

Monitoring and Evaluation (M&E)

Why monitor activities?

Tracks inputs and outputs and compares them to plan Identifies and addresses problems Ensures effective use of resources Ensures quality and learning to improve activities and services Strengthens accountability Program management tool

Monitoring and Evaluation (M&E)

What is evaluation?

Episodic assessment of overall achievement and impacts Systematic way of learning from experience to IMPROVE current activities and promote better planning for future action Designed specifically with intention to attribute changes to intervention itself Answers the question, what have we achieved and what impact have we made

Monitoring and Evaluation (M&E)

Why evaluate activities?

Determines program effectiveness Shows impact Strengthens financial responses and accountability Promotes a learning culture focused on service improvement Promotes replication of successful interventions

Monitoring and Evaluation (M&E)

Types of evaluation Type
Formative Process

Purpose
Initial assessment of the target populations and contextual environment. Determines concept and design Seeks to identify the extent to which planned activities have been achieved and assesses the quality of the activities/services Examines specific program outcomes and accomplishments. What changes were observed, what does it mean, and if changes are a result of the interventions? Gauges the programs overall impact and effectiveness. Aims to strengthen design and replication of effective programs and strategies

Outcome

Impact

Monitoring and Evaluation (M&E)

Monitoring vs evaluation

Monitoring
Continuous: day-to-day Documents progress Focuses on inputs and outputs Alerts managers to problems Self-assessment

Evaluation
Periodic: important milestones In-depth analysis of achievements Focuses on outcomes and impacts Provides managers with strategy and policy options External analysis

Monitoring and Evaluation (M&E)

M&E Framework
Level
Inputs Outputs

Description

Frequency

Resources that are put into the project. Lead Continuous to the achievement of the outputs Activities or services that the project is providing. Outputs lead to outcomes Quarterly 2-3 years (short to medium term)

Outcomes Changes in behaviors or skills as a result of the implemented project. Outcomes are anticipated to lead to impacts

Impacts

Measurable changes in health status, particularly reduced STI/HIV transmission and reduced AIDS impact. Impact results are effects of the intervention

3-5 years (long term)

Monitoring and Evaluation (M&E)

How IFC Against AIDS integrates M&E

Level
Client

Description
Client engagement process M&E guide with tools attached Train clients/service providers on M&E Database for client monitoring data Internal client satisfaction survey External client satisfaction survey Database with all client data

IFC Against AIDS

Pre-engagement
Client identification: nature of deal, sector, country, internal stakeholders Mapping out IFC team & value-add

IFC Against AIDS Client Engagement and M&E Process

Implementation and partnering
Program execution and consolidation of partnership: Client and NGO implement the program Eventually IFC Against AIDS develops supervisory role Feedback to management
Monitoring & Evaluation KAP survey Choose appropriate intervention and monitor using M&E guide and indicators Contract service provider Monthly reports to management Quarterly reports to IFC for database Participate in IFC workshops This is tracked through program monitoring forms Monitoring & Evaluation Client Analyze monitoring data Conduct evaluation Re-plan using results of both IFC Analyze monitoring database Analyze client evaluation reports Client satisfaction survey Re-plan for new year This is tracked through program monitoring and evaluation forms

Foundations of an HIV/AIDS program

Infrastructure and assessment: Assessment of programmatic conditions Senior management buy-in Partnership with service providers
Monitoring & Evaluation Meetings with senior managers AIDS committees set up Focal persons identified Policy Implementation plan Budgets for programs MoUs with service providers This is tracked through program monitoring forms

Sustainability and maintenance

M&E and program transition: Consolidation of lessons learned M&E and program evaluation Bridge plan of action Feedback to management

Months 0-6

Months 6-12

Months 12-18

Monitoring and Evaluation (M&E)

Conclusion: Why M&E? M&E should be part of the design of a program Ensures systematic reporting Communicates results and accountability Measures efficiency and effectiveness Provides information for improved decision making Ensures effective allocation of resources Promotes continuous learning and improvement

Monitoring and Evaluation (M&E)

Practical exercise on IFC Against AIDS M&E tools

Monitoring

Appendix 1 Coordinators Workplace Peer Educator Training Form (M1) Appendix 2 Coordinators Community Peer Educator Training Form (M2) Appendix 3 Workplace Peer Educator Activity Form (M3) Appendix 4 Workplace Peer Educator Community Activity Form (M4) Appendix 5 Community Peer Educator Activity Form (M5) Appendix 6 Workplace Peer Educator Monthly Activity Summary (M6) Appendix 7 Workplace Peer Educator Monthly Community Summary (M7) Appendix 8 Community Peer Educator Monthly Activity Summary (M8) Appendix 9 Coordinators Monthly Activity Summary (M9) Appendix 10 Planned vs Achieved Matrix (E1)

Evaluation

Appendix 11 Process Evaluation: Structured Interview (E2) Appendix 12 Process Evaluation: Focus Group Discussion Guide (E3) Appendix 13 Outcome Evaluation: KAPB Survey Questionnaire (E4) Appendix 14 Outcome Evaluation: KAPB Focus Group Discussion Guide (E5)

IFC Against AIDS

http://www.ifc.org/ifcagainstaids
Sabine Durier - Program Leader
Tel: +1-202-473-4176, Email: SDurier@ifc.org

Gillette Conner - Program Officer

Tel: +1-202-473-4040, Email: GConner@ifc.org

Tish Enslin - Program Officer (Johannesburg)

Tel: +27-11-731-3062, Email: LEnslin@ifc.org

Noleen Dube - Program Officer (Johannesburg)

Tel: +27-11-731-3059, Email: NDube@ifc.org

Martin Lutalo - Program Analyst

Tel: +1-202-458-1406, Email: MLutalo@ifc.org

Ildio Silva - Consultant (Maputo)

Tel: +1-258-84-3070-360, Email: IDasilva1@ifc.org