Monitoring and Assessment Phase

Steps for Evaluation

Adapted from Source:  Training Manual for Assessing Impact:  Evaluating Staff Development by Joellen Killion with Linda Munger, Pat Roy, and Parker McMullen

© 2003

Date	Steps
	1)  Planning the Evaluation  – Assessing Evaluability: ·        Set goal. ·        Determine standards of success. ·        Identify indicators of success. ·        Articulate the theory of change, the sequence of components and underlying assumptions that achieve the intended results. ·        Create the logic model, including the inputs/resources, activities/processes, initial outcomes (usually knowledge and skills) of the activities, intermediate outcomes (usually attitudes, aspirations, and behaviors) of the activities, and long-term result(s) intended from the activities. ·        Tools:  Guiding Principles for Iowa Support System; Evaluation of Action Plan/Professional Development;  Creating a Theory of Change – Blue and Green Card Activity; Diagnosis Worksheet for Westlake Middle School; Action Plan for Westlake Middle School; The Domains and Critical Elements; KASAB; Charting the Logic Model; PowerPoint – An Introduction to Eight Steps of Evaluation
	2)  Planning the Evaluation -  Formulating Evaluation Questions: ·        Formulate evaluation questions that provide structure and focus to the evaluation framework.  Consideration should be given to each question being reasonable, appropriate, answerable, specific in terms of program success, and specific in terms of measure of performance. ·        Tools:  Guiding Principles for Iowa Support System; Evaluation Questions – Examples and Commentary; Writing Evaluation Questions
	3)  Planning the Evaluation – Constructing Evaluation Framework: ·        Construct evaluation questions based on what we need to know, how we will know, who/what will tell us, and how we will collect the data. ·        Tools:  Evaluation Framework Worksheet; Data Collection Methods
	4)  Conducting the Evaluation – Collecting Data: ·        Collect data systematically. ·        Tools: Guiding Principles for Iowa Support System; Monitoring Key Activities; Data Collection Plan
	5)  Conducting the Evaluation – Organizing and Analyzing Data: ·        Organize, analyze, and display the data. ·        Tools:  Data Analysis Methods, Westlake Middle School Evaluation Framework Worksheet
	6)  Conducting the Evaluation -  Interpreting Data: ·          Make meaning from the data, resulting in changes based on merit and impact. ·         Tools:  Evidence vs Claim
	7)  Reporting the Evaluation – Disseminating Results and Findings: ·          Consider the audiences for the information. ·          Send same message to all audiences but use forms of communication appropriate to each audience. ·         Tools:  Guiding Principles for Iowa Support System
	8)  Reporting the Evaluation – Evaluating the Evaluation: ·        Answer the questions, “What have we learned from the evaluation process?” “What would we do again?” and “What would we change?” ·        Tools: Configuration Map for Phase V

PowerPoints:

• Phase V:  Evaluation - An Introduction to the Eight Steps of Evaluation - Presentation and Notes (090307) 

Tools and Resources:

• Table of Contents for Monitoring and Assessment - The Evaluation Phase
• Steps for Evaluation
• Guiding Principles of Iowa Support System
• Evaluation of Action Plan/Professional Development
• Creating a Theory of Change – Green and Blue Card Activity
• Diagnosis Worksheet for Westlake Middle School
• Westlake Middle School Action Plan
• The Domains and Critical Elements
• KASAB
• Charting the Logic Model    
• Evaluation Questions – Examples and Commentary           
• Writing Evaluation Questions  
• Evaluation Framework Worksheet                                               
• Data Collection Methods      
• Monitoring Key Activities                                                             
• Data Collection Plan                                                                       
• Data Analysis Methods                                                                  
• Westlake Middle School Evaluation Framework      
• Participants’ Evaluation of Learning Opportunity
• Configuration Map for Monitoring and Assessment
• Trainers’ Evaluation of Learning Opportunity

Other Tools and Resources: