Evaluation and Outcomes

During the early stages of Project ACHIEVE planning and at the beginning of its implementation, decisions are made as to how different goals, objectives, activities, and outcomes will be evaluated. In general, Project ACHIEVE designs evaluation approaches in the following five outcome areas:

• Evaluations of School-Level Outcomes
• Evaluations of Staff-Level/Professional Development Outcomes
• Evaluations of Student-Level Outcomes
• Evaluations of Treatment or Implementation Integrity Outcomes
• Evaluations of Project ACHIEVE Satisfaction and Service Outcomes

During the evaluation process, short-term or formative evaluations are conducted to determine student, staff, and school progress toward specific goals.  Long-term, end-of-the-year, or summative evaluations are conducted to determine the successful completion of specific goals and what future — or "next-year" — goals are needed.  In addition, some evaluations focus on process—for example, whether an intervention is implemented accurately or for a long enough period of time. Other evaluations focus on products or outcomes — that is, the number of students scoring at "Proficient" or above on their state standards tests, whether discipline referrals to the Principal's Office are decreasing.

Evaluation is crucial to determining the success of a School Improvement Plan and Project ACHIEVE. Project ACHIEVE has designed numerous evaluation surveys, tools, approaches, and data-based systems to facilitate data collection, analysis, and reporting. Project ACHIEVE also helps schools to design and implement longitudinal data collection processes so that they can evaluate and compare outcomes across years and situations.

Examples of Project ACHIEVE Evaluation Tools:

Project ACHIEVE has designed numerous evaluation surveys, tools, approaches, and data-based systems to facilitate data collection, analysis, and reporting. Among some notable Project ACHIEVE evaluation tools designed by or available to participating schools are the following:

• SWOT Analysis and School/District Resource Analysis Forms
• Mission Statement Analysis Form
• School Resource Survey and Resource Directory Form
• The Scale of Effective School Discipline and Safety
• The Scale of Staff Interactions and School Cohesion
• The ADDRESS (Automated Discipline Data Review and Evaluation Software System-through the Arkansas State Personnel Development Grant, Arkansas Department of Education)

Examples of Project ACHIEVE Evaluation Outcomes:

Student:

• Academic Achievement
• Academic Engagement in the Classroom
• Discipline Referrals to the Principal's Office
• Suspension/Expulsion
• Attendance
• Special Education Referrals/Placements
• Grade Retention/Promotion
• High School Graduation (Regular Diploma)
• Special Education:
  • Least Restrictive Environment Placements
  • AYP
  • Graduation/Drop-Out
  • Due Process Litigation
  • Disproportionality
• SPRINT/Early Intervention Success (Academic and Behavioral)
• Independent Learning and Self-Management
• Self-Efficacy and Evidence of Protective Factors
• The Behavioral Matrix/School Accountability Forms
• The Special Situation Analysis Forms
• The Stop & Think Social Skills Program Implementation, Observation, and Evaluation Forms
• The SPRINT Team Process and Outcome Survey
• The SPRINT Consultation Referral Audit
• The Academic Achievement Audit
• The Student Articulation Process Forms

School:

• Positive and Safe School Environments
• Parent Involvement and Community Support
• Staff Satisfaction and Collaboration
• Completion of School Improvement Plan Goals
• ESEA and IDEA Success
• Increased Building Capacity—Professional Development Success and Instructional and Intervention Autonomy