Program Design & Evaluation
Book: Bringing out the best…
In this assignment, you will continue to play the role of a behavior-consulting intern. Your company is now working with Pathways an alternative high school. You will analyze the collected data and provide a summary of your findings based on the scenario presented below.
Scenario: Pathways High School
Pathways is an alternative high school. Pathways allows students with behavior challenges to complete their high school experience with a more flexible and positive approach. Their mission is to create an environment that allows students to consistently exceed expectations, maintain high levels of student and family satisfaction, and meet cost effectiveness standards. They strive to provide the highest education possible to students from a variety of communities and cultural backgrounds.
Acme, Inc., assisted Pathways with the creation of individual behavior intervention plans (BIP) for students displaying high levels of inappropriate behaviors. In addition, ACME used behavior skills training (BST) to train all staff on the basics of ABA and how to implement each BIP.
A behavior management division headed by a full-time behavior specialist at the school is responsible for implementing the plans that were originally created in collaboration with Pathways’ staff. In addition, Acme is responsible for ongoing staff training and monitoring the effectiveness of each plan.
You are asked to do a follow-up to determine the success of the procedures that were put in place. In addition, you are asked to conduct some inter-observer Agreement (IOA) probes and determine whether the staff has maintained the skills taught during training.
You are provided with a variety of data to analyze and will need to use the data to determine the effectiveness of the current interventions.
The behavior specialist has been collecting and compiling data and presents them in the figures displayed in the Spreadsheet.
Figure 1: Summary of comments from staff questionnaires related to the success of the intervention and satisfaction with training.
Figure 2: Line graph of the frequency of aggressive behavior incidents for the entire school reported before (Baseline) and after (Treatment) the program began.
Figure 3: Frequency data from an observation session with two different teachers and one student’s behavior. Figure 3 reflects the frequency of physical aggression during the sessions.
Figure 4: Data from Staff Integrity Checklist.
You must now review the data and present a summary of your findings to your supervisor at ACME, Inc., as well as the school. You should include the following in your summary:
For all Figures:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process. Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.” Discuss whether the type of data is appropriate for the context of the evaluation.
For Figure 1:
Discuss the overall purpose of this data and how it should be used in analyzing the effectiveness of the program.
Using the data contained in this figure, discuss the implications with regard to the effectiveness of the program.
For Figure 2:
Use visual analysis and discuss the level, trend, and variability of the challenging behavior incidents reported during baseline (before) and treatment (during the intervention).
Using the data, describe the effect that the intervention had on the frequency of behavior incidents within Pathways.
Considering the level of data, as well as any trends in the data, discuss the effectiveness of the program.
For Figure 3:
Calculate the total frequency of physical aggression for each observer.
Using the total count method of IOA; calculate the percentage of IOA.
Discuss the result of IOA.
Is the IOA percentage within the acceptable range?
Discuss what changes should be considered to increase the IOA percentage. If changes are not necessary, discuss what factors contribute to high percentage of IOA.
Discuss how IOA measures can be used to assist with determining the effectiveness of the program.
For Figure 4:
Calculate the percent correct results of the treatment integrity checklist before intervention; one day after intervention; and at the 3-month follow-up.
This is the total factors with a “Yes” out of the total number of factors, multiplied by 100.
Relate these treatment integrity measures to the effectiveness of the program.
Discuss the importance of treatment integrity in relation to the success of behavior management programs.
Your paper should be a minimum of 3–4 pages in length, include proper APA formatting (including properly formatted headings for each section of your plan), and include at least two academic references (including your course readings).
Your Assignment should include:
Main body of the paper (3–4 pages)
Properly formatted headings for each section of your plan
At least two academic references (including your course text)
Correct APA Style formatting for in-paper cites