What's Left
...
Technology Tools for Accountability

Technology Tools to Make Educational Accountability Work

Gary West

Greenwood School District 50

Copyright 2000

 

INTRODUCTION

The South Carolina Education Accountability Act of 1998 (EAA) establishes new standards for student performance.  There is little doubt that such standards are needed as our State attempts to move up the ladder toward excellence.  It is significant that this is a “State” effort; it would have been easy -- and incorrect -- to assign the responsibility to "schools."  All of us finally agree that all of us are -- and always have been -- responsible.

 

The State has set the standards by which quality performance is to be gauged.  If student performance is to be the "product" of the educational industry, there must be valid and reliable quality assurance procedures throughout the "production" process.  At every step in production, we must be able to show that the previous steps have been successfully completed before we can go on to the next steps.

 

With that in mind, let's consider what the EAA does, who it does it for, and what those people need to assure success.  In essence, we must (1) find out who is responsible for each step, (2) determine how they can be successful, and, (3) make sure they have the tools they need to be successful.  The tools must include a curriculum management system that provides the necessary step-by-step quality assurance measures.

 

WHO IS ACCOUNTABLE?

Under the EAA, each school in the state is to be the subject of a report card that details the school’s success in creating student performance.  As it should be, student performance is the only measure of a school’s success. 

 

Immediately after a school’s success -- or lack of success -- is demonstrated on the school report card, the principal of that school will be declared successful.  Or not.  The immediate reaction in every community will be to equate the principal with the school.  Each community will begin to hold the principal accountable for the school’s success.  Student performance will become the measure of each principal’s success.

 

Principals who are held accountable by their communities will be called upon to improve student performance or to move on.  Those who decide to stay will immediately begin analyzing the “profit centers” in their schools -- the classrooms.  Student performance is created in those classrooms.  Principals will begin looking deeply into the patterns of student performance in those classrooms.  Invariably, those patterns will  lead to an analysis of teacher performance.  Who creates student performance; who does not. 

 

The classroom teacher has the responsibility for creating student performance.  Despite other  factors, including parent involvement and available resources, the classroom teacher ultimately will be held accountable for student performance.  Like their principals, teachers will be called upon to create student performance or to move on.

 

HOW CAN TEACHERS CREATE STUDENT PERFORMANCE?

The EAA provides the standards against which student performance will be measured.  It also provides training for those who must create student performance.  Standards and staff development, in effect, define what the product should look like and how that product can be created.  The EAA, however, does not provide the management strategies or tools needed for assuring success in the production process.  That process requires accurate, complete, and timely information.

 

That information can be different for each student in each subject area or course.  That information changes as each student completes a learning activity.  That information is always changing.

 

To create student performance, a teacher needs to know (1) what the student already knows, (2) what the student does not know, (3) what the student should know, and (4) what to do to move the student from what he/she doesn't know to what he/she should know.  A teacher who does not know these four pieces of information cannot systematically create student performance.

 

This is not different from the information required to be successful in manufacturing or service industries.  The manufacturing process goes from (1) the condition of the raw material to (2) what has to be added to the raw material to (3) what the final product should look and work like to (4) the assembly of the pieces to make it look and work like that.

 

Throughout the manufacturing process, the materials and production practices are tested again and again to be sure that those meet the specifications required to create the final product.  The testing is completed and the results are at least satisfactory before going on to the next phase of production.  In industry, that's called "quality assurance."  It is universal.

 

In education, it doesn't exist.  In education, we test.  No doubt about that.  We teach it, we test it, we score it, we put it in the grade book.  Then, it's on to the next lesson or grade level regardless of the results.  We tend to use those tests to end an instructional activity rather than starting the next activity.  We use the results to document success -- or lack of it -- in the prior process rather than documenting that we have been successful in preparing our product for the next process.  We send both the successful and the unsuccessful on to the next phase of production.

 

It's important to note here that "successful" and "unsuccessful" do not refer to children.  We make the mistake of making emotional rather than rational decisions when we equate "children" with our "product."  Children are not the product of the education industry.  "Student performance" is that product.  We must create a systematic process for assuring and ensuring successful student performance at all points along the production continuum.

 

If we are to be successful at creating student performance, our teachers must have and use valid and reliable quality assurance procedures.  Before starting any learning activity, a teacher should have assessed, in some fashion, what each child knows, doesn't know, and should know.  The learning activity should be designed to move the student from some known point to another known point.  And only the students who are assessed with similar needs should be involved in that activity.  Other students with different needs should be involved in other activities.  If students are involved in activities they don't need, the teacher is not systematically creating student performance.

 

After an activity is completed, it is essential that each student's performance is assessed again.  Some may have progressed more than others.  It is not reasonable to assume that every student made the same progress -- for even one such activity. 

 

This is part of quality assurance.  Test, adjust, test again. Adjust again.  Test again.  Each time, the test determines what is to be done next.  And sometimes, "next" means going back and doing it again.

 

This is what teachers must do if they are to be successful in creating student performance.  The problem is:  We have not provided our teachers the tools they need to gather and analyze the information they need.  As a result, we may be unable to hold those teachers accountable for creating student performance.

 

WHAT DO TEACHERS NEED IN ORDER TO BE SUCCESSFUL?

One of the standard rules of the manufacturing and service industries involves product testing.  They test each part, each process, and each product or service.  They look at the test results to see if everything is ready to move forward.  If not, they re-tool it and test it again.  This is repeated until everything works as it should -- at each step in the production process.

 

One of the most pervasive myths of education is that we test too much. 

 

The reality is that (1) we test too few of the important things along the way; (2) we use the results to measure things already done rather than things that still need to be done; (3) our one quality assurance test is given only after we've finished production, and (4) we don't have the tools or resources to do it any other way.

 

We know we must change the way we do the first three.  We cannot be successful unless we can give our teachers the appropriate tools and resources to empower them to make those changes.

 

Educational accountability requires that teachers create student performance.  To be successful, they must have real-time data from which they can make real-time decisions about the students with whom they work.  Without those data, education will continue to base important decisions on year-old test scores and decades-old myths.  Without day-to-day data and the resources to act on those data, teachers cannot be expected to succeed.  No business or industry can succeed without such data and without such resources. If it is to be a successful industry, education is no different.

 

The information needs of teachers have changed dramatically as a result of the EAA.  No longer can teachers afford to wait until the end of the year to see if their efforts to create student performance have been successful.  No longer can they assume they’re creating successful student performance only to find out that it just doesn’t show up in the end-of-year achievement testing. 

 

No longer can they permit one measurement to define their success -- or lack of success -- over the course of a whole school year.

 

Teachers must have information throughout the production process.  That information must be used to make critical decisions about what to do next with each child.  That information must be used to systematically create student performance.

 

There’s too much of that information to manage -- unless we change the way we do our business.  Unless we change the set of tools we use in our planning and delivery of instruction.  Unless we use technology to help.

 

WHAT ARE THE TOOLS THAT TEACHERS NEED TO ASSURE SUCCESS?

Technology is the only tool we have to help us manage the volume of information we must have if we are to be successful -- regardless of the industry.  The EAA creates an absolute need for a new set of tools for teachers.  What should that tool set include?

 

The Tools

Everyone understands that teachers must have computers in their classrooms.  Those computers can provide access to knowledge and information for students and teachers.  Under the EAA, those computers become doubly important because they provide access to the information tool set that teachers must have.

 

The tool set needed by teachers is generically known, in South Carolina, as a “curriculum management system” -- CMS.  CMS contains tools for specific jobs related to accountability and the creation of student performance.  The following includes a brief description of the essential tools:

 

·         Database of Performance Standards in Each Content Area (State, District, School):  This database should contain all the performance standards defined in the State and local accountability policies.  These should be coded for easy correlation to other accountability factors.

·         Database of Goals and Objectives Correlated to Performance Standards in Each Area (District, School):  This database should contain all the goals and objectives defined in local plans to address the State and local performance standards.  These should be coded for easy correlation to the performance standards and to other performance factors.

·         Database of Resources for Use in Instruction (District, School, Other):  This database should contain lists and descriptions of locally available resources for addressing the local goals and objectives.  These resources should include materials, equipment, persons, web sites, and others.  These should be coded to the goals and objectives as well as the activities in which the resources can be used.

·         Database of Activities for Each Goal and Objective, Including Resources Available (District, School, Other):  This database should include teacher-made and other activities designed to deliver content and learning to the student.  Activities should be coded for easy correlation to local goals and objectives and to the broader performance standards.  These activities can be thematic units (instructional modules) or parts of thematic units, coded appropriately.

·         Database of Diagnostic Assessment Items Correlated to Goals, Objectives, and Performance Standards (State, District, School, Other):  This database includes informal assessment items designed for assessing current status of student knowledge.  This item bank can be used to create daily assessments to identify what a student knows and does not know.  Based on that information, the teacher or teaching team can choose activities that will help the student attain the knowledge that should be known.  Diagnostic assessments are not part of grading or measuring student achievement; rather, diagnostic assessments are used to guide the teacher(s).

·         Database of Performance Assessment Items Correlated to Goals, Objectives, and Performance Standards (District, School, Other):  This database includes assessment items designed for assessing student achievement.  These items become part of a database from which teachers and administrators can select items to measure achievement.  These items can be compiled into assessment instruments (tests) for the purpose of grading and/or reporting student performance.

·         Database of Performance Assessment Instruments Correlated to Goals, Objectives, and Performance Standards (State, District, School, Other):  This database can contain pre-built assessment instruments (tests) for assessing student performance at specific points along the instructional continuum.  For example, end-of-term, end-of-year, and end-of-course tests can be created from the item database and stored for use with all students in a particular grade level or course.

·         Database of Standardized Achievement Test Results (District and School):  This database should contain year-to-year results from standardized achievement test results.  The results should be linked through student ID numbers to permit longitudinal analysis.  This database can be used to identify programmatic needs as well as show patterns in student achievement and performance.

·         Student Database Containing Results of Daily and Other Periodic Assessments for Each Student (District, School, Other):  This database stores results from diagnostic and other assessments.  The data are current and can be used by the teacher to identify the students to engage in specific activities related to specific performance standards.  This database is the most important daily source of information for teachers because it helps pinpoint what a student knows and does not know.  Using that information and information about what the student should know, the teacher is able to plan activities that have specific purposes.

·         Grade Recording and Reporting System (Traditional Gradebook):  The gradebook tool permits the teacher to record, average, and report grades without duplicating any work.  In addition, the gradebook can be used to report mastery of objectives and standards to parents.  It can also be the tool that links daily and period-by-period attendance to the school management system. 

·         Database of Report Formats for Longitudinal Analysis of Standardized Achievement Test Results:  This database contains a set of report formats from which teachers can print standardized test information about the students they teach.  The reports would give several years’ comparisons, subtest results, and right/wrong response analysis.  These reports would help teachers understand the general areas of student needs.

·         Database of Report Formats for Teacher Use in Making Instructional Decisions for Individual Students and Groups (including Traditional and Diagnostic Assessment Data):  This database contains a set of report formats from which teachers can print daily diagnostic information for students or groups of students.  Each report format would permit the teacher to query for lists of students who have not mastered specific objectives or standards.  The reports could also include specific references to activities that could help the identified students.  This database would be used daily by teachers as they check and re-check for specific student needs and plan specific activities to meet those needs.  These reports provide the quality assurance information needed to make mission-critical decisions about individual students or groups of students.

·         Database of Report Formats for Principal Use in Making Decisions about Instructional Needs (including Teachers and Students):  This database of reports can give principals and other instructional leaders information about programmatic needs and staff development needs based on specific student performance results.  These reports help principals identify profit and loss centers within the curriculum and in instructional programs.

·         Database of Report Formats for Accountability and Reporting to the Community:  This database contains report formats that clearly and concisely show what is happening in each of the curriculum areas.  This information is intended to be part of the report to the agencies that manage accountability and to the community.  While this information would not identify specific teachers or students, it would identify specific areas and the level of achievement attained in those areas during the reported period.

 

The purpose of the curriculum management system is to provide the tools for teachers and principals who must assure that systematic academic growth is taking place.  That assurance is based entirely on controlling the production process so that the product -- student performance -- is created at the end of that process.  Without these tools, there can be no systematic quality assurance during that process.

 

Using the Tools

With the appropriate technological tools, teachers can have access to important student information that they’ve never had before.  With that access, the typical instructional day, from a teacher’s perspective, might look like this:

 

·         At the end of the previous day or at the beginning of the current day, the teacher logs onto the network.  She/he asks (queries) CMS for lists of students who have not shown mastery of specific objectives and standards that are to be addressed in the morning’s activities.  CMS provides those lists of names and provides a list of possible activities and resources that might help those students.  Without CMS, the teacher may not be able to get lists of names grouped by specific needs without several hours’ work.  The biggest advantage of CMS is that it provides important information in a very short period of time, freeing the teacher to use her/his time to deal with the face-to-face tasks of teaching and creating student performance.

·         With those lists, the teacher is able to create two or three groups that have specific needs and can organize the lessons and materials needed for those students.  When students arrive for class, they can immediately find their places for instruction.  The teacher can deliver a preview or background lesson to the entire class; then, he/she can move the students into their respective groups.  The activities for the groups are organized so that students in one or two groups can get started without further direction while the teacher works with another group.  The teacher is then able to visit each group or individual students at the appropriate times.  Constant monitoring, coaching, and teaching takes place in each group.  Students learn to stay on task during this process.

·         With the proper planning and implementation, learning activities will include integrated content, spanning several subject areas and the appropriate performance objectives for each.  A social studies activity could include, for example, specific reading and writing tasks related to art and economics in the period being studied.

·         As students complete specific tasks, the teacher is able to assess individual performance and update each student’s CMS information.  In some cases, students can update their own information based on the teacher’s direction.  When appropriate, the teacher can administer an informal diagnostic test or may provide a formal assessment for a grade.  Some of those assessments can be online and can automatically update the student record.  At other times, the teacher or an aide (who may serve more than one teacher for record keeping purposes) will update each student’s record.  These updates will always include more than one content area and more than one objective or standard for each content area.

·         As the day progresses, the teacher is able to query CMS for status reports on student performance.  If some students need additional help, they may be re-grouped with others for more assistance.  Others who have shown mastery in specific areas can be directed into other activities.  At times, the teacher may re-group for peer assistance, using CMS reports to identify students who can help others with specific activities.  This process is repeated throughout the day, with CMS providing the information needed to make the necessary instructional decisions.

 

Because instruction must be data-driven, the data must be accurate, complete, and current at all times.  The information that teachers can get from CMS will be only as good as the data given to CMS.  The fact is that teachers cannot teach at the same time they are collecting and recording data about student performance. 

 

As part of changing the way they do business, schools must find ways to manage the data collection process without taking away from the teaching.  Part of that process should include daily planning time and clerical help for teachers.  Teachers need clerical aides who can accurately collect and input data related to student performance.  These aides can work with more than one teacher in a grade level, cluster, or department.  It is important to include this component if CMS is to work.  Teachers’ time is too expensive and valuable to be used for tasks that do not involve face-to-face instruction. 

 

Note that this changes the way teachers do business.  Instruction becomes a data-driven activity rather than relying on scope-and-sequence charts provided by curriculum publishers.  Scope-and-sequence addresses only the content needs; CMS provides information about individual student needs.

 

CONCLUSIONS

South Carolina’s classroom teachers are responsible for creating student performance.  Their success means success for their students and their schools.  The Education Accountability Act of 1998 identifies the things that students should know (performance standards) and provides strategies for helping teachers understand those standards how those standards are to be integrated into instruction.

 

In order for the accountability process to be successful, it must provide a quality assurance process that provides teachers the information they need to create systematic student performance.  The “curriculum management system” described above provides the tools and information to assure systematic growth.  CMS creates a data-driven instructional process that is always changing as student needs change.

 

We know what to do (defined by our performance standards).  We know how to do it (through our staff development programs).  We do not know when, for whom, by how much, or what next.  That’s the information that can come only from CMS.

 

Without the information to make day-to-day decisions about what to do next for each student, teachers cannot be held accountable for student performance.  Without that information, accountability will fail to change the way our students perform. 

 

Without that information, none of us can live up to the responsibility we’ve assumed for our children.

 

Gary West

116 Limerick Road

Greenwood, South Carolina 29649

864/223-1685 (home)

864/941-5466 (office)

westg@mail.gwd50.k12.sc.us

 

This article was published in THE Journal, December 2000.  It can be viewed at http://www.thejournal.com/magazine/vault/A3225.cfm.

 
 
Click here to comment about this article.  Please put the article title in subject line. 
 
What's Left -- Discussions that go beyond the simple stuff.
All materials copyright. All rights reserved.