September 23, 2002
Mr. Arne Duncan:
For the past several years, the Chicago Board of Education has mandated the administration of the Chicago Academic Standards Exam for all freshman and sophomore students in the core subject areas. For the past two years, teachers have been required to count the results of this exam as ten percent of the tested students' final grades. The CASE was created and implemented to hold teachers accountable for basing instruction on the Chicago Academic Standards toward the end of helping students acquire the skills detailed in the standards. As teachers in the Chicago Public School system, we are very concerned about this exam.
Our primary concern is that the CASE does not reflect the standards for which it was designed, particularly in the subjects of English and Social Studies. Using the Illinois State Goals as a foundation, the creators of the Chicago Academic Standards detailed their standards and framework statements to promote the idea that students do not only need to acquire basic skills such as recall and memorization, but also higher order thinking skills, including inference, synthesis, and analysis. The CASE, however, only evaluates students on recall and simple comprehension skills. In fact, the majority of the standards detailed in the Chicago Academic Standards are not assessed by this exam.
Furthermore, this fall, the Board of Education has mandated the implementation of the Chicago Reading Initiative (CRI). This initiative is designed to engage teachers in effective reading instruction across the curriculum. This model of reading instruction, developed by Tim Shanahan at UIC, requires teachers to implement strategies designed to develop student reading fluency, word knowledge, reading comprehension, and writing. The CASE, as it is currently written, does not accurately reflect the objectives of the CRI.
Another major concern is that the test, particularly in the English and Social Studies sections, includes many poorly constructed and often inaccurate test questions and answer choices. The text selections on the English exam are often at a higher reading level than is expected of the grade being tested. As a result, students are not able to complete reading in the allotted time thereby significantly reducing test validity. In addition, the test does not truly test students' skills. Text selections sometimes reflect a major work taught by teachers. Therefore, the test reflects familiarity with texts and prior knowledge rather than the skills those students have acquired. Also, since some teachers do not teach the works reflected in the CASE text selections, there is no equity in students' ability to achieve good results on the test. The rubrics use such imprecise and vague language that establishing any norm for inter-rater reliability is impossible. In addition, the English rubric only assesses one mode of writing, yet often the extended constructed response prompts do not ask for the mode of writing assessed by the rubric.
The results of the exam, while they must be counted towards the students' grades, are not used for any discernable purpose outside of the classroom. While the CASE is designed to measure teacher accountability, the results mean nothing, not only in terms of the test's lack of validity, but also because they are not used to assess instructional practices or to see whether students are really up to the standards.