Thursday, January 31, 2008

How is the PSSA developed?

Who are these "almighty gods of standardized testing"? Who actually makes up the test?
The process by which the PSSA is developed is a complex one using experts writers, statistics, field tests, and Assessment anchors to develop questions. The Pennsylvania State Board of Education contracts with a company called Data Recognition Corporation (DRC) to compose suitable questions, find and reprint suitable reading passages, test the questions, gather statistical and subjective feedback on the questions, and then finally put the questions in to use on the tests. Data Recognition Corporation distributes the tests, collects the tests, and grades the tests. (DRC Tech. Report 2006) (Yes, it is a lot of reliance on one company to get the job done. Let’s hope they know what they are doing.)

DRC does not have total control. DRC works in conjunction with such organizations as The National Center for Improvement of Educational Assessment (NCIEA) and the National Center for Educational Outcomes to create a test that adheres to basic principles of quality standardized tests. Making sure the questions and graphics are neat, readable, measurable are all part of these principles. During the test composition process and before the final test is given, all aspects of the PSSA tests are reviewed by PDE (Pennsylvania Department of Education) committees. The committees are comprised of teachers, educators, administrators, and some members of the PDE staff. Members of the Board of Education have the final formal approval. (DRC Tech Report gr 5, 8, and 11)

In addition, there are guidelines to ensure test questions are free of bias toward any particular group. “DRC’s guidelines for bias, fairness, and sensitivity include instruction concerning how to eliminate language, symbols, words, phrases, and content that might be considered offensive by members of racial, ethnic, gender, or other groups. Areas of bias that are specifically targeted include, but are not limited to: stereotyping, gender, regional/geographic, ethnic/cultural, socioeconomic/class, religious, experiential, and biases against a particular age group (ageism) and against persons with disabilities.” (4, 6, 7 pg 14) A Bias, Fairness, and Sensitivity Committee including PDE staff members and DRC trained diverse men and women, reviews the test items to, once again, ensure they are free of any biased language or sensitive material. (DRC Tech Report 5, 8, 11) (Are any of us bias-free? With that in mind, and from sources which do not wish to be revealed, there are still some questionable items that sneak through).