TPMCafe
« Patent Reform | Home | Home Economics »

Teaching to the Test

user-pic

I suppose this will be no more popular than any of my other views regarding No Child Left Behind, but the notion that it's horrible because it involves teachers "teaching to the test" strikes me as totally inane. Obviously, teaching to a bad test is going to produce bad results. But that's just to make the banal point that if we're going to have testing, we need to have good tests. And I think one can legitimately worry that NCLB doesn't offer enough quality-control on this front. But as a general matter, what's wrong with teaching to the test?

I think this is one of the few subjects on which the president has made some pithy and insightful remarks: "If you test a child on basic math and reading skills, and you're teaching to the test, you're teaching math and reading." When I experienced teaching to the test in, say, AP Physics class I learned, well, a good deal of introductory level physics. I'll admit this probably wasn't the most useful approach to French literature (though I sure learned when to use the subjunctive and when not to!), but as a general matter it strikes me as an excellent way of defining what it is we think kids need to learn and then making sure they're learning it. Anyway, just keep in mind that before Howard Dean devised the funny-but-meaningless phrase "no school board left standing" liberals in good standing like Ted Kennedy and George Miller were the big NCLB boosters.

Update [2005-6-3 20:55:55 by yglesias]: Some more liberal thoughts below the fold.

That all aside, some common complaints I'm happy to get on board with. Should we be scapegoating teachers for schools' problems? Obviously not, but I don't think this is what's actually going on. Don't we need to provide schools with more resources to do the job? Yes. Tons of resources. NCLB did boost school funding a bunch. I'd be happy to boost it a bunch more. Aren't smaller class sizes the key? I think the evidence on this is mixed -- schools deserve to get a lot more money for teacher salary and try out various combinations of more teachers, or better-paid teachers, or some mix of the two.

Isn't the 100 percent proficiency requirement too stringent? Probably. The current set-up is just going to encourage states to make standards ridiculously lax so as to meet universal compliance goals. It would make more sense to set higher standards and then allow for some failure. This strikes me, however, as a distinctly second-order issue.

Isn't it crazy to punish bad schools by taking their money away? Sure, but that's not really what the law does. More to the point, if we're going to have states step in to take over persistently failing schools don't we need to do more to ensure that state departments of education actually have resources at their disposal to do something useful about it? Yes indeed.


53 Comments

| Leave a comment

Matt, my wife is a teacher in the Philadelphia school district.  And "teaching to the test" in Philly means a little more than it does when you bring it up here.  Teachers and faculty actively help the children cheat on the various evaluations the students are given.  My wife is regularly forced into situations where she feels obligated to report this abuse.  Problem is, so many people are in on it nothing is ever followed up.

 Admittedly, better outside enforcement would obviate this problem, but those kind of enforcement resources don't appear to be provided under NCLB.  Oy.

Now that, Teaser, is a serious problem and, as you say, in need of a serious remedy. I would be an advocate of a federal remedy, but in the absence of one it would make sense for individual states to take action on this front.

Since I was a bit harsh in my criticism of the earlier thread, I think I should thank Matt for responding more fully and not focusing just on the federal/state issue, as I accused him of doing before.

 Some of the responses Matt makes are at least moderately convincing.  On the other hand, I'm still not sure about the "teaching to the test" business.  I too took various AP (and IB) classes which, I suppose, could be said to be "teaching to the test."  But the basic fact is that the kind of basic proficiency tests that NCLB requires simply cannot be anything like AP tests.  Any test which is going to be made a standard like this is almost certain to be bad.

 I remember the Maryland Functional tests we had to take.  The teaching for the Functional Writing test was the most incredibly stupid thing I've ever come across.  We were taught that we had to write the most absurdly rigid five paragraph essays that you could possibly imagine.  I would guess that this is going to happen a lot.

1. if you only test math & reading, mediocre schools may de-emphasize music, PE, etc. in order to goose their numbers.


2. The more fundamental objection is the problem of "memorization without understanding". Richard Feynman's essay on physics-teaching in Brazil:


http://www.gorgorat.com/


"one of the first things to strike me when I came to Brazil was  to  see  elementary  school kids  in bookstores, buying  physics

books. There are so  many  kids  learning physics  in Brazil, beginning much earlier than kids do  in the United States, that it's amazing you don't find many physicists in Brazil -- why is that? So many kids are working  so hard, and nothing comes of it. . .Finally, I said  that I  couldn't see how anyone could  be  educated by this self-propagating system in which people pass exams, and teach others to pass exams, but nobody knows  anything."


Traditionally, this kind of "memorization without understanding" has not been in a problem in the US, but it could become one if "teaching to the test" becomes more prevalent.


My personal opinion on education reform has three parts:


1) A voluntary national test/curriculum and the surrounding infrastructure, spelling out what kids should know and giving parents/teachers the tools to teach them.

2) Equalizing funding between rich and poor school districts (a good compromise: more state/federal money for poor school districts)

3) School vouchers, in order to put power in the hands of parents, and not district administrators, teachers unions, and politicians (a good compromise: more charter schools/school choice)


The ability of parents to "vote with their feet" will, in my opinion, act as a deterrent to the harmful aspects of "teaching to the test", as well as harmful axing of extracurricular programs.

1. Designing an appropriate test is not quite as simple as you imply when you dismiss as obvious that you shouldn't teach to a bad test. For instance, no achievement test that I'm aware of measures what it's supposed to measure with better than about 10-20% validity (r=.35 or so). No test perfectly measures achievement - not even close. Testing with a good test, let's say a test with a validity of 15%, is certainly better than a poor test, or nothing at all, but there are inherent and unavoidable limitations.

2. "Teaching to the test" sometimes means teaching the skills necessary to pass a good test, in which case it's a good thing. But sometimes it means teaching the specific items that will appear on a specific test. That is obviously not an appropriate way to learn, because the test is really just a sample of a broader set of items, all of which the student is presumed to know. The obvious solution to this is to make sure that teachers don't know the specific test items, but in practice that's not always the case.

3. Generally speaking, it's better to encourage a process orientation rather than an outcome orientation to learning. IMO, we have too much of an outcome orientation in our culture, and it results in an "anything goes" attitude, including rampant cheating.

For what it's worth, I think testing is a good idea, but we shouldn't underestimate how difficult it is to achieve and we shouldn't overestimate its benefits.

Here is a Rand report on the validity issue. Basically, they found that while Texas test scores did increase, there wasn't a commensurate rise in other academic measures. It's possible to raise test scores by "teaching to the test" and even by cheating, in such a way that students are not really learning more. It doesn't have to be that way to be sure, but it's an obvious problem that must be dealt with when high-stakes testing is implemented.

Testing is not bad in and of itself.  The problems are twofold.  One, you mentioned AP Physics, which, unless you're some kind of serious genius (which you may well be, for all I know), you took that class in your late high school years.  By then, you have (hopefully) had years of exposure to the critical thinking and problem solving that makes that kind of teaching to the test more than rote memorization.


I learned a lot while studying for my AP Chem exam too, but it's not the same for 5, 6, 7 year olds.


The second problem is how much of the time is spent teaching to the test.  When everything depends on every child passing these tests, that's all the teachers do.  There's little time for creativity or variation or free thought.  Nevermind time to stop and help the kids who aren't getting it as fast as the testing schedule demands.


Which brings me to another point, my mother's specialty: developmental age.  Not all 6-year olds are at the same level of development, but that's exactly what over-standardization forces on them.  Kids must be allowed some latitude to grow at their own pace, especially during these critical early years.


In looking over my posts, I notice that I refer to my family perhaps too often, so forgive me, but this is best example I can offer.  My sister and I learn very differently, always have.  I took to reading from a very early age and was reading full children's novels before I started Kindergarten.  My sister, four years older but raised by the same parents, struggled with reading and didn't really learn until one of her teachers finally noticed in the third grade.


One last thing has to do with retention.  I hear from almost all the teachers I know that many of the kids that are passing the test aren't retaining anything they learned for it a week or two weeks later.  I don't remember the molecular structure of sugar or any of the other hydrocarbons I had to memorize for my AP Chem exam, but if I picked up a Chemsitry book now or read an article in Science, I would understand it.  My sister comes back after winter break and often has to practically re-teach half the last semester because nothing stuck.


Okay, I lied, but this is really the last thing.  I agree with you that testing can be a powerful tool to highlight deficiences and would then hopefully be used to bring extra support to those areas.  And accountability is certainly important - gym teachers shouldn't be teaching Algebra just for the extra money.  But NCLB as structured doesn't accomplish either of these goals and while it may be boosting test scores, I don't believe it's contributing to better minds in any sense.

Thanks for that.  It was a much more effective and economical way of making most of the points I was trying to make.

We want children to be taught knowledge (both factual and operational) about a subject area. A test is at best a proxy for that knowledge. "Teaching to the test" makes the proxy the goal and appart from possibly confusing parents, kids and teachers as to the real goal, it can have a series of unfortunate consequences.

The incentive to cheat point has already been mentioned (see also Freakonomics by Levitt and Dubner for an example of how widespread the problem is) but I actually find the impact on education more troubling.

Tests are by their very nature constrained in a number of ways: they are a one-time sample (>fitness and motivation on that day, circadian rhythm) , wherein in a particular situation (group, seated) a limited number of response options (verbal, often selection from options) on a series of discrete problems is used to form an estimate. Presumably the average score of a school is free of these problems (provided we haven't forgotten to sacrifice several ducks to the deity of the uncorrelated error), but if you happen to be an indivual who performs best when applying and combining general knowledge from several areas to a new problem in the seclusion of your own home during the night through sketches and numbers, your test results will not reflect your knowledge particularly well. Much the same goes for people who have skills not reflected in traditional curicula (e.g. social ones) or pretty much anyone who isn't going to work behind a desk doing paperwork.

"Teaching to the test" invariably involves teaching test taking skills irrelevant to the actual knowledge, unless of course you believe "test taking" to be a valuable skill in itself.

Moreover, tests force you to break down the body of knowledge in particular ways, which usually ends up favouring short-term rote learning over long-term understanding. It also means focussing on matters which can be broken down into neat, independent components, to the detriment of the considerations of complex systems with multiple dependencies. Similarly, if favours broad and shallow knowledge over in-depth knowledge of a limited field.

Now, all these problems can be (and are) addressed, but if the main incentive is getting good test results, you can be fairly certain, that improvements which might make the test a better estimate of knowledge but yield worse overall results will not even be considered. Which is just another way of saying that replacing the real goal with a proxy goal is a bad idea. What kids should learn and checking on whether they actually did learn that should be done without limiting ourselves to the subset that is readily testable.

To the extent that test are a necessary evil and to the extent that they actually can measure a particular field accurately, we should of course use them, but just as we are not content to limit our effort to fight poverty to people below a certain income (the proxy), we shouldn't make tests the goal of education.

journalist and policy wonk who never set foot in a public school a day in their life but support NCLB agrees to teach for five years in the system and send their own kids to public schools for their entire k-12 education.

It's clear that it is standard pedagogical practice is to teach some material and then test students on what they learned. Matt defends this standard if imperfect practice, and claims he is defending "teaching to the test."

You know what? Maybe he's right. Nobody's ever fully explained to me what this phrase means. For all I know, it could just be what everyone does already.

Let me think back to grade school and high school.  What I recall is that the test covered a subset of the material taught. In theory, you were expected to learn everything, but in practice, you might be able to guess which parts were important. Barring that you raise your hand and whine "will this be on the exam?" although that was a little more prevalent in college than earlier.

Depending on the subject, you might learn a general principle to apply--say solving quadratic equations by "completing the square." or you might literally be tested on a subset of facts you were expected to know. In some classes, there could be essay questions, and there really weren't any stated guidelines; somehow the teacher would just figure out if what you wrote indicated that you had grasped the textbook and class discussions.

Now if that is "teaching to the test" I agree with Matt. But I'm pretty sure "teaching to the test" means something else. In conventional pedagogy, the teacher makes up a curriculum and then comes up with a test intended to determine how well the student learned it. I've done this myself as a TA.  You usually know you'll leave something out, but the student doesn't know what, so a student who does very well probably learned the untested parts as well. I would call this "testing what you taught."

My impression of teaching to the test is that you as a teacher see the test or a very typical sample test ahead of time. You then construct a curriculum in such a way that students who follow that curriculum will maximize scores on the test. In some cases--say a spelling test--the results might be identical to testing what you taught. In other cases, any resemblance is inadvertent.

In theory, there might be tests that are so well-conceived that the process of teaching to these tests results in the construction of a very solid curriculum. I really don't know. But the process strikes me as ass-backwards. If we had good teachers and could count on them to devise a good curriculum first of all, we would have a direct rather than indirect way of getting students to learn a subject area.

Now some standardized tests (the SAT) test material needed for some many curricula that it is reasonable to assume that anyone who has been educated through 12th grade has been exposed to it. True, people take Kaplan courses to enhance their scores, but that was never the intent. Simply being well-read tended to be enough to get a good score on the old multiple choice SAT verbal for instance. I would call teaching to the test a failure of the testing process rather than a reasonable approach to teaching. 

Having experienced both American education and 'British' style education I find the entire debate about 'teaching to the test' somewhat amusing. In American educational discourse the phrase 'teaching to the test' is spoken of pejoratively. At the same time one of the most popular educational gurus speak of backwards design; meaning that in good educational practice you look to educational goals and design assessment that will evaluate if you have met those goals first.
 The funny thing is that ‘teaching to the test’ and ‘backwards curriculum design’ amount to much the same thing. Of course this presumes that the test design is robust and systematic. But if it is; and tests are not so predicable that they can be ‘taught to’ in a rote fashion then as a previous commenter pointed out an excellent curriculum should flow from ‘teaching to the test’. And certainly one, that on the aggregate, is better than one that teachers just make up on the fly as is often the case when there are no larger standards or curriculum to match themselves against.

I don't know any educational theory, so I can't reply to specifics. I think that it would certainly be reasonable to have a standardized set of subject goals--almost like a requirements document in software engineering--and then create both a teaching curriculum and a test from such a document. What bothers me is the idea of the test serving double duty as the learning goals, since tests are inevitably incomplete and not intended for that purpose.

It's not even that unreasonable to include material in the curriculum that you have not figured out how to test, since you have some probability of imparting the knowledge whether you can measure it or not.

Bush's statement about testing is circular logic.  Of course if we have a test that covers certain subjects and then have the students do rote memorization exercises in preparation for it, they will pass the test.  But this does not mean that we have taught them anything.

To use an apocryphal Einstein example, is it more important that I know the exact speed of light, or that I learn how to find it, as well as other information?  Is it more important that I know certain facts and figures, or that I am able to take the facts and figures, apply them critically and innovatively to a problem, and produce a workable solution?

Certain things must be memorized.  But NCLB makes our education system merely an information transference and retention system.  There is no learning to study, to analyze, to research, to problem solve, to think.  As the information that is quite literally at our fingertips increases exponentially, it is less important that we fill up our kid's heads with facts and figures, and more important that we teach them how to organize and use this information.

Bush created a false crisis and then addressed the "crisis" by making the schools look even worse because they weren't living up to arbitrary standards.  (Yes, there are schools and districts in crisis, but the nation as a whole is not).   The increased funding that has come to schools is not enough to pay for the costs of the testing and other requirements, so yes, this is, at the least, a not fully funded mandate.  Schools have laid off workers - teachers - in order to meet these requirements.

I am not one for conspiracies, but I cannot see how NCLB is anything other than an attempt to destroy the public education system in the USA.  And before you dismiss my fear, think of what Bush is trying to do to Social Security. 

To expand on the (maybe ill-suited) software engineering example: Backwards design sounds something like test driven development, in which you first design a test and then implement code intended to pass it. But both test and implementation are based on the requirements and design documents.

By contrast, "teaching to the test" sounds more like scamming the QA department. You find out what they're capable of testing in the software, and then you make it just good enough for them to let it through. If you have the world's best QA department, that might just be enough. But otherwise it seems like a crazy approach. 

"If you teach a child to read, then he or her will be able to pass a literacy test."

Seriously, there is nothing wrong with testing what you've taught. That's what a teacher should be testing. The problem is that because of the importance of the tests (and we are now giving over something like 30 instructional days per year to accountability testing) the tests are driving the curriculum, and this has an impoverishing effect on the curriculum.

Once when I moved to a new state and went to take my drivers' license test, the state trooper handed me a rules booklet. He made a point of saying that I should give attention to the sample questions at the back before taking the written exam. I did. And to my surprise, all of the questions on the exam were identical to the sample questions. No doubt these were important points. But of all the driving rules, those were the only ones I learned. That's what is meant by teaching to the test. You learn only what shows up on the tests. To my way of thinking, this is an impoverished approach to learning that makes of it a joyless experience.

As the parent of a child in a "failing" public school I have a little experience with this subject.

Firstly, the concept of teaching to the test is misguided when the focus is on test taking itself. Teaching a child how to do process of elimination and educated guessing is not particularly helpful when you are trying to teach long division.

Secondly, the whole concept of "high stakes testing" is completely insane. The Tacoma public Schools actually had to mandate elementary school recess this past year because principals across the city had cancelled it to create more class time for test prep. Here in Massachusetts, my child's school has after-school programs that focus purely on raising the math scores on the MCAS exams. You have 7 year olds that are being forced to do three hours of math homework in a detention-like setting every day. And guess what? The scores have not improved in two years. Oops. Wrong answer.

This leads me to my final point- the various college admissions tests. I have been studying for the LSAT which I will be taking on Monday. A while back, when I took my first first practice test I did fairly well with no preparation whatsoever. After a little tutoring on the games section, I have increased my practice scores dramatically into the highly competitive range. As an older, nontraditional law school applicant, my LSAT score will be weighted unusually heavily. Please tell me how in the world my new found ability to quickly diagram a twitty question about '6 students sharing 5 lockers' will make me a better lawyer. Is a high school student who spends $1000 bucks on a Kaplan SAT course actually better prepared for college than a kid who has to flip burgers to help his family pay rent?

I understand your point that *sometimes* teaching to the test is an efficient way to master certain subjects, but in this NCLB era, it is a lousy rule of thumb. 

I totally agree with what many of the commenters are saying re: testing.Test results are not a true reflection of development or learning, and privileges a kind of learning that isn't necessarily the kind that makes for good citizens and thinking individuals. As one person said, too, making a "good" test isn't simple. I've spent most of my adult life as a teacher, and while I think testing--and even standardized testing is necessary, I'm certain it's not the best way to determine how schools should be dealt with.
Regardless, this NYT's article strikes me as really showing what's kind of f-ed up about NCLB:http://www.nytimes.com/2005/06/03/nyregion/03recruit.html?pagewan
ted=1&incamp=article_popular 
holy crap!

The 100% passing requirement is "probably" too stringent? Good grief! In the law as written, all children in the eighth grade (for example) will pass the state achievement test by 2017 or the school fails. All means all; including students with less than 80 IQs. This provision virtually ensures that nearly every school will be failing by 2017.

"Probably" is a pretty weak protest for someone who purports to exist in the realty-based community.  The 100% requirement is outrageously unfair.
 

Testing to standards that are measured by tests aligned to those standards is fine. Rote memorization and drill will create many dropouts, such as those currently in Texas.

Even if we instituted merit pay, completely equalized funding passed out unlimited vouchers, and made it easier to fire teachers there would still be vast achievement gaps in our schools.

Many kids have parents that can't or won't support their education in anywhere near the fashion that their suburban peers recieve. There has been research demonstrating that children born in poverty are exposed to less than half the vocabulary in their homes than their middle class peers. Half!  Think of what an obstacle that is. Teachers in urban schools live with this daily. That is why there is a high attrition rate in the first five years of service; who wants to be beaten over the head for things they can't control and get paid $35000?

Equalizing funding would help. Small class size can be effective with competent teachers.  A national curriculum is necessary so texts and effective teaching practices can be standardized.  Assessment should include a value-added component so that schools can be measured by how much progress is made.  In this scheme the poorest schools can be measured along side the wealthiest.  But there is no panacea and NCLB, in its current shape, will not achieve its stated goals.

user-pic

Testing would be most effective if done like a blind scientific study:

The first objective is to develop a curriculum, an outline of knowledge that every student is expected to have upon completion of each grade level. Only after we decide what students should know can tests be developed to measure what they do know.

When a new drug is being tested, the scientific method requires that the studies be done "blind." That is, the study subjects don't know who is getting the real drug, and who is getting a placebo. The objective is to measure real world results without introducing any bias due to the testing process itself. Of course, we aren't going to give some kids a "placebo" test, but we can use some aspects of the scientific method in school testing to measure real world knowledge rather than the ability to score well on a particular test.

The students and even their teachers should not know in advance the details of test format or content. All they would have in advance would be standard curriculum outlines detailing what students would be expected to know about various subjects. Neither the teachers in the classroom nor the students should even know very far in advance precisely when the testing would be conducted. Without prior knowledge, teachers would be forced to teach subject matter more broadly, not narrowly tailored to a particular test.

An old article, but still relevant to this thread:

School Testing, the Scientific Way

 

user-pic

I'm a sophomore at college currently, and I can tell you that throughout my years in elementary, middle, and high school, "teaching to the test" generally meant that teachers would spend an inordinate amount of time trying to make sure everyone learned the material to a minimum standard. Unfortunately, there were always a few kids in the classes who just didn't care and were truly determined to fail (since I went to the worst inner city public schools in the area, there were always people in the classes with that mindset regardless of what level the class was supposed to be at). So the end result was that even in advanced classes the teachers spent a lot of precious time trying to make everyone meet a minimum standard while leaving the competent kids to do whatever they please.

 The problem then is that the advanced students are getting woefully inadequate schooling so that they will go on to college less prepared than they should be, just because in the short term it's to the benefit of the teachers to focus on making sure everyone reaches a minimum standard than making sure that opportunities for learning are distributed uniformly across the classroom.

That situation is a common one as far as a I know, and is one that I think is necessarily induced by required standardized testing when the students can't be put into classes with their peers. That is precisely the reason that I feel obligated to oppose NCLB, because its methods for trying to help everyone are not guaranteed to ultimately help the lower level students really and has a good probability of just making it harder for good students to learn more.

Teaching to the test may not be the best way to teach a certain subject, but the idea is to standardize the information we are imparting to students.  Does anybody posting on this thread actually teach in a K-12 classroom?  25 years ago, a 6th grade world history class could vary drastically between cities, districts, and even schools.  I remember spending a month on Charlemagne which I haven't studied since and still remember quite a bit about it today.  We spent a few days on the Roman Empire.  At the very least, we can be confident that what is being taught in a school in downtown San Francisco is similar to what is being taught in a school in Palm Springs.  That is a significant step forward and testing is what makes it possible.

Attempting to get qualified teachers into every classroom is a noble goal as well, but in a lot of places that runs into reality--there aren't enough teachers out there.  Pay is part of the issue, but one of the really big problems (at least in California) is becoming a fully certified teacher, especially after you've pursued other avenues and want to teach as a new career.  The amount of hoops you have to jump through to become fully credentialed is ridiculous and I believe a lot of people simply decide it's not worth it.  There has to be a better way for people who didn't pursue an education degree in college, but want to get into teaching to do so.  California has a huge teacher shortage and yet makes it exceedingly difficult for someone to become a teacher.

The 79th Texas legislature closed on Monday. Figuring out how to fund public schools was supposed to be their top priority. They are under a drop-dead order to come up with a new system of funding to replace the old one, which has been deemed unconstitutional. If nothing is done by October of this year, all funding for public schools will cease. For the third year in a row, this Republican controlled legislature in this Republican controlled state failed to reach agreement. Every person in the state realizes that there will have to be some changes to the tax code, but none of the politicians is willing to stick his / her neck out to do anything about it. So, the schoolchildren of Texas are up a creek without a paddle unless Gov. Perry calls a special session or the State Supreme Court steps in. These legislators are the same ones who wasted weeks trying to pass unconstitutional bills outlawing gay foster parents and prohibiting suggestive high school cheerleading routines. And, of course, they are the legislators who are ultimately in charge of our public school accountability system.

As a parent and a teacher, I would describe this pitiful state of affairs in the language of school accountability testing. The 79th Do Nothing Texas Legislature is a low-performing legislature. They failed to meet minimally-acceptable standards. After three years of continued low-performance, they have triggered interventions and now outside management should be brought in.

Fiddling with the public schools is every politician's favorite hobby. They can do it with impunity. They are the only people in the system who, in practical terms, are accountable to no one. Most of these clowns are locked into office for life and run unopposed. If they are voted out of office, it usually isn't over their votes on public education.

user-pic

This is an obvious point (obvious most of all to the students themselves), but it gets overlooked.  Most students are not ever going to use physics.  They're not going to use trigonometry, and they're really not even going to use algebra except in a very vague, word-problem-y way.  (Please, spare me the story about how you solved a system of linear equations to figure out how many cans of pimento-stuffed olives you needed for the number of guests at your last dinner party.)

Now, some kids -- the ones who excel -- really do need to know that stuff.  Why?  Partly so they can get into elite colleges.  To the extent that those skills are just a proxy that the colleges use to guess which are the "smart" kids, this isn't a problem in itself, but it's still a huge issue because it leads to kids in poor schools and with a poor level of family support for eduction not making it into the elite colleges.

Partly also because smart kids will actually be doing things that involve these skills.  We need scientists, accountants, Arabic translators, etc.

But it does seem like we should maybe let go of the idea that every kid needs to be a motivated, excited kid excelling in geometry, English lit, and biology.  A lot of kids just tolerate school (or appreciate it for its social aspects) and our goal should be to make sure there's no racial or class barriers to not being one of those kids, not to make sure that that class of kids ceases to exist.

The comparison to software development is not  bad one. In software design you have a robust set of requirements set by the appropriate stakeholders. At the same time you plan certain tests to see if the programs you develop meet these expectations. In the educational context these 'tests' may be traditional sit down exams, but would realistically include many types of assessment 'authentic' assessment as educators might say.

However, if you continue to follow the software design analogy you find that even in software design, a process which one would assume (because it involved computers) is rational and orderly is quite often anything but. I my experience software development is frequently far more fruitful when it is approached in a constructivist, 'feedback' loop model where specifications are continually reassessed as design moves forward. However, such a process is only possible when the people involved are quality participants that are actively involved in the process.

 The same is true for education. It is all well and good to talk about 'authentic' learning, and genuine understanding; and teaching each student to his or her own ability level rather than to a 'standard'... but schools must face important realities; 1. Not all teachers are as capable as others and 2. Not all students can be assumed to actively involved in the process of learning.

 It is under the realization of these facts that standardized, standards based and exam measured curriculum comes in. To set an aggregate standard for a state (or country). If schools and teachers can go beyond the standard all the better; but its criminal to both teachers and students not to have a measurable objective stadard at all.
user-pic

Why?
Well, it would take thousands and thousands of words to really explain why, but here are a few (hopefully pithy) pieces.
1) Teaching to the test reduces schooling to that which is testable.
Think about your best memories of your best teachers. The things that really stick with you are NOT the things that these tests are intended to teach. Nor are they things that we can teach.
Things like why? Self-confidence. The idea that if you keep at it, you will be able to do it (i.e. persistance). A new way of looking at something. The ability to put an argument together (or take it apart). Help with a personal issue. Drawing a connection between the class work and real life.
The things that REALLY stick with us are not the explict content or curriculum. At their best, those things are used to teach deeper lessons. But when they become the ends, rather than being used as means to a greater ends, schooling is made the less for it. 
Let me give you my standard set of example of content that is important, and yet not the point. Things that you likely were tested on, but which, today, don't measure how good your education was.
A) Log(A) + Log(B) = Log(??)B) What is a Shakespearean sonnet?C) What is the atomic mass of nitrogen?D) What century was the Declaration of the Rights of Man?
That's Math, English, Science and Social Studies. Those lessons were important ONLY BECAUSE they led to greater lessons. But they are the things you were tested on at the time.
2) There ARE good tests of content. Matt is right to cite the AP tests. But the AP tests are VERY expensive (>$80/taker). The tests that states are using are not nearly as good. 
3) It is fine and dandy to have basic reading and math tests. But what about higher level content? How much trig should be on the high school math test? How much post-WWII v. pre-WWII on the American History exam? How much local history v. national history? There is no consensus on these questions. A single state test give someone the power to define the curriculum who probably should not have that power (the test designers). Why should teachers teach to that particular test? 
4) The problem really isn't even the tests, though. The idea of accountabiiity is fine, but you've got to realize how accurate (or not) these tests are and the massive consequences being attached tot hem. It is well known (and intuitively obvious) that schools and students respond differently to tests with high stakes attached to them, but attaching high stakes to a test that is less than 100% reliable has a certain cruelty to it (and they tend to be about 85%, leave 1/7 of kids SOL). 
But that one is not about teaching to the test. Let me give you one more
5) The best tests, technically, must be fairly unidimensional (essentially measure just one thing). That fine when you are measuring reading or basic math. But high school content (the formal expicit stuff and the more important implicit stuff) is multi-dimensional. Even if you COULD test it, it would take multiple tests. That MORE testing, MORE time, MORE cost. It's not going to happen, so we end up testing the things are are the easiet to test and then we end up with my first objection. 
6) It's not clear how much tests test the supposed material as opposed to the ability to do that kind of tests. Quite often, two multiple choice tests (one math, one reading) are more highly correlatated than two math tests (one multiple choice, one show all your work and your answer). Clearly, there is a lot to be gained by teaching kids that style of test, rather than the specific material. 
That's enough for now. I can give you plenty more, if you've got the time.

I guess that I did not sign in properly.&nbsp;<div><br /></div><div>This (&quot;<span class="Apple-style-span">Teaching to the test reduces schooling to that which is testable&quot;) was by me.</span></div>

People who are all gung ho on things like NCLB are almost universally not involved in public schools. Its the same as the whole TNR-type the "teachers unions are awful" type stuff. Yeah, the teachers unions are far from perfect, but why don't you guys get out of your cushy Washington magazine sinecures and get up at 5 each morning to face the public school students of the District of Columbia. Then a lot of the Congressional reform agenda and public school teacher bashing will stop, that I know.

Seriously, I have yet to meet a public school teacher or an education researcher who thinks NCLB is a good idea. And this is something that cuts across the political spectrum - its not a liberal or conservative issue. Its a question of people who actually know something about education and people who don't.

There is a construct in educational psychology called Bloom's Taxonomy that defines six levels of cognition that people progress through as they learn information (rote knowledge, comprehension, application, analysis, synthesis, and evaluation).  "Teaching to the test" would not be problematic if the tests spanned all levels of Bloom's Taxonomy; however, studies have shown that 95% of standardized test questions involve only the first two rungs of the heirarchy: rote knowledge and comprehension.  There is a reason that AP and IB tests are frequently used as "good" examples of teaching to the tests -- they are the only tests in wide use that require a degree of analysis or synthesis. 

The reason that most tests measure only knowledge and comprehension is that tests become much more difficult and expensive to produce the higher the skill being measured is on Bloom's Taxonomy.  It is very difficult to control for the variables that make a test scientifically sound (reliability, validity, and accuracy) when you are measuring abstract skills.

With all of the money being thrown around by NCLB, one area that has been neglected is improving the science of testing.  We need to improve what can be accurately measured by tests so that "teaching to the test" will no longer be a euphamism for rote indoctrination.  Also, if these tests are going to be used for high-stakes rewards or penalties, we need to ensure that they are scientifically sound. 

I agree fully on your points about developmental age.  I had an interesting experience when I was young -- I went to a hippie school that completely rejected the traditional idea of age-based grouping of students.  Instead, there was a certain set of skills defined that you needed to master in order to progress to the next grade.  If it took you 6 months or 16 months to finish, fine.  Since people were moving between grades all of the time, there was no stigma attached to staying in one grade for a certain duration of time, like there is with being "held back" in traditional schools.  Also, since you were promoted independently in different subjects, you could be in 3rd grade in reading but 5th grade in math. 

Since this was essentially "teaching to a test", I can't reject that concept outright.  I think what made that system work was the fact that "our test" was much more sophisticated and required a greater depth of knowledge than the tests given in public schools.

I would love to see more schools take this approach.  Since your education is self-guided, it really instills a love of learning and an ownership of your education.  You also don't have the pitfalls of testing in an age-segregated environment, where advanced students do not progress because teachers are focusing on helping slower students pass the tests.  Also, the real world isn't age segregated -- I think students mature (in a good way) much more quickly in an environment where they are interacting with children of different ages.

there is a teaching shortage:

1) It is hard job. Try getting up at 5 or 6 every morning, and then imagine going into a lower-income underperforming school. Where you have to play policeman before you can even start trying to impart knowledge

2) This problem is compounded because teacher pay is not very good, maybe 30,000 for those just beginning, 70,000 for those at the highest end: at least thats what it is Washington state. Its not awful, but its not good enough for me - and I suspect many others - especially considering things like those mentioned in point 1.

3) Thirdly, I don't know if this is residual sexism or not, but teaching is generally considered as being as prestigious. This isn't help by a lot of the anti-public school/anti-teacher rhetoric that comes out of the kind TNR-style quasi-liberal circles. If you want people to support reform, at least first show some sympathy for people who are for the most part trying.

Ben P

teaching is generally not considered to be especially prestigious.

Ben P

As a 5th grade teacher in a low-income area, I have a couple of observations. First, I think it is important to make a distinction between standards-based teaching and high stakes testing. While I agree that high stakes testing has many problems, having a standardized list of learning goals for every grade is necessary. As a previous poster noted, without these standards, teachers frequently would spend a great deal of time on relatively minor points and often fail to address key areas of the curriculum. Furthermore, as a new teacher (only last year) having a set of state standards served as an invaluable map for where I wanted me students to be at the end of the year. If I knew where I wanted my students to be, I could design a plan to get them there. Unfortunately, that is not always the case. Even with state standards, testing based on these standards, and a pretty regimented administration, it is amazing how some teachers in my building spend their instructional time. I can only imagine how bad it must have been when teachers had complete curricular freedom.

On to the effects of state testing. I have a long, long list of problems that these tests cause, but I'll just post the "best" one for now. In California where I teach, schools get scored from 0-1000 based on their test results. My district, one of the worst in the state, decided that, instead of focusing on teaching and learning to improve our scores, they would take a short cut. Students can score in one of five performance levels (far below basic, below basic, basic, proficient, advanced) on their tests.  Schools earn bonus points when students move from one performance level to the next during a year. So if a student is basic in 4th grade and then moves to proficient in 5th grade, the schools gets extra points. Seems like a good idea to reward students making progress, but my district took it way too far. At the begining of the year, we identify the "bubble" students who are near the high end of a performance level and thus not far from making the jump to the next level. We are supposed to track these students carefully and monitor their progress. Every two weeks we meet with other teachers to compare notes on how well these "bubble" students are doing. At some schools in the district, teachers are told to give these students extra help, have them sit in the front of the room, and call on them first for answers. Obviously, this is a zero sum game as teachers don't have an infinite amount of time or energy, so students who are not on the bubble would recieve less attention. The most insidious part about this is that "bubble" does not mean that the student is most in need of help. There could be a student who is  so far below basic that they would not be deemed worthy of the attention, while a student who is nearly advanced and one of the highest students in the class would get extra help. Not the way to design effective instruction. The program, at least last year, was unsuccsesful. Shockingly, while the bubble students' scores went up, many other students' went down. I know, it's hard to imagine that students who recieve less attention and help will not do well, but that is sadly the state of many district officials who are trying to navigate NCLB.   

I solute you courage for facing the Anti-Testistas Matt. Unfortunately you knew the pseudo-Deweyites and those protecting the bureacracy of the Teacher's unions weren't going to budge from the luddite bunker. Oh well.

that my problem - and is a position I have adopted by dating a public school teacher at a "problem" school, and being friends with or family to at least a dozen or so people who are either public school teachers or educational researchers, none of whom I know have a positive word to say about NCLB, and who represents a fairly wide swath of political opinion - is the way in which NCLB places standardized testing at the center of public school teaching by determining funding decisions based on the results. As I outlined here, I do think "teaching to the test" becomes a problem in poor schools. And I am also very dubious of whether studying for standardized tests relates in any significant way to learning the kind of skills that are going to help a student in college or in a career. I don't think the AP test example is a good one for reasons mentioned above - ie nature of the students taking the AP test/studying for the AP test, but also the kind of things the AP test expects you to learn, the kind of skills the AP test actually "tests." I think a better comparison would be studying for the GRE.

I think standardized testing is fine as a kind of baseline/skills proficiency exercise that can help you determine the kind of ballpark your students are in. This, however, is not the motivation or intellectual rational behind NCLB. As far as I understand it, NCLB - and people like Bush, who I think knows next to nothing about education - style tests become central to determining how much students have learned in a given year, suggesting that a standardized test - which I assume is a kind of multiple choice affair almost always - is the best way of measuring learning. Basically, people that still think rote memorization curriculum, particularly in poorer, less well-performing schools - which this kind of testing philosophy has the danger of causing - is seen as a fringe theory, analogous to say, Janice Rogers Browns' thinking is to contemporary constitutional scholarship. Ie in priveleges learning a series of facts - which will be surely forgotten - at the expense of a process of thinking through problems, solving problems, skills which will be applicable even when the subject isn't, say, geometry or modern American literature (which of course, for almost all students, it surely won't be)

Matt,

You wrote: >>>Howard Dean devised the funny-but-meaningless phrase "no school board left standing" liberals in good standing like Ted Kennedy and George Miller were the big NCLB boosters<<<

You can bet your ass I don't, and won't, forget it.  Just like i won't forget that Dems like you supported the war in Iraq.  I won't forget that Kerry failed to support a minimum wage in Florida. I won't forget that National Dems, for the most part, RAN away from the enviormental movement.  I won't forget that National Dems...and Dems like you, failed to raise the torture issue in the 2004 election.

I won't forget that because of Dems like you...who supported the NCLB bill, the military now gets to get inside the high schools to go after kids hectoring them to join.   Did they come to Harvard Matt?  Did they ask YOU to join?  Just curious.  If they did what did you say to them?  No......I won't forget you...... 

 

Its surprising to me that so many people don't know, or cannot visualize, what is meant by 'teaching to the test', or how that works. As a parent of a middle schooler in Houston that has been involved in the Texas version of this program from the start I'll explain exactly what it looks like.

What happens is the teachers use last year's TAKs test to prepare the kids for this year's test. For example, a 4th grade math section of the test includes simple exercises in adding coins. The test has a picture of 2 quarters, 1 nickle, 2 dimes, and 3 pennies, and the student is required to determine what that adds up to in dollars and cents. There is no 'rote memorization' of answers, because the actual test will not have an identical question. That's a myth. Further, if children are doing this work and the homework, and they end up able to calculate the value of coinage...isn't that exactly what we want to accomplish? Of course it is. "Teaching to the test" merely prepares kids for the look and feel of the test. They aren't 'memorizing' the test so they can cheat it, they are learning the material.

At the end of the year we get a report from the school that shows exactly how our child scored in each subject and broken down into individual sections. From that it is fairly easy to see what your child's weak areas may be. The report also gives global scores for the school and the district, and breaks them down by race, etc. It is a very informative report and quite useful if you are interested in what's going on in your local schools.

The teacher' unions don't like it. Meh, tough. Nobody likes to have their performance measured like this. But they aren't the only ones reasponsible for the results by any stretch and my sense of it is if they'd use the results to lobby for the reasources they need it would be more productive for them. At a local level the teachers I've talked to don't hate the testing. Some like it, some don't like it that much. I've talked to quite a few about it though and nobody is marching in the streets over it.

NCLB is a good law. It sets a foundation of measurable achievement for the schools in the country. There are other things that can be done but this was a much needed reform.

user-pic

Just wait until the test includes Intelligent Design.  There have already been moves in this direction by Santorum and others.

I was one of those bored kids in grade school, and my parents fortunately had the resources to take me out of public school, where I wasn't being challenged, and put me in a private Montessori school after 4th grade.


The structure of what you're talking about was similar to what we had there: 4th-6th graders were all together so that it didn't matter what age or grade you technically were.  If you were particularly quick with math or science, then you learned those subjects in a different section.  But there was no stigma attached to being in one section or another.


The other truly beneficial thing was the non-traditional teaching methods they used.  Math for us was a combination of algebra, geometry, even some basic trig, and it was taught with hands-on materials, not just out of books.  Science was a little bio, a little chem, a little physics.


This is not an ideal learning environment for every child - some kids do need more structure in order to focus, but wouldn't be nice if this was an option for kids who would benefit from it?


I also couldn't agree more with your point about stigma.  Study after study shows that it's not about biological age at all.  The fact that some kids can master trig as 13-14 year olds doesn't mean that the ones who don't get it until they're 17 are inferior.  It merely means that the kids have different brains that are good at different things.  Wouldn't be great if our educational system recognized that?

First off, I wanted to wish you good luck on Monday.  I'm also an older, non-traditional law student.  I took the test in February and will be headed to school in the fall.  I wish I could say I improved dramatically on the games section.  Oy.  I will say that at some schools, they use 1/3 GPA, 1/3 LSAT, 1/3 personal statement regardless of age.  At other schools, they're going to place more emphasis on the personal statement and resume of an older applicant.  But in any case, good luck.


On a more substantial note, these tests are a perfect example of both the perils of teaching to the (bad) test and also why tests often aren't measuring anything other than an ability to take tests.  The people at Kaplan and even most of the admissions people I talked to said that your LSAT score is a terrible predictor of how well you'll do in law school or how good of a lawyer you'll be.

Matthew -- for those of us who live in the real world...  I have three kids in high school -- their school is one of four in the district.  Each high school must muster 95% compliance in taking the NCLB test.  The system does not adjust for drop outs; one high school has so many kids in jail that they don't reach 95% compliance -- so the whole district is on probation.  For a third of the students at my kids' school, English is a second language.  Those who don't achieve `proficient' or higher on this year's English test, must take a remedial course in addition to mainstream English next year -- yet there are no additional funds to add teachers or classes -- so teachers will be shifted and classes overcrowded.  Their principal invests an extraordinary amount of resources and energy into bringing marginal students up to speed, under enormous financial constraints.  This in a state (California) where the public education system in general & teachers in particular are under attack by the Governor.   Worrying about whether the NCLB test gets the formula just right, misses the point.  


My kids do fine on these exams, but they have two PhDs at home to edit essays and help them with french, calculus, and chemistry questions.  That's not true for most of their classmates.   And no, this is not a `failing' public high school.  My kids are getting a rigorous education from dedicated professionals.  Teachers who claim that '1984' is the most important book ever written, teachers who protest military recruiters on campus by passing out leaflets as students arrive in the morning, teachers who tutor physics on the weekend (gratis), teachers who teach latin off the books during the summer...  


I support the concept of national baseline standards in education, and national standardized tests are an obvious tool to measure progress.  But NCLB is quick to punish and slow to repair.  When a week every year is given over to taking these exams, they can't help but impoverish the gifts that qualified teachers impart.  The challenges I see won't be cured by another Bush policy of swatting flies, or is it mosquitos?  Now I've gone & mixed my metaphors.

user-pic

My friend, an extraordinarily successful teacher, now teaches to the test because No Child Left Behind has created an unhealthy obsession. For 5th graders my friend faces an explicit choice: he can teach to the test in math, which, means teaching calculations since that is what the test will test. However, he knows for absolute fact, based on experience, that the students would learn far more math if he taught math concepts. He cannot afford to take this risk. So he teaches rote calculations, which, is what the test requires, which, is a waste of time because calculators are coming any day now, which, makes it harder for students to learn math, and, which guarantee they learn less math, and which guarantees that the slowest students will be worse prepared for the next level of math.

Elitist means many things, and oftentimes it just means ignorant. The teach to the test assumption, if extended, requires no teachers at all. There are the workbooks, there is the goal, get to work. Save a lot on salaries.

Complaints with US elem/sec. education (and NCLB):

- Our system produces an inferior outcome compared to other countries (Japan, India, etc.).  Why is that?  Why do Japanese students outpace US students so much at the end of secondary education (including the large amount of homwork expected, and much tighter school discipline)?

- It has been recognized for some time that our students get their best world-class education in college, not in pre-college. What does this do to help non-college kids prepare for their life?

- Yes reading is critical to everything.  So is some facility in writing?  Math?  No so much beyond basic arithmetic, unless certain professions are the object.  Why teach algebra and trig to kids not going to college in those specific professions?

- Second language facility is increasingly important, but grossly neglected.  The time to being this is pre-school and early in school, but where does this happen.  Starting in high school is just silly.

It's oversimplistic & can't be taken too extremes, but what I basically believe in for an education system is centralized funding (i.e. the feds) and local control (i.e. the parents).

What we have now, in a way, is localized funding, various attempts at centralized control & regulation, and with many parents having not much choice or say over what kind of education their kids receive.

user-pic

I have to agree with this idea.  Standardized testing emphasizes only the most basic levels of knowlege, stressing memorization and limited synthesis.  The problem for most standardized tests is logistical:  How can you assess how well a student has truly integrated a concept into his or her world-view using a Scantron?  There has been a paradigm shift in education over the past decade with an increasing emphasis on critical thinking skills and analysis, and less emphasis on memorizing facts and dates.  Despite claims from the testing industry that they can accurately assess these skills, I don't buy their arguments.  If a student can respond to a critical thinking problem in the exact same way the test designer does, he gets it right.  If he approaches the problem from a different angle, he gets it wrong.  Ask a roomfull of adults what 53 + 39 is.  They will (hopefully) all get it right.  Then ask them how they arrived at the answer.  I think you would be surprised at the variety of methods people use for a simple problem like adding two numbers.

Our schools are struggling to meet the demands of our economy and the world of the 21st century.  Now is a time to allow educators the freedom to "think outside the box" and try a variety of strategies.  Unfortunately, the restrictive burden of high stakes testing is stiffling the creativity that may ultimately be our salvation.

Teaser:  Bravo for your wife, because everyone in this area knows that teaching in the Philadelphia schools is only for the strong at heart.

I live in the suburbs, land of well funded, good schools that don't teach to the tests (to quote my cousin, who is a public school administrator, "you don't have to worry about the All Children Left Behind Act, because you live in a wealthy district").  We routinely hear newly minted graduates who are looking for jobs say that they won't take a teaching job in Philadelphia (or Coatesville or Reading, for that matter).

That, I think, really gets to the heart of the matter.  NCLB doesn't affect wealthy, suburban school districts in anything close to the way that it does affect impoverished urban and rural districts.  My best friend is a music teacher in the Baltimore County (not City) Schools, and they have been told that all teachers are reading teachers now, because their kids perform so poorly on the tests.  So now, the music teachers, PE teachers, art teachers, etc. are all supposed to incorporate reading into their lessons.  Of course, next year, general music is being eliminated, so she'll be expected to work reading into lesson plans for band, orchestra and chorus rehearsals.

Back in Philadelphia, they are trying to deal with the problems by bringing in Edison Schools (a private school management company).  I'm pretty sure that isn't working out the way they planned. 

that most teachers opposition exists because of having the quality of there work measured.

That might be the union's rationale, but not specific teachers.

Again, standardized can be good to be to establish a kind of remeidal baseline. But multiple choice testing should not be central to determining whether or not schools get funding, because the kind of things it tries to evaluate are not central to what is valuable about education.

Your coin example shows this point. Sure its great that kids could learn that. But conveying specific facts, for the most part, is not the purpose of education. The purpose of education is to develop thought processes, critical thinking skills, problem solving ability in a more generalized sense. Learning thinks like what you mention above are only useful as a baseline: like memorizing your times tables. If you want to get the kind of jobs that college level education requires, the kind of learning encouraged by standardized testing should not be central to the education process.

And this ultimately is the problem. Wealthier schools will not have to make standardized test material central to their curriculum, whereas poor schools will be much more likely to, because, a) these children start from a higher baseline and thus need less preparation; and b) they won't depend on federal funding.

I won't rate you down here, but given you an opportunity to respond.

How do you counter much of the substantive criticism raised here, by people - I'm guessing - no much more about what is like to be a teacher than you do?

The problem isn't standardized testing per se. The problem is when standardized testing becomes central to the education process, which is what can happen when poor schools depend on improving their scores for federal funding while wealthy schools don't (and don't have to spend as much time preparing for the test anyway).

Most of the comments here focus on "teaching to the test", and whether tests are good measures of learning, etc. Personally, my belief is that well-designed tests can provide a reasonably good proxy measure of students' learning level. But a lot of NCLB is based on the supposition that school quality can be measured by looking at what percentage of students at the school reach a specified learning level, as measured by the test. Even if the test is well-designed to measure learning levels, the question remains as to whether this is a good way to measure the quality of a school. Because students enter different schools with dramatically different learning levels on average, and also learn dramatically different amounts during the summer, it does not seem sensible to measure school quality by simply looking at the percentage of students at the school above a certain learning level. Rather, we need to measure how much they have learned while at the school, the schools' "value added", which may be measured by the change in test scores, not the test score level. This may seem an academic debate, but under NCLB, schools that are deemed "failing schools" may be subject to severe sanctions. If in fact these schools are not really poor quality schools, we have a serious problem.

user-pic

The test tends to LIMIT what is taught. That is the whole point. It has nothing to do with the quality of the test, as no test can be truly comprehensive.

user-pic

ERIC (Education Resources Information Center) has a collecton of articles about school testing and standards, and one of them discusses why teaching the test is bad.  (Appropriately named: "Why Teaching the Test is a Bad Thing")

 

First, what does teaching the test mean? It means that teachers only teach what is on the test, often in the specific format that the test takes.  Therefore, quality of the education depends heavily on the quality of the test.  And even a good test can only test a certain subset of skills in a certain subset of formats.

 

So, the danger is that if the teacher only teaches a certain test format, students will only learn how to answer problems posed in that manner.  In fact, if students are only taught one way to answer questions they might not actually have learned the main skill that the test was supposed to be assessing.  To cite an example from the article, one study showed that when students were taught how to translate from Roman to Arabic numerals, they couldn’t necessarily do the reverse.  In fact, their test scores went down 35% to 50% from the former to the latter.

 

Another problem is that the skills and subject areas that are not tested are often pushed slowly out the curriculum.  This is certainly true of classes in the arts and outdoor recreation.  However, when only reading and math skills are tested, areas such social studies and the sciences are often neglected, as well. 

 

Another problem is that standards of learning tests rarely test for critical thinking skills or skills involving the synthesis of information (not to mention creativity).  That means that these skills are often not taught when teachers are teaching the test.  For example, the article mentions that in one study, “elementary teachers had given up reading real books, writing and long term projects and were focusing on word recognition, recognition of spelling answers, language usage, punctuation, and arithmetic operations” .

 

The truth is, no test can adequately all the skills that are valuable to students.  That’s why teaching the test is so bad.  You leave out important information and skill areas. 

The link to the articles is here:

http://www.eric.ed.gov:80/ERICWebPortal/Home.portal?_nfpb=true&am p;ERICExtSearch_SearchValue_0=%22standards+and+testing+and+teache rs%22&ERICExtSearch_Operator_2=and&ERICExtSearch_SearchTy pe_2=eric_metadata&ERICExtSearch_SearchType_0=eric_metadata&a mp;ERICExtSearch_SearchCount=2&ERICExtSearch_PubDate_From=199 8&ERICExtSearch_FullText=true&ERICExtSearch_SearchValue_1 =%22teaching+the+test%22&ERICExtSearch_Operator_1=and&ERI CExtSearch_SearchType_1=eric_metadata&ERICExtSearch_PubDate_T o=2004&_pageLabel=RecordDetails&objectId=0900000b8013af14

(The comment editor isn't recognizing my html for some reason)

<span class="Apple-style-span">Find just below a letter from honors student John Wood, who did not graduate last week in Ohio because he refused to take the high school exit exam:</span&gt

<span class="Apple-style-span">___________________________</span&gt

Here are the reasons why I didn't graduate from Federal Hocking last weekend:

http://www.athensnews.com/issue/article.php3?story_id=20780

By John Wood

Sunday was my high-school graduation. However, despite being ranked sixth in my class, I did not cross the stage or receive a diploma. I did not drop out at the last minute and I was not expelled. I didn't graduate because I refused to take the Ohio Proficiency Tests.

I did this because I believe these high-stakes tests (which are required for graduation) are biased, irrelevant and unnecessary.

The bias of these tests is demonstrated by Ohio's own statistics. They show consistently that schools with high numbers of low-income and/or minority students score lower on state tests. It is argued (in defense of testing) that this is not the test's fault, that the scores are only a reflection of the deeper social economic injustices. This is very likely true. What makes the test biased is the fact that the state does little or nothing to compensate for the differences that the students experience outside the classroom.

In fact, the state only worsens the situation with its funding system.  Ohio's archaic school-funding system underfunds schools in poorer areas because it is based on property taxes. The way we fund our schools has been declared unconstitutional four times, and yet the state Legislature refuses to fix the problem.

The irrelevance of these tests is also demonstrated by state statistics -- in this case, the lack of them. In 13 years of testing, Ohio has failed to conduct any studies linking scores on the proficiency test to college acceptance rates, college grades, income levels, incarceration rates, dropout rates, scores on military recruiting tests, or any other similar statistic.

State officials have stated that it would be too difficult or costly to keep  rack of their students after high school but I find this hard to believe.  My high school is tracking my class for five years with help from the Coalition of Essential Schools. Certainly, the state, with all its bureaucrats, could do the same.

Both of these factors, the test's biases and irrelevance, contribute to making it unnecessary. This system is so flawed it should not be used to determine whether or not students should graduate.

More importantly, a system already exists for determining when students are ready to graduate. The ongoing assessment by teachers who spend hours with the students is more than sufficient for determining when they are ready to graduate.

However this assessment is being undermined by a focus on test preparation  that has eliminated many advanced courses and enrichment experiences.  Additionally, since the tests do not and cannot measure things such as critical thinking, the ability to work with others, public speaking, and other characteristics of democratic citizenship, these things are pushed aside while we spend more time memorizing for tests.

After almost a decade and a half of testing, many people cannot imagine what could be done in place of high-stakes testing, but here in southeast Ohio, alternative assessments are alive and kicking. At my school, Federal Hocking High School, every senior has to complete a senior project (I built a kayak), compile a graduation portfolio, and defend his or her work in front of a panel of teachers in order to graduate. These types of performance assessments are much more individualized and authentic, and are certainly difficult, something I can attest to, having completed them myself.

There may be a place for standardized testing in public education, but it should not be used to determine graduation.

Because of these reasons, I decided to take a stand against the Ohio Proficiency Tests, even though it would cost me my graduation and diploma.  But why such a drastic measure? The reason is simple; someone has to say no.  Education is the key to maintaining our democracy, and I have become disgusted by the indifference displayed by lawmakers who make statements about the value of public education while continuing to fail to fairly and adequately fund it or commit to performance-based assessments.

I have written a number of state senators and representatives from both parties recommending the state allow districts to set alternatives to high-stakes tests for graduation. Having done everything required for graduation but take the tests, I thought I would provide them an opportunity to rethink testing. Sadly, I have not received a response from any of them, even after personally approaching and rewriting them.

What this has taught me is that one voice is not enough, and to make a difference in our democracy, the people must speak with a unified voice. Iencourage everyone concerned about the damage being done by high-stakes testing and inadequate funding of public education to speak out. Join me in just saying no to high-stakes testing.

Editor's note: John Wood is a non-graduate of Federal Hocking High School inStewart. He will be attending Warren Wilson College in Ashville, N.C.

<span class="Apple-style-span">
</span&gt

<span class="Apple-style-span">
</span&gt

<span class="Apple-style-span">
</span&gt<span class="Apple-style-span"> </span&gt
user-pic

Will everyone use algebra, or physics, or even English lit?  Of course not.

You hit on one of the important issues yourself, though - foundational knowledge.  If algebra, and trig, and physics are required for higher skills, and we de-emphasise those, how many able students get left behind?  There are quite a few intelligent children out there who need to be pushed to reach their potential - this is one of the things that teachers do.

More importantly, though, does the fact that they may never use it make it useless?  I'm a software engineer, and I haven't used my physics knowledge since the day I stepped out of class.  Even for technical professionals, there's information you don't use.  "Don't use" and "useless" are two very, very different things.  These subjects help teach analytical skills, problem solving, and different ways of looking at problems.  A better appreciation of English literature might make more people realize what a load of tripe the Left Behind books really are, or lead them to read a little deeper into news reports.  All useful skills.

Most importantly, though, this is a self-reinforcing cycle of ignorance.  If we stop caring about teaching advanced topics because a lot of kids don't care about it, then we teach ALL the kids that advanced topics aren't worth caring about.  And that is a very scary future.

Leave a comment

Advertisement
Please disable your adblocker!
Ads are how we pay the bills!

Subscribe

The Coffee House
TPMCafe's regulars

House Brew
From Your Cafe Editor

Special Guests
Big names and big brains

Special Features
Pressing topics and trends

Table for One
An expert's week-long talk.

All Reader Posts
TPM readers discuss.

Recent Reader Posts

All Reader Posts »



Book Club Calendar


Coming Soon



Nov. 30-Dec. 4



January 12-16



« Book Club ArchiveFull calendar »

Book Club Archive



Masthead

Editor-in-Chief
Josh Marshall

Site Editor
Lila Shapiro

Intern
Kyle Krahel-Frolander



Subscribe to TPMCafe's feed.
Subscribe to TPMCafe's reader blog feed.

Advertise Liberally
Share
Close Social Web Email

"To" Email Address

Your Name

Your Email Address