Specificity could clear the fog away from educational testing

We need to define what we want and expect from high school graduates.

Educational testing sails on troubled seas these days. Tests of ability and capability are everywhere and seemingly inescapable but as the volume of testing increases, so does the volume of protests against them.

Some of the protests are merely self-serving. Claiming that a test was unfair is the easiest way for a student or a parent to explain a poor score or failing grade.

It is at the aggregate, political level, though, that protests of unfairness present the most significant problems for educational achievement tests. While these protests are often effective in getting a test discounted or discarded, they are equally as often misdirected.

The protests of bias against the entrance examinations used by New York City’s very best high schools are an excellent example of off-target protests. It is undeniable that fewer black and Hispanic students from the city’s elementary schools score high enough on the test to be admitted to the elite high schools. But the problem isn’t with the test; it is with the quality of the education those students are receiving.

Significantly, eliminating the test would not solve the problem. If New York City does not improve the quality of its minority schools, abandoning the test would just spread the educational decay to the elite schools.

That said, there is undoubtedly a problem with the test, too, but in a very real sense it is biased against everybody, not just minority groups. Educational tests do not measure achievement on an absolute scale. Instead they measure how one student’s achievements compare with those of other students. And because the “Bell Curve” is used to validate new tests, we lose our ability to tell whether students are improving or losing ground. In fact, we lose our ability to judge whether we are testing the right things.

Education author and lecturer Alfie Kohn recently wrote an essay y entitled “Why Can’t Everyone Get As?” Its subtitle explains his view that “Excellence is not a zero-sum game.”

Kohn enjoys a reputation as an iconoclast because he poses discomforting questions about things that most of us simply accept as unquestionably correct.

The question he poses about grades is very pertinent to today’s educational and regulatory institutions, which are often finding themselves engaged in battles over testing and grades. Frequently these battles are fought over political and social grounds that have little to do with the educational process but a lot to do with educational outcomes.

The short answer to his question is that at the classroom level there is no good reason why everyone cannot get As — if they earned them. For that matter they could all get F’s. Yet the teacher who filed those grades for a class in any subject, at virtually any level, would promptly find himself or herself called to account by the school administration.

Independent of outside complaints, the validity of grading on a curve depends on what is a questionable application of Bermouli’s Law of Large Numbers. In short, the existence of a bell-shaped curve of performance at the large, aggregate level of grades doesn’t mean that the grades for each class have to take that same shape. But education administrators, from school principals to college deans and government regulators, have come to view any grade reports that aren’t bell-curve shaped as wrong — and the prime suspect, usually, is the test standard.

What it does mean, though, as Mr. Cohn writes, is that “The inescapable, and deeply disturbing, implication is that ‘high standards’ really means ‘standards that all students will never be able to meet’.”

We don’t have to agree with his conclusion to recognize that it is technically correct and that he has described a real problem.

The issue will not be resolved until we address the question of what it is we wish to test and why. Educational testing has a recurrent problem with fogginess. Within living memory, for example, mathematics through high school was a matter of solving problems that had real world applicability.

Today’s tests, though, are dotted with questions on concepts, which, as test items, have yet to prove themselves useful in skill development and are likely to present many K-12 students with simply another way to fail — and parents another reason to feel frustrated.

The educational testing system and our K-12 issues are closely entangled. We might try testing more specific skills, much along the lines of tests used by the Federal Aviation Administration to test needed pilot skills and similarly structured tests used for doctors and other health care providers. Of course, it would force us to define what we want and expect of high school graduates, leaving much of the concepts to colleges where they are a more comfortable fit. It couldn’t hurt.

Talk to us

More in Herald Business Journal

FILE - In this June 17, 2015 file photo, an Airbus A350 performs a demonstration flight at the Paris Air Show, in Le Bourget airport, north of Paris. Airbus announced Wednesday Jan. 11, 2017 that it delivered 688 planes over the year, primarily in the single-aisle A320 family, compared with 635 in 2015. The company increased deliveries of its long-delayed A350 wide-body. (AP Photo/Francois Mori, File)
Union leaders: As Boeing shrinks, what about Airbus?

They told state senators that old allegiances aren’t worth much in these economic hard times.

Inside the new Quil Ceda Creek Casino's open floor that will contain 1,500 slot machines on Wednesday, Oct. 28, 2020 in Tulalip, Wa. (Olivia Vanni / The Herald)
An early 2021 opening is in the cards for new Tulalip casino

The 126,700-square-foot Quil Ceda Creek Casino will replace the current one across the road.

The nose of the 500th 787 Dreamliner at the assembly plant in Everett on Wednesday morning on September 21, 2016. (Kevin Clark / The Herald)
Boeing says it has no plans for 787 or 747 factory space

The two models will leave Everett in coming years. Meanwhile, thousands of more jobs will be eliminated.

A Boeing 777X airplane flies over Moscow, Idaho. during a test flight Tuesday, June 23, 2020. The new model of airplane had its first flight on Jan. 25, 2020, from Paine Field in Everett, Wash. The 777X will be the world's largest and most efficient twin-engine jet, according to Boeing. (Geoff Crimmins/The Moscow-Pullman Daily News via AP)
‘The market has spoken’: Jet buyers see a grim Boeing future

The company reports third-quarter results on Wednesday with two key products in deep trouble.

The Hanford nuclear site. (Business Wire)
Longer transition allowed for $16B in contracts at Hanford

The plan will help employees comply with safety guidelines intended to limit the spread of COVID-19.

An Israeli Air Force Boeing AH-64 Apache attack helicopter from the 113th Squadron, also known as the Hornet Squadron, lands during a display for the foreign press in Ramon air force base near the Israeli town of Mitzpe Ramon, in the Negev desert, southern Israel, Monday, Oct. 21, 2013.(AP Photo/Ariel Schalit)
Boeing’s Arizona chopper plant under scrutiny by Army team

The company reported quality problems it says were caused by a derelict technician.

Bill McSherry, vice president of government operations for Boeing Commercial Airplanes, walks back to his seat, Tuesday, Feb. 25, 2020, after testifying before the House Finance Committee at the Capitol in Olympia, Wash. The committee was hearing testimony on a bill introduced at Boeing's request to suspend the aerospace giant's preferential business and occupation tax rate in Washington state unless the United States and European Union reach an agreement on their long-running international trade dispute that would allow the lower tax rate. Last year, the World Trade Organization body ruled that Boeing received an illegal U.S. tax break from Washington state that damaged sales by European archrival Airbus. (AP Photo/Ted S. Warren)
A Boeing executive delivers good and bad news for Everett

The commercial headquarters could indeed come to Paine Field. But demand for big jets will not rebound quickly.

FILE - An American Airlines Boeing 737-823 lands at Miami International Airport, Monday, July 27, 2020, in Miami.American Airlines said Tuesday, Aug. 25 that it will furlough or lay off 19,000 employees in October as it struggles with a sharp downturn in travel because of the pandemic. Flight attendants will bear the heaviest cuts, with 8,100 losing their jobs.  (AP Photo/Wilfredo Lee, File)
American plans flights with Boeing 737 Max by year-end

Customers can see on American’s website the type of plane for any flight if they know where to click.

Patrick Ky, executive director of the European Aviation Safety Agency, in Amsterdam on Nov. 27, 2018. MUST CREDIT: Bloomberg photo by Yuriko Nakao.
Boeing Max judged safe to fly by Europe’s aviation regulator

A synthetic sensor to aid pilots when the mechanical angle-of-attack sensors fail is still two years out.

The Boeing factory at Paine Field in Everett. (Boeing Co.)
Could Everett become Boeing’s next jetliner headquarters?

The company is considering selling the Commercial Airplanes division offices at Longacres in Renton.

Cop turned pinup model in Gold Bar charged with $67K fraud

Brenda Cavoretto was injured when a dead body fell on her in 2012. She’s accused of overselling its lasting impact.

Washington unemployment rate drops to 7.8%

Most job growth occurred in leisure and hospitality, construction and other services.