COMET • Vol. 3, No. 08 – 25 February 2002

ARTICLES & ANNOUNCEMENTS (CALIFORNIA FOCUS)

“Exit Exam to Accommodate Disabled” by David Kravets

Source: Contra Costa News – 22 February 2002

URL: http://www.bayarea.com/mld/cctimes/living/community/education/2724128.htm

A federal judge on Thursday ordered California to accommodate disabled students taking an exit exam necessary to graduate high school.

If needed, the students should be allowed to use calculators, spell-checking devices and, among other things, have the tests read to them, according to the order by U.S. District Judge Charles Breyer.

“This has huge implications for the students who have to pass the test,” said Melissa Kasnitz, an attorney with Oakland-based Disability Rights Advocates. “They have a right to be assessed and a right to be sure the assessment accurately assures their knowledge.”

The state will begin administering the tests to sophomores next month [March 5-7]. Last year, the state issued the exams, but a failing grade did not count against students.

More than 90 percent of disabled students failed the math section and 82 percent failed the language portion. The failure rate for nondisabled students was half as large.

The class of 2004 is California’s first to be required to pass the exam to get a diploma. Students get seven tries to pass the exam. More than two dozen states issue mandatory high school exit exams.

Each of California’s 45,000 disabled sophomores who will begin taking the test next month have an Individual Education Plan that explains what type of accommodations they can use for in-class exams and assignments. Thursday’s ruling [Chapman v. California Department of Education, C01-01780] allows those same accommodations for the exit exam.

The California State Board of Education maintained that the disabled students could be accommodated, but it was unclear whether the individual plans covering in-class work and assignments would cover the exit exams.

“The court wanted to make some things clear,” said Rae Belisle, chief counsel for the California State Board of Education.

The judge did not halt the testing altogether, as the disabled groups had requested, but did require California to implement a test for students too disabled to pass the exit exam…

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ARTICLES & ANNOUNCEMENTS (NATIONAL FOCUS)

(1) “Calculator Rule for Tests has Schools Crunching Numbers” by Katherine Morales

Source: The Dallas Morning News – 20 February 2002

URL: http://www.dallasnews.com/localnews/stories/calculators_20met.ART0.b5fc7.html

…As Texas rolls out a new testing regimen next year, students in ninth, 10th and 11th grades will be required to use graphing calculators, which plot math equations. The Texas Education Agency [TEA] has ordered school districts to provide the pocket-size devices, which start at $85 each, on test days. But so far, the state hasn’t announced any extra funding.

That has many school districts scrambling to find thousands–or hundreds of thousands–of dollars in already-tight budgets.

Even though the state forbids districts from requiring parents to buy the calculators, parents…are finding they have to foot the bill if they want their kids to have use of the calculators outside of math class…

Graphing calculators are used in classes such as algebra, geometry and pre-calculus. Retail prices range from about $85 to $130, though manufacturers sometimes offer discounts to school districts that order in bulk.

Districts are being asked to have enough calculators to cover ninth, 10th and 11th grades if they were all tested on the same day, said David Anderson, managing director of curriculum for the TEA.

“Our analysis said that we would be about 96,000 calculators short of what we would need if the assessment were given next week,” Mr. Anderson said.

That many calculators, if purchased for $90 each, would cost about $8.6 million. TEA officials say they’re working with private companies to provide grants to districts that need calculators.

The use of graphing calculators–by teachers and students–has been required in math classes since changes to the state curriculum in 1997. But students haven’t had to use the devices on the major rounds of state tests.

That changes with the introduction of the Texas Assessment of Knowledge and Skills, or TAKS, which replaces the Texas Assessment of Academic Skills next year…

Teaching students how to use graphing calculators is another hurdle for districts that also have to provide training to teachers.

Susan Hull, director of mathematics at the Dana Center in Austin, provides Texas educators with training and support services. Since the curriculum changes in 1997, she said, the center has hosted a steady stream of teachers seeking training on graphing calculators. The pace has quickened in the last two years, she said.

“Because of the new testing requirements, there is a heightened sense of awareness and interest,” Dr. Hull said. “Graphing technology is a really important part of algebra. We expect that 3,000 teachers have gone through training here since 2000, and about 500 principals.”

(2) “Paige Meets With School Superintendents, School Board Members From Nation’s Largest School Districts” (Press Release)

Source:  U.S. Department of Education (Dan Langan, Melinda Malico: 202-401-1576) – 19 February 2002

URL:  http://www.ed.gov/PressReleases/02-2002/02192002.html

U.S. Secretary of Education Rod Paige today met with school superintendents and school board members from some of the nation’s largest school districts as part of his new Partnership to Leave No Child Behind.

“As the leaders of our great urban school districts, you oversee the education of almost four million children–more than eight percent of our nation’s public school students,” Paige said. “The futures of these and millions more children–and the well being of our nation–will be greatly affected by each of you, which is why our meeting today is so important.

“My goal is to create a new partnership with state and local leaders–to engage you in an ongoing conversation about the principles and details of this new law,” Paige said. “Most important, however, I want to make sure that we work together to strengthen our schools and ensure that no child in America is left behind.”

The session today was an opportunity for Paige and his staff to outline many of the elements of the new law, and to hear comments and suggestions from local school leaders. Last month, Paige hosted a similar meeting with state education chiefs in Alexandria, Va.

School superintendents and school board members from the nation’s largest urban public school systems were invited to the meeting. Leaders from the following systems attended: Atlanta Public Schools; Birmingham City Schools; Broward County Public Schools; Buffalo City School District; Charlotte-Mecklenburg Schools; Chicago Public Schools; Clark County School District; Columbus Public Schools; Dayton Public Schools; Denver Public Schools; and Detroit Public Schools.

Also: District of Columbia Public Schools; Fresno Unified School District; Fort Worth Independent School District; Guilford County Schools; Houston Independent School District; Jefferson County Public Schools; Milwaukee Public Schools; New York City Board of Education; Norfolk Public Schools; Oklahoma City Public Schools; Omaha Public Schools; Orange County Public Schools; Philadelphia Public Schools; Pittsburgh Public Schools; Richmond Public Schools; Rochester City School District; Seattle Public Schools; Toledo Public Schools…

For more information about the No Child Left Behind Act of 2001, visit http://www.ed.gov/nclb/.

(3) “Researching the Researchers” by Debra Viadero

Source:  Education Week – 20 February 2002

URL:  http://www.edweek.org/ew/newstory.cfm?slug=23advocacy.h21

The Education Policy Studies Laboratory, a study center at Arizona State University in Tempe, seemed to be gearing up for a fight when it circulated a report last fall attacking the work of the Mackinac Center, a Michigan-based think tank.

“Mackinac Center work is often of low quality, and because of this it should be treated with considerable skepticism by the public, policymakers, and political leaders,” concluded the study, which was written by two academics. The authors based their conclusion on an examination of 11 years of education-related studies by the think tank, which was founded to advance free-market principles.

The words were harsh–especially in the generally cautious and genteel world of education scholarship. But the mission of the policy-studies lab, founded by a feisty education professor at the university, is to provide a counterpoint to what some see as a proliferation of education reports coming from think tanks, like Mackinac, that were founded to advocate particular points of view.

Not to be outvoiced, the Mackinac Center countered with a statement pointing out that the Arizona center was not without some potential sources of bias of its own. For one, the study was paid for by a foundation created by Michigan’s largest teachers’ union, a longtime foe of the Michigan think tank. What’s more, the Mackinac Center noted, the authors had failed to uncover any outright errors in the center’s work. And, while it’s true that the Mackinac Center’s reports do not undergo the same degree of peer scrutiny as articles written for academic journals, neither did the critique issued by the Arizona center.

Though unusually pointed, the back-and-forth between the two centers laid open a common–and, some say, growing–dilemma for policymakers and educators trying to puzzle out the mounting heap of reports and studies on education that cross their desks. Whose advice is right and whose is wrong, the more determinedly neutral among them might ask. Who is the dispassionate scholar, and who is the advocate?

Education research that may be colored by advocacy–and the difficulty that readers of research face in distinguishing it– are causing concern for some researchers.

“To bring about educational change, I believe advocacy is required. And I would hope that advocates would look to educational research as one source of the basis for their advocacy,” says Andrew Porter, the president of the American Educational Research Association, a Washington-based group representing 22,000-plus researchers worldwide. “In education research, however, I think there’s no room for advocacy.”

Porter was concerned enough about the issue to call for a panel on the subject at the AERA’s annual meeting in New Orleans this spring.

Researchers disagree over whether education studies with a point of view are growing in number. After all, they say, a vein of advocacy has always run through the social sciences–and even in the so-called hard sciences, such as medicine.

“There’s no such thing as being value-free,” says Bruce J. Cooper, an education professor at Fordham University in New York City who has written on the subject. “Why would researchers choose a topic unless it was something they felt strongly about?”

Scholars agree, however, that advocacy research is not just a product of think tanks or organizations with a cause. Professors can also become advocates when they become convinced that they have hit upon a policy idea or a program that can make a difference for schools and children.

Experts say the problems arise when that bias begins to elbow out objectivity in researchers’ work, or when studies that are skewed to a particular outcome masquerade as dispassionate analyses.

“I think we’re on contested ground in public education now,” says Peter W. Cookson Jr., an associate professor of education at Teachers College, Columbia University, and the main author of the study on the Mackinac Center. “I think there are a number of organizations that are writing from their own perspective, and that’s OK. The issue arises when that advocacy raises the level of the publication to some definitive study that ought to be relied on for policymaking.”

“What happens is a particular fact gets into the press and then becomes kind of the conventional wisdom,” he adds, “and that affects the money flow.”

The effectiveness with which many think tanks are getting their points across to policymakers on education issues has, in fact, prompted some of the attention that researchers are giving the subject now.

In Michigan, for example, the Mackinac Center is widely credited with influencing the debate that led to new laws allowing charter schools and easing restrictions on school boards’ privatization of some school-related services, such as transportation or janitorial work. The center receives most of its funding from private foundations.

“Before the Mackinac Center researched and published about the benefits of allowing parents to choose the safest and best schools for their children, charter schools weren’t even on the table,” says Joseph Lehman, the executive vice president of the center, which is based in Midland, Mich. For all its work, the center gets an average of 1,200 mentions a year in the state’s print media, Lehman says.

“Policymakers don’t read academic journals,” he says. “If they did, we would publish our work there.”

One reason the more advocacy-oriented research organizations are making a difference, observers of the field say, is that they can feed much-needed information to legislators, governors, and other policy leaders in a fraction of the time it takes for traditional researchers to publish their studies in academic journals. For some journals, the process of reviewing, editing, and publishing a study can take up to a year, while think tanks can get a report into print in a few months.

“One of the huge problems for education research is that it takes time,” says Ellen Condliffe Lagemann, the president of the Spencer Foundation, a Chicago-based philanthropy that supports education research, including coverage of the subject in Education Week. “You cannot produce instant knowledge.”

Often, what slows the publication channel in an academic journal is a lengthy peer-review process designed to provide assurance that the study meets scholarly standards. Typically, researchers say, articles being vetted for publication in serious academic journals are reviewed by three scholars who have either worked in the same field or used the same research techniques. The reviews are also “blind” in the sense that the critics don’t know whose work they are reading. For reviewers working in the same field, though, it’s often easy to guess.

The review processes at think tanks, by comparison, tend to vary, although “blind” reviews are much rarer. Books being considered for publication by the Brown Center on Educational Policy at the Brookings Institution, a long-established Washington think tank, are reviewed by five scholars, according to Tom Loveless, the center’s director. Two of the reviewers are resident scholars, and three are nonresident scholars who also sit on the center’s board.

At the Mackinac Center, says Lehman, the reviewers come from a 40-member board of scholars, some of whom are affiliated with Michigan universities and some of whom may be lawyers or business people.

Reports published by the Washington-based Thomas B. Fordham Foundation are scrutinized by Chester E. Finn Jr., the foundation’s president, and Diane Ravitch, one of its founding scholars.

“I don’t have much use for peer review in education research,” says Finn, who served as the U.S. Department of Education’s assistant secretary for research in the Reagan administration. “By selecting the peers, you’re preordaining the outcome of the review–and that’s the short, dirty secret of education research.”

“We’re engaged in an argument,” he adds. “We’re not refereeing an argument.”

Think-tank research in education has also generated concern in some quarters because of what some see as a growth in studies with right-of-center viewpoints.

Jack Jennings, who served as a top Democratic staff member for the House Education and Labor Committee for three decades, from 1967 until the Republican takeover of the House in the 1994 elections, says he has seen the ideological shift in the hundreds of reports and studies that cross his desk.

In the 1960s and 1970s, he says, conservatives complained that many education-related reports smacked of liberal biases. Now, “the latest development is that the very conservative elements of society have organized to create their own think tanks and cadres of researchers and evaluators who issue reports that will represent more of their point of view,” says Jennings, who now directs the Center on Education Policy, a Washington think tank that tries to hug the ideological center.

It’s hard to tell if Jennings is right. Mackinac, for example, belongs to a network of 40 regional think tanks around the country that share a free-market approach to public policy. And a number of conservative-leaning or free-market think tanks with more of a national audience, such as the Heritage Foundation, the Manhattan Institute, the Cato Institute, and the Fordham Foundation, have all ratcheted up their focus on education issues since the late 1980s. But some more liberal-minded education groups have grown in influence, too.

“What these conservative think tanks have done over the last 20 years is coupled their documents with a very sophisticated publications and media strategy,” says Alex Molnar, the education professor who founded the Education Policy Studies Laboratory at Arizona State. University professors, in comparison, have no well-organized means for injecting their findings into the public debate, says Molnar, who co-wrote the report on the Mackinac Center.

The policy-studies lab is part of the university but some of its projects are financed by grants from various groups, including the Michigan Education Association, Consumers Union, and the Rockefeller Foundation.

To counter the work of ideological-leaning think tanks, Molnar is drawing together scholars from around the country who can respond to studies quickly, while they are still being played in the news media.

For the Mackinac study, Molnar and Cookson rated 22 center studies against social science research guidelines drawn up by the American Psychological Association for publication in its journals. The studies were divided into two groups: original studies and interpretative analyses of existing work. The former was given an average rating of 1.80 on a scale of 3; the latter scored an average of 2.09 on the same scoring system.

But Lehman of Mackinac points out that producing research for publication in academic journals was never the center’s point.

“We wouldn’t get published in poetry magazines, either,” he says. “We could perhaps make some marginal improvements in our peer-review process, but the cost of that would be risking the timeliness and relevance of our publications.”

While the Mackinac Center is upfront about aiming to promote free-market answers to problems, advocacy is often harder to discern when it comes from individual scholars.

“There’s always a fine line between believing in one’s scientific results and wanting to disseminate those results because the evidence is there, and starting out with a strong preference and using research creatively and selectively in support of that preference,” says Michael J. Feuer, the executive director of the Center for Education at the National Research Council. The council is the main operating arm of the National Academy of Sciences, which was chartered by Congress in part to sort out competing scientific advice.

One education researcher who has encountered some criticism from colleagues in the field for his efforts to promote his own work is Robert E. Slavin, the co-developer of Success for All, a comprehensive improvement program used in roughly 1,800 elementary schools. Slavin, the director of a federal education research center based at Johns Hopkins University in Baltimore, and his wife, Nancy Madden, formed a nonprofit foundation to support dissemination of their popular program…

Other researchers have come in for criticism by taking their work straight to the press, rather than letting it percolate more slowly through the traditional academic channels, or by making broader interpretations than their data warrant.

As public intellectuals, education researchers also get asked for their opinions by reporters, Loveless of the Brookings Institution observes. “In order to communicate with reporters, students, and the outside world, scholars have to simplify their findings, and sometimes they oversimplify,” he says. “Those oversimplifications sometimes seem biased.”

Yet not all advocacy is bad, scholars say, and debate between experts who forcefully advocate their positions can be a good thing for education research.

“I don’t think any researcher goes into research questions completely neutral,” says David C. Berliner, an Arizona State education professor. “If research is done well and meets peers’ requirements, then it’s fine to take it seriously. But what I’m saying is ‘take it seriously,’ rather than take it as truth.”

“My rule of thumb is that the more controversial the issue, the more likely people are to take sides,” says Cooper of Fordham University. “When I see that, I know it’s important research.”

Part of the problem, he says, is that politicians may unwittingly bring on academic debates when they they fail to build mechanisms and money into new programs so that they can be properly evaluated from the beginning…

Even for fellow academics, however, it can be hard to tell when bias has crept into a study…One way to tell, says Berliner, is to find out if the researchers have released their data so that others can check and reanalyze their work.

Nel Noddings, the current president of the National Academy of Education, an elite group of scholars in the field, also says serious researchers are careful to address all the arguments that cast doubt on their findings. “Sometimes, researchers just pick out the goofiest arguments on the other side, address them, and say their critics don’t have anything,” she says.

A look at the research question that a study poses, Loveless says, might also show that the study was meant to have a predetermined outcome.

Molnar says a hallmark of high-quality research is whether the methods used are appropriate to the questions asked.

But doing the difficult work of sorting out the substantive study from the biased report may be too much to expect from policymakers and practitioners right now, he says.

“My view is that it’s already a step forward when they know there’s an argument,” Molnar says. He says his own goal in the short term is just to provide decisionmakers and readers of research with another side.

“What I can say is, ‘You have this document, and now you have our documents,'” he says. “Use your own good judgment and common sense, and sort it out as best you can. Right now,” he adds, “there ain’t much sorting out.”

The Research section [in Education Week] is underwritten by a grant from the Spencer Foundation.

(4) Carnegie Foundation Names Five New Members To Board

Source:  Gay Clyburn (650-566-5162) – 14 February 2002

URL:  http://story.news.yahoo.com/news?tmpl=story&u=/020215/180/13zlq.html

The Carnegie Foundation for the Advancement of Teaching named five new members to its Board of Trustees at its November meeting in Washington, D.C.: John Bransford, Centennial Professor at Vanderbilt University (Tenn.); Susan Fuhrman, dean of the Graduate School of Education at the University of Pennsylvania; Nils Hasselmo, president of the Association of American Universities (Washington, D.C.); Renee Moore, lead teacher at Broad Street High School (Miss.); and Lynn Olson, a senior editor with Education Week (Md.). They will attend the first board meeting of their four-year terms in July…

The Carnegie Foundation for the Advancement of Teaching was founded in 1905 by Andrew Carnegie, “to do and perform all things necessary to encourage, uphold and dignify the profession of the teacher and the cause of higher education.”

The Carnegie Foundation is governed by an independent, national Board of Trustees and uses income from its endowment to support its research and publication activities. The Foundation makes no grants.

(5) The Carnegie Foundation for the Advancement of Teaching

URL:  http://www.carnegiefoundation.org/

The Foundation is the only advanced study center for teachers in the world and the third oldest foundation in the nation. A small group of distinguished scholars conducts the Foundation’s research activities.

With a focus on the scholarship of teaching, the Foundation seeks to generate discussion and promulgate sustainable, long-term changes in educational research, policy and practice. Foundation programs are designed to foster deep, significant, lasting learning for all students and to improve the ability of education to develop students’ understanding, skills and integrity.