Retired Officers Raise Questions on Crime Data
Of course, as I read about this research I thought about the schools. And here's reader comment #1 at the Times website:
The same Bloomberg administration that wants data to show crime is down, wants data to show our kids are learning more and the schools are improving. The same way retired police officers are coming forward now to talk about "fudging" the input, retired teachers and principals will soon come forward to admit to manipulating the data in our schools. It's happening on a daily basis. You can count on it
And here's another observation with direct relevance to the schools:
Another negative facet of Comstat is that in every Precinct, District or Unit there are three or more sworn police personnel,whose sole purpose is compiling statistics and information for their commanding officer to prepare them for each Comstat secession. These are cops that could actually be performing police work.
And here's a wowser:
This isn't about police integrity, it's about corporate management, the MBA-mentality that needs numbers to confirm things. As the first commenter responded, this very thing is now taking place in NYC schools because the teachers and administrations are being pressured to raise their graduation rates â€" at the same time they are cutting budgets, eliminating popular programs and threatening penalties and even closing for the failure to meet the Bloomberg administration's goals. Teachers and police do hard work and don't need the extra pressure of MBA's, who produce nothing tangible for their time. They produce statistical analyses. Their sole accomplishments have been to ship jobs off-shore and bankrupt America. Police officers' and teachers' jobs can't be shipped off-shore. But the Bloomberg administration, ever intent on statistical proof of its progress, demands that data, even if they undermine the integrity of the professions, increase paperwork (taking time away from service, the actual job). Adding insult to injury, the police and the teachers are then blamed for the resulting problems. Put the blame where it rightly belongs: on the Bloomberg administration.
By William K. Rashbaum
More than a hundred retired New York Police Department captains and higher-ranking officers said in a survey that the intense pressure to produce annual crime reductions led some supervisors and precinct commanders to manipulate crime statistics, according to two criminologists studying the department.
The retired members of the force reported that they were aware over the years of instances of "ethically inappropriate" changes to complaints of crimes in the seven categories measured by the department's signature CompStat program, according to a summary of the results of the survey and interviews with the researchers who conducted it.
The totals for those seven so-called major index crimes are provided to the F.B.I., whose reports on crime trends have been used by Mayor Michael R. Bloomberg and his predecessor, Rudolph W. Giuliani, to favorably compare New York to other cities and to portray it as a profoundly safer place, an assessment that the summary does not contradict.
In interviews with the criminologists, other retired senior officers cited examples of what the researchers believe was a periodic practice among some precinct commanders and supervisors: checking eBay, other Web sites, catalogs or other sources to find prices for items that had been reported stolen that were lower than the value provided by the crime victim. They would then use the lower values to reduce reported grand larcenies -- felony thefts valued at more than $1,000, which are recorded as index crimes under CompStat -- to misdemeanors, which are not, the researchers said.
Others also said that precinct commanders or aides they dispatched sometimes went to crime scenes to persuade victims not to file complaints or to urge them to change their accounts in ways that could result in the downgrading of offenses to lesser crimes, the researchers said.
"Those people in the CompStat era felt enormous pressure to downgrade index crime, which determines the crime rate, and at the same time they felt less pressure to maintain the integrity of the crime statistics," said John A. Eterno, one of the researchers and a retired New York City police captain.
His colleague, Eli B. Silverman, added, "As one person said, the system provides an incentive for pushing the envelope."
The Police Department disputed the survey's findings, questioned its methodology and pointed to other reviews of the CompStat process that it said supported its position.
The survey, which involved an anonymous questionnaire, was done in coordination with the union representing most of the senior officers in the department. The questionnaires were sent to 1,200 retired captains and more-senior officers; 491 responded, including 323 who retired from the department after 1995, the first full year that the agency, then under William J. Bratton, used CompStat. It is based on the scrupulous tracking of crime complaints and a mix of mapping crime trends, identifying trouble spots and holding precinct commanders directly responsible for attacking those problems.
The survey has its limitations. It is unclear exactly when the retired senior officers left the department, making it impossible to say whether any alleged manipulations came early on or had developed over years and across more than one mayoral administration. The CompStat approach has been widely replicated across the country and has been credited with improving police work in many cities.
Also, the questionnaires did not set out to measure the frequency of any manipulation. None of the respondents were asked to identify specific acts of misconduct, and none admitted to having done it themselves. In addition, it was unclear whether the officials who said they were aware of unethical conduct had firsthand knowledge.
But the survey asked provocative questions and clearly elicited disturbing answers. The retired members of the force were asked whether they were aware of changes to crime reports. Of the 160 who indicated that they were, more than three-quarters said the changes were unethical.
Paul J. Browne, the Police Department's chief spokesman, who was provided a copy of the survey's summary Thursday, said that two other significant, independent and more comprehensive studies had been done in recent years analyzing the integrity of the city's crime statistics -- one in 2006 by a New York University professor and another by the state comptrollerâ€™s office -- and that he had found them to be reliable and sound.
The report by the N.Y.U. professor, Dennis C. Smith, contained this assessment: "We conclude, as did the state comptroller five years ago, that the city and department officials, and the public can be reasonably assured that the N.Y.P.D. data are accurate, complete and reliable."
The researchers in the new survey emphasized that the responses -- the questionnaires were mailed in September 2008 and returned in early 2009 -- showed that most of the senior officers believed that CompStat had been a valuable management innovation. And even few department critics would seriously dispute that the city is much safer than it was in the early 1990s, with murders cut by nearly 80 percent and with neighborhoods, from the notoriously violent to the largely affluent, transformed.
The CompStat system was put in place by Mr. Bratton, Mr. Giuliani's first of three police commissioners. Versions of the system have been franchised to hundreds of police departments. It was adopted, and in some cases modified, by Mr. Bratton's successors under Mr. Giuliani, Howard Safir and Bernard B. Kerik, and by Mr. Bloomberg's commissioner, Raymond W. Kelly.
But as the city annually reported reductions in crime, skepticism emerged in certain quarters -- several police unions other than the one that assisted with this survey, elected officials, residents in some neighborhoods --about whether the department's books were being "cooked."
Concerns over crime statistics are not unique to New York. Police departments have faced accusations of tampering in Atlanta, Baltimore, Dallas, New Orleans and Washington.
Mr. Kelly, for his part, has said that he instituted a rigorous auditing system to maintain the integrity of the crime reporting operation. And Mr. Browne said Friday that every precinct's books were audited twice a year, "and where errors are discovered, they are corrected and reflected in revised crime statistics." He added, "In cases where it is determined that the errors were the result of intentional manipulation, the personnel responsible are disciplined."
Mr. Browne said that Mr. Kelly had meted out discipline in 11 cases, 4 involving precinct commanders. One of them, he said, was demoted and three others lost their commands. Last week the department confirmed in an article in The Daily News that it was investigating whether the commanding officer in the 81st Precinct in Brooklyn downgraded crimes or refused to take complaints from complainants to artificially reduce serious-crime statistics.
Mr. Browne criticized numerous aspects of the survey, suggesting, for instance, that many of the respondents might simply have been repeating what they had heard or learned from news reports about the "relatively rare instances that gained notoriety."
"The survey's biggest flaw is that a hundred respondents may be recalling the same lone incident everyone was talking about when they said they knew of instances when crime reports were manipulated," he said. "Further, anonymously supplied answers are problematic because it's hard to assess whether they originate from retirees who felt they were unfairly denied promotion or have some other ax to grind."
Mr. Browne said that only 37 of the 323 retired senior officers surveyed had served as precinct commanders, arguing that only they would have firsthand CompStat experience. But the researchers said the survey included responses from aides to precinct commanders and higher-ranking officers who oversaw the work of the commanders.
Professor Eterno said the suggestion that 100 former officials might be talking about the same incident was "ludicrous," and Professor Silverman said the department's criticism of the use of an anonymous survey indicated a limited understanding of social science methodology.
The seven-page summary of the survey certainly indicates that many of the retired officers believe the system has gone significantly wrong.
Indeed, the researchers said the responses supported longstanding concerns voiced by some critics about the potential problems inherent in CompStat. The former officers indicate that it was the intense pressure brought to bear on the commanders of the city's 76 precincts in twice-weekly CompStat meetings -- where they are grilled, and sometimes humiliated, before their peers and subordinates, and where careers and promotions can be made or lost â€" that drove some to make "unethical" and "highly unethical" alterations to crime reports.
Mr. Browne said that when Mr. Kelly took over the department in 2002, he barred spectators from CompStat meetings in light of complaints from some commanders that they had been ridiculed in the forum in front of outsiders. He said Mr. Kelly believed that the presence of outsiders "demeaned the process and was unprofessional."
The two researchers are writing a book scheduled for publication this summer based in part on the survey; it is tentatively titled "Unveiling CompStat: The Naked Truth." They provided a copy of the summary and the survey questions to The New York Times. They declined, however, to provide a full report until the head of the union with which they worked had shared it with the Police Department.
When Professor Eterno retired as a captain from the Police Department in 2004, he was working in its crime analysis and program planning section. He is now the director of graduate criminal justice studies at Molloy College on Long Island, which financed the study. Professor Silverman wrote a book about CompStat in 1999 before retiring from the John Jay College of Criminal Justice in 2003.
Roy T. Richter, president of the Captains Endowment Association, which represents the retired officials, said the challenges that his retired members had faced -- and his active members still face â€" were significant, as crime continues to decline and precinct commanders must continue to beat their previous yearâ€™s performance despite a force with thousands fewer officers.
He called the survey results â€śtroubling,â€ť and said that while CompStat can be an effective tool, to the extent that it is "used as a sword to subject a commander to humiliation before his peers, I don't think it's an effective management tool.â€ť"
More than a year before Professor Smith of N.Y.U. published his study praising CompStat in 2006, a city commission created to monitor the Police Department's effort to fight corruption sought to examine the integrity of the departmentâ€™s statistics. But while the department cooperated with the professor, it refused to comply with the commission.
And despite the efforts of its chairman, Mark F. Pomerantz, a respected former federal prosecutor, the commission could not win subpoena power, and it was not able to examine allegations that crime complaints were downgraded.
The department had argued that those allegations did not fall under the panelâ€™s mandate because the matters did not constitute corruption.
Al Baker contributed reporting.
Willliam K. Rashbaum
New York Times
INDEX OF RESEARCH THAT COUNTS