Tag Archives: checklists

NYT public editor addresses errors made in Cronkite article; some basic advice for preventing errors

nytbanner1New York Times public editor Clark Hoyt has weighed in on the paper’s recent, error-riddled story about Walter Cronkite. The story, written by television critic Alessandra Stanley, resulted in two corrections, one of which was for seven mistakes. I wrote about the mistakes, and Stanley’s history of error, in a recent column for Columbia Journalism Review.

Hoyt’s column offers new information, such as how five different editors reviewed her story and missed the mistakes. This is a classic example of how easy it is for mistakes to end up in print. It doesn’t matter how many people look at an article; they have to know what they’re supposed to be looking for.

The most interesting revelation in Hoyt’s piece was that, after attention was drawn to Stanley’s errors in 2005, the Times introduced a program to increase the fact checking of her work:

For all her skills as a critic, Stanley was the cause of so many corrections in 2005 that she was assigned a single copy editor responsible for checking her facts. Her error rate dropped precipitously and stayed down after the editor was promoted and the arrangement was discontinued. Until the Cronkite errors, she was not even in the top 20 among reporters and editors most responsible for corrections this year. Now, she has jumped to No. 4 and will again get special editing attention.

The extra scrutiny helped. Then things regressed, and that’s the lesson here. The gap in the plan for “special editing attention” is that it doesn’t include a training component. Stanley could, with a little bit of effort, improve her level of accuracy. Additional oversight isn’t going to train her to be more accurate. It will make her more careful, but it won’t fix the source of the problem. Eventually she will stop receiving special attention and things will go back to the way they were.

It’s kind of a variation on the old “give a man a fish” saying: Give an error-prone reporter special editing attention and you’ll publish fewer of her errors. But train her how to be more accurate and she’ll make fewer errors. That’s a big difference.

I concluded my CJR column by writing that “whatever system [Stanley] has for checking her work isn’t sufficient. The same goes for how the copy desk is handling her articles. The Times can let her twist in the wind with errors like these, or realize this situation is hurting the organization and come up with a training program that helps her stop making simple factual errors at such an alarming rate.”

This is, as they say, a teachable moment. It’s an opportunity for the paper to create a newsroom-wide program that will help all reporters. After all, you can’t give everyone special editing attention. But you can teach good habits that prevent the need for special attention. Eliminate or at least reduce the errors at the source and suddenly there are less things that can slip through the cracks.

After my CJR column appeared online, I received an email from an editor asking me for some error-prevention advice. Here’s what I sent to him:

1. Self-Diagnose: Are you making or missing the same kinds of errors. Do you misspell names? Garble numbers? Etc. Take a month and track your mistakes. Write them down. Note how they happened and any other relevant information. At the end of the month, tally up your errors. Now you know your pain points. I recommend keeping an error journal; just create an Excel doc or Google Doc spreadsheet and keep track of your errors. This is hugely valuable data. (The Times has an internal errors database, so it already keeps some of this data.)

2. Create Good Habits: If you have a tendency to misspell names, then you need to start every interview by asking the person to spell their name. If, as an editor, you tend to overlook misspelled names, then the first thing you do with a new story is check the names. The key is to create habits/actions that are mapped to your mistakes. The best way to do this is to…

3. Use A Checklist: Whether you’re writing or editing, you should use a checklist to guide your fact checking process. I have a sample checklist available as a free download here. And if you need convincing, read this column about why checklists are so powerful.

I know one thing for sure: if Alessandra Stanley started using a checklist to review her work prior to sending it for editing, her level of accuracy would improve.

UPDATE August 3: Steven A. Smith has some good thoughts about this situation over on his blog. A sample:

Reporters with fact-error issues have to work a bit harder, have to develop personal double-checks that can be time-consuming and frustrating, especially on deadline. But that is the only way reporters can work themselves out of an accuracy funk. Some take on the challenge because of professional pride and a genuine desire to do their jobs as well as they can.

Others require a bigger stick. That’s just the truth of it.

I remember one reporter who worked on my regional staff at The Pioneer Press in St. Paul. He had experienced a terrible run of corrections, all the result of careless reporting practices. Working with him, we developed a series of steps he was urged to take before moving any story to his editors. Within days his desktop computer was covered in yellow sticky notes reminding him to check phone numbers and addresses, use the city directory, and so on. He took responsibility and his hard work produced results. His correction rate dropped dramatically and the new habits stuck with him.

But the reporter knew his job was on the line. ‘Fix it or lose it” was the message.

Was such a message delivered to Stanley at the time her editors developed a personalized editing program? If so, does the latest debacle mean she will lose her job? Should she lose her job?

Does “intellectual heft” in reporting compensate for inaccurate reporting?

CJR columns: an argument in favor of checklists, a look at homegrown errorists

cjr2After releasing my free Regret the Error Accuracy Checklist earlier this week (download your copy here), I devoted my latest CJR online column to the subject of checklists. This column offers background on why checklists have proven useful in so many different industries and professions. I examine why they work for journalists, and why we don’t use them. My column from the week before is a look at one man in Illinois who spends his mornings spotting errors in his local paper. Excerpts are below.

From today’s column (click on the headline for the full text):

Checklist Charlie

In 1935, Boeing Corporation almost went bankrupt after its Model 299 long-range bomber literally crashed and burned during a U.S. Army flight competition. Major Ployer P. Hill, the pilot, and one other crew member died in the crash. As a result, the Army contract went to a competing company, causing major financial difficulties for Boeing.
As a consolation, the Army ordered a few Model 299s for further testing. The question was how to fly them safely. The New Yorker’s Atul Gawande writes that the Army eventually “came up with an ingeniously simple approach: they created a pilot’s checklist, with step-by-step checks for takeoff, flight, landing, and taxiing.”
“With the checklist in hand, the pilots went on to fly the Model 299 a total of 1.8 million miles without one accident,” according to Gawande. The Army eventually ordered thousands of the aircraft, which became known as the B-17.
Gawande’s December 2007 story is a paean to the checklist, one of the simplest and most effective error-reduction tools. Checklists have been proven to work for pilots, doctors, nurses, and even people working at a nuclear power stations. For example, the use of a World Health Organization surgical safety checklist helped reduce inpatient deaths following operations by 40 percent, according to a studyNew England Journal of Medicine. published in the
Checklists also work for journalists. We just don’t use them …

From my January 30th column:

Homegrown Errorists

The package arrived two weeks ago, a bulging manila envelope with a return address in Decatur, Illinois. Inside was a mass of paper with a polite letter placed on top.
“Dear Mr. Silverman,” it began, “you have published a book on errors found in journalism and have a website devoted to the subject.” The writer, Robert S. Reed, continued on for two pages:

As a subscriber to the Herald & Review in Decatur Illinois, I have seen hundreds of errors in newspaper articles in addition to errors in the photo captions and the headlines/sub-headings. Most are misspelled words, missing words, extra words, wrong verb tenses, and, in some cases, factual inaccuracies.
Two of the articles from 2008 are attached to illustrate my point … I am also attaching 82 photo captions that appeared in the Decatur Herald & Review in 2008. All contain errors of one type or another. The corrections are indicated in ink. Also enclosed are 35 copies of headlines and sub-headings.

The more than 100 clippings were roughly an inch thick, and Reed was as good as his word. Each page correctly noted a copy editing or factual error from the paper. Red ink was everywhere, and in all the right places. The collection represented hours of work, not to mention the time spent photocopying them for delivery to me.
Some may wonder why anyone would choose to dedicate this amount of time to cataloging the errors in their local paper. But it’s no surprise to me at all. I’ve seen it before. (Plus, I’ve dedicated the last four years to reading hundreds of thousands of corrections and errors. I’m in no position to judge.) …

Announcing the Regret the Error paperback and a free accuracy checklist

rte-paperback-cover-web11

This week marks the release of the US paperback edition of the Regret the Error book. Order your copy here.

In addition to a lower price, the paperback includes a new introduction by me and the best corrections and apologies of 2007-08.  We also corrected the errors identified in the hardcover. (Read and subscribe to my book corrections here.) Plus, the cover makes note of the fact that the book won the Arthur Rowse Award for Press Criticism from the National Press Club in Washington.

Free Accuracy Checklist

To celebrate the release of the paperback, I’m offering a free download of a special Regret the Error accuracy checklist. Reporters can use the checklist to help achieve accuracy in their work. Have a look:

checklist

Instructions

  • Download the PDF file.
  • Print it off on a 4×6 piece of photo-quality paper. (Regular paper will also work.)
  • Laminate it.
  • Use a dry-erase marker (the finer the point, the better) to check off items as you complete them.

I recommend the photo paper, lamination and a dry erase marker because this process will enable you to use the same checklist over and over. Just keep it at your desk and reuse it for every story. Better yet, stick it to the corner of you monitor so it’s always in front of you. If photo paper/lamination isn’t your style, you can just print off a new checklist for each story. The laminated version is better because it saves time and paper, but it’s your choice.

This checklist is divided into four sections:

  1. At the top is space to write the name of the story you’re working on. Underneath that are a few lines where you can list your sources for the story.
  2. A section that lists a number of behaviors that will help you while reporting, such as “Ask sources to spell name & title.” Check off these items as you work on the story.
  3. A section that lists ten different things to check when you’re finished writing the story. Again, check them of as you complete each task.
  4. A section where you can write in story-specific items to check. For example, if a story contains medical terms and concepts, you would write them on these lines to make sure you check them before submitting the story.

Why a checklist?

Checklists help reporters and editors increase their level of accuracy. Checklists are also used in other industries and professions, such as medicine. Train yourself to use one, and you’ll make fewer factual errors. Seriously, it’s one of the easiest things a journalist can do to prevent factual errors.

This checklist is primarily aimed at reporters, but sections three and four could just as easily be used by editors. If you have any edits or suggestions for improving the checklist, please let me know. I’d also love to receive testimonials from people who use it.

Enjoy!

Corrections and accuracy wishes for the new year

This is the final Regret post for 2008. Regular posting will resume on January 5, 2009.

I’m usually so busy tracking corrections and errors that I don’t get a chance to write about the best ways to prevent and correct mistakes. With 2008 coming to a close, it’s a perfect time to list some of the things news organizations should be doing with online corrections, and share some of my ideas for new prevention and correction practices.

I decided to write these suggestions in the form of “Wouldn’t it be great if…” because if any or all of them take flight this year, it would be a great thing for corrections and accuracy. Here are my accuracy and corrections wishes for the new year:

Wouldn’t it be great if every news website had a regularly-updated online corrections page linked from their homepage?

Wouldn’t it be great if all news sites placed corrections within the offending article?

Wouldn’t it be great if news sites stopped scrubbing away errors?

Wouldn’t it be great if we had a way to automatically notify a website that a correction was made to an article they’ve linked to? I’ve taken to calling this the “Reverse Trackback” or a “Correctforward.” A Trackback is a way of automatically notifying a site that its content (usually a blog post) has been linked by someone else. We need to reverse this and create a system that spiders out a correction notice to news sites or blogs that previously cited the original, incorrect article. The notification could, for example, take the form of a comment on the related post. (”This is an automated message to inform you that the Regret the Error post you linked to has been corrected. Please read the corrected post here [link].”) This would go a long way to helping push corrections out to the public, which is what needs to be done on the web. We shouldn’t expect people to go hunting for corrections.

Wouldn’t it be great if we had a “Notify Me If This Article Is Corrected” button alongside all of the “Print” and “Share” buttons that appear on most online articles? The reader could simply enter their email address and receive an email if a correction was issued for the story. It’s great that more and more news sites are placing corrections within the story, but how many people go back and reread an article? A lot of readers are not seeing the corrections. As I noted above, we need to find a way to push corrections out to readers. This tool would enable readers to receive corrections for articles that they consider particularly important or useful.

Wouldn’t it be great if all news sites had an online form like the Chicago Tribune’s to help people report errors?

Wouldn’t it be great if readers could receive credit for spotting errors? For example, if a site asks people to create a user account, then that person’s profile could list “Number of corrections submitted” and “Number of corrections accepted.” It could also include “Letters to the editor published,” and a listing of that person’s comments on the site. Maybe the best error-spotter earns a prize at the end of the month or year? This system would encourage people to participate and contribute — and it would help decrease the number of uncorrected errors, which are a big problem.

Wouldn’t it be great if we could create standardized accuracy checklists for reporters, editors and other newsroom staff? These checklists (examples: 1,2,3) would help people take a systematic approach to verifying articles before they’re published. To see how checklists are helping improve intensive care in hospitals, read this great New Yorker article.

Wouldn’t it be great if we had a central place where people from different newsrooms could share tips for achieving accuracy? There’s a lot of knowledge out there, but it’s scattered among different organizations. A wiki for accuracy tips would help share knowledge and go a long way towards creating best practices.

What else would be great to see happen this year? Add your thoughts in the comments.