ribbon

 

 

 

 

 

 

 

 

 

 

 

 

Consumer Comparison

A new kit designed to measure what consumers think of their health plan is so popular that the agency that came up with it has gotten about 500 orders—and the kit’s not even been officially released.

The Agency for Health Care Policy and Research developed the Consumer Assessment of Health Plans Study (CAHPS) "to address a need that we saw," said Charles Darby, a project officer with the agency. "Consumers did not have the kind of reliable information they needed about what other consumers thought about health plans to help them make their decisions."

The BBOC, or Big Book of CAHPS, is being printed, but about 60 organizations have received advance copies, and many are starting to use them, Darby said. The kit includes surveys and a software program.

The assessment tool works like this: A company that wants more information about the health plans it offers selects a questionnaire—which can be carried out by mail or telephone—and administers it to employees in the various plans. So if the company offers six plans, the software program can analyze the results, enabling the company’s benefits manager to compare plans. Topics covered in the survey range from how the health plan deals with questions to how well providers communicate.

CAHPS (pronounced caps) already is being used to conduct the first survey of beneficiaries in Medicare managed care plans. About 64 percent of the 130,000 enrollees who received the survey have responded so far, Darby said.

 

Seeking Approval
Does JCAHO accreditation prove anything?

By Valerie J. Nelson
Illustration by Malcolm Garris/PhotoDisc
June 5, 1998

Getting a stamp of approval from the Joint Commission on Accreditation of Healthcare Organizations is time-consuming, nerve-wracking, and pricey. But every three years, most hospitals commit time, energy, and money to the survey process, hoping their efforts will be validated with an accreditation from the organization.

Why? The easiest answer is that accreditation makes a hospital eligible for Medi-Cal and Medicare payments. It also lends credibility in the eyes of other insurers and health plans and consumers. And the underlying goal, says the JCAHO, is to ensure that the hospital provides quality care. But is accreditation worth it?

To plan or not to plan?

Few people would say the process is perfect. One criticism centers on the planned nature of the site visit that’s part of the accreditation process. For example, nurses in New York who were interviewed about JCAHO accreditation called it a "charade" because supplies suddenly became readily available during a site visit, said Glen Von Nostitz, research director for the Public Advocate for the City of New York. Earlier this year, the group published a blisteringly critical report of JCAHO accreditation of New York hospitals.

And surprise visits can be different from planned ones. Last year, one hospital’s rating fell after complaints from the Service Employees International Union prompted the JCAHO to make two unannounced visits. Infractions that can be prevented during a planned visit—like overcrowding, chronic understaffing, and equipment shortages, which the hospital was cited for—were obvious enough to prompt the Joint Commission to take away its "accreditation with commendation."

But focusing on the three-day site visit misses the point, says a spokesperson for the American Hospital Association (AHA). That’s because it ignores the self-examination it took to get there.

"It would be a mistake to invest too much of your expectations in the survey process itself," said Tom Granatir, director of quality initiatives for the AHA. "It’s a private, voluntary accreditation program. They want the interchange to be as productive as possible, which means planned surveys."

Too much cheerleading?

But preparing for the on-site review has a downside, according to critics: The teamwork that goes into preparing gets in the way of honesty. "When a hospital has gone through all of this rah-rah preparation that’s handed out in seminars and meetings, it creates a whole football game attitude," Von Nostitz said. "It’s ‘We are going to win this game.’ Are you as a nurse going to stand there and say something critical? It doesn’t elicit honest information."

It comes back to the significance of preparation in the assessment process, said Kurt Patton, executive director of the JCAHO hospital accreditation program. Calling the preparation for the survey "very valuable for a hospital" because of the self-examination it requires, Patton said the Joint Commission has procedures in place that enable workers to speak confidentially, if needed. Hospital staff are encouraged to report problems to their managers and help find solutions. If regular channels fail, they can request a public information interview without management or file a complaint via a telephone hotline.

But on the other hand …

Still, the Joint Commission does attempt to respond to criticism, and the process is improving. Mary Dee Hacker, MBA, RN, vice president of patient care services at Childrens Hospital Los Angeles, said in 1997 the surveyors from the Joint Commission were better than in the past, and the accreditation survey was the best the hospital has undergone.

"The surveyors are more current in understanding health care than in years past," Hacker said. "They served more as educators."

The No. 1 comment from hospital CEOs is that they like the "consultative nature" of the process, Patton said. "Surveyors have traveled to hospitals throughout the country and come back with ideas and approaches on ways to do things that the chief executives find particularly valuable."

The goal of the JCAHO accreditation process is to improve, not police, Granatir said. Making the on-site element random would not improve it, he added, because the preparation to meet the hundreds of standards is such an integral part of the experience.

"Do you want to catch people doing something bad, or do you want to find out what they are doing good?" Granatir said. "The accreditation process takes steps to make it better. It doesn’t begin with the survey. That’s just a blip."

The evolution of value

Eyebrows also can be raised over an accreditation process that can cost anywhere from $7,200 to $90,000—and has to be repeated every three years. "It’s a very expensive service," Hacker said. "It’s an inappropriate use of hospital dollars. It needs a major overhaul."

Another example of the need for change is in standards meant for acute care hospitals that make no sense in the pediatric world, she said. While saying there is "real value" in having an outside agency checking hospital safety and quality, Hacker called the Joint Commission’s approach "really burdensome."

The accreditation process is evolving. "Organizations that do accreditation like ours are beginning to look more at performance measurement activities," Patton said. For example, instead of only examining policies, the impact of policies on procedures and training activities would be assessed.

The JCAHO is under pressure to be more responsive to the public, patients, and staff, Von Nostitz said. He points out the commission is in a "little bit of a balancing situation" because the hospital industry it is judging makes up 80 percent of its budget.

Only 1 percent of hospitals fail to earn JCAHO accreditation.

"They have customers, and they have to make them happy," Von Nostitz said. "At the same time, people like us apply pressure from the patient consumer perspective in order to counterbalance the hospital perspective."

 
 
 

Decades of Accreditation

1917: The American College of Surgeons developed its one-page "Minimum Standard for Hospitals." The next year, the ACS began on-site inspections. Of 692 inspected hospitals, 13 percent passed muster.

1951: The Joint Commission on Accreditation of Hospitals was formed by the ACS, the American College of Physicians, the American Hospital Association, the American Medical Association, and the Canadian Medical Association. The private nonprofit offered voluntary accreditation. Accreditation began in 1953.

1964: For the first time, the Joint Commission started charging for its surveys.

1965: The Medicare Act, passed by Congress, said that Joint Commission accreditation qualified facilities to participate in Medicare and Medicaid.

1970: Standards changed from emphasizing a minimum to promoting optimal quality. That year, RNs and hospital administrators begin doing accreditation surveys along with physicians.

1972: A change in the Social Security Act required the secretary of the Department of Health and Human Services to began validating the Joint Commission’s findings and evaluating its work annually in the HHS report to Congress.

1987: The name change to the Joint Commission of Accreditation of Healthcare Organizations reflected the expansion beyond hospital accreditation.

1993: Standards shifted toward measuring actual performance rather than assessing a facility’s ability to perform well.

1997: Oryx was launched to bring outcomes into accreditation.