2010 Survey Public Comment Responses 100322
Description
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey Number Category Theme of Public Comment Leapfrog Response 1 General We appreciate that The Leapfrog Group has Leapfrog actively encourages hospitals to provide listened to recent hospital feedback and is not feedback on the survey at various points throughout the making substantial changes to the 2010 survey. survey cycle, including debriefing calls, the public comment period, and pilot testing the new survey. Through these opportunities to provide feedback, hospitals have indicated the importance of having a year to focus on existing survey standards; Leapfrog also recognizes that many hospitals participate in reward programs which also require at least two years of measures. . 2 CPOE Evaluation Tool Imposing a potential $5,000 fee for hospitals to For the initial 2010 survey reporting period, Leapfrog use the CPOE Evaluation Tool might be budget has decided to hold-off on implementing a fee for prohibitive to hospitals in 2010. 2010 budgets are hospital use of the CPOE Evaluation Tool. Leapfrog will already developed and approved. Leapfrog would continue to assess the need for a fee as the CPOE need to wait until the 2011 Survey cycle to move Evaluation Tool is further developed. forward with this initiative. 3 CPOE Evaluation Tool How would a $5,000 fee to use the CPOE Charging a fee for use of the CPOE Evaluation Tool Evaluation Tool be beneficial to hospitals? In ...
Informations
| Publié par | Zikes |
| Nombre de lectures | 5 |
| Langue | English |
Extrait
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Number Category 1 General
2
3
Theme of Public Comment Leapfrog Response We appreciate that The Leapfrog Group has Leapfrog actively encourages hospitals to provide listened to recent hospital feedback and is not feedback on the survey at various points throughout the making substantial changes to the 2010 survey. survey cycle, including debriefing calls, the public comment period, and pilot testing the new survey. Through these opportunities to provide feedback, hospitals have indicated the importance of having a year to focus on existing survey standards; Leapfrog also recognizes that many hospitals participate in reward programs which also require at least two years of measures. . CPOE Evaluation Tool Imposing a potential $5,000 fee for hospitals to For the initial 2010 survey reporting period, Leapfrog use the CPOE Evaluation Tool might be budget has decided to hold-off on implementing a fee for prohibitive to hospitals in 2010. 2010 budgets are hospital use of the CPOE Evaluation Tool. Leapfrog will already developed and approved. Leapfrog would continue to assess the need for a fee as the CPOE need to wait until the 2011 Survey cycle to move Evaluation Tool is further developed. forward with this initiative. CPOE Evaluation Tool How would a $5,000 fee to use the CPOE Charging a fee for use of the CPOE Evaluation Tool Evaluation Tool be beneficial to hospitals? In this would provide Leapfrog the means to ensure the Tool time of cost containment, additional costs could remains a current and valuable experience for deter hospitals for completing the survey. hospitals. Potential enhancements include expansion of the Help Desk support and creating additional order sets. Leapfrog is very sensitive to the economic pressures that every organization faces. Hence, this is why Leapfrog has not rushed into the decision to charge a fee and why Leapfrog is actively seeking feedback from hospitals on this proposed change.
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
5
Number Category Theme of Public Comment Leapfrog Response 4 CPOE Evaluation Tool If a fee for using the CPOE Evaluation Tool goes For the initial 2010 survey reporting period, Leapfrog through, would the fee be voluntary? Would has decided to hold-off on implementing a fee for paying the fee be a requisite to complete the hospital use of the CPOE Evaluation Tool. Leapfrog will CPOE Leap? continue to assess the need for a fee as the CPOE Evaluation Tool is further developed. If a fee is implemented for accessing the CPOE Evaluation Tool, the fee would likely apply to all hospitals. Paying the fee would not be a requisite to a hospital completing the CPOE Leap, per se, but given that an assessment with the Tool is an integral part of the CPOE Leap, achieving high performance on the CPOE Leap will not be possible without conducting an assessment with the Tool. CPOE Evaluation Tool If a fee is charged, could hospitals choose not to For the initial 2010 survey reporting period, Leapfrog assess their system with the CPOE Evaluation has decided to hold-off on implementing a fee for Tool and have their final results on the CPOE hospital use of the CPOE Evaluation Tool. Leapfrog will Leap not be negatively impacted? continue to assess the need for a fee as the CPOE Evaluation Tool is further developed. Given the current scoring algorithm for the CPOE Leap, a hospital’s failure to assess their CPOE system with the CPOE Evaluation Tool would have a negative impact on their overall CPOE Leap score. CPOE Evaluation Tool Why would Leapfrog want to "penalize" hospitals Since its inception, Leapfrog has encouraged hospital for implementing a costly CPOE system, by then adoption of CPOE systems. But given the substantial charging them to evaluate their system? cost of those systems, both Leapfrog and hospitals want to ensure those systems are implemented effectively. The CPOE Evaluation Tool provides hospitals the opportunity to conduct a post-implementation assessment. To ensure the Tool remains an effective assessment, Leapfrog does need to have the means to fund necessary enhancements.
6
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
8
Number Category Theme of Public Comment Leapfrog Response 7 CPOE Evaluation Tool With hospitals being so cash-strapped, it is hard to For the initial 2010 survey reporting period, Leapfrog see how many hospitals would be in favor of a fee. has decided to hold-off on implementing a fee for That being said, our hospital’s administration is hospital use of the CPOE Evaluation Tool. Leapfrog will prepared to pay a reasonable amount for use of continue to assess the need for a fee as the CPOE the CPOE Evaluation Tool. Evaluation Tool is further developed. Leapfrog will continue to reflect on needed Tool enhancements, and continue to solicit hospital feedback, to determine an appropriate fee amount that would allow Leapfrog to keep the CPOE Evaluation Tool a current and valuable experience for hospitals. CPOE Evaluation Tool Our hospital is one hospital in a six hospital For the initial 2010 survey reporting period, Leapfrog system. For hospital systems, how would fees be has decided to hold-off on implementing a fee for assessed for use of the CPOE Evaluation Tool? hospital use of the CPOE Evaluation Tool. Leapfrog will Will each hospital have to pay the fee? continue to assess the need for a fee as the CPOE Evaluation Tool is further developed. As the Leapfrog Hospital Survey asks each individual hospital to assess their CPOE system with the CPOE Evaluation Tool, that policy would likely extend to having each hospital pay the fee. Leapfrog is committed to creating a fee structure that is fair to all hospitals, regardless of size or affiliation. CPOE Evaluation Tool Would the fee to use the CPOE Evaluation Tool At this point, hospitals are asked to assess their CPOE be charged for each survey cycle? system at least once during each survey cycle. A fee, if implemented, would most likely be charged for each use. Leapfrog will be assessing the issue of frequency of test taking for high performing hospitals. CPOE Evaluation Tool Small and not-for-profit hospitals have to pay If a fee is implemented for accessing the CPOE premium dollars for our EMRs because we don't Evaluation Tool, Leapfrog is committed to creating a have the purchase leverage that large facilities fee structure that is fair to hospitals of all sizes. and networks have. Would Leapfrog consider a prorated fee structure based on average daily census or annual discharges?
9
10
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
12
Number Category Theme of Public Comment Leapfrog Response 11 CPOE Evaluation Tool Once our hospital has tested their CPOE system Leapfrog’s experts have found that hospital CPOE using the CPOE Evaluation Tool, and the result is systems frequently change over time. Between a successfully completed test, we see no need for assessments, alerts may be turned on and/or off and the organization to keep retesting for each annual software may be updated. It is important to both survey. Unless of course, content of the CPOE consumers and purchasers of health care that hospitals Evaluation Tool is changed. periodically demonstrate that their implemented CPOE system continues to provide appropriate decision support to prescribers. Leapfrog will be working with the national experts to assess frequency for consistently high performing facilities. However, at this point the thresholds for successfully completing the test are quite low and it has been anticipated that those thresholds for success would increase over time. CPOE Evaluation Tool Currently, the CPOE Evaluation Tool provides the Given that the CPOE Evaluation Tool currently has a user with a score (percentage) for each order limited number of test orders in the database, and the checking category and an overall result. But users integrity of the test needs to be maintained, Leapfrog is don't know the number of questions per order unable to share back the details of specific orders with checking category or the number of missed hospitals. While Leapfrog hopes to be able to enlarge questions per category. From a continuous the test order database, it is unlikely that we will identify improvement standpoint, it would be useful if individual orders, except for those which would result in hospitals received more information on the specific severe harm, in our feedback to hospitals. It is our questions that were answered incorrectly. It would hope that hospitals work with their clinicians and give hospitals an opportunity to address the areas vendor to determine appropriate alerting levels. of concern for future evaluations. Currently, if a hospital’s CPOE system did not produce an alert for a test order that could have caused the patient “severe harm, thatinformation is shared back with the hospital at the conclusion of the test. CPOE Evaluation Tool How is it valuable for hospitals that are currently in Leapfrog would agree with the assessment that much the process of implementing CPOE to have of the learning about CPOE goes on post-access to the CPOE Evaluation Tool? There is implementation, however, hospitals implementing much learning that occurs post-implementation. CPOE systems would benefit from being able to access the CPOE Evaluation Tool to test issues of connectivity across different information sources, as well as to provide feedback to clinicians/prescribers on where to focus their attention for protocols and alerting. .
13
Number 14
15
16
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Category Theme of Public Comment Leapfrog Response CPOE Evaluation Tool Paying a fee to use the CPOE Evaluation Tool Leapfrog continues to look at opportunities to ensure would be okay, but only if it would help to provide the accuracy of hospital responses to the main part of a method of validating test answers to increase the Leapfrog Hospital Survey and the CPOE Evaluation the worth of test. We would not be in favor of a fee Tool. As we continue to evaluate assessing a fee for to increase Help Desk support or to have hospitals use of the CPOE Evaluation Tool, we will keep this that are implementing CPOE systems participate. potential use of funds in mind. CPOE Evaluation Tool The literature and references for drug-drug The developers of the CPOE Evaluation Tool are interactions vary greatly. Drug reference currently working on creating new order sets. The new databases that are utilized for commercial clinical order sets will only test hospitals on those drug-drug decision support also vary greatly. Therefore, the interactions that have been categorized as the highest CPOE Evaluation Tool should use only drug level by major formulary databases. interactions that are rated at the highest level (severe) by most or all CDS databases. CPOE Evaluation Tool It takes considerable time and effort to respond to Leapfrog and its purchaser members appreciate the the survey, so hospitals are already bearing a cost efforts hospitals put forth to complete the Leapfrog of providing information to Leapfrog. To charge a survey. If Leapfrog does decide to charge a fee for use fee on top of this creates a disincentive to comply. of the CPOE Evaluation Tool, the funds collected would be reinvested into the CPOE Evaluation Tool, to keep it a current and valuable experience for hospitals.
Number 17
18
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Category Theme of Public Comment Leapfrog Response CPOE Evaluation Tool Leapfrog has structured the CPOE evaluation and The CPOE Evaluation Tool is a high-level sample of overall process so that hospitals are left to how effectively a hospital’s implemented CPOE system elucidate the CPOE safety criteria. A more alerts prescribers to common, serious prescribing proactive approach would be similar to The Joint errors. The intent of the Tool is not to test hospital Commission and NCQA through making the systems on all decision support capabilities, nor should new/revised standards, criteria and specifications the test scenarios be construed as the only decision available to hospitals prior to formal Survey support hospitals need to have in place. Each test evaluations. Hospitals can then evaluate their contains a small number of orders and is intended to be current practices and systems in order to a sample of the performance of the system. Leapfrog implement the recommended systems and policies focuses it efforts on transparency of performance as & procedures. Leapfrog could do more to promote the lever to improve quality, and relies on its national safe medication practice by providing specific experts for measure development to assess how best information upfront on what decision support to measure performance. As an organization Leapfrog content authenticates safe medication practice. does not intend to certify or accredit facilities, but rather This would provide hospitals the opportunity to to provide valuable information on hospitals’ current have dialog with drug database vendors to performance. evaluate and possibly implement the Leapfrog Leapfrog does encourage hospitals to continue to recommendations. This would create a more engage their vendors in discussions about CPOE and collegial relationship focused on safe medication medication safety. practices for patients. CPOE Evaluation Tool In our experience, hospitals still see the CPOE The CPOE Evaluation Tool developers are working on Evaluation Tool as a "work in progress" that still updates to the Tool orders; updates that will help has much progress to make before it's truly address the validity and reliability concerns that reliable. Adding a charge to use it would probably hospitals have raised over the last 18 months. The not be well received and perhaps may increase updated orders are slated to be introduced in Fall 2010. opposition to the CPOE Leap.
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Number Category Theme of Public Comment Leapfrog Response 19 CPOE Evaluation Tool Charging hospitals a fee of $5,000 may preclude For the initial 2010 survey reporting period, Leapfrog some organizations from participating in the has decided to hold-off on implementing a fee for survey. Leapfrog should consider applying for hospital use of the CPOE Evaluation Tool. Leapfrog will federal stimulus funding to support the ongoing continue to assess the need for a fee as the CPOE research and development of this tool. Evaluation Tool is further developed. Leapfrog has had two meetings with the Office of the National Coordinator for Health Information Technology (ONCHIT) and presented to him and his staff details about the CPOE Evaluation Tool and hospital performance on the Tool. Leapfrog urges hospitals that have successfully implemented CPOE systems to send letters to the National Coordinator to share your experiences on system implementation. Leapfrog has been actively pursuing funding for the CPOE Tool from both government sources and private foundations. CPOE Evaluation Tool Leapfrog noted that additional test orders might be While the additional test orders will be added to the added to the CPOE Evaluation Tool. We want to master test database, the number of orders each ensure hospitals are given enough time to hospital will receive for their evaluation is not expected complete a test if these additional order sets are to change. The additional orders should not increase added. the time it takes hospitals to complete an assessment. CPOE Evaluation Tool While the enhancements related to expanding the The current web-based form for hospitals to contact the Help Desk Support to include a telephonic option Help Desk does include the option for hospitals to for communication could prove to be invaluable to indicate either that a test is underway and immediate hospitals, it would be helpful if it could include help is needed, or they have a general question about having rankings for priority requests. For example, the Tool. If a telephonic option for the Help Desk does in some situations, hospitals may have general become available, we would continue to provide questions, but in other situations, hospitals may hospitals a way to indicate the urgency of their have questions or need help the day that the question. hospital is scheduled to take the CPOE Evaluation Test and need a more immediate response.
20
21
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
23
Number Category Theme of Public Comment Leapfrog Response 22 CPOE Evaluation Tool Does Leapfrog have any intent of changing the Leapfrog does not have plans to change the scoring scoring algorithm for the CPOE Evaluation Tool? algorithm for the CPOE Evaluation Tool in the 2010 Currently, if a hospital does not score a minimum survey cycle. Leapfrog’s CPOE expert panel felt of 50% in the drug-drug and drug-allergy performance in the drug-drug and drug-allergy order categories, scores in the other categories do not checking categories was essential to hospitals matter. demonstrating basic medication safety. Future changes to the scoring algorithm could include raising the 50% threshold within an order category for hospitals to receive credit for that order checking category. CPOE Evaluation Tool Does a score of 100% on an individual order CPOE systems that do have adequate clinical decision checking category reflect a CPOE system that is support in place to alert prescribers to common, serious safer and one that results in better outcomes? prescribing errors would be considered safer than Research has found that too many alerts result in systems that do not adequately alert prescribers. But to alert fatigue and make the meaningful alerts less ensure a hospital’s CPOE system is not over-alerting effective. prescribers, the CPOE Evaluation Tool includes a handful of “nuisance orders within each test. These “nuisance orders are orders for which a prescriber should not be receiving an alert. IPS (ICU Physician Providing rural hospitals partial credit for 24 hour, The intent in providing additional partial credit to rural Staffing) 7 day a week teleintensivist coverage is a fair add. hospitals for 24 hour, 7 day a week teleintensivist This is a positive change and one that addresses coverage was in recognition of the challenges rural the challenge of attracting intensivists to rural hospitals face in attracting on-site intensivists. Thank areas. you for recognizing the intent. IPS (ICU Physician Our hospital’s e-ICU coverage includes 19 hour/7 Leapfrog’s IPS expert panel indicated, that in their Staffing) day-a-week intensivist coverage and 24 hour/7- experience, the 24 hour, 7 day a week teleintensivist day-a-week ICU nurse coverage. Our experience staffing model is one best suited for achieving has been that this coverage has demonstrated significant changes in outcomes. very positive improvement in both length of stay and mortality rates. We would recommend that intensivist coverage of e-ICU should be reviewed with those who have experience with this modality to determine what their recommendations are for "clinically effective" intensivist coverage.
24
25
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Number Category 26 EBHR-AAA 27 EBHR All Surgeries/Conditions
28
29 30
Safe Surgical Scheduling
Safe Surgical Scheduling Safe Surgical Scheduling
Theme of Public Comment Leapfrog Response What was the rationale for removing the "beta- The recent evidence of this safety practice conflicts blocker prescribed at discharge" process measure with the original guidelines. for AAA patients (AAA-2)? The public comment materials stated that the A link to a white paper that explains the research, model parameters used in calculating and scoring methodology, and calculations behind the Survival the Survival Predictors would be assessed by the Predictor models can be found on the survey home model developers for appropriateness of use in page. the 2010 Survey. Is there any documentation about this process? Who are the model The model developers are Drs. John Birkmeyer. MD developers? and Justin Dimick. MD from the University of Michigan and Dr. Doug Staiger, Ph.D., from Dartmouth. Other than outpatient surgery centers, how could a As was indicated in the Safe Surgical Scheduling Leap hospital not have interruptions in elective cases by guidelines, patient flow through the hospital is improved emergencies? by dedicating a number of operating rooms to ‘unscheduled’ cases and reserving the rest of the operating rooms for ‘scheduled’ or elective cases. The draft language for this Leap is quite vague. Thank you for that feedback. We will review our The "admission smoothing" process and outcome current documentation to identify how the language need to be better defined, among other things. explaining the Leap can be better defined. It is important that Leapfrog stick to evidence- These approaches have been implemented by based interventions. Do all the interventions numerous hospitals across the U.S., resulting in outlined in the Leap criteria really have evidence substantial improvements in both patient flow and behind them? patient throughput.
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Number Category 31 Safe Surgical Scheduling
32
33
34
Safe Surgical Scheduling
Safe Surgical Scheduling
Safe Surgical Scheduling
Theme of Public Comment Leapfrog Response While linking the scheduling of operating rooms to There is indirect evidence that these approaches can patient safety has an intuitive appeal, there is little, reduce errors in providing care. These approaches to no, evidence proving this connection. The have produced both reductions in staff overtime and suboptimal delivery of safe care may possibly be staff stress, both of which have been linked to lower related to scheduling, but there are several other quality and less safe care. Another indirect safety factors that could lead to the same outcomes, effect is there should be fewer patients being held in such as staffing and physical capacity. It is the ED, as full ICUs should be less common. Finally, acknowledged that the methods suggested can in given the national shortages in both doctor and nurse fact improve the utilization and efficiency of staffing, any efforts to reduce waste will benefit the operating room, but implying that this leads to level of care that patients receive. improved patient safety does not appear to be based in any data. Conversely, it is evident that The focus of this Leap is not on reducing the length of certain patient safety measures have actually led time a patient and their surgeon spend in the operating to less efficient use of OR resources such as the room, but on ensuring the operating rooms, the OR timeout and the use of checklists. staff, and downstream units are being used efficiently. The use of "operations management" and Thank you for that feedback. The methods for "variability methods" is weakly defined, and many implementation do require scientific rigor and expert hospitals could argue they are doing this. If the advice. We will review our current documentation to intent of the survey requirement is to expect a identify how the language explaining the Leap can be certain level of scientific rigor is used in scheduling better defined. practices, then the standard needs to specify what that is very clearly. The expectation that a hospital experiences a 15% Given the expected growth in Medicare beneficiaries increase in operating room (OR) throughput over and the addition of insured patients resulting from three years assumes that the volume exists to health care reform legislation, the demand for health grow at this rate. Fifteen percent growth averages services is expected to grow substantially over the next to about 5% per year, which in the current five years. Leapfrog wants to ensure hospitals are healthcare environment is an entirely unrealistic using their current physical resource in an efficient expectation. At our hospital, our OR volume has manner, before undertaking expensive expansions. In been static, which has to do more with external addition, hospitals always do have the option of factors, than anything we are doing internally to reducing the number of OR suites they are operating. grow business and capacity. The methods suggested in the references are While small in number, those hospitals that have relatively new concepts. To our knowledge, very adopted these approaches to-date have seen a few hospitals in the country have successfully substantial improvement in both patient flow and implemented this scheduling approach. To adopt patient throughput. Leapfrog believes wide-spread
Leapfrog Responses to Public Comments on the 2010 Leapfrog Hospital Survey
Number Category
35
36 37
38 39
Safe Surgical Scheduling
Safe Surgical Scheduling Safe Surgical Scheduling
Safe Surgical Scheduling Safe Surgical Scheduling
Theme of Public Comment Leapfrog Response this as a mainstream best practice is premature implementation of these ideas would have a and, at this point, unfounded. transformative effect on the delivery of health care in the U.S. To require a hospital budget for such efforts is Process improvement programs, even those at unnecessary. Much of this work can be done progressive hospitals, are often most successful when within the available resources at more progressive supported with dedicated staff time. The budget could hospitals. reflect the internal and/or external resources needed to implement the Leap. Without more discussion and significant Leapfrog will continue to explore opportunities to better refinement, our hospital cannot support the define the Leap criteria and definitions. proposed Safe Surgical Scheduling standard. Our hospital’s understanding is that Leapfrog The proposed standard for the Leap is a 15% proposes to use a measure of improvement in a improvement in all surgical/procedural units over three hospital's overall patient throughput to assess the years. The standard does not speak to overall patient hospital's efforts and success in managing their throughput, although a side-benefit is that emergency surgical schedules. In our experience, patient rooms will not be overcrowded due to back-ups in throughput is mostly affected by the volume of surgical suites or ICU’s. medicine patients, not surgical patients. The Leapfrog proposal for this new section of the survey seems to be too narrow and does not reflect real circumstances. The proposed Leapfrog Safe Surgery Scheduling Thank you for that input. measures appear to be a reasonable approach and directionally correct. The proposed three year timeline for progression Thank you for that input. seems appropriate based on our own experience focusing on this area for the past three years.
© 2010-2024 YouScribe