Healthcare Policy
How Timid or Bold Are Ministries of Health and Provincial Health Authorities in Canada in Planning for Healthcare Quality?
Abstract
Introduction: World Health Organization (WHO) guidelines recommend countries set quality plans for their health systems with clear priorities, indicators and targets. This paper examines whether Canada's federal, provincial and territorial governments are applying these principles.
Methods: We evaluated plans from 2010 to 2019 for 14 ministries of health and four health authorities in provinces with a single authority against a rubric that considered the existence of indicators, baselines, targets, time frames and progress reports.
Results: Ratings ranged from A+ to F with a median B/B-. Most jurisdictions had indicators, but only five of 18 jurisdictions had clear baselines, numeric targets and time frames. Irregularities were observed, such as vague indicators; setting goals to “improve” without targets; announcing targets only after plans had ended; setting minimal targets; removing targets after missing them previously; or inappropriate characterization of progress.
Discussion: Most Canadian governments are reluctant to set quality targets. We speculate there may be fear of criticism if targets are missed. However, several jurisdictions had clear, ambitious plans that may serve as examples for others.
Background
Governments in Canada have exhibited major interest in healthcare quality over the past two decades. During this period, seven ministries of health have established provincial health quality or patient safety councils to promote quality improvement. Multiple jurisdictions have legislated mandatory reporting of critical incidents (Milligan et al. 2021), and Ontario requires that healthcare organizations establish quality committees of boards and link executive compensation to quality results (Excellent Care For All Act, 2010). Governments have also invested in the measurement of quality; federal/provincial/territorial health ministers agreed to adopt common quality indicators in the 2003 Health Accords for strengthening the health system (Health Canada 2003), and subsequently, the Canadian Institute for Health Information (CIHI) expanded data collection to include wait times, patient experience, hospital safety and quality in long-term care and home care (CIHI n.d.a., 2019).
Another key role of governments is quality planning. The Handbook for National Quality Policy and Strategy of the World Health Organization (WHO) (2018) recommends setting goals that are “clear and meet a particular need, and should also be time bound, with a means to assess progress and achievement” (p. 22). Decades of psychology research show that organizations and individuals achieve better results when they set specific goals (Locke and Latham 2002). A clear goal directs attention to important tasks and wards off distractions. An ambitious goal has energizing effects, which stimulate effort and persistence. These findings are consistent with the SMART (Specific, Measurable, Achievable, Relevant and Time-Bound) goal framework in the management literature (Doran 1981), which states that goals should be specific, measurable and have a time limit for completion. According to the Country Planning Cycle Database of the WHO (WHO n.d.), which archives national plans of ministries of health, many countries have followed these principles by setting ambitious multi-year goals to reduce undesirable outcomes by 40% to 50% (Chan et al. 2019).
This paper explores whether governments in Canada have adopted key principles of good planning: the establishment of clear and measurable targets, timelines and progress reports. Within Canada, there has been interest in facility-level target setting. Ontario's Excellent Care for All Act, 2010, mandates that healthcare organizations establish annual quality improvement plans with targets, and academic health centres in Canada have published guidelines for quality plans emphasizing measurable goals, targets and annual evaluation (Collaborative for Excellence in Healthcare Quality 2012). What is not known is whether these principles have been applied to an entire federal/provincial/territorial jurisdiction. One possible reason why governments might avoid committing to clear goals is that they may risk criticism from the opposition and media if targets are missed.
Methods
This paper followed a qualitative research design using the historical method. We constructed an evaluation framework based on the above-mentioned principles of planning, searched for past examples of quality plans and rated them according to the framework.
Scope
This paper examined the planning principles of setting measurable targets with a clear time frame and regular monitoring. Other components of planning are also important, such as resource allocation, governance and accountabilities, but they are beyond the scope of this analysis.
Inclusion/exclusion criteria
The authors examined planning documents for each federal, provincial and territorial ministry of health in Canada and analyzed plans for health authorities managing healthcare for an entire province (i.e., Alberta, Saskatchewan, Nova Scotia, Prince Edward Island [PEI]) as these plans encompassed the entire health system. They also examined plans for the entire jurisdiction but within a specific sector (e.g., for long-term care, seniors, public health, cancer, mental health, etc.) issued either by the ministry or its designated planning bodies (e.g., provincial cancer or public health agencies).
Excluded from this study were regional health authorities for sub-regions within provinces/territories, health information agencies and research institutes. Provincial quality councils were also excluded; their role is to support quality improvement (Excellent Care for All Act, 2010; Health Quality Council Act, 2002; Health Quality Council of Alberta Act [2011]) and not target setting. The time period for inclusion of plans was from 2010 to 2019, inclusively. If an organization had plans for different time periods, only the most recent plan was evaluated. “Strategy” and “plan” were used interchangeably to allow for differences in definition between jurisdictions.
This article did not require ethics review as it examined only publicly available documents and no data on individual subjects were used.
Search strategy
The authors searched government websites using search engines, such as Google, employing the following search terms: [strategy; strategic plan; operational plan; development plan; plan; quality plan; annual report] in combination with [ministry of health, department of health, name of health authority] and [each province/territory, Canada].
Scoring algorithm
The authors developed a rubric for scoring system-level health plans based on recommended best practices underscored by WHO guidelines and other seminal research or frameworks (Appendix 1: Table A1, available online here). Plans were scored from zero to seven, where one point was awarded for each of the seven criteria. Partial or minimal implementation of an item in the rubric was scored as a half or quarter point. Situations resulting in partial points included meeting the criteria for only a few of the priorities listed or major methodological flaws (e.g., setting targets, but announcing them only after the plan expires). Also, if the system-level plan of a jurisdiction failed to meet a particular criterion, partial points were awarded if at least some sector-specific plans met the criteria. Minimal scoring was awarded where only one narrowly defined example of the item was found. A letter grade was assigned based on the numeric score as follows: A (6.5), B (5), C (3.5), D (2) and F (1 or less), with a “plus” or “minus” for a half-point above or below these levels (e.g., A+ for a score of 7, A- for 6).
Planning information may appear in multiple documents; for example, priorities could be in a strategic plan, indicators and targets in an accompanying operational plan and progress in an annual report (Appendix 1: Table A2, available online here). Scoring was based on the ensemble of such documents.
All three authors participated in the assessment of plans against the rubric. Each plan had at least two independent initial assessments, and discrepancies in scores were resolved in subsequent group discussions.
Validation
The authors prepared a detailed description of the justification for each criterion of the rubric for each jurisdiction (available upon request). This information and a draft of this manuscript were sent to each deputy minister of health and each provincial health authority's chief executive officer (CEO), with a request to identify missing plans or misinterpretations. Eight jurisdictions responded. Some additional documents were identified, but scores did not change.
One jurisdiction, however, challenged the validity of the criteria for stretch targets, arguing that achievability was critical and unrealistic goals would lead to demoralization. In response, we conducted a sensitivity analysis of the scoring with this item removed.
Results
There was wide variation in scores for clarity and in ambitiousness of planning, ranging from A to F with median B/B− (Table 1). Most jurisdictions had indicators, but only five of 18 fully met the criteria for clear baselines, numeric targets and time frames. Detailed footnotes in Table 1 describe the justification of partial or minimal scores.
Quebec's Ministry of Health and Social Services (MHSS), Nova Scotia Health Authority (NSHA) and Health PEI (the provincial health authority) received the highest scores (A or A+). Quebec's 2015–2020 strategic plan (Gouvernement du Québec 2015) was notable for having three main priorities, multiple objectives within each priority and at least one quality indicator for each objective. Annual reports described progress toward goals in each year, and targets remained consistent throughout the planning period (Gouvernement du Québec 2016, 2017, 2019a, 2019b).
Nunavut, Manitoba and Ontario had the lowest scores (F, F and D respectively), with almost no indicators or targets. In Manitoba, there was no system-wide plan; its cancer plan (CancerCare Manitoba 2016) mentioned some indicators, but no targets. Patients First, the system-wide plan of the Ontario Ministry of Health and Long-Term Care (Ontario MOHLTC 2015), had no indicators or targets. Nine sector-specific plans were identified for cancer, access to care, public health (two plans), smoking reduction, renal care, mental health, critical care and planning at the regional level (i.e., local health integration network) (Cancer Care Ontario 2019a, 2019b; Public Health Ontario 2013; Ontario MOHLTC 2013; Ontario Ministry of Health and Ministry of Long-Term Care 2018; Ontario Renal Network 2019; Ontario's Mental Health & Addictions Leadership Advisory Council 2017; Critical Care Services Ontario 2018; Health Shared Services Ontario 2018). Among these, mental health had indicators but no targets while smoking reduction had indicators, stretch targets and time frames. All other plans had no indicators. In particular, Ontario's public health plan was boldly titled Make No Little Plans (Ontario MOHLTC 2013) but contained no indicators or targets.
Scores were higher for plans from the four province-wide health authorities compared to ministries of health (average, 6.0 vs. 3.5). In the two provinces with health authorities that achieved high scores (Nova Scotia and PEI), the ministry of health received very low scores.
Only Saskatchewan had a perfect match in priorities between its ministry and the health authority (Saskatchewan Ministry of Health (n.d.a.: 4, 7, 9, 10; SHA n.d.). For the other three provinces, the description of priorities was different between the two. For example, the business plans of the Nova Scotia Department of Health and Wellness (2018, 2019) listed six priorities: collaborative primary healthcare; continuing care; mental health and addictions; orthopedic surgeries; digitalization; and redevelopment of facilities in two sites. The priorities in the 2016–19 Strategic Plan of NSHA (n.d.a.) were quality, workforce and citizen engagement.
Several provinces fulfilled the criteria for stretch targets. Examples include the following:
- Increase the proportion of residents with a family doctor from 66% (pre-2015) to 85% (Gouvernement du Quebec 2015: 10).
- Increase the proportion of cancer patients receiving surgery within 28 days from 60% (pre-2015) to 90% (Gouvernement du Quebec 2015: 11).
- Decrease the 90th percentile wait time for hospital beds for admitted emergency department patients from baseline 49.9 hours (2017–18) to 16 hours (2018–19) (Health PEI 2018: 16).
- Reduce the difference between the actual and expected length of stay from 2.4 to 1.67 days from 2017–18 to 2018–19 (Health PEI 2018: 16).
- Decrease hospital standardized mortality ratio from 112 (FY14/15) to 93 (NSHA 2017: 5).
- Improve patient experience from 81.9% (over multiple previous years) to 90% (NSHA 2017: 4).
- Decrease smoking prevalence to 5% by 2035, from 17.4% in 2015–16 (Health Canada 2019: 23).
There was variation between jurisdictions in time span of the plan, ranging from one, three and five years. In several cases, the annual reports of the ministry included results of indicators in the plan and hence were judged to be a progress report. Some jurisdictions (Alberta Health Services [AHS], Quebec) had standalone progress reports, which closely mirrored the structure of the plan, making it easier for the reader to evaluate progress.
Sensitivity analysis
There were only minor changes in relative rankings after removing stretch targets from the rubric. The lowest six jurisdictions scoring D or lower remained in the lowest six. The top five with A- or higher remained in the top five; however, British Columbia and Alberta ministries of health rose in relative ranking to join this top group. There were no changes in relative ranking for the middle group (B to C-). A complete table of these results is available on request.
Examples of irregularities in planning
VAGUE INDICATORS
The Ontario government's 2015 “Patients First” plan outlined four priorities: access, connect, inform and protect (Ontario MOHLTC 2015). Each priority had only vague descriptions of improvements, such as “see a specialist sooner,” “more innovative approaches based on evidence” and “expand patient engagement” (Ontario MOHLTC 2015: 6–7). A one-page collage described past achievements for assorted indicators (e.g., increase in pharmacies offering flu shots from zero to 2,400) but there was no clear assignment of these indicators to a specific priority, nor was it clear whether these indicators were to be used for future monitoring (Ontario MOHLTC 2015: 8).
INTENDED DIRECTION WITHOUT NUMERIC TARGETS
The Performance Measure Framework 2014–2019 (Yukon Department of Health and Social Services 2014: 3–5) specifies indicators for its strategic plan (e.g., Chlamydia incidence, smoking prevalence and vaccination rates). The framework contains baseline data, but the target is simply to “decrease” or “increase” these measures.
RETROSPECTIVE TARGETS
The New Brunswick Department of Health published information on whether the targets were met, but the target for a particular year was publicly disclosed in an annual report after the completion of the planning year (Government of New Brunswick 2015, 2016, 2017, 2018).
In contrast, The 2017–2020 Health Plan and Business Plan (AHS 2017: 15–18) contained targets for each of three future fiscal years, and its year two and year three progress reports describe whether these targets were met (AHS 2018: 15–18, 2019: 16–19). Quebec's 2015–2020 strategic plan (Gouvernement du Québec 2015) specified a completion date of 2020 for all targets, and each subsequent ministry annual report from 2015–16 to 2018–19 (Gouvernement du Québec 2016, 2017, 2019a, 2019b) consistently reported progress toward these targets.
CHANGE OR ELIMINATION OF TARGETS
In New Brunswick, some targets shifted from year to year for reasons that were not transparent. For hospitalizations for ambulatory-care sensitive conditions per 100,000 population where lower is better, the target as reported in the Health Annual Report 2014–2015 was 535 in 2014/15 and the actual performance was 548 (Government of New Brunswick 2015: 7). The next year, a more ambitious target was reported (454) and the performance improved (477), although it was still short of the target (Government of New Brunswick 2016: 8). Without explanation in the subsequent year 2016–17, performance was much worse (542) and the reported target had been revised to 516 (Government of New Brunswick 2017: 9). After missing this target again in 2017–18 (Government of New Brunswick 2018: 7), the target was eliminated in 2018–19 and reported as “N/A” (Government of New Brunswick 2019: 7).
Similarly, the Plan for 2018–19 of the Saskatchewan Ministry of Health (n.d.a.) proposed a “35% reduction in emergency department waits” (p. 5). The Annual Report for 2018–19 noted that the target was missed and waits had actually increased (Saskatchewan Ministry of Health 2019: 8). In the Plan for 2019–20, the target became non-specific: “reduction in emergency department wait time…” in selected cities (Saskatchewan Ministry of Health n.d.b.: 4).
MINIMAL TARGETS
Some targets represented only minimal improvements, such as AHS's target to reduce unplanned hospitalization readmissions from 13.5% to 13.2% over three years (AHS 2017: 16).
NARROW REPRESENTATION OF OVERALL QUALITY
Targets were sometimes defined for a very narrow subset of activities within a sector or patient group. For example, the 2019/20–2021/22 Service Plan of the British Columbia Ministry of Health (2019: 9) aims for “continued improvement of hospital services,” but the sole indicator was the Clostridium difficile infection rate. There were no indicators for broader hospital issues, such as the rate of adoption of best practices or other adverse events.
MISREPORTING OF PROGRESS
In Ontario, the Patients First: Action Plan for Health Care – Year-Two Results report stated that “During the last two years, we've made great strides to improve the health care experience … For example: 94% of people in Ontario now have a family doctor or other primary healthcare provider” (Ontario Ministry of Health and Ministry of Long-Term Care 2017: 1). However, in the original plan released two years previously, the same figure of 94% was quoted as the baseline (Ontario MOHLTC 2015: 8).
REDEFINING INDICATORS AND OBSCURING EVALUATION
NSHA set targets for primary care access – defined as the percentage of patients with a family doctor across multiple years (NSHA 2016: 3, 2017: 4). But later, it changed the definition to the number of persons who found a new doctor in its Healthier Together 2016–19: Measuring Our Progress report (NSHA n.d.b.: 9), making it impossible to ascertain if the original target was met.
UTILIZATION MEASURES INSTEAD OF INDICATORS
Many plans reported utilization measures instead of true quality indicators. There is no information on the percentage of persons who did not receive the services indicated for their condition. Examples include the following:
”Frail seniors will be provided with 10,000 more rehabilitation therapy visits”. Patients First (Ontario MOHLTC 2015: 11).
“Number of patients being provided oral systemic therapy.” 2016–2021 Manitoba Cancer Plan (CancerCare Manitoba 2016: 30).
“Number of priority surgeries in targeted areas completed.”2019/20–2021/22 Service Plan (British Columbia Ministry of Health 2019: 5).
RELIANCE ON DESCRIBING STRUCTURE
Structural indicators describe milestones, such as the introduction of a program, new facilities or staffing increases. They can be useful for describing key investments needed for progress but should be complemented by process or outcome indicators describing adoption of best practices or achievement of a desired result. Nunavut's Business Plan 2018–2021 only described structural changes, such as “expand the use of Telehealth” and “incorporation of traditional knowledge in programs” (Government of Nunavut 2018: 137, 138). The 2016–2021 Manitoba Cancer Plan monitored the number of “molecular tests made available” and “surgical leaders in the province” but had no process or outcome indicators (CancerCare Manitoba 2016: 31, 32). The Strategic Plan 2019–2022 of PEI's Department of Health and Wellness called for the “redevelopment of a provincial health plan” but had no quality indicators (PEI Department of Health and Wellness 2019: 7).
DATA AVAILABILITY
Some provinces acknowledged lack of data as a barrier to planning and aimed to address this gap. The 2016–2021 Manitoba Cancer Plan identified “Enhanced Reporting on Performance, Quality and Safety” as one of its six strategic objectives (CancerCare Manitoba 2016: 7). It proposed expanded health information system infrastructure, data collection on patient experience and public reporting of standardized indicators. Similarly, the Strategic Plan 2017–20 of the Newfoundland and Labrador Department of Health and Community Services (2017: 14) specified using eHealth technology and evidence to improve healthcare as a priority to inform future health planning and policy development.
Elsewhere, however, plans lacked targets despite evidence of rich data sources. For example, the Ontario Critical Care Plan 2018–2021 lists past accomplishments, such as an increase in the percentage of life-or-limb-threatening cases transported within four hours in one region or improved Intensive Care Unit-to-ward transfer times at one hospital (Critical Care Services Ontario 2018: 25). However, these indicators were not used for setting firm targets (Critical Care Services Ontario 2018: 22).
Discussion
This paper demonstrates wide variation between jurisdictions in Canada in planning for healthcare quality. Some jurisdictions had clear priorities, bold targets and a consistent method for reporting to the public on progress toward goals. In other jurisdictions, some or all of these elements were missing, resulting in plans that lacked clarity and ambition. We observed multiple examples of the lack of indicators, baselines and targets, as well as shifting or withdrawal of targets, minimal targets and targets announced only after the plan was complete.
Jurisdictions lacking a clear plan can still achieve improvement but must do so without the benefits of setting targets. Bold targets can mobilize the hearts and minds of workers within complex adaptive systems to move in the same direction. Don Berwick, former CEO of the Institute for Healthcare Improvement, used the phrase “some is not a number, soon is not a time” to launch the 100,000 Lives Campaign in 2004, aimed at recruiting American hospitals to implement six patient safety interventions to prevent this number of deaths within 18 months (Berwick et al. 2006: 325). Although the exact count of lives saved is disputed (Wachter and Pronovost 2006), even critics acknowledge the campaign's remarkable impact in galvanizing organizations toward a common goal.
Weak target setting is inconsistent with commonly used leadership frameworks. Kotter's “8 steps” for leading transformational change include “establishing a sense of urgency”, which corresponds to having a clear baseline that highlights problems requiring attention, and “creating a vision,” which corresponds to having bold targets (Kotter 1995: 61). Similarly, the Hoshin Kanri planning framework within Lean methodology (Zairi and Erskine 2015) emphasizes setting multi-year targets with yearly milestones and identifying actions at each organizational level to support the achievement of targets.
Our findings raise the question of why the clarity of planning varied widely. First, it is important to identify key actors involved in creating plans. Within governments, these include the ministers, senior civil servants and planning departments; within health authorities, these include the CEO, board, senior management and planners. One theory is that ministers are elected officials facing intense public scrutiny and may be more risk averse in planning. Risk aversion by the bureaucracy advising the minister may also be a contributing factor. Survey data demonstrate that public managers perceive a more risk-averse organizational culture compared with non-profit managers (Chen and Bozeman 2012) and that persons with low-risk tolerance are more likely to choose careers in government than in non-profit organizations or the private sector (Dong 2017). Higher job security may draw risk-averse individuals to the civil service (Lewis and Frank 2002) and rules-based processes may discourage risk-taking behaviour (Bozeman and Kingsley 1998). These factors could help explain why ministries had substantially lower scores than health authorities.
The government–media relationship may also contribute to risk aversion. Studies show that bad news predominates over good news (Stafford 2014; Vanderwicken 1995), likely due to greater consumer demand for negative stories (Trussler and Soroka 2014), which in turn is driven by the tendency of humans to pay more attention to negative events. This cognitive bias is believed to originate from a survival mechanism to quickly identify threats. Furthermore, when a negative event occurs, humans are more likely to attribute the outcome or “assign blame” to a particular actor compared with when a positive event occurs (Morewedge 2009). Hence, goal setting comes with high risk and low reward; failure generates more media attention, criticism from the opposition and blame on governments, but success is less likely to be noticed and attributed to government efforts.
Risk aversion theory, however, does not fully explain the observed variations and the reason why some jurisdictions, such as Quebec's MHSS, achieved high scores. Other explanations for variation include regional differences in political culture, government–media relations or communication strategies. One factor that may counter the negative impact of risk aversion is the well-documented intrinsic motivation of civil servants to serve the public good (Perry and Wise 1990). Future qualitative research should examine why some governments manage the risk of bold planning better than others.
The WHO's quality planning guidelines stipulate that governments should consult broadly with stakeholders in developing plans. It is not clear whether this has occurred in Canada; in all planning documents reviewed, there is no description of stakeholder consultations. Involving leaders of healthcare institutions, professional associations and patient groups increases support for the plan's goals and participation in its implementation. Furthermore, shared ownership of the plan could allow political risk to be shared, especially if the plan includes commitments by stakeholders to make measurable improvements that contribute to the plan. Future research should examine the degree of stakeholder input into planning and examine whether such input will lead to clearer, bolder plans.
The cause of the observed wide variation in scores is not known and warrants further investigation. One hypothesis is that Canada is a federation with limited ability to set national standards for quality planning. Another is that the larger and more complex the system, the more reluctant governments may be to set bold plans because complexity hinders the ability to influence actors and institutions. Although there is insufficient statistical power to test this hypothesis, it appears less likely as there are examples of large and small health systems within the highest and lowest rankings.
Another hypothesis is that some governments have chosen to delegate planning and target setting to health regions and consider this task to be operational. In two provinces with health authorities that achieved high scores, the ministry scored very low. Future research should explore this hypothesis. Even if policy makers believed that planning should be devolved to health regions, it would not explain the absence of targets in areas of the exclusive purview of the ministry.
Another potential cause of variation is that changes in government might lead to a ministry to stop progress reports until a new plan is released. There is insufficient data to examine this hypothesis because in most jurisdictions the political party did not change during the most recent plan. Future studies could examine changes in planning and reporting after elections with change in government.
One enabler of good planning is data, which requires significant investment. Lack of data was acknowledged in plans in Manitoba and Newfoundland, and both promised to establish measurement systems. Most jurisdictions participate in the National Ambulatory Care Reporting System and submit emergency department data allowing measurement of wait times but as of 2021/22, Newfoundland, New Brunswick and the Northwest Territories were not yet submitting data (CIHI n.d.b.). Similarly, PEI, Quebec, the Northwest Territories and Nunavut have not yet committed to measuring data using the Resident Assessment Instrument-Minimum Data Set in long-term care homes (CIHI n.d.a.). Investments to address these data gaps will require strong political will.
Few jurisdictions set stretch targets. One possible explanation is that planners are reluctant to commit to unrealistic targets, which could lead to the demotivation of staff. Another is a lack of knowledge on what constitutes an achievable stretch target. CIHI's Your Health System portal allows users to compare a hospital's results against averages for peer groups but does not report the best results attained by any institution (CIHI n.d.c.). Health Quality Ontario (n.d.) publicly reports which facilities have the lowest wait times. Such information could be used for target setting, but this information is subject to interpretation as superior results could be due to factors beyond the control of a health provider, such as differences in case-mix even after adjustment, available resources or geography. Ideally, research should be undertaken to determine if superior results obtained in some sites were due to skilful implementation of best practices or these other factors. If the former, then the result could serve as a benchmark.
Study Limitations
This study did not investigate the reasons why governments are reluctant to set targets. Future qualitative research using interviews with past and current public officials could provide insight.
Although the authors conducted an extensive search, it is possible that some plans were missed. This limitation was mitigated by asking the ministries of health and health authorities to identify missing sources or misinterpretations.
This paper only examined target setting. Other elements of good planning include the use of evidence to define priorities; the assignment of adequate resources; clear accountabilities for action; and stakeholder engagement. These items warrant further evaluation. Future research could also examine whether plans succeeded in their implementation.
Another limitation is that this paper is a cross-sectional analysis examining variations in planning based on the most recent plan. However, it is possible that scores may fluctuate over time, due to changes in risk-tolerance of government, technical knowledge of planners or other factors. Interestingly, while Nunavut had a score of zero, a previous public health plan developed in 2008 – before the study period – with multiple indicators and targets, would have scored highly (Government of Nunavut Department of Health and Social Services 2008). Future research could examine what factors lead to shifts in planning scores over time.
Conclusion
Governments and provincial health regions in Canada varied widely in the boldness and clarity of their plans for improving quality. Many jurisdictions appeared wary of setting targets for improvement, likely because of risk aversion to negative publicity if the target was missed. A few jurisdictions nonetheless developed bold plans. Future research should examine enabling factors for clear planning so that lessons can be shared with others.
Correspondence may be directed to Benjamin T.B. Chan by e-mail at drben.chan@utoronto.ca.
Dans quelle mesure les ministères canadiens de la Santé et les autorités sanitaires provinciales sont-ils timides ou audacieux dans la planification de la qualité des soins de santé?
Résumé
Introduction : Les lignes directrices de l'Organisation mondiale de la Santé (OMS) recommandent aux pays d'établir, pour leurs systèmes de santé, une planification de la qualité des soins qui comprend des priorités, des indicateurs et des objectifs clairs. Le présent document évalue dans quelle mesure les gouvernements fédéral, provinciaux et territoriaux du Canada appliquent ces principes.
Méthode : Nous avons évalué les plans, entre 2010 et 2019, de 14 ministères de la Santé, et quatre autorités sanitaires dans les provinces ayant une seule autorité, en fonction d'une grille qui tenait compte des indicateurs, des données de référence, des objectifs, des échéanciers et des rapports d'étape.
Résultats : Les cotes allaient de A+ à F avec un B/B- médian. Il y avait des indicateurs dans la plupart des administrations, mais seulement cinq des 18 administrations étudiées s'étaient dotées de bases de référence, d'objectifs numériques et d'échéanciers clairs. Des irrégularités ont été observées, comme des indicateurs vagues, l'établissement d'objectifs d'« amélioration » sans cibles, l'annonce de cibles seulement après la fin des plans, l'établissement de cibles minimales, l'élimination de cibles après les avoir ratées ou la caractérisation inappropriée des progrès.
Discussion : La plupart des gouvernements canadiens hésitent à fixer des objectifs pour la qualité. Nous supposons qu'il pourrait y avoir une crainte des critiques si les objectifs ne sont pas atteints. Cependant, plusieurs administrations se sont dotées de plans clairs et ambitieux qui pourraient servir d'exemples pour les autres.
About the Author(s)
Benjamin T.B. Chan, MD, MPH, MPA, Assistant Professor, Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Assistant Professor, Clinical Sciences Division, Northern Ontario School of Medicine, Sudbury, ON
Susmitha Rallabandi, MBBS, MPH, MPA, Research Coordinator, Independent Consultant, Toronto, ON
Dan Florizone, MBA, Executive-in-Residence, Johnson Shoyama Graduate School of Public Policy, University of Regina and University of Saskatchewan, Saskatoon, SK
References
Alberta Health Services (AHS). 2017. The 2017–2020 Health Plan and Business Plan. Retrieved July 26, 2023. <https://www.thebsf.ca/media/files/upload/3g.%20Alberta%20Health%20Services%20-%202017-2020%20Health%20Plan%20and%20Business%20Plan.pdf>.
Alberta Health Services (AHS). 2018. The 2017–2020 Health Plan and Business Plan: Year 2 of 3-Year Plan 2018/2019. Retrieved July 26, 2023. <https://www.albertahealthservices.ca/assets/about/org/ahs-org-hpbp-2017-2020.pdf>.
Alberta Health Services (AHS). 2019. The 2017–2020 Health Plan and Business Plan: Year 3 of 3-Year Plan 2019–2020. Retrieved July 26, 2023. <https://www.albertahealthservices.ca/assets/about/org/ahs-org-hpbp-2017-2020-year3.pdf>.
Berwick, D.M., D.R. Calkins, C.J. McCannon and A.D. Hackbarth. 2006. The 100,000 Lives Campaign: Setting a Goal and a Deadline for Improving Health Care Quality. JAMA 295(3): 324–27. doi:10.1001/jama.295.3.324.
Bozeman, B. and G. Kingsley. 1998. Risk Culture in Public and Private Organizations. Public Administration Review 58(2): 109–18. doi:10.2307/976358.
British Colombia Ministry of Health. 2019, February. 2019/20–2021/22 Service Plan. Retrieved July 26, 2023. <https://www.bcbudget.gov.bc.ca/2019/sp/pdf/ministry/hlth.pdf>.
Canadian Institute for Health Information (CIHI). n.d.a. Continuing Care Metadata. Retrieved August 10, 2021. <https://www.cihi.ca/en/continuing-care-metadata>.
Canadian Institute for Health Information (CIHI). n.d.b. NACRS Emergency Department Visits and Lengths of Stay by Province/Territory, 2021-22 (XLSX). Retrieved August 8, 2023. <https://www.cihi.ca/en/nacrs-emergency-department-visits-and-lengths-of-stay>.
Canadian Institute for Health Information (CIHI). n.d.c. Your Health System. Retrieved August 10, 2021. <https://yourhealthsystem.cihi.ca/hsp/?lang=en>.
Canadian Institute for Health Information (CIHI). 2019. CIHI: A History. Retrieved August 10, 2021. <https://www.cihi.ca/en/cihi-a-history>.
CancerCare Manitoba. 2016. Delivering Excellence: 2016–2021 Manitoba Cancer Plan. Retrieved July 25, 2023. <https://www.iccp-portal.org/system/files/plans/Manitoba_Cancer_Plan_2016-2021.pdf>.
Cancer Care Ontario. 2019a. Ontario Cancer Plan 5 2019–2023. Retrieved July 25, 2023. <https://www.cancercareontario.ca/en/cancerplan>.
Cancer Care Ontario. 2019b. Access to Care Plan 2019–2023. Retrieved July 25, 2023. <https://www.publications.gov.on.ca/CL29550>.
Chan, B.T.B., J.H.M. Veillard, K. Cowling, N.S. Klazinga, A.D. Brown and S. Leatherman. 2019. Stewardship of Quality of Care in Health Systems: Core Functions, Common Pitfalls, and Potential Solutions. Public Administration and Development 39(1): 34–46. doi:10.1002/pad.1835.
Chen, C.A. and B. Bozeman. 2012. Organizational Risk Aversion: Comparing the Public and Non-Profit Sectors. Public Management Review 14(3): 377–402. doi:10.1080/14719037.2011.637406.
The Collaborative for Excellence in Healthcare Quality. 2012, February. A Guide to Developing and Assessing a Quality Plan. Retrieved August 10, 2021. <https://www.longwoods.com/articles/images/Guide-Developing-and-Assessing-a-Quality-Plan.pdf>.
Collins, J. and J.I. Porras. 2005. Built to Last: Successful Habits of Visionary Companies. Random House Business Books.
Critical Care Services Ontario. 2018, December 19. Ontario Critical Care Plan 2018–2021. Retrieved July 25, 2023. <https://criticalcareontario.ca/wp-content/uploads/2020/10/CCSO-Strat-Plan-2018-2021-Feb-4-flat.pdf>.
Donabedian, A. 1966. Evaluating the Quality of Medical Care. The Milbank Memorial Fund Quarterly 44(3): 166–206. Doi:10.2307/3348969.
Donabedian, A. 1988. The Quality of Care: How Can It Be Assessed? JAMA 260(12): 1743–48. Doi:10.1001/jama.1988.03410120089033.
Dong, H.-K.D. 2017. Individual Risk Preference and Sector Choice: Are Risk-Averse Individuals More Likely to Choose Careers in the Public Sector? Administration & Society 49(8): 1121–42. doi:10.1177/0095399714556500.
Doran, G.T. 1981. There's a S.M.A.R.T. Way to Write Management's Goals and Objectives. Management Review 70(11): 35–36.
Excellent Care for All Act, 2010, S.O. 2010, c. 14. Government of Ontario. Retrieved July 15, 2023. <https://www.ontario.ca/laws/statute/10e14>.
Gouvernement du Québec. 2015. Plan stratégique du ministère de la Santé et des Services sociaux du Québec 2015–2020. Retrieved July 25, 2023. <https://cdn-contenu.quebec.ca/cdn-contenu/adm/min/sante-services-sociaux/publications-adm/plan-strategique/PL_17-717-01W_MSSS.pdf>.
Gouvernement du Québec. 2016. Rapport annuel de gestion du ministère de la Santé et des Services sociaux 2015–2016. Retrieved July 25, 2023. <https://publications.msss.gouv.qc.ca/msss/fichiers/2016/16-102-01W.pdf>.
Gouvernement du Québec. 2017. Rapport annuel de gestion du ministère de la Santé et des Services sociaux 2016–2017. Retrieved July 25, 2023. <https://cdn-contenu.quebec.ca/cdn-contenu/adm/min/sante-services-sociaux/publications-adm/rapport-annuel-de-gestion/RA_17-102-01W_MSSS.pdf>.
Gouvernement du Québec. 2019a. Rapport annuel de gestion du ministère de la Santé et des Services sociaux 2017–2018. Retrieved July 25, 2023. <https://cdn-contenu.quebec.ca/cdn-contenu/adm/min/sante-services-sociaux/publications-adm/rapport-annuel-de-gestion/RA_18-102-01W_MSSS.pdf>.
Gouvernement du Québec. 2019b. Rapport annuel de gestion du ministère de la Santé et des Services sociaux 2018–2019. Retrieved July 25, 2023. <https://cdn-contenu.quebec.ca/cdn-contenu/adm/min/sante-services-sociaux/publications-adm/rapport-annuel-de-gestion/RA_19-102-01W_MSSS.pdf>.
Government of New Brunswick. 2015. Health Annual Report 2014–2015. Retrieved July 26, 2023. <https://www2.gnb.ca/content/dam/gnb/Departments/h-s/pdf/en/Publications/AnnualReport_2014-2015.pdf>.
Government of New Brunswick. 2016. Health Annual Report 2015–2016. Retrieved July 26, 2023. <https://www2.gnb.ca/content/dam/gnb/Departments/h-s/pdf/en/Publications/AnnualReport_2015-2016.pdf>.
Government of New Brunswick. 2017. Health Annual Report 2016–2017. Retrieved July 26, 2023. <https://www2.gnb.ca/content/dam/gnb/Departments/h-s/pdf/en/Publications/AnnualReport_2016-2017.pdf>.
Government of New Brunswick. 2018. Health Annual Report 2017–2018. Retrieved July 26, 2023. <https://www2.gnb.ca/content/dam/gnb/Departments/h-s/pdf/en/Publications/AnnualReport_2017-2018.pdf>.
Government of New Brunswick. 2019. Health Annual Report 2018–2019. Retrieved July 26, 2023. <https://www2.gnb.ca/content/dam/gnb/Departments/h-s/pdf/en/Publications/AnnualReport_2018-2019.pdf>.
Government of Nunavut. 2018. Business Plan: Government of Nunavut & Territorial Corporations, 2018–2021. Retrieved July 26, 2023. <https://www.gov.nu.ca/sites/default/files/2018-2021_business_plan-eng.pdf>.
Government of Nunavut Department of Health and Social Services. 2008. Developing Healthy Communities: A Public Health Strategy for Nunavut 2008–2013. Retrieved July 25, 2023. <https://www.gov.nu.ca/sites/default/files/files/Public%20Health%20Strategy%20-%20English%20final.pdf>.
Health Canada. 2003, February 5. 2003 First Ministers' Accord on Health Care Renewal. Retrieved August 10, 2021. <http://www.scics.gc.ca/CMFiles/800039004_e1GTC-352011-6102.pdf>.
Health Canada. 2019. 2019–20 Departmental Plan. Retrieved July 26, 2023. <https://www.canada.ca/content/dam/hc-sc/documents/corporate/transparency/corporate-management-reporting/report-plans-priorities/2019-2020-report-plans-priorities/2019-2020-dp-eng.pdf>.
Health PEI. 2018, November. Business Plan 2018–2019. Retrieved July 26, 2023. <https://www.princeedwardisland.ca/sites/default/files/publications/health_pei_business_plan_2018-2019.pdf>.
The Health Quality Council Act, SS 2002, c H-0.04. CanLII. Retrieved August 11, 2023. <https://www.canlii.org/en/sk/laws/stat/ss-2002-c-h-0.04/latest/ss-2002-c-h-0.04.html>.
Health Quality Council of Alberta Act. 2011. Province of Alberta. Retrieved August 10, 2021. <https://hqca.ca/wp-content/uploads/2020/09/Health-Quality-Council-of-Alberta-Act.pdf>.
Health Quality Ontario. n.d. System Performance: Time Spent in Emergency Departments. Retrieved August 10, 2021. <https://www.hqontario.ca/System-Performance/Time-spent-in-emergency-departments>.
Health Shared Services Ontario. 2018, Annual Business Plan / Health Shared Service Ontario 2018/19. Retrieved July 25, 2023. <https://www.publications.gov.on.ca/annual-business-plan-health-shared-service-ontario-2018-2019>.
Kotter, J.P. 1995. Leading Change: Why Transformation Efforts Fail. Harvard Business Review: 59–67.
Lewis, G.B. and S.A. Frank. 2002. Who Wants to Work for the Government? Public Administration Review 62(4): 395–404. doi:10.1111/0033-3352.00193.
Locke, E.A. and G.P. Latham. 2002. Building a Practically Useful Theory of Goal Setting and Task Motivation: A 35-Year Odyssey. American Psychologist 57(9): 705–17. doi:10.1037/0003-066X.57.9.705.
Milligan, C., S. Allin, M. Farr, E. Farmanova, A. Peckham, J. Byrd et al. 2021. Mandatory Reporting Legislation in Canada: Improving Systems for Patient Safety? Health Economics, Policy and Law 16(3): 355–70. doi:10.1017/S1744133121000050.
Morewedge, C.K. 2009. Negativity Bias in Attribution of External Agency. Journal of Experimental Psychology: General 138(4): 535–45. doi:10.1037/a0016796.
Newfoundland and Labrador Department of Health and Community Services. 2017. Strategic Plan 2017–20. Retrieved July 26, 2023. <https://www.gov.nl.ca/hcs/files/publications-hcsstrategicplan2017-20.pdf>.
Nova Scotia Department of Health and Wellness. 2018, March. Business Plan 2018–19. Retrieved August 10, 2023. <https://beta.novascotia.ca/sites/default/files/documents/1-1903/business-plan-2018-19-department-health-and-wellness-en.pdf>.
Nova Scotia Department of Health and Wellness. 2019, March. Business Plan 2019–20. Retrieved July 25, 2023. <https://beta.novascotia.ca/sites/default/files/documents/1-1902/business-plan-2019-20-department-health-and-wellness-en.pdf>.
Nova Scotia Health Authority (NSHA). n.d.a. Healthier Together: 2016–19 Strategic Plan. Retrieved July 1, 2019. <https://www.nshealth.ca/sites/nshealth.ca/files/nsha-measuring_our_progress.pdf>.
Nova Scotia Health Authority (NSHA). n.d.b. Healthier Together 2016–19: Measuring Our Progress. Retrieved July 25, 2023. <https://www.nshealth.ca/sites/nshealth.ca/files/nsha-measuring_our_progress.pdf>.
Nova Scotia Health Authority (NSHA). 2016, June. Macro Key Performance Indicators. Retrieved July 26, 2023. <https://www.nshealth.ca/sites/nshealth.ca/files/nsha_accountability_agreement_-_macro_indicator_report_annual_report_fy15-16.pdf>.
Nova Scotia Health Authority (NSHA). 2017, July. Macro Key Performance Indicators. Retrieved July 26, 2023. <https://www.nshealth.ca/sites/nshealth.ca/files/nsha_accountability_agreement_-_macro_indicator_report_annual_report_fy16-17.pdf>.
Ontario's Mental Health & Addictions Leadership Advisory Council. 2017. Mental Health and Addictions: Realizing the Vision. Government of Ontario. Retrieved July 25, 2023. <https://www.health.gov.on.ca/en/common/ministry/publications/reports/bmhmbh_2017/vision_2017.pdf>.
Ontario Ministry of Health and Long-Term Care (MOHLTC). 2013, April. Make No Little Plans: Ontario's Public Health Sector Strategic Plan [Archived]. Government of Ontario. Retrieved July 25, 2023. <https://news.ontario.ca/en/backgrounder/25296/make-no-little-plans-ontarios-public-health-sector-strategic-plan>.
Ontario Ministry of Health and Long-Term Care (MOHLTC). 2015, February. Patients First: Action Plan for Health Care. Retrieved July 25, 2023. <https://www.health.gov.on.ca/en/ms/ecfa/healthy_change/docs/rep_patientsfirst.pdf>.
Ontario Ministry of Health and Ministry of Long-Term Care. 2017, April. Patients First: Action Plan For Health Care – Year-Two Results. Retrieved July 25, 2023. <https://www.health.gov.on.ca/en/ms/ecfa/healthy_change/docs/year_two_results_action_plan_en.pdf>.
Ontario Ministry of Health and Ministry of Long-Term Care. 2018. Smoke-Free Ontario: The Next Chapter – 2018 – for a Healthier Ontario. Retrieved July 25, 2023. <https://www.health.gov.on.ca/en/common/ministry/publications/reports/SmokeFreeOntario/SFO_The_Next_Chapter.pdf>.
Ontario Renal Network. 2019. Ontario Renal Plan 3 2019–2023. Retrieved July 25, 2023. <https://www.ontariorenalnetwork.ca/en/renalplan>.
Perry, J.L. and L.R. Wise. 1990. The Motivational Bases of Public Service. Public Administration Review 50: 367–73. doi:10.2307/976618.
Prince Edward Island (PEI) Department of Health and Wellness. 2019. Strategic Plan 2019–2022. Retrieved July 26, 2023. <https://www.princeedwardisland.ca/sites/default/files/publications/dohwstrategicplan20192022.pdf>.
Public Health Ontario. 2013. Strategic Plan 2014–2019. Retrieved July 25, 2023. <https://www.publichealthontario.ca/-/media/Documents/S/2013/strategic-plan-2014-19.pdf?rev=2669300c21194dc7887e14016eba6f9b&sc_lang=en>.
Rousseau, D.M. 1997. Organizational Behavior in the New Organizational Era. Annual Review of Psychology 48(1): 515–46. doi:10.1146/annurev.psych.48.1.515.
Saskatchewan Health Authority (SHA). n.d. Health System Strategic Plan 2019–2020. Retrieved July 4, 2019. <https://www.saskhealthauthority.ca/our-organization/reports-publications>.
Saskatchewan Ministry of Health. n.d.a. Plan for 2018–19. Retrieved August 11, 2023. <https://pubsaskdev.blob.core.windows.net/pubsask-prod/106275/106275-HealthPlan1819.pdf>.
Saskatchewan Ministry of Health. n.d.b. Plan for 2019–20. Retrieved July 26, 2023. <https://pubsaskdev.blob.core.windows.net/pubsask-prod/110564/110283-HealthPlan1920.pdf>.
Saskatchewan Ministry of Health. 2019. Annual Report for 2018–19. Retrieved July 26, 2023. <https://pubsaskdev.blob.core.windows.net/pubsask-prod/112662/2018-19HealthAnnualReport.pdf>.
Sherman, S. 1995, November 13. Stretch Goals: The Dark Side of Asking for Miracles. Fortune (pp. 231–32). Retrieved January 11, 2022. <http://www.iot.ntnu.no/innovation/norsi-pims-courses/huber/Kerr%20in%20Fortune.pdf>.
Stafford, T. 2014, July 28. Psychology: Why Bad News Dominates the Headlines. BBC. Retrieved August 10, 2021. <https://www.bbc.com/future/article/20140728-why-is-all-the-news-bad>.
Thompson, K.R., W.A. Hochwarter and N.J. Mathys. 1997. Stretch Targets: What Makes Them Effective? Academy of Management Perspectives 11(3): 48–60. doi:10.5465/ame.1997.9709231663.
Trussler, M. and S. Soroka. 2014. Consumer Demand for Cynical and Negative News Frames. The International Journal of Press/Politics 19(3): 360–79. doi:10.1177/1940161214524832.
Vanderwicken, P. 1995. Why the News Is Not the Truth. Harvard Business Review. Retrieved August 10, 2021. <https://hbr.org/1995/05/why-the-news-is-not-the-truth>.
Wachter, R.M. and P.J. Pronovost. 2006. The 100,000 Lives Campaign: A Scientific and Policy Review. The Joint Commission Journal on Quality and Patient Safety 32(11): 621–27. doi:10.1016/S1553-7250(06)32080-6.
World Health Organization (WHO). n.d. Country Planning Cycle Database: Health Planning, Governance, Aid Effectiveness & Support Towards Universal Health Coverage. Retrieved August 10, 2021. <https://extranet.who.int/countryplanningcycles/>.
World Health Organization (WHO). 2018. Handbook for National Quality Policy and Strategy: A Practical Approach for Developing Policy and Strategy to Improve Quality of Care. Retrieved August 10, 2021. <https://www.who.int/publications/i/item/9789241565561>.
Yukon Department of Health and Social Services. 2014, December. Performance Measure Framework 2014–2019. Authors.
Zairi, M. and A. Erskine. 2015. Excellence is Born Out of Effective Strategic Deployment: The Impact of Hoshin Planning. International Journal of Applied Strategic Management 2(2): 1–28.
Comments
Be the first to comment on this!
Personal Subscriber? Sign In
Note: Please enter a display name. Your email address will not be publically displayed