Nurse staffing and patient-perceived quality of nursing care: a cross-sectional analysis of survey and administrative data in German hospitals

The present study aims to shed further light on the association between nurse staffing and patient-perceived quality of nursing care. In particular, we examine this relationship between nurse staffing levels, nurse skill mix and patient-perceived quality of nursing care based on large-scale survey data combined with administrative data. Especially the use of a multidimensional survey instrument reflecting the patient perspective on nursing quality for measuring this relationship is quite novel. Second, we addressed substantial parts of potential endogeneity by including a rich set of patient-related and hospital-related control variables. Thereby, we specifically consider physician staffing and investigate to which degree physician staffing is a relevant predictor of patient-perceived quality of nursing care. In addition, we apply a fixed effects model to account for differences across hospital unit types, which seems important to reduce endogeneity problems. Finally, we allow for non-linear effects of nurse staffing on quality of nursing care and conduct subgroup analyses on patient case severity, hospital size, and medical versus surgical hospital units.

Methodologically, examining the link between nurse staffing and patient outcomes is at risk of endogeneity problems, such as omitted variable bias (eg, skill mix, hospital-unit-type and patient characteristics, or physician staffing could all be related to nurse staffing and patient outcomes) or endogenous sorting (whereby hospitals devote more resources to patients with a higher risk of adverse outcomes). 1 4 8 16 27 The risk of endogeneity increases with the level of aggregation; as many studies use staffing information at the aggregated hospital level, 6 17 20 21 28 29 they do not consider important information at the level of hospital units 7 30 31 or of patients. 16 32 At the other extreme, using microlevel data on the patient level 32 33 usually implies substantial primary data collection efforts and a focus on one or few organisations, hence limiting generalisability. As an in-between approach, the number of studies using data at the level of hospital units has grown, 7 31 34–39 yet often suffers from limited sample sizes both in terms of patients and hospitals. 15 In addition, recent evidence hints to the fact the effect of nurse staffing on quality of nursing care non-linear, that is, the effect of an additional nurse per patient might be high if nurse staffing is low; with higher numbers of nurses, the effect of each additional nurse probably decreases. 15 Furthermore, recent studies indicate that the association between nurse staffing and patient outcomes can differ depending on patients’ case severity, 8 40 hospital size, 6 41 and between medical versus surgical units. 8 28 Yet most of these studies have analysed the associations between nurse staffing and clinical patient outcomes.

Several empirical studies that have analysed the relationship between nurse staffing levels and perceived quality of care have considered the nurse’s rather than the patient’s perspective. 19–22 While the former is of course crucial, there is evidence that nurses’ perceptions of the quality of their work can deviate substantially from the patients’ perceptions. 23 In addition, most studies that have analysed quality of care as an outcome have used measures that are very general (eg, single items to rate overall quality of care or patient safety). 17 22 24 25 Outcome measures like these are less informative about the quality of care provided by nurses and therefore potentially less sensitive to nurse staffing. Some studies have used multidimensional constructs of patient satisfaction or patient experience with care. Yet, these constructs usually comprise dimensions and indicators that do not relate to nursing care, but other aspects, such as responsiveness of hospital staff, discharge information, and overall hospital rating, all of which are also indicators of other health professionals’ quality of care. 11 16 20 26 Only a handful of studies have used items that ask directly about the quality of care provided by nurses, or quality of nursing care. 20–22 To our knowledge, no studies to date have used a validated, multiitem, and multidimensional scale for patient-perceived quality of nursing care.

Nurses are responsible for delivering the highest proportion of care to patients in hospitals and therefore a main contributor to quality of hospital care. Nurses who work on units with inadequate staffing are probably not working as effective and efficient as nurses on better-staffed and better-skilled units. As a result, nurses do not have enough time for providing care and instructions, observe vital signs timely, and to respond to patients’ individual needs., which leads to missed care and ultimately unfavourable clinical patient outcomes and bad patient experiences and perceptions of quality of care. A large body of empirical studies, including several literature reviews and meta-analyses, has examined how nurse staffing levels affect patient outcomes. 1–10 Most studies have thereby relied on clinical outcomes available in administrative data and, for example, found significant effects of nurse staffing on mortality, pressure ulcers, and pneumonia. 3 Several studies depict that the effect of inadequate nurse staffing on adverse events is through missed care. 11–13 In light of calls for care (and, indeed, research) to be more patient oriented and for health systems to become more responsive to patient needs and expectations, 14–16 the number of studies examining links between nurse staffing patterns and patient experiences of care—that is, perceived quality of care—has steadily grown. 15–17 In addition, in the wake of many studies on the effects of skill mix on clinical outcomes, 3 recent studies investigated the association between skill mix and patient-perceived quality of care. 15 18 19

This study is part of a larger project on the association between nurse staffing and quality of care. 3 42 43 The public, that is, a statutory health insurance, hospital managers and patient representatives were involved in the design of the overall project. In addition, patients, practitioners (nurses, physiotherapists, doctors) and scientific experts were involved in the development of the survey (described in more detail in Refs. 3 43 ). Results of the study and the overall project will be disseminated to the participants via the statutory health insurance and via additional practice-oriented publications and newsletters.

Moreover, we conducted subgroup analyses. As suggested by previous studies, the association between nurse staffing and patient outcomes can differ depending on patients’ case severity. 8 40 To study these potential differences, we split our sample into patients with low case severity (PCCL=0) and those with high case severity (PCCL >0) and estimated our main regression model for each of the subsamples. Additionally, we considered that our results might vary due to differences in hospital size. 6 41 We therefore split our sample into two categories—that is, patients admitted to hospitals with fewer than 500 beds (category ‘small’) and patients admitted to hospitals with at least 500 beds (category ‘large’). Lastly, by categorising our unit types as medical or surgical, we estimated our statistical model separately for medical and surgical patients.

where is the value of one of the three factors for patient i admitted to unit type . is the intercept of the regression. and with coefficients and are the mean-centred independent nurse staffing variables of interest, which correspond to the patient-to-nurse and skill mix ratio of the hospital unit associated with patient i minus the group means and for each unit type u . Assuming that the marginal effect of the PTN on quality of nursing care decreases as staffing levels increase, we also included a squared patient-to-nurse term with coefficient . and are the coefficients of the between-unit effects. represents a vector of patient-unit-related, hospital-unit-related, and hospital-unit-related control variables at level one of the model. First, it includes the patient-to-physician (PTP) ratio, because it might correlate with the PTN ratio and also affect the outcome. 27 Second, we account for in patient risks by including age, gender, and each patient’s case severity reflected by the Patient Clinical Complexity Level (PCCL) index (0–6), which indicates the degree of comorbidities and complications for each patient. It is derived from a closed list of comorbidities and complications and is meant to predict a patient’s need for hospital resources, such as nursing care. 45 We directly incorporate the PCCL index in our model because sensitivity analyses using dummy variables for each score suggested a linear relationship. Furthermore, we control for the rurality of each patient’s place of residence using an index ranging from one (urban area) to four (rural area), four hospital size categories (50—299, 300—499, 500—749 and at least 750), and monthly fixed effects. refers to the fixed effects for the 24 hospital unit types.

We calculated each dimension of quality of nursing care by taking the arithmetic mean of the underlying items after recoding reverse-coded items. Dimensions 1 and 2 are on a scale of 1 to 5, with 5 representing the best quality of nursing care, and dimension 3 is on a scale of 1–4, with 4 representing the best quality of nursing care. Dimension one represents patients’ perception of the general quality of nursing care. Dimension 2 represents patients’ perception of the guidance provided by nurses. Dimension 3 comprises two items that capture patients’ loyalty to a hospital based on the nursing care provided.

Because the definition of nursing care varies from country to country, it is necessary to use an instrument that takes country-specific regulations into account. We therefore chose the Patients’ Experience of Nursing Quality in Acute Hospitals (PENQuAH) instrument developed by Blume to analyse the relationship between nurse staffing and patient outcomes. 43 The instrument was designed to evaluate patients’ perceptions of quality of nursing care in German hospitals. The instrument consists of 24 items, which were chosen based on a review of the literature and interviews with nursing experts. To examine the scale’s dimensionality and factor-based validity, Blume conducted exploratory and confirmatory factor analyses with a randomly split sample. 43 Their exploratory factor analysis revealed that three main dimensions captured the structure of the underlying item set: general nursing care, guidance provided by nurses, and nurse-related patient loyalty to the hospital. The results of their confirmatory factor analysis suggested a good overall model fit (CFI=0.978; TLI=0.976). Table 1 shows the three dimensions and exemplary related items.

The total number of nurses (based on full-time nurses employed) comprise all registered nurses with at least 3 years of training and assistant nurses with at least 1 year of training. The numbers are derived from the annual quality reports of each hospital, representing the situation at the end of the year and not accounting for sickness absences or other sources of within-year variations such as variation caused by holidays. To calculate occupation days, we used the number of inpatients and approximated the average length of stay or each hospital unit based on the average length of stay of more than 6.2 million inpatient cases available in our claims data set over the period 2014 to 2019. We draw on the 5-year period for this approximation because we cannot observe all patients in each hospital unit in 1 year; to ensure robustness, we considered only those hospital units with more than 150 observations to approximate the length of stay.

The claims data in our data set contained patient-level information about the course of disease during each patient’s hospital stay, as well as the dates of hospital admission and discharge, the type of hospital unit and ICD (International Statistical Classification of Diseases and Related Health Problems) codes. The quality reports contained general information at the hospital unit level, such as the number of patient cases treated and staffing numbers that relate to the situation at the end of 2017.

This study is part of a larger project on the association between nurse staffing and quality of care. 3 42 43 Our study analysed data from an online patient survey. To ensure the quality of the survey, we followed the scientific standards for scale development. The entire development and validation of the survey is described elsewhere. 43 To sum up our proceeding, we drew on a systematic literature search and expert interviews to derive our initial items. We conducted two pretests (one paper and pencil pretest and one online pretest) with different participants and collected, discussed and reported all changes made to the survey. After data collection, we performed comprehensive exploratory and confirmatory factor analyses to ensure the validity and reliability of the survey. We combined the survey data with (1) claims data provided by the largest statutory health insurance fund in Germany and (2) data from the mandatory quality reports published annually by each hospital in the country. The combined data set comprised data from patients discharged from non-paediatric, non-intensive and non-psychiatric hospital units between January and October 2019. We define a hospital unit as an operating unit within a hospital that focuses on specific types of patients (eg, geriatrics or cardiology). Our sample included only those patients who stayed at least two nights in the hospital. We contacted patients in monthly waves and asked them to participate in the survey, 8 weeks after they had been discharged from the hospital at the latest. The survey contained questions related to patients’ perceptions of the quality of the nursing care provided during their hospital stay. Each patient was contacted only once. In total, we contacted 212 554 patients, of whom 30 174 responded, yielding a response rate of 14.2%. The response rate is comparable to other large-scale patient surveys. We checked for representativeness of the study population. Compared with the general population of hospitalised patients in Germany, our sample is generally representative in observable characteristics. Only the share of patients older than 80 is lower in our sample compared with the general population of hospitalised patients in Germany. We also compared respondents to non-respondents and did not find any substantial deviations in observable characteristics.

Finally, when we divided patients into those admitted to medical or surgical units, we found that the PTN significantly affected perceptions of guidance by nurses and nurse-related patient loyalty for medical patients only. The associations between the skill mix ratio and quality of nursing care seem largely unaffected by the sample split. Finally, it shows that medical patients were more sensitive to physician staffing compared with surgical patients (see online supplemental appendix 7 ).

When splitting our sample into patients admitted to a hospital with fewer than 500 beds and those admitted to a hospital with at least 500 beds, we found that an increase in the PTN significantly decreased general nursing care and nurse-related patient loyalty only for patients admitted to hospitals with fewer than 500 beds. Skill mix significantly affected general nursing care perceptions and nurse-related patient loyalty in small hospitals only, while it significantly affected the perception of guidance provided by nurses in small and in large hospitals. Moreover, we found a significant association between physician staffing and patient-perceived quality of nursing care for patients admitted to larger hospitals but not for patients admitted to smaller ones (see online supplemental appendix 6 ).

Differentiating between patients according to their case severity, we found that the mean-centred PTN and its square are significantly associated with all three dimensions of patient-perceived quality of nursing care for patients with low case severity, but not for those with high case severity. The effects of the skill-mix ratio are also only significant for patients with low case severity, while the effects of the PTP ratio are slightly larger and only significant for high-case severity patients (except for general nursing care) (see online supplemental appendix 5 ).

The regression results of the logit model indicated that an additional patient per nurse decreases the odds of a patient reporting high quality of nursing care. For nurse-related patient loyalty, this effect is significantly non-linear in the same way as in our main model (stated above). Increasing the share of assistant nurses decreases the odds of reporting high quality. An additional patient per physician does not significantly decrease the odds of reporting a high quality of quality of nursing care (see online supplemental appendix 3 ).

As shown in table 3 , our results indicate that the two nurse staffing variables were significantly related to quality of nursing care. An increase in the PTN significantly decreased the general quality of nursing care, the patient perception of nursing guidance, and nurse-related patient loyalty to a given hospital. Additionally, there were significantly positive associations between the squared PTN, on the one hand, and the general quality of nursing care, guidance and patient loyalty, on the other. Hence, the negative effect of the PTN is greater when the PTN is smaller (in other words, if a nurse already has to care for a lot of patients, one additional patient has a less strong effect on quality perceptions). We illustrate the non-linear relationship in online supplemental appendix 2 (for factor 1).

After excluding extreme values for our nurse staffing variables and removing observations with missing values for one or more of the control variables, our final sample comprised 28 136 patients ranging from 18 to 97 years of age (average: 61.12 years) who had been discharged from 3458 distinct hospital units in 1017 hospitals. 39.2% of the survey participants were female. table 2 illustrates the distribution of patients and the average response for each of the three dimensions of quality of nursing care across the 24 types of hospital units. Overall, the variation in the distribution of patients across the 24 unit types was large. Almost 50% of the patients had been discharged from general surgery or internal medicine, followed by orthopaedics, urology, neurology, trauma surgery and cardiology, from each of which between 6% and 10% of the patients had been discharged. All of the other unit types each accounted for less than 3% of the patients in our sample. In terms of our dependent variable, quality of nursing care, we obtained an average response of 4.33, 3.77 and 3.38 for the three dimensions general nursing care, guidance provided by nurses, and nurse-related patient loyalty to the hospital, respectively, indicating that the perceived quality of nursing care was above the scale average for each. In addition, we found that patient perception of the guidance provided by nurses was, on average, 0.56 scale points lower compared with the general perception of quality of nursing care. We also found that the average responses varied across hospital unit types. For instance, for dimensions 1 and 2, the average responses for patients discharged from internal medicine were 0.24 and 0.46 scale points lower, respectively, compared with orthopaedic patients.

Discussion

Our results provide important new insights into the relationship between nurse staffing and patient outcomes, in particular, patient-perceived quality of nursing care. We found that patient-perceived quality of nursing care significantly decreased as staffing levels, measured using the PTN, decreased. This finding is in line with previous research that has examined the relationship between nurse staffing levels and general perceived quality of care measures.15 16 19–22 25 26 47–49 Our study adds to the previously ambiguous evidence in literature by providing insights into the specific aspects of perceived quality of nursing care that are affected by staffing levels. Evidence on the perceived quality of guidance provided by nurses has been inconsistent and scarce.20 22 Our results, however, corroborate and extend the findings of Zhu et al,22 who found that higher staffing levels improved satisfaction with nurses’ guidance on medications and medical aids, pain management, and self-help.22 With respect to nurse-related patient loyalty, our results confirm the findings of previous studies that have found that higher nurse staffing levels in hospitals increase the likelihood of patients generally recommending a hospital to family and friends.20 21 Thus, nurse-related patient loyalty seems to be highly related to overall recommendation behaviour. In sum, staffing levels affect whether an adequate amount of time is devoted to caring and providing instructions as well as nurses’ responsiveness to patients’ individual needs. Furthermore, nurse staffing levels have direct consequences for hospitals in terms of patient loyalty. Yet, those effects are not linear; instead, the negative effects become smaller with rising numbers of patients per nurse. This decreasing marginal effect of the PTN on quality of nursing care with increasing staffing levels is in line with prior research15 and seems reasonable: when the ratio is small, each additional patient will substantially affect the amount of time and the responsiveness of a nurse, thus probably substantially reducing missed care.11–13 In contrast, the effect will be lower when a nurse already needs to care for a high number of (potentially less complex) patients and each additional patient only has a low impact.

Our results suggest that the nurses’ level of educational attainment, as measured using the skill-mix ratio, significantly influences patient-perceived quality of nursing care. This finding adds to the few available studies on the relationship between skill mix and patient-perceived quality of care.15 18 19 We found strong evidence that a higher proportion of assistant nurses, which means a lower proportion of professionalisation among nursing staff, is negatively associated with all three dimensions of quality of nursing care. Nurses with lower levels of educational attainment may have less training in interacting with patients, might work less efficiently and hence have less time per patient, or both. In addition, it is conceivable that they are less experienced in providing instructions suited to a patient’s particular needs—for example, with regard to medication, pain relief, or the use of medical aids. Any of these factors could lead to negative perceptions among patients of quality of nursing care and potentially also to an increased number of adverse events.8 17 50

We found that one additional patient per physician significantly reduced all three dimensions of patient-perceived quality of nursing care. This is in line with the findings of, for example, West et al,51 who found that both physician and nurse staffing impact intensive care unit patient mortality. However, we found that the effect sizes for physician staffing were less pronounced compared with those for nurse staffing levels, indicating that our instrument is more closely related to nurse staffing than to physician staffing. This result might indicate that patients are not fully capable of differentiating between different occupational groups when assessing quality of care in hospitals. Another explanation might be that physician staffing does in fact have an impact on quality of nursing care; if physicians have to care for a large number of patients, they might omit passing on information which nurses need to adequately care for a patient—for example, information on the patients’ needs or patient-specific treatment instructions. Additionally, stressed physicians might cause a bad civility climate, which in turn negatively impacts nurses’ civility towards patients.52 53

The significant association we observed between the PTN and patient-perceived quality of nursing care was driven mainly by low-severity patients. This stands in contrast to the study of West et al,51 which found that reductions in mortality risks from having more intensive care unit nurses is larger for patients who are the most severely ill. This might indicate that the effect of nurse staffing differs across hospital units (in particular, intensive vs non-intensive care) and/or across outcomes (in that case, patient-perceived quality of care and mortality). Additionally, for low-severity patients, the share of assistant nurses affects their perceptions of quality of nursing care, while for high-severity patients, the PTP ratio affects their perceptions of quality of nursing care. Because high-severity patients are more dependent on various health professionals and their collaborative performance, the quality of cooperation and consistency within and across occupational groups might explain their perceptions of quality of nursing care rather than staffing levels and skill mix.53 Low-severity patients might be less relying on different professionals, so that the composition of the nurses, as expressed in their skill mix, is of greater relevance to them.

Similarly, splitting our sample using two separate bed categories reveals that an increase in the PTN decreases patient-perceived quality of nursing care among patients admitted to hospitals with fewer than 500 beds rather than for patients admitted to hospitals with at least 500 beds. Yet, the patient-perceived guidance is only significantly affected by staffing levels in large hospitals (significant non-linear effect). While skill mix significantly affects patient-perceived general nursing care and loyalty in smaller hospitals only, it significantly relates to guidance in both small and large hospitals. Thus, we see some variation in how our variables of interest relate to the different quality of nursing care dimensions. The PTP ratio in turn only significantly affects patient-perceived quality of nursing care in large hospitals for all three quality of nursing care dimensions. This might be explained by a higher proportion of high-severity patients admitted to larger and potentially more highly specialised hospitals. In addition, in larger hospitals, collaboration across different occupational groups might be of higher importance than in smaller hospitals.

The stronger statistical significance of the relationship between nurse and physician staffing levels and quality of nursing care for medical patients compared with surgical patients seems plausible, as well. For nurse staffing, the finding is in line with previous studies that have analysed the relationship between nurse staffing levels and patient outcomes based on administrative data and found stronger associations for medical patients.8 The difference in effects might be explained by surgical patients being healthier (ie, as a precondition for being eligible for surgery) and therefore being less dependent on nurses. For medical patients, the collaboration between professional groups might also be of higher relevance, which can explain the significant effects of physician staffing.

Although our study makes important contributions to understanding the relationship between nurse staffing and patient outcomes, it is not without important limitations, each of which offers avenues for further research. First, both of the nurse staffing variables used in our analysis (ie, patient-to-nurse and skill-mix ratios) represent annual averages and do not capture day-to-day variations in nurse staffing. Similarly, even though we were able to consider several variables which are likely related to nurse staffing and patient outcomes, we might have omitted variable bias from other hospital-unit-related characteristics, such as the availability and use of technology, the share of temporary or immigrant nurses, the team climate, or absences due to sickness. These variables were not available in our data sample but might be associated with nurses’ workload and also have an effect on patient outcomes.27 53 In addition, the model complexity and the limited sample size drove our choice to conduct subgroup instead of moderating analyses. Thus, although this study overcomes several endogeneity issues of previous studies it cannot claim to fully address them. While the large size of our sample may compensate for some of these issues, future studies may want to draw on or collect more finely grained data covering day-to-day variations in nurse staffing variables and should try to account for further hospital characteristics. In addition, administrative staffing measures have been shown to deviate from perceived staffing adequacy54 55; therefore, accounting for the latter in relation with quality of nursing care is a valuable avenue for further research, too. Another limitation this study shares with previous research is its cross-sectional nature. As the causal order and the generalisability of our results cannot be verified, future studies would be valuable to investigate the relationships in other settings and over time. Finally, the PENQuAH instrument has only been tested in Germany and our sample shows slight variations from the German hospitalised population, which might affect the generalisability of our results. As it has been able to provide more fine-grained insights into the dimensions of patient-perceived quality of nursing care, we recommend applying, adapting, and validating it to further data samples, and adjusting it to the hospital environments of other countries.

Our results have important implications for hospital managers and health policy makers pursuing stronger patient orientation. By providing strong evidence that quality of nursing care is affected by nurse staffing, we show that nurse staffing decisions are critical for favourable patient care experiences. We find that in addition to staffing levels, nurses’ skill mix is an important factor associated with quality of nursing care. Therefore, we recommend considering nurses’ levels of educational attainment, qualifications and specialisations when designing policies, such as minimum staffing regulations, to improve nurse staffing in hospitals.