Skip to main content
  • Original Research
  • Open access
  • Published:

Improving recognition of patients at risk in a Portuguese general hospital: results from a preliminary study on the early warning score

Abstract

Background

Early warning score (EWS) is a system that assists in the timely recognition of hospitalized patients outside critical care areas with potential or established critical illness at risk of deteriorating and who may be receiving suboptimal care. No such systems have been implemented in Portuguese National Health Service's wards. We performed a preliminary study to assess the potential outcome of applying the EWS in our hospital setting.

Methods

An observational retrospective study was conducted based on 100 patients assessed by the outreach team due to an acute event. The EWS was calculated a posteriori on three preceding periods from the acute deterioration (−12, −24, and −72 h).

Results

In 35 patients, there was insufficient recording of vital signs. The final sample of 65 patients includes 62.0% men, and the mean age (±SD) was 67 ± 16 years old. Respiratory problems were the main cause of deterioration (44.6%). The EWS score increased from −72 to −12 h. More than half of cases (63.0%) were admitted into high care units, and their mean (±SD) score was higher in comparison to those remaining in general wards (Intermediate Care Units 3.75 ± 1.9, Intensive Care Units 4.2 ± 1.5, wards 3.5 ± 1.4). Score at −24 and −12 h seemed to predict length of stay (LoS; p < 0.05) and mortality, respectively. The EWS would have incremented early medical attention by 40.0% if a threshold of ≥3 was used.

Conclusions

EWS systems are not widely used in Portuguese health service. Our data suggests that the EWS would allow early recognition for a higher number of patients in comparison to current ward care. Clinical worsening, lengths of stay, admission into high care units, and mortality may be predicted by the EWS. Prospective studies with multivariable analysis are needed to clarify the global outcome of the EWS implementation in national wards.

Background

It is clinically intuitive that physiological deterioration precedes critical illness. Several studies have shown that abnormalities in vital signs can help identify clinical deterioration in patients minutes to hours before a serious adverse event occurs [[1]–[7]]. In addition, early intervention has demonstrated to improve patient outcomes [[8],[9]].

Basic observations have been a form of implicit physiological tracking without an explicit trigger [[10]]. Early warning scoring (EWS) systems are tools based on aggregate weighted scoring of physiological variables and provide tracking and a trigger if the total score reaches a predefined alert threshold.

In the UK, many hospitals are using criteria to trigger a rapid medical response based on the modified early warning system [[11]]. In other countries, such as Australia or the USA, ‘calling criteria’ are used to activate a medical emergency team (MET) [[12]].

In Portugal, the General Health Directorate (GHD) recommended in 2010 the implementation of ‘In-Hospital Medical Emergency Teams (MET)’ within an organizational framework that should enable early and rapid recognition and treatment of patients in acute deterioration [[13]]. At the afferent component of the system, MET calling criteria were proposed based on the guidelines of the ‘First Consensus Conference on Medical Emergency Team’ [[14]]. Despite that these criteria may predict an increased risk of death [[12]], they have been considered late deterioration criteria [[5]]. On the contrary, a track and trigger system based on an EWS may detect early signs of deterioration [[10]]. These systems have not been widely applied or studied in our national health service.

The GHD recommends that each health care institution should adopt the best strategy to increase clinical monitoring of hospitalized patients [[13]]. Therefore, we performed a preliminary study to evaluate the impact of the EWS system at our setting.

In our hospital organizational model to the critical patient at the time of this study, the on-call medical emergency team was activated according to the established calling criteria in order to assist the deteriorating patient on the wards and decide the need of Intensive Medicine care. After initial evaluation and stabilization of the patient, the MET transported the patient to the Emergency Room (ER) at the Emergency Service, for additional approach, including urgent investigation on the reasons of deterioration, additional treatment, and decision regarding the level of care (return to ward, admission to Intensive or Intermediate Units). The Emergency Room concept in our institution differs from the majority of national hospitals. It is conceived as an extension of the Intensive Medicine care and includes a permanent intensivist physician on 24/7 basis. The assessment of this model of care was not the aim of this study.

Our study's main goals were (1) to assess the EWS in specific time windows preceding the acute event, (2) to study its temporal behavior and its relation with outcomes, and (3) ultimately to compare it with the established ward care.

Methods

An observational, retrospective, non-controlled study was conducted. The sample consisted of the first consecutive 100 adult ward inpatients assisted by the outreach team and transferred to the Emergency Room, in the period from 1 January to 31 April 2009.

It was assumed that all ward-to-ER transfers were from acutely deteriorated patients who needed additional urgent stabilization. Inclusion criteria are adult patients admitted into the ER from wards of different hospital services. Exclusion criteria are incomplete vital sign records and patients from the Pediatric and Obstetric Services, Intermediate and Intensive Care Units (ICU), and Cardiothoracic Unit.

The studied variables were age and sex; clinical reason for admission at the ER; hospital service of origin of the patient; estimated EWS at −12, −24, and −72 h; in-hospital mortality; and on-call doctor alert. The main clinical reason leading to ward-to-ER transfer was categorized in five groups: ‘respiratory’ (airway or breathing compromise), ‘cardiovascular’ (hemodynamic instability or life-threatening arrhythmias), ‘neurological’ (acute changes in consciousness state), ‘renal’ (urinary output acute changes, metabolic and hydro-electrolytic disturbances), and ‘others’ (all situations not included in the previous items).

Based on records from patients’ clinical files, the EWS was retrospectively calculated at three periods prior to patient ward-to-ER transfer (−72, −24, and −12 h).

The selected EWS system was based on the original EWS developed by Morgan et al. [[15]]. A score threshold of ≥3 was defined as a ‘trigger’ as previously described [[16]–[18]].

Data collection and analysis were carried out with Microsoft Excel 2007®. Categorical variables are presented as absolute and relative frequencies and continuous variables as mean and standard deviation (SD); when relevant, confidence intervals (CI), median, and interquartile range are also presented. A bivariate analysis was based on Student's t test to compare continuous variables, including age, length of stay (LoS), and the EWS at −12, −24, and −72 h; χ2-square test was used to compare categorical variables.

Results

From the selected 100 patients transferred from the wards to the ER, 18 were excluded due to significant absence of vital sign records (17 were excluded due to errors in clinical archive). Respiratory rate (RR) was the least recorded vital sign. The final sample consisted of 65 patients. Their mean age was 67.7 years old (SD 15.8, minimum 18.0 and maximum 92.0, median 71.0, interquartile range 57.0 to 77.0), and there was higher number of male patients (62.0%).

Before their deterioration and admission into the ER, patients’ mean LoS was 14.4 days (CI 9.2 to 19.6, SD 20.9, median 6.0, minimum 0.0 and maximum 113.0 days). A significant association (p = 0.036) between the EWS at −24 h and length of in-hospital stay was observed.

Most of the patients were transferred to the ER during periods of reduced medical physical presence. Nine patients (14.8%) were transferred to the ER in the morning (8:30 a.m. to 1:30 p.m.), 19 (31.1%) during the afternoon (1:30 p.m. to 8:00 p.m.), and 33 (54.1%) at night (8:00 p.m. to 8:00 a.m.). A higher number of patients were transferred to the ER on Fridays (12.0%) and Sundays (23.0%).

Almost half of the patients were transferred to the ER due to respiratory problems (44.6%), followed by cardiovascular and neurological deterioration (27.7% in each group). Patients who deteriorated from respiratory problems came from the Internal Medicine wards (41.3%).

Ward-based physicians and nurses transferred 35.4% of patients to the ER (29.2% and 6.2%, respectively), while 64.4% of the cases were directly managed by the MET.

Adjusting the number of patients for the stocking of hospital service beds, it was noticed that 47.7% of the patients who deteriorated came from non-medical wards (Figure 1).

Figure 1
figure 1

Proportion of patients’ transfers from wards to ER adjusted to total number of beds of each Service. ENT, ear, nose, and throat (Otorhinolaryngology Service); %, relative frequency.

Of the 65 patients admitted in the ER, 63.0% were admitted in ICU or Intermediate Care Units (26.0% and 37.0%, respectively), 20.0% returned to their origin wards, and 17.0% died in the ER. The overall in-hospital mortality was 53.8%.

An analysis of the score in the −12 h period revealed that the score was higher, although not statistically significant, in the patients that were admitted into the Intensive or Intermediate Care Units: mean ± standard deviation of 3.5 ± 1.4 at wards (n = 12), 3.8 ± 1.9 at the Intermediate Care Unit (n = 24), and 4.2 ± 1.5 at ICU (n = 17). Retrospective calculation of the EWS on this sample showed an aggravating score tendency on the three evaluated periods before transfer to the ER (Table 1).

Table 1 EWS score at three periods preceding ward transfer to the ER

A progressive increase in scores as approaching to the moment of acute deterioration was documented in three studied periods (Figure 2).

Figure 2
figure 2

Graphs showing progressive increase in scores toward the moment of acute deterioration.

An in-between analysis comparing the three periods (Figure 3) showed a significant correlation between the score at −12 h vs −24 h (p < 0.0001), −12 h vs −72 h (p = 0.0026), and −24 h vs −72 h (p = 0.0007).

Figure 3
figure 3

In-between analysis comparing the three periods.

Using a threshold of ≥3 on the three periods and comparing it to the occurred alert to the on-call doctor which is based on nurse staff clinical judgment, an increment of alerts based on the EWS ranging from 39.7% to 43.3% would have occurred (Table 2).

Table 2 Comparison of real alert of the on-call doctor versus the predicted EWS trigger

Applying the EWS to the set of cases in which a real alert occurred (on-call doctor alert), the analysis shows that all of these patients had a significantly higher EWS in comparison to the group of cases in which no real alert occurred (Figure 4).

Figure 4
figure 4

Comparison of EWS between cases in which real alert occurred vs. cases in which no real alert occurred.

Mortality rate was high in the subset of cases with an EWS ≥ 3: 71.4% (15/21) in patients with a high EWS at −72 h, 63.3% (19/30) at −24 h, and 58.0% (29/50) at −12 h. The mean score (±SD) of patients who did not survive after catastrophic deterioration was 4.1 (1.5) at −12 h, 2.5 (1.7) at −24 h, and 2.9 (1.9) at −72 h. In the subset of patients who survive, mean (±SD) EWS was 3.5 (1.9) at −12 h, 2.3 (2.0) at −24 h, and 2.1 (1.7) at −72 h. The EWS score at −12 h was related to the in-hospital mortality, with a mean (±SD) of 4.3 (1.2) in patients who died in the hospital and 3.6 (1.8) in patients who survived, although this difference was not statistically significant.

Discussion

Safety of the hospitalized patient has been highlighted in the past two decades [[19]]. Patients who are at risk of becoming acutely unwell on general hospital wards receive ‘suboptimal care’ - lack of knowledge regarding the significance of findings relating to dysfunction of airway, breathing, and circulation, causing them to be missed [[20],[21]]. Suboptimal care is enhanced by problems such as not taking vital signs, not communicating concern, and not responding appropriately where physiological deterioration occurs [[19]].

Several studies have shown that vital sign monitoring occurs infrequently and their measurements may not be performed predictably, accurately, or completely [[22]–[25]]. In our sample, records on vital signs were missing in almost one fifth of the patients. Respiratory rate, an early indicator of disease [[24],[26]], was very often neglected by the ward staff, a finding that has already been noticed by others [[24]]. Importantly, the use of an EWS has shown to improve ‘observations’ records [[27]].

We have only found one study with EWS in Portuguese national hospitals. A prospective ‘action-research’ study in 113 surgical patients in 2009 found that nearly 20% presented a risk score (>3) which leads to activation of medical assistance in 33% of their EWS records. It was found that RR was consistently less valued, although it was the vital sign that contributed the most to final score changes. The authors concluded that an EWS in association with a medical activation algorithm translates into benefits for patients as well as ward staff [[28]].

Our study has limitations due to its retrospective methodology, the small sample size, and lack of multivariable analysis. However, it was able to provide preliminary relevant data.

Of note, we did not exclude patients in palliative care or under ‘do not resuscitate’ orders. In agreement with other authors [[16]], we believe these patients demand a sensible management that should implicate both patient (if possible) and relatives. An EWS might help in early definition of their ‘optimal’ care.

Our research revealed that most acutely deteriorated patients were elderly or older adults, with 50.0% of them aging between 57 to 77 years. Older age, although not included in patient assessment by EWS, may influence patients’ resilience and predisposition for catastrophic deterioration. A relation of age and mortality with higher EWS scores has been demonstrated, and it was suggested that inclusion of age in EWS could be advantageous in improving EWS function [[29]].

Several studies have demonstrated an increase in in-hospital mortality at night or during weekends [[30],[31]]. These ‘weekend effect’ was also observed in Portuguese hospitals [[32]].

Our data shows a higher number of transfers from wards to ER during periods of less medical attendance (afternoon and night) and weekends. Although it might be a consequence of random effect, our local perception is that patients’ deterioration is high during these periods. This may be explained by a lack of awareness on patients’ impending deterioration by the ward staff, problems in shift handovers, and periods of diminished physician attendance as a consequence of local working organization.

Our study showed that patients deteriorate mainly due to respiratory problems and that most of them stay in the Internal Medicine Service. Two main reasons may contribute to this figure: (a) in our setting, the majority of patients in Internal Medicine wards suffer from chronic cardiorespiratory diseases, and (b) an airway or breathing problem may be easier to recognize by nurse staff. These results reflect the nature of the organization models of Portuguese hospitals.

Non-medical wards were responsible for almost 50% of admissions in the ER. This finding may be explained not only by a greater physical fragility of surgical patients, but also by the lower number of physicians assigned to these wards in comparison to medical wards. The EWS system would be helpful in assisting health care staff in these wards, a benefit that has already been demonstrated [[33]].

Despite the research on EWS outcomes, the original EWS was developed not as a predictor of outcomes but solely as a tool to ‘secure the timely presence of skilled clinical help by the bedside of those patients exhibiting physiological signs compatible with established or impending critical illness’ [[10]]. We share the view of Morgan et al. that the clinical course of a critically ill patient is influenced by a multitude of factors that trying to predict outcomes on the basis of routine observations may be an ‘unrealistic expectation’ [[10]]. This complexity may explain why several studies suggest that EWS may predict outcomes [[16]–[18],[29]] while others found no impact in patient outcomes [[34],[35]]. Nevertheless, we have found interesting associations between EWS and patient's outcomes.

The mean hospital stay before catastrophic deterioration was 14.4 days, and we only found a correlation between LoS and EWS at −24 h which may be due to the small sample size. Groarke et al. observed a correlation between higher EWS on admission and LoS [[18]].

More than half (63%) of the ‘acutely ill’ patients on the wards ended up admitted to a higher level of care (Intermediate or ICU). Our analysis suggests that patients admitted into these units had a higher score in comparison to patients that returned to the wards. Subbe et al. prospectively demonstrated an association between a raised EWS and increased mortality and admission into ICU and high-dependency units [[16]].

Our data demonstrates that EWS correlates with patients’ deterioration (Figures 2 and 3). This finding suggests that EWS may predict patients at greater risk and in need of more medical intervention.

There was also a relation, although non-significant, between EWS and mortality at the ER as well as in-hospital mortality which emphasizes the potential of this score in predicting outcomes. More than half of patients admitted to the ER have ultimately died during the hospitalization. At a time of limited resources, a low cost and easy to apply system, such as the EWS, would allow carefully planning the admission and optimizing the safety of patients in general wards. Therefore, any improvement in the prevention of catastrophic deterioration would probably have a beneficial impact. Nevertheless, a prospective study, with a comparative arm, is needed to evaluate the outcome of the EWS.

Among patients who have died after admission into the ER, the EWS seemed to be higher on the preceding periods, with the greatest score difference on the ‘−12 h’. This result highlights the potential of the EWS in predicting catastrophic deterioration. Several studies have already concluded that an EWS can identify patients in need of hospital admission, predict morbidity and mortality, and diminish ‘code blue’ events as well as admissions into the ICU [[17],[18],[36],[37]].

Based on the EWS, different trigger cutoffs and physiological values have been used without prospective validation, raising problems on sensitivity and specificity of the system [[16],[38]]. Duckitt et al. validated a scoring system after a multivariate logistic regression analysis in a large sample of patients admitted to the Emergency Care Unit. After comparison of the new derived system with the EWS as recommended by the UK's Department of Health, it was found that the cutoff point that gave maximum sensitivity and specificity was 3 (sensitivity and specificity of 0.63 and 0.72 vs 0.60 and 0.67, respectively) [[39]].

Using a trigger threshold of ≥ 3, we calculated an increment of nearly 40% of alerts in comparison to current ward care. This level would lower to approximately 20% if the threshold was raised to ≥ 4. These variations could lead to different outcomes regarding patients’ care. Therefore, the optimal trigger score deserves additional research in order to prevent excessive evaluation of patients who have abnormal vital signs but who are not at risk for serious adverse events and to avoid failures in recognition of patients potentially ‘at risk’ [[12]]. Whatever the trigger cutoff and physiological variables, the increase in medical workload must be accepted [[40]] since the EWS improves care quality in comparison to current ward care and clinical judgment.

Conclusions

In Portugal, track and trigger systems are not widely applied. The outreach system afferent component has relied on ‘MET calling criteria’ which is considered a late recognition system of patients at risk.

Our results revealed that the EWS objectively correlates with patients’ impending deterioration and may predict admission into higher level of care units, length of stay, and in-hospital mortality. In comparison to current clinical ward care, the EWS would have significantly increased the detection of critical ill patients by ward staff by 40%. This enhancement in surveillance would probably yield a huge benefit on patient outcome since the current in-hospital mortality of patients at risk is very high (around 50%).

The available literature suggests that the benefit of the EWS outweighs the predicted increase in medical workload. Nevertheless, more prospective research on EWS systems is needed to establish the appropriate variables, the most sensitive and specific warning threshold, as well as its effect on patients’ outcomes.

The EWS may be a valuable auxiliary tool to assess patients’ risk of deterioration at the ward level. Allied to periodic reinforcements in staff education and organization, systems such as EWS may bring us closer to the ‘optimal care’.

Setting

The work was performed at the University Hospital São João, in Porto, Portugal.

References

  1. Schein RM, Hazday N, Pena M, Ruben BH, Sprung CL: Clinical antecedents to in-hospital cardiopulmonary arrest. Chest 1990,98(6):1388–1392. 10.1378/chest.98.6.1388

    Article  CAS  PubMed  Google Scholar 

  2. Franklin C, Mathew J: Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med 1994,22(2):244–247. 10.1097/00003246-199402000-00014

    Article  CAS  PubMed  Google Scholar 

  3. Goldhill DR, McNarry AF, Mandersloot G, McGinley A: A physiologically-based early warning score for ward patients: the association between score and outcome. Anaesthesia 2005,60(6):547–553. 10.1111/j.1365-2044.2005.04186.x

    Article  CAS  PubMed  Google Scholar 

  4. Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K: A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom–the ACADEMIA study. Resuscitation 2004,62(3):275–282. 10.1016/j.resuscitation.2004.05.016

    Article  PubMed  Google Scholar 

  5. Jacques T, Harrison GA, McLaws ML, Kilborn G: Signs of critical conditions and emergency responses (SOCCER): a model for predicting adverse events in the inpatient setting. Resuscitation 2006,69(2):175–183. 10.1016/j.resuscitation.2005.08.015

    Article  PubMed  Google Scholar 

  6. Watkinson PJ, Barber VS, Price JD, Hann A, Tarassenko L, Young JD: A randomised controlled trial of the effect of continuous electronic physiological monitoring on the adverse event rate in high risk medical and surgical patients. Anaesthesia 2006,61(11):1031–1039. 10.1111/j.1365-2044.2006.04818.x

    Article  CAS  PubMed  Google Scholar 

  7. Buist MD, Jarmolowski E, Burton PR, Bernard SA, Waxman BP, Anderson J: Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a tertiary-care hospital. Med J Aust 1999,171(1):22–25.

    CAS  PubMed  Google Scholar 

  8. Rivers EP, Coba V, Whitmill M: Early goal-directed therapy in severe sepsis and septic shock: a contemporary review of the literature. Curr Opin Anaesthesiol 2008,21(2):128–140. 10.1097/ACO.0b013e3282f4db7a

    Article  PubMed  Google Scholar 

  9. Fresco C, Carinci F, Maggioni AP, Ciampi A, Nicolucci A, Santoro E, Tavazzi L, Tognonia G: Very early assessment of risk for in-hospital death among 11,483 patients with acute myocardial infarction. GISSI investigators. Am Heart J 1999,138(6 Pt 1):1058–1064. 10.1016/S0002-8703(99)70070-0

    Article  CAS  PubMed  Google Scholar 

  10. Morgan RJ, Wright MM: In defence of early warning scores. Br J Anaesth 2007,99(5):747–748. 10.1093/bja/aem286

    Article  CAS  PubMed  Google Scholar 

  11. Gao H, McDonnell A, Harrison DA, Moore T, Adam S, Daly K, Esmonde L, Goldhill DR, Parry GJ, Rashidian A, Subbe CP, Harvey S: Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med 2007,33(4):667–679. 10.1007/s00134-007-0532-3

    Article  PubMed  Google Scholar 

  12. Jones DA, DeVita MA, Bellomo R: Rapid-response teams. N Engl J Med 2011,365(2):139–146. 10.1056/NEJMra0910926

    Article  CAS  PubMed  Google Scholar 

  13. Saude D-G: Criacao e implementacao de uma Equipa de Emergencia Medica Intra-Hospitalar (EEMI), Circular No15/DQS/DQCQ. Direccao-geral de Saude, 2010. [cited 2010 22nd December 2011]; Available from: ., [http://www.dgs.pt]

  14. Devita MA, Bellomo R, Hillman K, Kellum J, Rotondi A, Teres D, Auerbach A, Chen WJ, Duncan K, Kenward G, Bell M, Buist M, Chen J, Bion J, Kirby A, Lighthall G, Ovreveit J, Braithwaite RS, Gosbee J, Milbrandt E, Peberdy M, Savitz L, Young L, Harvey M, Galhotra S: Findings of the first consensus conference on medical emergency teams. Crit Care Med 2006,34(9):2463–2478. 10.1097/01.CCM.0000235743.38172.6E

    Article  PubMed  Google Scholar 

  15. Morgan RJM, Williams F, Wright MM: An early warning scoring system for detecting developing critical illness. Clin Intensive Care 1997, 8: 100.

    Google Scholar 

  16. Subbe CP, Kruger M, Rutherford P, Gemmel L: Validation of a modified early warning score in medical admissions. QJM 2001,94(10):521–526. 10.1093/qjmed/94.10.521

    Article  CAS  PubMed  Google Scholar 

  17. Burch VC, Tarr G, Morroni C: Modified early warning score predicts the need for hospital admission and inhospital mortality. Emerg Med J 2008,25(10):674–678. 10.1136/emj.2007.057661

    Article  CAS  PubMed  Google Scholar 

  18. Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R, Courtney G: Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J 2008,25(12):803–806. 10.1136/emj.2007.051425

    Article  CAS  PubMed  Google Scholar 

  19. Robb G, Seddon M: A multi-faceted approach to the physiologically unstable patient. Qual Saf Health Care 2010,19(5):e47.

    PubMed  Google Scholar 

  20. Adam S, Odell M: An acute problem? A report of the National Confidential Enquiry into Patient Outcome and Death. Nurs Crit Care 2005,10(5):225–227. 10.1111/j.1362-1017.2005.0135b.x

    Article  PubMed  Google Scholar 

  21. McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G, Nielsen M, Barrett D, Smith G, Collins CH: Confidential inquiry into quality of care before admission to intensive care. BMJ 1998,316(7148):1853–1858. 10.1136/bmj.316.7148.1853

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  22. Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet 2005,365(9477):2091–2097. 10.1016/S0140-6736(05)66733-5

    Article  PubMed  Google Scholar 

  23. Leuvan CH, Mitchell I: Missed opportunities? An observational study of vital sign measurements. Crit Care Resusc 2008,10(2):111–115.

    PubMed  Google Scholar 

  24. Cretikos MA, Bellomo R, Hillman K, Chen J, Finfer S, Flabouris A: Respiratory rate: the neglected vital sign. Med J Aust 2008,188(11):657–659.

    PubMed  Google Scholar 

  25. Goldhill DR, White SA, Sumner A: Physiological values and procedures in the 24 h before ICU admission from the ward. Anaesthesia 1999,54(6):529–534. 10.1046/j.1365-2044.1999.00837.x

    Article  CAS  PubMed  Google Scholar 

  26. Cretikos M, Chen J, Hillman K, Bellomo R, Finfer S, Flabouris A: The objective medical emergency team activation criteria: a case-control study. Resuscitation 2007,73(1):62–72. 10.1016/j.resuscitation.2006.08.020

    Article  PubMed  Google Scholar 

  27. McBride J, Knight D, Piper J, Smith GB: Long-term effect of introducing an early warning score on respiratory rate charting on general wards. Resuscitation 2005,65(1):41–44. 10.1016/j.resuscitation.2004.10.015

    Article  PubMed  Google Scholar 

  28. Albino AP, Jacinto V: Implementation of an Early Warning Score. 2009.

    Google Scholar 

  29. Smith GB, Prytherch DR, Schmidt PE, Featherstone PI, Kellett J, Deane B, Higgins B: Should age be included as a component of track and trigger systems used to identify sick adult patients? Resuscitation 2008,78(2):109–115. 10.1016/j.resuscitation.2008.03.004

    Article  PubMed  Google Scholar 

  30. Bell CM, Redelmeier DA: Mortality among patients admitted to hospitals on weekends as compared with weekdays. N Engl J Med 2001,345(9):663–668. 10.1056/NEJMsa003376

    Article  CAS  PubMed  Google Scholar 

  31. Peberdy MA, Ornato JP, Larkin GL, Braithwaite RS, Kashner TM, Carey SM, Meaney PA, Cen L, Nadkarni VM, Praestgaard AH, Berg RA: Survival from in-hospital cardiac arrest during nights and weekends. JAMA 2008,299(7):785–792. 10.1001/jama.299.7.785

    Article  CAS  PubMed  Google Scholar 

  32. Sea L: Variacao na mortalidade e na demora media do internamento por dia de admissao e de alta. Rev Port Saude Publ 2008, 7: 117–129.

    Google Scholar 

  33. Gardner-Thorpe J, Love N, Wrightson J, Walsh S, Keeling N: The value of Modified Early Warning Score (MEWS) in surgical in-patients: a prospective observational study. Ann R Coll Surg Engl 2006,88(6):571–575. 10.1308/003588406X130615

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  34. McGaughey J, Alderdice F, Fowler R, Kapila A, Mayhew A, Moutray M: Outreach and Early Warning Systems (EWS) for the prevention of intensive care admission and death of critically ill adult patients on general hospital wards. Cochrane Database Syst Rev 2007, 3: CD005529.

    PubMed  Google Scholar 

  35. Subbe CP, Davies RG, Williams E, Rutherford P, Gemmell L: Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia 2003,58(8):797–802. 10.1046/j.1365-2044.2003.03258.x

    Article  CAS  PubMed  Google Scholar 

  36. Cei M, Bartolomei C, Mumoli N: In-hospital mortality and morbidity of elderly medical patients can be predicted at admission by the Modified Early Warning Score: a prospective study. Int J Clin Pract 2009,63(4):591–595. 10.1111/j.1742-1241.2008.01986.x

    Article  CAS  PubMed  Google Scholar 

  37. Maupin JM, Roth DJ, Krapes JM: Use of the Modified Early Warning Score decreases code blue events. Jt Comm J Qual Patient Saf 2009,35(12):598–603.

    PubMed  Google Scholar 

  38. de Pennington J, Laurenson J, Lebus C, Sihota S, Smith P: Evaluation of early warning systems on a medical admissions unit. JICS 2005, 6: 19–21.

    Google Scholar 

  39. Duckitt RW, Buxton-Thomas R, Walker J, Cheek E, Bewick V, Venn R, Forni LG: Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth 2007,98(6):769–774. 10.1093/bja/aem097

    Article  CAS  PubMed  Google Scholar 

  40. Smith GB, Prytherch DR, Schmidt PE, Featherstone PI, Higgins B: A review, and performance evaluation, of single-parameter “track and trigger” systems. Resuscitation 2008,79(1):11–21. 10.1016/j.resuscitation.2008.05.004

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nuno Correia.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All authors have made substantial contributions to the paper. NC and LL were involved in study conception. NC gathered all the data and drafted the main manuscript. RR and MS actively cooperated in statistical analysis and actively contributed to result interpretation and review of the manuscript. LL additionally contributed with final remarks. PD made important suggestions on the interpretation of results and general review. Professor AP made substantial contributions in revising the paper critically for important intellectual content and scientific relevance. All authors approved the final version to be submitted. We declare that we had no writing assistance. All manuscript's data, figures and tables, have not been published previously, and the manuscript is not under consideration elsewhere. The authors suggest following two reviewers who have not been involved in the design, performance, and discussion of the data and are not co-workers.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Correia, N., Rodrigues, R.P., Sá, M.C. et al. Improving recognition of patients at risk in a Portuguese general hospital: results from a preliminary study on the early warning score. Int J Emerg Med 7, 22 (2014). https://doi.org/10.1186/s12245-014-0022-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12245-014-0022-7

Keywords