Publications

2019
Roger Daglius Dias and Jacson Venancio de Barros. 2019. “Burden of hospitalisation among older people in the Brazilian public health system: a big data analysis from 2009 to 2015.” J Epidemiol Community Health.Abstract
BACKGROUND: The world's population is progressively ageing, and this trend imposes several challenges to society and governments. The aim of this study was to investigate the burden generated by the hospitalisation of older (60 years) compared with non-older population, as well as the epidemiology of these hospital admissions. METHODS: Using the Brazilian Unified Health System (known as 'Sistema Único de Saúde' (SUS)), an analysis of all hospital admissions of adult patients in the SUS from 2009 to 2015 was undertaken. The following indicators were used: hospital admission rate, intensive care unit (ICU) admission rate, average length of hospital and ICU stay, hospital mortality and average reimbursement per hospitalisation. RESULTS: A total of 61 958 959 admissions during the 7-year period, were analysed, encompassing 17 893 392 (28.9%) older patients. Elderly represent 15% (n=21 294 950) of the Brazilian adult population, but are responsible for 29% (n=17 893 392) of hospitalisations, 52% (n=1 731 299) of ICU admissions and 66% (n=1 885 291) of hospital mortality. Among the adults, elderly represents 39% of the total reimbursement made related to admission/hospitalisation. For 2009 to 2015, while the older population increased 27%, ICU admission rate increased 20%; the average length of ICU stay was 12% higher in 2015 (6.5 days) compared with 2009 (5.8 days); and the hospital mortality increased from 9.8% to 11.2%. CONCLUSION: These findings illustrate the current panorama of the burden due to hospitalisation of older people in the Brazilian public health system, and evidence the consolidation of the epidemiological transition toward the predominance of non-communicable diseases as the main cause of hospitalisation among the elderly in Brazil.
Joao Gabriel Rosa Ramos, Otavio T Ranzani, Beatriz Perondi, Roger Daglius Dias, Daryl Jones, Carlos Roberto Ribeiro Carvalho, Irineu Tadeu Velasco, and Daniel Neves Forte. 2019. “A decision-aid tool for ICU admission triage is associated with a reduction in potentially inappropriate intensive care unit admissions.” J Crit Care, 51, Pp. 77-83.Abstract
PURPOSE: Intensive care unit (ICU) admission triage occurs frequently and often involves highly subjective decisions that may lead to potentially inappropriate ICU admissions. In this study, we evaluated the effect of implementing a decision-aid tool for ICU triage on ICU admission decisions. METHODS: This was a prospective, before-after study. Urgent ICU referrals to ten ICUs in a tertiary hospital in Brazil were assessed before and after the implementation of the decision-aid tool. Our primary outcome was the proportion of potentially inappropriate ICU referrals (defined as priority 4B or 5 referrals, accordingly to the Society of Critical Care Medicine guidelines of 1999 and 2016, respectively) admitted to the ICU within 48 h. We conducted multivariate analyses to adjust for potential confounders and evaluated the interaction between phase and triage priority. RESULTS: Of the 2201 patients analyzed, 1184 (53.8%) patients were admitted to the ICU. After adjustment for confounders, implementation of the decision-aid tool was associated with a reduction in potentially inappropriate ICU admissions using either the 1999 [adjOR (95% CI) = 0.36 (0.13-0.97)] or 2016 [adjOR (95%CI) = 0.35 (0.13-0.96)] definitions. CONCLUSION: Implementation of a decision-aid tool for ICU triage was associated with a reduction in potentially inappropriate ICU admissions.
Roger D Dias, Marco A Zenati, Heather M Conboy, Lori A Clarke, Leon J Osterweil, George S Avrunin, and Steven J Yule. 2019. “Dissecting Cardiac Surgery: A Video-Based Recall Protocol to Elucidate Team Cognitive Processes in the Operating Room.” Ann Surg.Abstract
MINI: In this study we identified a total of 137 unique cognitive processes related to the intraoperative phase of coronary artery bypass grafting procedures. This study advances the current body of knowledge by elucidating cognitive processes involved during the intraoperative phase of cardiac surgery from the perspective of multiple operating room team members. OBJECTIVE: The aim of this study was to elucidate the cognitive processes involved in surgical procedures from the perspective of different team roles (surgeon, anesthesiologist, and perfusionist) and provide a comprehensive compilation of intraoperative cognitive processes. SUMMARY BACKGROUND DATA: Nontechnical skills play a crucial role in surgical team performance and understanding the cognitive processes underlying the intraoperative phase of surgery is essential to improve patient safety in the operating room (OR). METHODS: A mixed-methods approach encompassing semistructured interviews with 9 subject-matter experts. A cognitive task analysis was built upon a hierarchical segmentation of coronary artery bypass grafting procedures and a cued-recall protocol using video vignettes was used. RESULTS: A total of 137 unique surgical cognitive processes were identified, including 33 decision points, 23 critical communications, 43 pitfalls, and 38 strategies. Self-report cognitive workload varied substantially, depending on team role and surgical step. A web-based dashboard was developed, providing an integrated visualization of team cognitive processes in the OR that allows readers to intuitively interact with the study findings. CONCLUSIONS: This study advances the current body of knowledge by making explicit relevant cognitive processes involved during the intraoperative phase of cardiac surgery from the perspective of multiple OR team members. By displaying the research findings in an interactive dashboard, we provide trainees with new knowledge in an innovative fashion that could be used to enhance learning outcomes. In addition, the approach used in the present study can be used to deeply understand the cognitive factors underlying surgical adverse events and errors in the OR.
Roger D Dias, Marco A Zenati, Ronald Stevens, Jennifer M Gabany, and Steven J Yule. 2019. “Physiological Synchronization and Entropy as Measures of Team Cognitive Load.” J Biomed Inform, Pp. 103250.Abstract
The operating room (OR) is a high-risk and complex environment, where multiple specialized professionals work as a team to effectively care for patients in need of surgical interventions. Surgical tasks impose high cognitive demands on OR staff and cognitive overload may have deleterious effects on team performance and patient safety. The aim of the present study was to investigate the feasibility and describe a novel methodological approach to characterize dynamic changes in team cognitive load by measuring synchronization and entropy of heart rate variability parameters during real-life cardiac surgery. Cognitive load was measured by capturing interbeat intervals (IBI) from three team members (surgeon, anesthesiologist and perfusionist) using an unobtrusive wearable heart rate sensor and transmitted in real-time to a smartphone application. Clinical data and operating room audio/video recordings were also collected to provide behavioral and contextual information. We developed symbolic representations of the transient cognitive state of individual team members (Individual Cognitive State - ICS), and overall team (Team Cognitive State - TCS) by comparing IBI data from each team member with themselves and with others. The distribution of TCS symbols during surgery enabled us to display and analyze temporal states and dynamic changes of team cognitive load. Shannon's entropy was calculated to estimate the changing levels of team organization and to detect fluctuations resulting from a variety of cognitive demands and/or specific situations (e.g. medical error, emergency, flow disruptions). An illustrative example from a real cardiac surgery team shows how cognitive load patterns shifted rapidly after an actual near-miss medication event, leading the team to a more organized and synchronized state. The methodological approach described in this study provides a measurement technique for the assessment of team physiological synchronization, which can be applied to many other team-based environments. Future research should gather additional validity evidence to support the proposed methods for team cognitive load measurement.
2018
Marco A Zenati, Kay Leissner, Suzana Zorca, Lauren Kennedy-Metz, Steven J Yule, and Roger D Dias. 12/12/2018. “First Reported Use of Team Cognitive Workload for Root Cause Analysis in Cardiac Surgery.” Semin Thorac Cardiovasc Surg.Abstract
Cognitive workload data of members of the cardiac surgery team can be measured intraoperatively and stored for later analysis. We present a case of a near-miss (medication error) that underwent root cause analysis using workload data. Heart rate variability data, representing workload levels, were collected from the attending surgeon, attending anesthesiologist, and lead perfusionist using wireless heart rate monitors. An episode of cognitive overload of the anesthesiologist due to a distractor was associated with the preventable error. Additional studies are needed to better understand the role of psychophysiological data in enhancing surgical patient safety.
Roger D Dias, Heather M Conboy, Jennifer M Gabany, Lori A Clarke, Leon J Osterweil, David Arney, Julian M Goldman, Giuseppe Riccardi, George S Avrunin, Steven J Yule, and Marco A Zenati. 10/2018. “Intelligent Interruption Management System to Enhance Safety and Performance in Complex Surgical and Robotic Procedures.” OR 2.0 Context Aware Oper Theaters Comput Assist Robot Endosc Clin Image Based Proced Skin Image Anal (2018), 11041, Pp. 62-68.Abstract
Procedural flow disruptions secondary to interruptions play a key role in error occurrence during complex medical procedures, mainly because they increase mental workload among team members, negatively impacting team performance and patient safety. Since certain types of interruptions are unavoidable, and consequently the need for multitasking is inherent to complex procedural care, this field can benefit from an intelligent system capable of identifying in which moment flow interference is appropriate without generating disruptions. In the present study we describe a novel approach for the identification of tasks imposing low cognitive load and tasks that demand high cognitive effort during real-life cardiac surgeries. We used heart rate variability analysis as an objective measure of cognitive load, capturing data in a real-time and unobtrusive manner from multiple team members (surgeon, anesthesiologist and perfusionist) simultaneously. Using audio-video recordings, behavioral coding and a hierarchical surgical process model, we integrated multiple data sources to create an interactive surgical dashboard, enabling the identification of specific steps, substeps and tasks that impose low cognitive load. An interruption management system can use these low demand situations to guide the surgical team in terms of the appropriateness of flow interruptions. The described approach also enables us to detect cognitive load fluctuations over time, under specific conditions (e.g. emergencies) or in situations that are prone to errors. An in-depth understanding of the relationship between cognitive overload states, task demands, and error occurrence will drive the development of cognitive supporting systems that recognize and mitigate errors efficiently and proactively during high complex procedures.
Christopher L Tarola, Sameer Hirji, Steven J Yule, Jennifer M Gabany, Alessandro Zenati, Roger D Dias, and Marco A Zenati. 8/2018. “Cognitive Support to Promote Shared Mental Models during Safety-Critical Situations in Cardiac Surgery (Late Breaking Report).” 2018 IEEE Conf Cogn Comput Asp Situat Manag CogSIMA (2018), 2018, Pp. 165-167.Abstract
To address the, currently unmet, need for intra-operative safety-critical cognitive support in cardiac surgery, we have developed, validated, and implemented a series of customized checklists to address intra-operative emergencies, using a simulated operative setting. These crisis checklists are designed to provide cognitive and communication support to the operative team to reduce the likelihood of adverse events and improve adherence to best-practice guidelines. We recruited a number of content specialists including members of the hospital safety network and intraoperative cardiac surgery team members, and utilized a Delphi consensus method to develop procedure-specific guidelines for select intraoperative crises. Cardiac surgery team members were subsequently trained on utilizing the developed checklists, performed operative simulations, and were surveyed to determine checklist facility and effectiveness. We developed and validated five checklists for the following cardiac surgery crisis scenarios: (a) Cardiopulmonary Bypass Failure; (b) Systemic Air Embolism; (c) Venous Air Lock; (d) Protamine Reaction; Heparin Resistance. Upon initiation of the crisis management, a crew resource management approach was triggered. A member of the operative team was designated as the "reader" for each scenario to guide the team through the process. After training, 89% of operative team members surveyed indicated that they would like the crisis checklist to be used if they had one of these events occurring to them. Crisis management challenges members of the cardiac surgery team in reasoning accurately and according to best practice during periods of high cognitive workload and psychological stress. These crisis checklists were developed, validated, and simulated with the goal of supporting human performance and shared mental models in the clinical setting.
Roger D Dias, Leon J Osterweil, Giuseppe Riccardi, Heather M Conboy, George S Avrunin, Steven J Yule, Jennifer M Gabany, David Arney, Marco A Zenati, Lori A Clarke, and Julian M Goldman. 8/2018. “Development of an Interactive Dashboard to Analyze Cognitive Workload of Surgical Teams During Complex Procedural Care.” IEEE Int Interdiscip Conf Cogn Methods Situat Aware Decis Support, 2018, Pp. 77-82.Abstract
In the surgical setting, team members constantly deal with a high-demand operative environment that requires simultaneously processing a large amount of information. In certain situations, high demands imposed by surgical tasks and other sources may exceed team member's cognitive capacity, leading to cognitive overload which may place patient safety at risk. In the present study, we describe a novel approach to integrate an objective measure of team member's cognitive load with procedural, behavioral and contextual data from real-life cardiac surgeries. We used heart rate variability analysis, capturing data simultaneously from multiple team members (surgeon, anesthesiologist and perfusionist) in a real-time and unobtrusive manner. Using audio-video recordings, behavioral coding and a hierarchical surgical process model, we integrated multiple data sources to create an interactive surgical dashboard, enabling the analysis of the cognitive load imposed by specific steps, substeps and/or tasks. The described approach enables us to detect cognitive load fluctuations over time, under specific conditions (e.g. emergencies, teaching) and in situations that are prone to errors. This in-depth understanding of the relationship between cognitive load, task demands and error occurrence is essential for the development of cognitive support systems to recognize and mitigate errors during complex surgical care in the operating room.
Joao Gabriel Rosa Ramos, Roger Daglius Dias, Rogerio Hora da Passos, Paulo Benigno Pena Batista, and Daniel Neves Forte. 8/2018. “Prognostication in urgent intensive care unit referrals: a cohort study.” BMJ Support Palliat Care.Abstract
OBJECTIVES: Prognostication is an essential ability to clinicians. Nevertheless, it has been shown to be quite variable in acutely ill patients, potentially leading to inappropriate care. We aimed to assess the accuracy of physician's prediction of hospital mortality in acutely deteriorating patients referred for urgent intensive care unit (ICU) admission. METHODS: Prospective cohort of acutely ill patients referred for urgent ICU admission in an academic, tertiary hospital. Physicians' prognosis assessments were recorded at ICU referral. Prognosis was assessed as survival without severe disabilities, survival with severe disabilities or no survival. Prognosis was further dichotomised in good prognosis (survival without severe disabilities) or poor prognosis (survival with severe disabilities or no survival) for prediction of hospital mortality. RESULTS: There were 2374 analysed referrals, with 2103 (88.6%) patients with complete data on mortality and physicians' prognosis. There were 593 (34.4%), 215 (66.4%) and 51 (94.4%) deaths in the groups ascribed a prognosis of survival without disabilities, survival with severe disabilities or no survival, respectively (p<0.001). Sensitivity was 31%, specificity was 91% and the area under the receiver operating characteristic curve was 0.61 for prediction of mortality. After multivariable analysis, severity of illness, performance status and ICU admission were associated with an increased likelihood of incorrect classification, while worse predicted prognosis was associated with a lower chance of incorrect classification. CONCLUSIONS: Physician's prediction was associated with hospital mortality, but overall accuracy was poor, mainly due to low sensitivity to detect risk of poor prognosis.
Roger D Dias, Avni Gupta, and Steven J Yule. 8/2018. “Using Machine Learning to Assess Physician Competence: A Systematic Review.” Acad Med.Abstract
PURPOSE: To identify the different machine learning (ML) techniques that have been applied to automate physician competence assessment and evaluate how these techniques can be used to assess different competence domains in several medical specialties. METHOD: In May 2017, MEDLINE, EMBASE, PsycINFO, Web of Science, ACM Digital Library, IEEE Xplore Digital Library, PROSPERO, and Cochrane Database of Systematic Reviews were searched for articles published from inception to April 30, 2017. Studies were included if they applied at least one ML technique to assess medical students', residents', fellows', or attending physicians' competence. Information on sample size, participants, study setting and design, medical specialty, ML techniques, competence domains, outcomes, and methodological quality was extracted. MERSQI was used to evaluate quality, and a qualitative narrative synthesis of the medical specialties, ML techniques, and competence domains was conducted. RESULTS: Of 4,953 initial articles, 69 met inclusion criteria. General surgery (24, 34.8%) and radiology (15, 21.7%) were the most studied specialties; natural language processing (24, 34.8%), support vector machine (15, 21.7%), and hidden Markov models (14, 20.3%) were the ML techniques most often applied; and patient care (63, 91.3%) and medical knowledge (45, 65.2%) were the most assessed competence domains. CONCLUSIONS: A growing number of studies have attempted to apply ML techniques to physician competence assessment. Although many studies have investigated the feasibility of certain techniques, more validation research is needed. The use of ML techniques may have the potential to integrate and analyze pragmatic information that could be used in real-time assessments and interventions.
George S Avrunin, Lori A Clarke, Heather M Conboy, Leon J Osterweil, Roger D Dias, Steven J Yule, Julian M Goldman, and Marco A Zenati. 5/2018. “Toward Improving Surgical Outcomes by Incorporating Cognitive Load Measurement into Process-Driven Guidance.” Softw Eng Healthc Syst SEHS IEEE ACM Int Workshop, 2018, Pp. 2-9.Abstract
This paper summarizes the accomplishments and recent directions of our medical safety project. Our process-based approach uses a detailed, rigorously-defined, and carefully validated process model to provide a dynamically updated, context-aware and thus, "Smart" Checklist to help process performers understand and manage their pending tasks [7]. This paper focuses on support for teams of performers, working independently as well as in close collaboration, in stressful situations that are life critical. Our recent work has three main thrusts: provide effective real-time guidance for closely collaborating teams; develop and evaluate techniques for measuring cognitive load based on biometric observations and human surveys; and, using these measurements plus analysis and discrete event process simulation, predict cognitive load throughout the process model and propose process modifications to help performers better manage high cognitive load situations. This project is a collaboration among software engineers, surgical team members, human factors researchers, and medical equipment instrumentation experts. Experimental prototype capabilities are being built and evaluated based upon process models of two cardiovascular surgery processes, Aortic Valve Replacement (AVR) and Coronary Artery Bypass Grafting (CABG). In this paper we describe our approach for each of the three research thrusts by illustrating our work for heparinization, a common subprocess of both AVR and CABG. Heparinization is a high-risk error-prone procedure that involves complex team interactions and thus highlights the importance of this work for improving patient outcomes.
Gabriela Toutin-Dias, Roger Daglius-Dias, and Augusto Scalabrini-Neto. 2/2018. “Breaking bad news in the emergency department: a comparative analysis among residents, patients and family members' perceptions.” Eur J Emerg Med, 25, 1, Pp. 71-76.Abstract
OBJECTIVE: Our main objective was to assess patient and family members' perception of bad news communication in the emergency department (ED) and compare these with physicians' perceptions. METHODS: This is a cross-sectional study carried out at the ED of a tertiary teaching hospital. To compare physicians' and receivers' (patient and/or family member) perceptions, we created a survey based on the six attributes derived from the SPIKES protocol. The surveys were applied immediately after communication of bad news occurred in the ED. We analyzed agreement among participants using κ-statistics and the χ-test to compare proportions. RESULTS: A total of 73 bad news communication encounters were analyzed. The survey respondents were 73 physicians, 69 family members, and four patients. In general, there is a low level of agreement between physicians' and receivers' perceptions of how breaking bad news transpired. The satisfaction level of receivers, in terms of breaking bad news by doctors, presented a mean of 3.7±0.6 points. In contrast, the physicians' perception of the communication was worse (2.9±0.6 points), with P value less than 0.001. CONCLUSION: Doctors and receivers disagree in relation to what transpired throughout bad news communications. Discrepancies were more evident in issues involving emotion, invitation, and privacy. An important agreement between perceptions was found in technical and knowledge-related aspects of the communication.
RD Dias, MC Ngo-Howard, MT Boskovski, MA Zenati, and SJ Yule. 2/2018. “Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload.” Br J Surg, 105, 5, Pp. 491-501.Abstract
BACKGROUND: Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics. METHODS: A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score. RESULTS: Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent). CONCLUSION: Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition.
2017
Roger Daglius Dias and Augusto Scalabrini Neto. 2017. “Acute stress in residents during emergency care: a study of personal and situational factors.” Stress, 20, 3, Pp. 241-248.Abstract
Providing care for simulated emergency patients may induce considerable acute stress in physicians. However, the acute stress provoked in a real-life emergency room (ER) is not well known. Our aim was to assess acute stress responses in residents during real emergency care and investigate the related personal and situational factors. A cross-sectional observational study was carried out at an emergency department of a tertiary teaching hospital. All second-year internal medicine residents were invited to voluntarily participate in this study. Acute stress markers were assessed at baseline (T1), before residents started their ER shift, and immediately after an emergency situation (T2), using heart rate, systolic, and diastolic blood pressure, salivary α-amylase activity, salivary interleukin-1 β, and the State-Trait Anxiety Inventory (STAI-s and STAI-t). Twenty-four residents were assessed during 40 emergency situations. All stress markers presented a statistically significant increase between T1 and T2. IL-1 β presented the highest percent increase (141.0%, p < .001), followed by AA (99.0%, p = .002), HR (81.0%, p < .001), DBP (8.0%, p < .001), and SBP (3.0%, p < .001). In the multivariable analysis, time of residency had a negative correlation with HR during the emergency (adjusted R-square = .168; F = 8.69; p = .006), SBP response (adjusted R-square = .210; F = 6.19; p = .005) and DBP response (adjusted R-square = .293; F = 9.09; p = .001). Trait anxiety (STAI-t) was positively correlated with STAI-s (adjusted R-square = .326; F = 19.9; p < .001), and number of procedures performed during emergency care had a positive association with HR response (adjusted R-square = .241; F = 5.02; p = .005). In the present study, emergency care provoked substantial acute stress in residents. Resident experience, trait anxiety, and number of emergency procedures were independently associated with acute stress response.
Roger Daglius Dias and Augusto Scalabrini-Neto. 2017. “Acute stress in residents playing different roles during emergency simulations: a preliminary study.” Int J Med Educ, 8, Pp. 239-243.Abstract
Objectives: To investigate acute stress response in residents playing nurse and physician roles during emergency simulations. Methods: Sixteen second-year internal medicine residents participated in teams of four (two playing physician roles and two playing nurse roles). Stress markers were assessed in 24 simulations at baseline (T1) and immediately after the scenario (T2), using heart rate, systolic and diastolic blood pressure, salivary α-amylase, salivary cortisol and salivary interleukin-1β. The State-Trait Anxiety Inventory was applied at T2. Continuous data were summarized for the median (1st-3rd interquartile ranges), and the Mann-Whitney U Test was used to compare the groups. Results: The percent variations of the stress markers in the physician and nurse roles, respectively, were the following: heart rate: 70.5% (46.0-136.5) versus 53.0% (29.5-117.0), U=89.00, p=0.35; systolic blood pressure: 3.0% (0.0-10.0) versus 2.0% (-2.0-9.0), U=59.50, p=0.46; diastolic blood pressure: 5.5% (0.0-13.5) versus 0.0% (0.0-11.5), U=91.50, p=0.27; α-amylase: -5.35% (-62.70-73.90) versus 42.3% (12.4-133.8), U=23.00, p=0.08; cortisol: 35.3% (22.2-83.5) versus 42.3% (12.4-133.8), U=64.00, p=0.08); and interleukin-1β: 54.4% (21.9-109.3) versus 112.55% (29.7-263.3), U= 24.00, p=0.277. For the physician and nurse roles, respectively, the average heart rate was 101.5 (92.0-104.0) versus 91.0 (83.0-99.5) beats per minute, U=96.50, p=0.160; and the state anxiety inventory score was 44.0 (40.0-50.0) versus 42.0 (37.50-48.0) points, U= 89.50, p=0.319. Conclusions: Different roles during emergency simulations evoked similar participants' engagement, as indicated by acute stress levels. Role-play strategies can provide high psychological fidelity for simulation-based training, and these results reinforce the potential of role-play methodologies in medical education.
Sabrina Corrêa da Costa Ribeiro, Ricardo Tavares de Carvalho, Juraci Aparecida Rocha, and Roger Daglius Dias. 2017. “Criterion validity and inter-rater reliability of a palliative care screening tool for patients admitted to an emergency department intensive care unit.” Palliat Support Care, Pp. 1-7.Abstract
OBJECTIVE: The use of palliative care (PC) screening criteria to trigger PC consultations may optimize the utilization of PC services, improve patient comfort, and reduce invasive and futile end-of-life care. The aim of the present study was to assess the criterion validity and inter-rater reliability of a PC screening tool for patients admitted to an emergency department intensive care unit (ED-ICU). METHOD: Observational retrospective study evaluating PC screening criteria based on the presence of advanced diagnosis and the use of two "surprise questions" (traditional and modified). Patients were classified at ED-ICU admission in four categories according to the proposed algorithm. Result A total of 510 patients were included in the analysis. From these, 337 (66.1%) were category 1, 0 (0.0%) category 2, 63 (12.4%) category 3, and 110 (21.6%) category 4. Severity of illness (Simplified Acute Physiology Score III score and mechanical ventilation), mortality (ED-ICU and intrahospital), and PC-related measures (order for a PC consultation, time between admission and PC consultation, and transfer to a PC bed) were significantly different across groups, more evidently between categories 4 and 1. Category 3 patients presented similar outcomes to patients in category 1 for severity of illness and mortality. However, category 3 patients had a PC consultation ordered more frequently than did category 1 patients. The screening criteria were assessed by two independent raters (n = 100), and a substantial interrater reliability was found, with 80% of agreement and a kappa coefficient of 0.75 (95% confidence interval = 0.62, 0.88). Significance of results This study is the first step toward the implementation of a PC screening tool in the ED-ICU. The tool was able to discriminate three groups of patients within a spectrum of increasing severity of illness, risk of death, and PC needs, presenting substantial inter-rater reliability. Future research should investigate the implementation of these screening criteria into routine practice of an ED-ICU.
Jamie M Robertson, Roger D Dias, Steven Yule, and Douglas S Smink. 2017. “Operating Room Team Training with Simulation: A Systematic Review.” J Laparoendosc Adv Surg Tech A, 27, 5, Pp. 475-480.Abstract
INTRODUCTION: Nontechnical skills (NTS) such as teamwork and communication play an important role in preventing adverse outcomes in the operating room (OR). Simulation-based OR team training focused on these skills provides an environment where team members can learn with and from one another. We sought to conduct a systematic review to identify simulation-based approaches to NTS training for surgical teams. MATERIALS AND METHODS: We conducted a systematic search of PubMed, ERIC, and the Cochrane Database using keywords and MeSH terms for studies describing simulation-based training for OR teams, including members from surgery, anesthesia, and nursing in September 2016. Information on the simulations, participants, and NTS assessments were abstracted from the articles meeting our search criteria. RESULTS: We identified 10 published articles describing simulation-based OR team-training programs focused on NTS. The primary focus of these programs was on communication, teamwork, leadership, and situation awareness. Only four of the programs used a validated instrument to assess the NTS of the individuals or teams participating in the simulations. DISCUSSION: Simulation-based OR team-training programs provide opportunities for NTS development and reflection by participants. Future programs could benefit from involving the full range of disciplines and professions that compose an OR team, as well as increased use of validated assessment instruments.
2016
Joao Gabriel Rosa Ramos, Beatriz Perondi, Roger Daglius Dias, Leandro Costa Miranda, Claudio Cohen, Carlos Roberto Ribeiro Carvalho, Irineu Tadeu Velasco, and Daniel Neves Forte. 2016. “Development of an algorithm to aid triage decisions for intensive care unit admission: a clinical vignette and retrospective cohort study.” Crit Care, 20, Pp. 81.Abstract
BACKGROUND: Intensive care unit (ICU) admission triage is performed routinely and is often based solely on clinical judgment, which could mask biases. A computerized algorithm to aid ICU triage decisions was developed to classify patients into the Society of Critical Care Medicine's prioritization system. In this study, we sought to evaluate the reliability and validity of this algorithm. METHODS: Nine senior physicians evaluated forty clinical vignettes based on real patients. The reference standard was defined as the priorities ascribed by two investigators with full access to patients' records. Agreement of algorithm-based priorities with the reference standard and with intuitive priorities provided by the physicians were evaluated. Correlations between algorithm prioritization and physicians' judgment of the appropriateness of ICU admissions in scarcity and nonscarcity settings were also evaluated. Validity was further assessed by retrospectively applying this algorithm to 603 patients with requests for ICU admission for association with clinical outcomes. RESULTS: Agreement between algorithm-based priorities and the reference standard was substantial, with a median κ of 0.72 (interquartile range [IQR] 0.52-0.77). Algorithm-based priorities demonstrated higher interrater reliability (overall κ 0.61, 95% confidence interval [CI] 0.57-0.65; median percentage agreement 0.64, IQR 0.59-0.70) than physicians' intuitive prioritization (overall κ 0.51, 95% CI 0.47-0.55; median percentage agreement 0.49, IQR 0.44-0.56) (p = 0.001). Algorithm-based priorities were also associated with physicians' judgment of appropriateness of ICU admission (priorities 1, 2, 3, and 4 vignettes would be admitted to the last ICU bed in 83.7%, 61.2%, 45.2%, and 16.8% of the scenarios, respectively; p < 0.001) and with actual ICU admission, palliative care consultation, and hospital mortality in the retrospective cohort. CONCLUSIONS: This ICU admission triage algorithm demonstrated good reliability and validity. However, more studies are needed to evaluate a difference in benefit of ICU admission justifying the admission of one priority stratum over the others.
Rafael Oliveira Ximenes, Alberto Queiroz Farias, Augusto Scalabrini Neto, Márcio Augusto Diniz, Gabriel Taricani Kubota, Maurício Menezes Aben-Athar Ivo, Caroline Gracia Plena Sol Colacique, Luiz Augusto Carneiro D'Albuquerque, and Roger Daglius Dias. 2016. “Patients with cirrhosis in the ED: early predictors of infection and mortality.” Am J Emerg Med, 34, 1, Pp. 25-9.Abstract
BACKGROUND: Patients with cirrhosis have high risk of bacterial infections and cirrhosis decompensation, resulting in admission to emergency department (ED). However, there are no criteria developed in the ED to identify patients with cirrhosis with bacterial infection and with high mortality risk. STUDY OBJECTIVE: The objective of the study is to identify variables from ED arrival associated with bacterial infections and inhospital mortality. METHODS: This is a retrospective single-center study using a tertiary hospital's database to identify consecutive ED patients with decompensated cirrhosis. Clinical variables and laboratory results were obtained by chart review. Logistic regression models were built to determine variables independently associated with bacterial infection and mortality. Scores using these variables were designed. RESULTS: One hundred forty-nine patients were enrolled, most of them males (77.9%) with alcoholic cirrhosis (53%) and advanced liver disease (Child-Pugh C, 47.2%). Bacterial infections were diagnosed in 72 patients (48.3%), and 36 (24.2%) died during hospital stay. Variables independently associated with bacterial infection were lymphocytes less than or equal to 900/mm(3) (odds ratio [OR], 3.85 [95% confidence interval {CI}, 1.47-10]; P = .006) and C-reactive protein greater than 59.4 mg/L (OR, 5.05 [95% CI, 1.93-13.2]; P = .001). Variables independently associated with mortality were creatinine greater than 1.5 mg/dL (OR, 4.35 [95% CI, 1.87-10.1]; P = .001) and international normalized ratio greater than 1.65 (OR, 3.71 [95% CI, 1.6-8.61]; P = .002). Scores designed to predict bacterial infection and mortality (Mortality in Cirrhosis Emergency Department Score) had an area under the receiver operating characteristic curve of 0.82 and 0.801, respectively. The Mortality in Cirrhosis Emergency Department Score performed better than Model for End-Stage Liver Disease score. CONCLUSIONS: In this cohort of ED patients with decompensated cirrhosis, lymphopenia and elevated C-reactive protein were related to bacterial infections, and elevated creatinine and international normalized ratio were related to mortality. Scores built with these variables should be prospectively validated.
Roger Daglius Dias and Augusto Scalabrini Neto. 2016. “Stress levels during emergency care: A comparison between reality and simulated scenarios.” J Crit Care, 33, Pp. 8-13.Abstract
PURPOSE: Medical simulation is fast becoming a standard of health care training throughout undergraduate, postgraduate and continuing medical education. Our aim was to evaluate if simulated scenarios have a high psychological fidelity and induce stress levels similarly to real emergency medical situations. MATERIALS AND METHODS: Medical residents had their stress levels measured during emergency care (real-life and simulation) in baseline (T1) and immediately post-emergencies (T2). Parameters measuring acute stress were: heart rate, systolic and diastolic blood pressure, salivary α-amylase, salivary interleukin-1β, and State-Trait Anxiety Inventory score. RESULTS: Twenty-eight internal medicine residents participated in 32 emergency situations (16 real-life and 16 simulated emergencies). In the real-life group, all parameters increased significantly (P < .05) between T1 and T2. In the simulation group, only heart rate and interleukin-1β increased significantly after emergencies. The comparison between groups demonstrates that acute stress response (T2 - T1) and State-Trait Anxiety Inventory score (in T2) did not differ between groups. CONCLUSIONS: Acute stress response did not differ between both groups. Our results indicate that emergency medicine simulation may create a high psychological fidelity environment similarly to what is observed in a real emergency room.

Pages