Focused cardiac ultrasound (FoCUS) is a valuable skill for rapid assessment of cardiac function and volume status. Despite recent widespread adoption among physicians, there is limited data on the optimal training methods for teaching FoCUS and metrics for determining competency. We conducted a systematic review to gain insight on the optimal training strategies, including type and duration, that would allow physicians to achieve basic competency in FoCUS.
Embase, PubMed, and Cochrane Library databases were searched from inception to June 2020. Included studies described standardized training programs for at least 5 medical students or physicians on adult FoCUS, followed by an assessment of competency relative to an expert. Data were extracted, and bias was assessed for each study.
Data were extracted from 23 studies on 292 learners. Existing FoCUS training programs remain varied in duration and type of training. Learners achieved near perfect agreement (κ > 0.8) with expert echocardiographers on detecting left ventricular systolic dysfunction and pericardial effusion with 6 h each of didactics and hands-on training. Substantial agreement (κ > 0.6) on could be achieved in half this time.
A short training program will allow most learners to achieve competency in detecting left ventricular systolic dysfunction and pericardial effusion by FoCUS. Additional training is necessary to ensure skill retention, improve efficiency in image acquisition, and detect other pathologies.
Technological advancements have led to increasing availability of high quality, low-profile ultrasound devices at reduced costs [1]. One area that has seen tremendous growth is that of focused cardiac ultrasound (FoCUS), which describes point-of-care ultrasound that is intended to provide a rapid qualitative assessment of cardiac function. The use of FoCUS has expanded to a variety of practice settings, including emergency medicine, critical care, anesthesia, internal medicine, and primary care, owing largely to its relative ease of use [2]. Prior studies suggest that trainees and non-cardiologist physicians with limited prior ultrasonographic experience can gain proficiency in FoCUS with brief training, such as a 1-day workshop and 20–50 practice scans [3, 4]. FoCUS has proven useful for the assessment of ventricular function, valvular abnormalities, volume status, as well as for the detection of cardiac tamponade, aortic dissection or aneurysm, and pulmonary embolism [5]. The use of FoCUS has been shown to alter management in perioperative [6, 7], critical care [8, 9], and emergency [10, 11] settings and has been shown to improve outcomes in select patients [12].
While FoCUS can be beneficial for patient care and more effective allocation of healthcare resources, there is potential for harm with inappropriate use [13]. The implications of relying on a false negative exam could include delayed or missed diagnoses. Similarly, false positive findings or misinterpretations could lead to unwarranted testing or procedures and increased healthcare spending. Despite the potential for such consequences, formal training programs have not been widely embraced, and quality control metrics are often lacking [14, 15]. Surveys have revealed the fear of missed diagnoses and the lack of training or certification as important barriers to the adoption of FoCUS [16]. The adoption of robust parameters for assessing competency in image acquisition, analysis, and interpretation among physicians is needed to effectively train learners and ensure appropriate use [17].
Leaders in ultrasonography have recognized the need for training standards and have supported the development of structured certification programs for FoCUS as well as quantitative transthoracic echocardiography (TTE), shown in Table 1 [24, 31]. Current certifications in TTE require between 75 and 250 scans and passing one or more standardized examinations, while certification in FoCUS typically requires between 20 and 50 supervised scans. However, many of these recommendations are based on guidance developed for the use of FoCUS and/or TTE in emergency and critical care settings, and their applicability outside of these settings has not been well-demonstrated. There is also no consensus on the optimal method of training in FoCUS or the appropriate metrics for determining skill development. Many small-scale studies have documented and compared strategies for FoCUS education and evaluation among various sub-populations and clinical environments [32]. Among these are studies on trainees and licensed physicians working in intensive care units, medical wards, emergency departments, and perioperative areas for which very different scanning protocols are employed. The heterogeneity of studies has made it difficult to draw conclusions, and thus, the type and duration of training to allow most learners to achieve competency in FoCUS remains undetermined. We conducted a systematic review and meta-analysis to examine existing strategies for FoCUS training and to gain insight on the optimal amount and type of training that will allow for attainment of basic competency in adult FoCUS.
All studies included in the analysis were non-randomized, observational studies of an intervention and thus were expected to have a substantial and unavoidable bias due to confounding. We identified several consistent sources of bias in the selection of participants, amount of training received by learners within each training program, number of scans performed, pre-existing knowledge of the clinical status of patient subjects, and interobserver variability. Bias was assessed for each study using the ROBINS-I tool (Table 2) [34].
FoCUS is intended to provide qualitative or semi-quantitative assessment of major cardiac abnormalities, such as identifying LV systolic dysfunction, pericardial effusion, or valvular abnormalities [59]. As a goal-directed tool, data obtained needs to be reliable as it is used to guide immediate clinical management. Thus, the development of a FoCUS training platform that ensures competency is necessary for safe and meaningful use. Our systematic review has shown that existing training programs vary substantially in their duration of training (45 min to over 20 h), type of training provided, skills taught, and clinical setting in which FoCUS skills were assessed. Our analysis also showed that a short duration of training, i.e., 2–3 h didactics and 2–3 h of hands-on training, may be sufficient for most learners to achieve substantial agreement with experts in identifying two major cardiac abnormalities: LV systolic dysfunction and pericardial effusion. Meanwhile, near perfect agreement (κ > 0.8) for detecting these abnormalities could be achieved after 6 h of didactics and 6 h of hands-on training. Identification of other pathologies, particularly wall motion abnormalities, valvular lesions, and IVC enlargement, was often more difficult, and most learners were only able to achieve fair to moderate agreement with experts after brief training.
Many studies included in our review involved comparison of data obtained through FoCUS exams performed using a small portable or handheld device to data obtained from a TTE performed using ultrasound machines with high resolution and advanced features. FoCUS is not performed for the same diagnostic purpose, nor should it be expected to match the precision of a comprehensive TTE. Yet we felt that comparison to a well-established standard was likely to be the most reliable metric to assess learner competency and that results yielded from this higher benchmark should be interpreted within a margin of non-inferiority. FoCUS training should also include education on the intended use and inherent limitations of FoCUS versus TTE.
Our review examined the effect of three training parameters on learner performance. We showed that substantial agreement (κ > 0.6) between learners and experts on the assessment of LV systolic function could be achieved with only 2 h each of didactic and hands-on practice and a minimum (4–10) number of scans. Similarly, substantial agreement with experts on the identification of pericardial effusion could be achieved with only 3 h each of didactic and hands-on practice. The greater amount of time required for identifying pericardial effusions may be due to misidentification of pericardial fat as an effusion, or to the fact that small effusions can be missed in some views. Regardless, these findings are impressive, given that only moderate (κ > 0.4) to substantial (κ > 0.6) agreement exists between trained experts for assessments of LV function by FoCUS [60]. We also show that learner performance for identifying LV systolic dysfunction improves with time spent on didactics and time spent performing hands-on practice, at least for up to 6 h each, whereas the total number of scans performed did not correlate with improvement in identifying LV dysfunction. This may be due to the fact that there was already substantial agreement (κ > 0.6) between learners and experts after very few (4–10) scans. Also, identifying LV dysfunction by FoCUS is a skill that may be best taught through a combination of didactics and supervised practice, while the actual number of exams performed may be less important. In contrast, identification of pericardial effusion improved with time spent on didactics as well as with the number of scans performed, and substantial agreement with experts could be achieved after 25 scans. This suggests that the detection of pericardial effusion is a skill that is gained through additional experience rather than supervised practice and supports the completion of between 20 and 30 focused exams for achieving competency in FoCUS as recommended by existing governing bodies (Table 1). Overall, our quantitative findings confirm that learners may be able to achieve reasonable competency using ultrasound to assess LV function and identify pericardial effusion after a very short (4–6 h) duration of training that includes equal portions (2–3 h each) of didactic and hands-on learning. Our findings also suggest that a small number of scans (20–30) may be sufficient for learners to gain basic competency in FoCUS.
To our knowledge, ours is the first systematic review and meta-analysis to be published on training in FoCUS. A prior systematic review by Rajamani et al. [61] examined 42 studies with an aim of evaluating the quality of point-of-care ultrasound training programs and their ability to determine competence. Roughly half of all studies did not include a comparator group against which to assess learner competency. Another prior systematic review by Kanji et al. [32] examined 15 studies in the critical care setting, most of which assessed learning based on pre- and post-training test scores and also did not include assessment of competency against an accepted standard as was required in our review. In addition to requiring a comparator for assessing competency, we also took a broader approach in examining the training of a diverse group of learners. As FoCUS adoption continues to expand, we wanted to report findings that might guide appropriate guidelines for the education of providers from different backgrounds and skill levels.
Our review is the first to provide quantitative evaluation of the impact of various training parameters on learner performance. While established curricula exist for FoCUS training in critical care and in emergency medicine, such standards do not currently exist for other specialties. By including a heterogenous population of learners in our review, we hope that the findings may be generalizable to learners in other specialties such as internal medicine, anesthesiology, and general surgery who may be examining patients in settings ranging from outpatient clinic, in the operating room, or post-operatively in the hospital wards. Studies also ranged in their scope of training and parameters assessed, emphasizing that the determination of competency in performing and interpreting FoCUS is a challenging distinction that depends heavily on the clinical context. Because the goal of FoCUS will vary based on the clinical context to which they are applied, the specific metrics for competency will also vary [17]. For example, sensitivity for the detection of a reduction in left ventricular ejection fraction needs to be high in outpatient settings, such as in the study by Croft et al. [41], when determining the need for specialty referral and tailored management of chronic conditions. Meanwhile, a lower sensitivity is likely acceptable in the emergency department, such as in the studies by Farsi et al. [42] and Carrie et al. [39], when determining the presence of a cardiogenic cause for hemodynamic instability.
When considering the wide range of potential clinical applications for FoCUS, it is important to recognize that training clinicians with different skill levels for the use of FoCUS in a variety of settings is unlikely to be successful with a single standardized curriculum. Rather than content-based training that uses completion of a set of material as an endpoint, a competency-based program recognizes that learners will progress at different speeds and that some will require additional material to reach the same level of competency. Competency-based programs enable learners to move through topics at their own pace, progressing when they are comfortable with a new skill and deemed competent by their supervisor(s). This form of training has been successful for teaching other clinical skills such as central line placement and orotracheal intubation, in which clinical competency is not strictly linked to a number of lines placed or intubations performed and no formal accreditation is needed. The future practice of FoCUS may benefit from a convergence on competency-based training that is tailored to a particular application and/or specialty, rather than from pursuit of formal accreditation across specialties.
When considering the most effective ways to train physicians on the use of FoCUS, it is also important to recognize that the co-existent clinical demands on physician-learners can impede skill acquisition. Some of the strategies to support learners that were adopted by the studies in this review include offering one-on-one or small group sessions for additional supervised practice, providing supervision during clinical application, and establishing processes that give learners access to ongoing feedback from experts. Flexibility in training availability and integration of FoCUS practice with existing clinical workflows were two recurring strategies that seemed to cater to the needs of physician-learners.
The need to train new generations of physicians in adult FoCUS presents the opportunity for future study in this field. An important consideration when designing a training program is the prevention of skill decay, which has been noted to occur rapidly (within 1–3 months) after the completion of a brief training program [62]. One study [56] found that learners retained their imaging skills at 6 months post-training, but there was no data on skill retention beyond 6 months in any included studies. The duration of the training phase may be inversely related to the rate of decay, suggesting that longitudinal support through deliberate practice and mentored review may help learners to retain their skills [56]. By making ultrasound devices readily available and easily accessible within clinical environments, physicians can develop ways to incorporate FoCUS into their daily practice. Training programs must find ways to support learners beyond the initial training period in a manner that is structured yet flexible.
It is important for the reader to recognize that all of the studies identified were non-randomized, observational studies with critical levels of bias. First, selection bias was often evident in both the selection of participants, many of whom were volunteers, and the selection of patient subjects for exams. For example, patients requiring urgent evaluation and treatment are those who are also most likely to benefit from rapid, point-of-care ultrasound, and yet many of these patients were excluded from learner examinations. Three studies reduced subject selection bias by using standardized patients or an ultrasound simulator [37, 40, 56], but at the expense of external validity. Second, few studies [39, 44, 45, 50, 55] acknowledged exams performed by each learner as dependent data points, and even fewer accounted for this through the use of linear modeling [45, 50]. Third, most studies were conducted in actual clinical settings, where time constraints, patient factors, and learner motivation are expected to introduce bias into the results. And lastly, while we report the minimum hours required for learners to detect LV systolic function and identify the presence of pericardial effusion, we were unable to determine the minimum training period required to achieve competency in other aspects of cardiac assessment due to insufficient data.
FoCUS is an important diagnostic tool and will likely soon be considered a standard skillset for any practicing physician. A formal training program that includes 2–3 h of didactic learning, 2–3 h of hands-on training, and requiring 20–30 scans is likely to be adequate for most learners to achieve competency in the detection of gross LV systolic dysfunction and pericardial effusion. Additional training is necessary for skill retention, efficiency in image acquisition, and the detection of more subtle abnormalities. The finding that reasonable proficiency can be obtained after only brief formal training should encourage physicians at any career level to pursue training in FoCUS.
Aggregated data available by request
