Emergency departments in The Netherlands: is there a difference in emergency departments with and without emergency physicians? a cross-sectional web-based survey
© Thijssen et al.; licensee Springer. 2013
Received: 22 November 2012
Accepted: 10 March 2013
Published: 15 April 2013
There is a growing interest in emergency departments (EDs) and the development of emergency medicine in The Netherlands. In the last decade several policy reports have stated that the quality of emergency care should be improved and that emergency physicians (EPs) play a large role in the quality improvement. The Netherlands Society of Emergency Physicians (NVSHA) has developed an emergency medicine training program, which has been nationally recognized since 2009. Nevertheless, not all EDs are staffed with EPs yet. This study aimed to explore differences between Dutch EDs with EPs and those without EPs.
A cross-sectional web-based survey was performed on data over the year 2008 or 2009 in all 105 Dutch hospitals with an emergency department. We documented which ED-specific courses were attended by physicians working in the ED (list of 3 courses) and which clinical audit activities were implemented (list of 6 activities). The choice of courses and clinical audits was based on those mentioned in published quality reports and in national debates on emergency care. We compared EDs with and without EPs. The final analysis was based on a linear regression analysis, controlling for ED size and having an EP training program. We considered P < 0.05 significant.
Our survey’s response rate was 67%. EPs worked significantly more often in larger EDs. The linear regression analysis shows that the total number of courses attended by physicians was on average 0.51 higher (P = 0.000) in EDs with EPs than in EDs without EPs, and the total number of implemented clinical audits was on average 0.49 higher (P = 0.008). After controlling for potential confounders, the effect of both the composite number of courses attended (P = 0.001) and the composite number of implemented clinical activities (P = 0.032) remained significant.
This study shows that EPs are significantly more present in larger EDs and in EDs where there is more continuing professional education and where there are more clinical audit activities. Our findings suggest that the presence of emergency physicians is positively associated with the quality of emergency care, but prospective research is required to examine causality.
Organizing emergency care is an important topic in many countries. Due to rising healthcare costs and the need to improve the quality of emergency care in The Netherlands, there is a nationwide special interest in Dutch emergency departments (EDs) and the ongoing development of emergency medicine. The Inspectorate of Healthcare published several reports stating that the quality of emergency care should be improved and that EDs could be divided into three different categories, ranging from basic EM care in smaller hospitals, to more specialized care in larger teaching hospitals, to full EM care in university medical centers and trauma centers. This has not been implemented during the timeframe of this study. This also is the case for the national Inspectorate of Healthcare’s preference of having an emergency physician (EP) working in every ED [1–3]. In response to these reports, expert consensus panelists developed a national quality requirement framework (QFR) intended to improve EM care in Dutch EDs . A small sample study showed that none of the Dutch EDs complied with these developed indicators. In the first years of the millennium, five Dutch hospitals started an emergency medicine (EM) training program, which has been officially recognized as a candidate specialty, as of January 2009 [5, 6]. The main reason for this development was that up until then Dutch emergency departments (EDs) were mostly staffed with young inexperienced physicians having just graduated as doctors . Specialists who were not physically present in the ED supervised these physicians. The Dutch emergency medicine training program is 3 years long and consists of multiple rotations, with intensive care medicine, anesthesiology, cardiology, pediatric medicine, family medicine and ambulance medical services as compulsory. More than 50% percent of the training program takes place in the ED, and there are three compulsory courses: Advanced Trauma Life Support (ATLS), Advanced Life Support (ALS) and Advanced Pediatric Life Support (APLS). Although the literature states otherwise, some medical specialties in The Netherlands still question the need for an Emergency Medicine specialty [4, 8–17]. Despite the rapidly growing number of EPs in the Dutch EDs, there are still EDs that do not have EPs. This makes the Dutch setting an ideal place for research. We hypothesized that having an EP in the ED will lead to an improvement in the quality of emergency care. The EP is continuously working in the ED, having EM as his domain, and is therefore more committed to implementing quality improvement measures in the ED than physicians who occasionally visit the ED for patient care . The aim of this study was to look at features of all Dutch hospitals and their emergency departments in general and compare EDs with and without EPs. We also documented the continuing professional education of clinical ED staff through attended courses as well as clinical audits through ED registrations and meetings, which we considered proxy measures of the quality of emergency care.
We performed a cross-sectional web-based survey using Limesurvey (http://www.limesurvey.org). Data of the survey were coded and analyzed in SPSS 18. The primary outcomes of the study were continuing professional education and clinical audit activities in emergency departments. The medical ethics committee of Arnhem-Nijmegen granted institutional review board exemption.
We obtained an updated list of all hospitals in The Netherlands from the national website http://www.ziekenhuis.nl in December 2009. Of the 170 listed locations, 105 hospitals met the inclusion criteria of having an operating emergency department in the years 2008 and 2009. Between January and March 2010, these 105 emergency departments were contacted by telephone. The purpose was to identify a contact person in each ED, typically the head of staff and preferably the consultant, or the head manager of the ED, to explain the goal of this study. Of the 105 hospitals with an operating ED, 101 agreed to participate. Four EDs refused because the data requested was not available or because of lack of time or interest. A few hospitals had more then one ED location. Where hospitals had an operating ED in more than one location, only one questionnaire was filled out. This was because policies on courses and registrations were the same in multiple ED locations of the same hospital. However, differences between these EDs in general features and registrations that could not be filled out in one questionnaire were separately documented by personal telephone interviews and put in the SPSS database manually. This was also the case if, in the timeframe of the data collection, there had been a change in course policy or registration. A total of 97 questionnaires were eventually sent, representing all of the 101 participating EDs.
First, we measured general characteristics of both the hospital and the ED, including the number of hospital beds, acute care facilities, general facilities, number of ED visits per year, percentage of self-referrals and whether EDs used a triage system. Secondly, we checked if an ED had an EP. Having an EP in the ED was defined as having an ED with at least one EP in the group of EDs with EPs. Since EM is a young specialty in The Netherlands, there are not enough EPs to facilitate 24/7 emergency care in all EDs in The Netherlands. We defined Emergency Physicians as physicians who successfully finished the Dutch EM training program and were registered as EPs in the Dutch Medical Specialist Registration Committee (MSRC) or EPs working in the studied EDs that were registered as EPs in their own country with a recognized EM training program. Thirdly, we documented which ED-specific courses physicians needed to have attended, past or present, when working in their current ED (list of 3 courses) and which clinical audit activities were implemented (list of 6 activities). The choice of courses and clinical audits was based on those mentioned in published Dutch emergency department’s quality reports and in national debates on emergency care. The questionnaire was designed by experienced researchers, authors 3 and 4, after reviewing the literature and a pilot testing by a randomly chosen ED. This ED later also participated in the final survey. Each contact person was asked to answer the questions with the most recent data available, preferably over 2009, but if that was not possible then over 2008. It was suggested that filling out the survey could be a joint effort of medical personnel and management working in the ED. This was to minimize the influence of recall bias and missing data. Over a 3-month period, a maximum of three reminder emails were sent if the survey had not been completed. On follow-up, reasons for not filling out the survey were: the available data was incomplete, there was a lack of time or the head of staff had changed during the timeframe of the survey.
For the comparison of characteristics of EDs with EPs and EDs without EPs, we used either t-tests or chi-square tests as appropriate. For exploration of a possible effect of the presence of EPs on continuing professional education and clinical audit activities, we used linear regression analysis. This allowed controlling for potential confounders. Dependent variables in this analysis were the number of emergency care courses physicians attended and the number of clinical audit activities implemented. The independent variable was the presence of an EP. We controlled for the size of the ED and the presence of an EP training program. In model I we checked the effect of the presence of EPs on each of these two outcomes, and in model II we added the two potential confounders. Size of the ED was added to control for possible financial and organizational advantages of larger EDs. The existence of an EP training program was added because two of the courses (ALS and ATLS) documented are compulsory in the EM training program. In all analyses we considered p < 0.05 as statistically significant. Standard errors in the regression analysis were adjusted for the finite population correction (69 out of 105 EDs in The Netherlands).
General descriptions of hospitals and EDs*
EP (N= 38)
No EP (N= 27)
Number of hospital beds#
Distance to the nearest other hospital (km)#
Emergency cardiac care
Acute admission ward$
Patients per year#
ED admissions per year#
Self referrals (%)#
Emergency department features show that EDs with EPs had significantly more patients attending the ED per year, with a mean of 24.613 (7,818–48,230) compared to 19.408 (8.100−42.000, P = 0.048). We found a mean self-referral rate of 34% (0%−80%) in EDs with EPs compared to 29% (5%−65%) in EDs without EPs. Apart from one missing variable, all emergency departments except one were open 24 h. There was a significant difference for having a shock room in the ED, namely 38 (100%) in EDs with EPs and 20 (74%) in EDs without EPs (P = 0.004).
Training of physicians and quality-improving activities in EDs with EPs compared to EDs without EPs
Number of emergency departments
With EP N= 38 (%)
Without EP N= 27 (%)
Continuing professional education for physicians
EP specialty training**
Advanced trauma life support
Advanced cardiac life support
Clinical audit activities
Adverse event reporting^^^
Electronic patient record
Child abuse meeting
Results of the regression analysis
Continuing professional education for physicians (Mean number of courses attended by physicians)
EP (no EP ref.)
No. attending ED patients (× 10,000)
EP training program
Clinical audit activities
(Mean number of activities)
EP (no EP ref.)
No. attending ED patients (× 10,000)
EP training program
Our survey’s response rate was 67%. EPs worked significantly more often in larger EDs. We found that in EDs with EPs, physicians attended significantly more courses and implemented more clinical activities than EDs without EPs. These differences remained significant in the regression analyses for both the number of courses and implemented clinical activities.
The lowest number of patient visits per year in our study, representing 69 EDs, was 7,818. The study of Ikkersheim, conducted in the same period and representing 27 Dutch EDs, found a minimum of 3,466 patient visits per year . This could be due to the different percentage of rural hospitals in the overall study, being 21.5% in our study compared to 63% in Ikkersheim’s. They also found a 100% score in having a triage system compared to our 85% in EDs without EPs (100% in EDs with EPs). This could simply be explained by the overall numbers of EDs studied.
Our data also shows that EPs work in small and large hospitals as well as in academic settings in all regions of The Netherlands. EPs however work significantly more often in EDs with larger patient visits per year. This is probably because EPs initially started working in larger EDs with EM training programs and over time expanded to academic hospitals and rural areas. In emergency departments with EPs, physicians had attended more courses both individually and as composite numbers compared to emergency departments without EPs. After controlling for a training program, the number of courses attended remained significant.
We also found that in emergency departments with EPs, more clinical audit activities were undertaken. This association remained significant after controlling for the size of the department. It is likely that the significant difference in the radiology meeting could be the underlying cause for the significant composite numbers of clinical audits in EDs with EPs. A large liability insurance company for hospitals instigated the radiology meeting together with EPs from The Netherlands Society of Emergency Medicine (NVSHA) . The significant difference in the number of hospitals with EPs that have a radiology meeting, suggests the influence of EPs on implementing clinical audit activities. Although the financial capacity for larger EDs might be influential in attending more courses or implementing clinical audits, our data does not support this hypothesis. Very little has been reported on training courses and quality-improving activities in Dutch emergency departments. Van Geloven found a very low percentage of physicians in the ED having followed courses like ATLS (27%) or ECGs (6%). That study however, was done in 1999 before the introduction of the emergency medicine training program . This could explain the higher numbers we found. Our study suggests that EPs have a positive influence on physicians attending ABCDE courses and in implementing clinical audit activities, but it is likely that ED leadership or hospital management is influential as well. Although this was one of the first nationwide inventories of its kind in The Netherlands, and other factors were mentioned as well, the positive influence of EPs suggests that their presence could improve the quality of care and therefore patient safety.
At the moment there are not enough EPs to staff all the EDs in The Netherlands and the length of their training program, 3 years, is not meeting the criteria of the ‘Doctors’ Directive of the European Union, which states it should be 5 years (EU Directive 2006/100/EC) . Dutch EPs need the longer training program and simultaneously the recognition as a Medical Specialist to run the ED as a closed format. Undoubtedly, EPs have improved the quality of patient care on an individual patient level, but until the above-mentioned criteria are met, it will be difficult for EPs to implement overall clinical audits for all ED patients.
This study might also suggest that increasing the size of EDs in The Netherlands could potentially improve quality registrations and meetings. Although audit and feedback were found to have a moderately positive effect in the most recent Cochrane review, this study cannot identify causal effects . Consequently, this would then lead to a reduction in the numbers of EDs. We already see a similar occurrence in GP practices where larger practices seem to have more safety features present [21, 22].
Some limitations of this study should be mentioned. We cannot rule out a possible selection bias, as the response rate was 67%. However, our sample included a variety of EDs from every region in the country, suggesting reasonable representativeness.
Respondents had different backgrounds and positions, which may have influenced their answers and could have resulted in information and recall bias. This response rate is however high compared to many surveys among healthcare providers. Furthermore, the relation between non-response and selection bias is not so obvious.
This study documented the presence of EPs in the ED, not taking into account the total numbers of EPs and whether or not they were present 24/7. Therefore we cannot say that it is the influence of the EPs alone that leads to a higher percentage of courses attended . It could well be that it is in fact the hospital that wants to improve the quality of care and therefore employs EPs and lets other physicians, working in the ED, attend necessary courses. However, finding a significant difference in having a radiology meeting in EDs with EPs, an initiative strongly supported by emergency physicians may suggest a positive influence of EPs.
Our study focused on general features, continuing professional education and clinical audit activities, which do not necessarily reflect the quality of patient care. However, after the timeframe of the data collection of this study, the Dutch inspectorate of health issued a document stating that all physicians working in the ED are obligated to attend an ABCDE course before treating ED patients. This might suggest that training and quality activities may benefit the quality of patient care. Given the cross-sectional design, however, this study cannot identify causal effects.
Our study was designed to examine whether, in the short time that EPs have been present in Dutch EDs, there has been a difference in EDs with and without EPs. It showed that EPs are significantly more present in larger EDs and in EDs where there is more continuing professional education and where there are more clinical audit activities. We assume that these courses and registrations have a positive influence on the quality of care provided in Dutch EDs. Although this study could not identify causal effects, our findings might suggest that the presence of emergency physicians is positively associated with quality of care.
- Inspectorate of health report, September 2004 “Spoedeisende Hulpverlening: Haastige spoed niet overal goed (Emergency care; not always good). http://www.acutezorg.nl/bibliotheek/bericht/39090128_spoedeisende_hulpverlening_haastige_spoed_niet_overal_goed
- Health Council of the Netherlands: A solid foundation is a must! Quality at a basic Accident and Emergency Department within a regional network. The Hague: Health Council of the Netherlands; 2012. publication no. 2012/02
- RIVM prestatie-indicatoren voor de spoedeisende keten: “Development and measurability or performance indicators for emergency care.”. Report 270111002/2009. http://www.rivm.nl/en/Library/Scientific/Reports/2009/augustus/Development_and_measurability_of_performance_indicators_for_emergency_care?sp=cml2bXE9ZmFsc2U7c2VhcmNoYmFzZT00NTQ4MDtyaXZtcT1mYWxzZTs=&pagenr=4549
- Ikkersheim DE, van de Pas H: Improving the quality of emergency medicine care by developing a quality requirement framework: a study from the Netherlands. International Journal of Emergency Medicine 2012, 5: 20. 10.1186/1865-1380-5-20PubMed CentralPubMedView Article
- Thijssen W, Giesen P, Wensing M: Emergency departments in the Netherlands. Emerg Med J 2012,29(1):6–9. 10.1136/emermed-2011-200090PubMedView Article
- Gakeer MI, van den Brand CL, Patka P: Emergency medicine in the Netherlands: a short history provides a solid base for future challenges. Eur J Emerg Med 2012, 19: 131–135. 10.1097/MEJ.0b013e3283509d94View Article
- van Geloven AAW, Luitse JSK, Simons MP: Emergency medicine in the Netherlands, the necessity for changing the system; results from two questionnaires. Eur J Emerg Med 2003,10(4):318–322. 10.1097/00063110-200312000-00015PubMedView Article
- Holliman CJ, Mulligan TM, Suter RE, Cameron P: The efficacy and value of emergency medicine: a supportive literature review. International Journal of emergency Medicine 2011, 4: 44. 10.1186/1865-1380-4-44PubMed CentralPubMedView Article
- Giesen P, Thijssen WAMH, Voorn T: SEH kan efficiënter, [ED’s can be more efficient]. Med Contact 2009, 64: 38. 1590
- Maas M, Thijssen WAMH, van der Meyden : SEH arts biedt meerwaarde [EP’s proof to be beneficial]. Med Contact 2007,62(6):251–253.
- Holmes JL: Emergency medicine in the Netherlands. Emergency Medicine Australia 2010, 22: 7581.
- Van Uden C: Studies on general practice out-of-hours care. PhDThesis: University Maastricht; 2005.
- van CEP M: Dutch General Practitioners in a time of change–Studies on out-of-hours and GP hospital care. University Amsterdam: PhD Thesis; 2007.
- Giesen P: Quality of out-of-hours primary care in the Netherlands. Radboud University Nijmegen: PhD Thesis; 2007.
- van Uden CJT, Giesen PHJ, Metsemakers JFM: Development of out-of-hours primary care by general practitioners (GPs) in the Netherlands: from small call rotations to large-scale GP cooperatives. Fam Med 2006, 38: 548–552.
- Grol R, Giesen P, van Uden C: After-hours care in the United Kingdom, Denmark, and the Netherlands: new models. Health Aff 2006, 25: 1733–1737. 10.1377/hlthaff.25.6.1733View Article
- Kathan C: Introduction of emergency physicians not always efficient. University of Groningen: PDH thesis; 2008.
- Final report follow-up emergency department and operating room; blijf scherp op de vangnetten: het geeft resultaat “ stay sharp on the safety nets, it brings results”: Final report follow-up emergency department and operating room; blijf scherp op de vangnetten: het geeft resultaat “ stay sharp on the safety nets, it brings results”. , Webside accessed 1march 2013 http://www.medirisk.nl/sites/default/files/attachments/brochure-follow-up-vangnetten-juni-2012.pdf
- Gaakeer M, Brand van den C, Lieshout van J, Patka P: Opleiding SEH arts toe aan vakverdieping [EM training programm ready for the next level]. Med. Contact 2013, 68: 6. 334
- Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012., (6): Art. No. CD000259 10.1002/14651858.CD000259.pub3
- Was 18 Gaal S, Vanden Homberg P, Verstappen W: Patient safety features are more present in larger primary care practices. Health Policy 2010,97(1):87–91. 10.1016/j.healthpol.2010.03.007View Article
- Was 19 Giesen P, Smits M, Huibers L, Grol R, Wensing M: Quality of after-hours primary care in the Netherlands:a narrative review. Ann Intern Med 2011,55(2):108–114.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.