|
|
||||||||
Health Policy and Practice |
1 From the Research Department (J.H.S., R.S.L.) and Committee on Radiologist Resources (B.S.), American College of Radiology, 1891 Preston White Dr, Reston, VA 20191; Department of Diagnostic Imaging, Brown University Medical School, Providence, RI (B.S.); Department of Diagnostic Imaging, Rhode Island Hospital, Providence (B.S.); and Department of Diagnostic Radiology, Yale University School of Medicine, New Haven, Conn (H.P.F.). Received July 3, 2001; revision requested August 20; revision received October 9; accepted November 12. Address correspondence to J.H.S. (e-mail: jonathans@acr.org).
| ABSTRACT |
|---|
|
|
|---|
MATERIALS AND METHODS: For the United States from 1990 to 1998, the authors compared three placement service measuresthe annual number of job listings, job seekers, and listings per seekerwith two presumably valid measures of the employment marketannual total jobs available (which was ascertained from surveys of hiring) and radiologist median income relative to the all-physician median. For the comparisons, both graphic displays of the data and correlation were used.
RESULTS: In graphs, patterns of change were similar. The correlation of job listings, which measure demand, with total jobs, which also measure demand, was 0.84 (P = .04). The correlation of (a) job seekers, a measure of supply, and (b) listings per seeker, which involve both supply and demand, with total jobs was substantial but lower: 0.58 (P = .23) and 0.76 (P = .08), respectively. Correlation of the three placement service measures with relative income, which presumably depends on both supply and demand, was 0.800.88 (P < .05 for each measure).
CONCLUSION: The statistical significance levels of the correlations and the pattern of findingsnamely, stronger correlations among measures of the same aspect of the employment marketindicate that these placement service data are valid and reasonably accurate measures of the employment market.
© RSNA, 2002
Index terms: Economics, medical Radiology and radiologists, socioeconomic issues
| INTRODUCTION |
|---|
|
|
|---|
The only data regularly available to show whether predictions like those of the Councilon Graduate Medical Education are proving to be true have been the all-physician unemployment rates (U.S. Bureau of Labor Statistics, unpublished data, quarterly). This statistic contains no specialty-specific information, although such information is critical, given the specialty-differentiated character of the forecasts of the Council on Graduate Medical Education and some of its predecessors, such as the Graduate Medical Education National Advisory Committee (4,13). To remedy this information deficit, the American College of Radiology (ACR) and subsequently the American Medical Association undertook a series of annual surveys that provided detailed specialty-specific information (11,1437). The ACR surveys dealt with radiology, and the American Medical Association surveys dealt with all sizable specialties. The surveys proved expensive, however, and because of the cost, both organizations discontinued them.
The purpose of this study was to determine whether data from a professional society placement servicethe Professional Bureau of the ACRare a valid measure of the employment market.
| MATERIALS AND METHODS |
|---|
|
|
|---|
The busiest period for the professional bureau each year is the last week of November during the annual scientific assembly and meeting of the Radiological Society of North America (RSNA), the largest radiology meeting in the world, when the professional bureau operates on site, and many face-to-face interviews take place. For our study, we used the data on the number of job seekers and jobs listed with the professional bureau at the RSNA meetings. These data provide a relatively clean point-in-time snapshot. In contrast, month-to-month data from the professional bureau are relatively convoluted because listings are for 6 months, are often not removed when a job is found or filled, and can be renewed. The professional bureau pledges confidentiality of name and address to those who use it. In keeping with that pledge, the professional bureau not only did not provide names and addresses for this study but also provided no individual-level information. We were given only the aggregate data on listings and job seekers shown in Table 1.
|
Data on physician incomes are taken from the annual Socioeconomic Monitoring Survey of the American Medical Association (38). As a measure, we used the ratio of the median income of radiologists to the median income of all physicians.
Analysis
The comparison of professional bureau annual statistics with actual total jobs available annually is an obvious means to ascertain whether the statistics of the professional bureau accurately measure the employment market; therefore, we made this comparison. Standard economics holds that when the supply of a good or servicesuch as radiologist servicesbecomes scarcer relative to demand, its price increases, and vice versa. Therefore, we compared annual professional bureau statistics with changes in radiologist incomes as another means to determine whether the former genuinely parallel changes in the employment market, as measured by the latter. However, because the predictions of economics are not always reliable, we first compared radiologist incomes with actual total jobs available to see if changes in radiologist incomes do, in fact, track known changes in the radiologist employment market.
We carried out comparisons of professional bureau statistics with the two presumably valid measures of the job market (a) first with graphing and accompanying descriptive analysis and (b) then with systematic quantitative analysis with standard statistical techniques. For reasons presented in the Discussion, we expected that each 1% change in total jobs available might be associated with a larger change2% or 3%in professional bureau statistics. Therefore, in the systematic quantitative analysis, we fit a model that assumes each 1% change in the independent variable (total jobs or radiologist incomes) is accompanied by a constant percentage changewhich may be either larger or smaller than 1%in the dependent variable (the professional bureau statistic). This is called measuring elasticity, which is a standard technique in economics that involves fitting a regression equation of the following form: logn (dependent variable) = b0 + b1logn (independent variable) + error. In this formulation, b1 is the elasticity and is the percentage change in the dependent variable associated with each 1% change in the independent variable.
In reporting results of the quantitative analysis, we emphasized the Pearson correlation coefficient. This is the most commonly used single measure of the strength of the association of two variables and, thus, should be familiar to a relatively large number of readers. The measure of association perhaps most prominent in regression analysis, R2 is the square of the Pearson correlation coefficient.
Because the professional bureau data are from near the end of the calendar year and, to a large extent, involve placements of residents and fellows completing their training in June of the following calendar year, we compared them with data for the following year. For example, 1990 professional bureau data are compared with 1991 total jobs available and relative income.
| RESULTS |
|---|
|
|
|---|
|
The number of radiologists seeking jobs through the professional bureau showed the same temporal pattern as the number of jobs listed with the professional bureau but with the opposite direction of change. That is, it peaked in 1994 rather than reaching a minimum. The number of professional bureau job listings per job seeker showed the same temporal pattern as the number of listings; it reached a minimum in 1994. However, it was more volatile, decreasing to approximately one-seventh of its beginning-of-decade level at its minimum, and then it nearly quadrupled over the next 3 years.
Quantitative Analysis
The correlation of the annual total number of jobs with radiologist relative income was 0.97 (P < .01) for the 5 years for which data are available for both variables.
The comparison of professional bureau job listings with annual total jobs shows an elasticity of 1.94, that is, listings changed by approximately 2% for every 1% change in actual total jobs (R2 = 0.84, P = .04) (Table 2). Professional bureau listings per job seeker showed a slightly weaker correlation with annual total jobs (R2 = 0.76; P = .08, which represents marginal statistical significance), but they were more elastic, changing by approximately 2.7% for every 1% change in annual total jobs. The relationship of job seekers who used the professional bureau to annual total jobs was substantial, but it was considerably weaker (R2 = 0.58, P = .23).
|
| DISCUSSION |
|---|
|
|
|---|
Overall Conclusions
Findings in our study indicate that professional bureau data are valid and reasonably accurate measures of the employment market. One strong body of evidence pointing to this conclusion consists of the strong relationshipshown in the Figure, the descriptive analysis, and the quantitative analysisbetween the professional bureau measures and the two presumably valid measures of the employment market. Another strong line of evidence lies in the specific form of this relationship.
The total number of jobs available is, obviously, a measure of the demand side of the employment market. Thus, it is expected that, as observed, its correlation would be strongest with the demand-side professional bureau measure, namely, job listings; weakest with the supply-side measure, namely, job seekers; and intermediate with the measure involving both supply and demand, namely, listings per job seeker. In contrast, radiologist relative income is a measure that presumably involves both supply and demand. Accordingly, it shows less difference in the strength of its relationship to the different professional bureau measures.
Most likely, the reason that changes in professional bureau listings are greater in percentage than are changes in total jobsthat is, the reason the elasticity is greater than 1is as follows: As the total number of jobs available increases, then, other things equal, it becomes more difficult on average to fill a job, and employers have to exert more efforts to succeed in hiring. They therefore, on average, make use of a greater number of employee-finding techniques, which means the probability of their using any given techniquesuch as the professional bureauincreases. In support of this view, the data in Table 1 show that when the total number of jobs was lowest, 6% of the total jobs for the year were listed with the professional bureau at the RSNA meeting, but 3 years later, when the total number of jobs had increased by two-thirds, 9% of the total for the year were listed with the professional bureau at the RSNA meeting. Presumably, a similar phenomenon takes place on the supply side of the employment market, with job seekers more likely to use the professional bureauor any other job-finding techniquewhen jobs are more difficult to obtain. Lacking a direct measure of seekers, we have no direct evidence on this point. However, it seems fairly certain that the three-to-one variation in job seekers using the professional bureau at the RSNA meeting in the 1990s (Table 1) is larger than the change in the total number of job seekers because the largest identifiable group of job seekers, the residents and fellows completing training each year, was nearly constant in size throughout the decade.
Techniques for Obtaining Employment Market Information
Various methods for obtaining information about the employment market have different advantages and disadvantages. Surveys can provide the most detailed information, including information not otherwise available that is of major concern, for example, the number of retirements (11,40). They can directly obtain information that is, by definition, valid, for example, the actual number of jobs available. However, they are slow, which means their information is available only with a serious lag, and they have proved so costly as to be feasible in only times of severe alarm regarding the employment situation. Finally, surveys are subject to sampling variability and nonresponse bias.
We have shown in this study that summary data from a professional society placement service are valid indicators of the employment market and can be leading indicatorsthat is, show what will happen in the near futureor, at least, coincident indicators. Given that a placement service is operating, such data are available at almost no cost in addition to the cost of operating the service. Currently produced summary data of the professional bureau contain no detail, but it would be feasible, with modest cost, for the professional bureau to tabulate listings and resumes to produce information about the number of listings and job seekers in specific subfields of radiology, the breakdown of jobs by region and between academic and nonacademic positions, the experience level of job seekers, and so on. However, the limited number of employers and job seekers using a placement service may limit the accuracy of disaggregated data.
One datum from a placement servicenamely, the ratio of job listings to job seekersincorporates information from both the supply and demand sides of the employment market and, therefore, is probably well insulated against a difficulty common to measures derived from nonsurvey sources. This difficulty is the likelihood that, as techniques used for job-finding and employee-finding changefor example, as electronic techniques to some extent displace print mediachanges in the measures will reflect changes in the use of techniques rather than actual changes in the employment situation. At the extreme, however, if other techniques eventually almost completely displace use of a placement service, its data are likely to become unreliable because they would be based on very few listings and job seekers.
Some of us (H.P.F., J.H.S.) have recently demonstrated that an index based on help-wanted advertising in leading journals is a valid and valuable measure of the radiology employment market (41). Seifer et al (42) previously used such indexes (without validation) to effectively illuminate relative trends in market demand for primary care and specialist physicians. Production of such indexes is less costly by an order of magnitude than the conduction of surveys; the indexes yield data more rapidly; and they offer a good deal of detail, although the information is not as extensive as that produced by surveys. On the other hand, their cost is not negligible, and the indexes will be biased downward over time if electronic employee-finding techniques gradually partially displace journal advertisements.
Limitations of the Study
Both of our presumably valid measures of the employment market have limitations. The total number of jobs available was measured with annual sample surveys. Like all sample surveys, these are subject to sampling variability and nonsampling bias. However, if there is a systematic nonsampling bias in our surveysfor example, if our survey findings were routinely 20% too smallthat would matter little because our analysis studied proportional year-to-year changes and not actual levels. Our surveys omit solo practices, which probably constitutes only a systematic downward bias. When groups report in the survey that they are recruiting, they may not all be working with equal vigor to hire radiologists.
The income data also came from sample surveys, with the limitations that implies. Moreover, it might, in the abstract, be preferable to use an absolute measure of radiologist income rather than their income relative to that of other physicians, the measure used in this study. However, Medicare payment changes and the advent of managed care have affected physician incomes in ways not related to changes in the surplus or shortage situation. In economist terminology, we think of these as shocks that consist of the use of market power in ways it had not been used before rather than changes in supply and demand. Thus, we used the relative measure. The relative measure, however, could be affected by changes in average supply of and demand for nonradiologist physicians that are extraneous to the phenomena we were trying to study.
Other limitations of our study include the following. For both total jobs available and radiologist income, data were available for only a limited number of years, which makes relatively strong correlations sometimes carry only modest statistical significance. Also, our study involved data from only one physician specialty. Although we have no reason to think that the employment market for radiologists operates differently from that for other specialties (contrary to a common impression, very few radiologists outside of academia are hospital employees), the generalizability of our results to other specialties has not been demonstrated. Finally, our study dealt with only the specific question of whether data from a professional society placement service are good measures of the employment markets rather than with the broad question of what factors affect the employment market. That question, and possibly relevant factors, such as retirement patterns, managed care, growth of workload, and number of graduates of training programs, have been the subject of other studies (5,11,4345).
Overall, however, we believe findings in this study demonstrate that data from a professional society employment service can be valid, reasonably accurate, and virtually costless measures of the employment market for a specialty.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Author contributions: Guarantor of integrity of entire study, J.H.S.; study concepts, J.H.S., H.P.F.; study design, J.H.S.; literature research, J.H.S.; data acquisition and analysis/interpretation, J.H.S., R.S.L.; statistical analysis, R.S.L.; manuscript preparation, J.H.S.; manuscript definition of intellectual content, editing, revision/review, and final version approval, J.H.S., B.S., H.P.F.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
A. Licurse, D. D. Saket, J. H. Sunshine, C. D. Maynard, and H. P. Forman Update on the diagnostic radiology employment market: findings through 2005. Am. J. Roentgenol., September 1, 2006; 187(3): W249 - W254. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. D. Saket, C. C. Nwanze, C. D. Maynard, J. H. Sunshine, and H. P. Forman Update on the Diagnostic Radiologist Employment Market: Findings Through 2004 Am. J. Roentgenol., December 1, 2005; 185(6): 1408 - 1415. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Bhargavan and J. H. Sunshine Workload of Radiologists in the United States in 2002-2003 and Trends Since 1991-1992 Radiology, September 1, 2005; 236(3): 920 - 931. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. H. Sunshine and Y. S. Cypel Types of Procedures Performed by Diagnostic Radiology Practices: Past Patterns and Future Directions Am. J. Roentgenol., November 1, 2004; 183(5): 1193 - 1201. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. H. Sunshine, C. D. Maynard, J. Paros, and H. P. Forman Update on the Diagnostic Radiologist Shortage Am. J. Roentgenol., February 1, 2004; 182(2): 301 - 305. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. D. Saketkhoo, J. H. Sunshine, A. M. Covey, and H. P. Forman Findings in 2002 from a Help Wanted Index of Job Advertisements: Is the Job-Market Shortage of Diagnostic Radiologists Easing? Am. J. Roentgenol., August 1, 2003; 181(2): 351 - 357. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Bhargavan and J. H. Sunshine Workload of Radiologists in the United States in 1998-1999 and Trends Since 1995-1996 Am. J. Roentgenol., November 1, 2002; 179(5): 1123 - 1128. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| RADIOLOGY | RADIOGRAPHICS | RSNA JOURNALS ONLINE |