BLS Labor Market Forecasts:  A Weak Foundation for Academic Program Evaluation

April 11, 2022

When evaluating current and new academic programs, community colleges usually focus on the needs of employers, in particular local employers.  This emphasis enables graduates to find jobs and fuels local economic growth.  

Fast-Growth Can Lead to Misconceptions

However, industries, occupations, and the economy move at a startling pace in our society.  Data science, AI, and machine learning barely existed ten years ago; now, they are large and fast-growing sectors.  Truck driving is a huge occupation, but it may be wiped out by automation within the next decade or two.  The economy itself can change rapidly, from boom to bust in 2008 and again in 2020.  Even prognostications about broad labor market trends are often wrong.  Remember, a few years ago, all the folks talking about the grim economic outlook, automation, and the future shortage of jobs?  Yet, now we are facing a shortage of workers, not jobs.

The Problem with BLS Forecasting

Given the rapid and unpredictable changes in the economy,  labor market forecasts are very inaccurate.  In particular, the forecasts by Standard Occupation Code (SOC) from the Bureau of Labor Statistics seldom come to pass.  Let’s start with a simple analysis we ran to determine if BLS correctly predicted whether an occupation would grow or decline.  As illustrated below, about 62% of BLS forecasts correctly estimate whether growth in an occupation will be positive or negative (“Same Sign” in the forecast as the actual).  This seems pretty good until you realize that a coin toss would be right 50% of the time (see endnote).

Then it gets worse.  Many institutions and some states use the BLS forecast to decide which current and new programs to invest in, so correctly predicting positive growth is very important.  However, 27% of positive forecasts turn out to be for SOCs that decline, which is slightly worse than a coin toss.  The forecast was better at predicting declines, only missing 10% of the time.  Overall, the BLS forecast is about the same as a coin toss, even for a relatively simple prediction of occupational growth or decline.

We expect the forecast to do more than predict whether a field will grow or decline – we want to know how fast it will grow or shrink.  My next post, will show how close BLS gets to predicting actual growth rates.

Throughout this series, please keep in mind that the folks at BLS are neither ignorant nor lazy.  The problem is that they are trying to predict the results of a chaotic system where slight fluctuations in a distant country, a nascent technology, or the DNA of a virus could cause major changes in the US economy.

Endnote on The Coin Toss Analogy

Growth predictions can either be positive, negative, or, in a very few cases, zero.  For simplicity, let’s ignore the zeros.  There can only be two outcomes in this case:  positive growth or decline;  actual growth would also have two outcomes.  A coin toss has two outcomes, as well.  We will flip two coins for this exercise, one representing the forecast and one representing the actuals.  Let’s assume “heads” stands for growth and tails stands for decline.  Over a few hundred rounds, the results should look like this:

 

 

Outcome 1

Outcome 2

Outcome 3

Outcome 4

Coin 1:  “Forecast”

Heads:
Growth

Tails:

Decline

Heads:

Growth

Tails:

Decline

Coin 2:
“Actual”

Heads:
Growth

Tails:

Decline

Tails:

Decline

Heads:

Growth

Prediction equals actual

25% Yes

25% Yes

25% No

25% No

% of Tosses

50% of “Forecasts = Actuals”

25% Forecast Growth, but Actual Declined

25% Forecast a Decline, but Actual Grew

Robert Atkins

CEO AND FOUNDER OF GRAY ASSOCIATES

Bob led Gray’s entry into the education industry and the development of Gray’s proprietary industry databases and service offerings. He has worked directly with many of Gray’s education clients, consulting with CEOs and CMOs on business strategy, pricing, location selection, curricular efficiency, and program strategy.

Related Posts

Recharge Your Program Portfolio with This Emerging Program

Looking for an exciting and innovative field of study? Look no further than energy storage! As advances in energy technology continue to drive demand for more efficient and powerful ways to store energy, the need for skilled graduates in this field is growing rapidly. From mechanical and thermal energy storage to hydrogen fuel cells and even quantum batteries, the possibilities for innovation are endless. Discover how higher education is rising to the challenge and offering exciting new programs in this emerging field.

2023 March Madness: Who Will Be This Year’s Cinderella?

Experience the thrill of March Madness and discover how Cinderella teams can boost a school’s brand awareness. Follow the success stories of St. Peter’s University and Loyola University Chicago, two schools that leveraged their teams’ tournament appearances to increase their image and attract top students. Join the conversation with expert commentary on which underdogs might surprise us this year. Don’t miss this opportunity to learn how March Madness affects higher education and the exciting possibilities it holds for lesser-known teams!

Benchmarking Hockey East Association Women’s Ice Hockey

Discover how benchmarking can help your school’s athletic department make strategic resource decisions. Learn about the importance of using both internal and external data to evaluate sports teams and conferences. Using women’s ice hockey in the Hockey East Association as an example, explore how benchmarking can be applied to assess the cost per participant, cost per sport, and more. Find out how this can help schools decide on conference changes or new sports programs and attract students who major in specific programs.

About Us
closeup photo of

Gray Associates, Inc. is a software and services firm focused on higher education. We help education clients develop fact-based institutional and marketing strategies that maximize outcomes for students, the school, and its constituencies.

Let’s Socialize

Popular Post
Subscribe to Our Blog

Don’t miss the latest research and insights from Gray Associates