By Barbara Feder Ostrov, CalMatters

033120ModelCoronavirusCaliforniaEvery day, while we’re all stuck at home, politicians and health officials and news anchors point to graphics showing the latest statistics on the coronavirus pandemic to indicate what might happen next, in your region and around the world. 

Underlying those visuals are disease forecasting models — complex mathematical algorithms that predict disease spread and severity based on different scenarios. Because they can help predict the effects of different interventions, including our social distancing, coronavirus pandemic models significantly influence how governments are responding. 

It’s tempting to regard these models as oracles that can tell us precisely what to do and when to do it. Can they tell us when we should return to work, or when our kids can go back to school? Is Grandma safe in her nursing home or should she come home? When can businesses safely reopen?

As California’s COVID-19 caseload tops 30,000, state officials are using a model developed at Johns Hopkins University to aid in their planning. If you’ve watched Gov. Gavin Newsom’s daily briefings online, some of the charts shown are based on the model’s predictions.

But the models need to be fed reliable data, and some data is in short supply, especially without widespread U.S. testing for the novel coronavirus that causes COVID-19. We still don’t know how many people have been infected without symptoms, for example. Other inputs, such as incubation periods and death rates, change by the day as we learn more about this virus. 

“What makes modeling especially challenging are the human factors. Individual behaviors, health care infrastructure and political response each can affect the outcome of an epidemic,” said Shweta Bansal, an associate professor of biology at Georgetown University who specializes in disease modeling. “I think of models as a call to action. They can tell us what happens if we don’t act and how we can prevent the most dire consequences.” 

Here are five things you should know to make sense of infectious disease models:

Why are there so many COVID pandemic models — and why are they all so different? 

There are different types of infectious disease models for different purposes. Each has limitations and each can be useful in its own way.

 “SEIR” models, for example, involve equations based on the number of susceptible people (S) who can be infected, the number of people exposed (E), the number of people infected (I) and the number of people recovered(R). Agent-based models use massive computer power to simulate the actions of millions of hypothetical people to predict the spread of disease. Still other models examine a disease outbreak in one country and try to predict outcomes elsewhere in the world based on that data. Some models look at travel patterns in spreading disease, and still others assess how age, ethnicity and contributing illnesses may affect survival rates. 

Epidemiologists say it helps to have more than one model in responding to disease outbreaks because they use different inputs. Combining results from multiple models can give a more nuanced picture of an outbreak’s trajectory. 

“The fact that there are so many models is a healthy sign,” said Bansal. “It’s the same with weather forecasts that rely on multiple mathematical models. But unlike a weather forecast, with a disease forecast we have the ability to change the outcome.”

The White House has controversially used a model developed by the University of Washington’s Institute for Health Metrics and Evaluation, which some disease experts have criticized as being based on overly optimistic assumptions about the benefits of social distancing, among other statistical issues. The Imperial College London model, which predicted as many as 22 million U.S. deaths if no action was taken, also apparently prompted the Trump administration to issue tougher new social distancing guidelines. 

  
What goes into making an epidemiological model for an infectious respiratory disease? 

California and some other states use an SEIR model developed by Johns Hopkins University epidemiologist Dr. Justin Lessler. This coronavirus pandemic model, according to the California Department of Public Health, takes into account assumptions about how long the disease takes to incubate, how long people are infectious, how many people each patient can infect, the fatality rate, how many people need hospitalization or intensive care, and importantly for hospital planning, how many people need ventilators because they can’t breathe on their own. 

The model assumes that NPIs – “non-pharmaceutical interventions” such as social distancing – started in the state March 20. In fact, some counties ordered residents to shelter in place earlier, some later.

California also has been faring better on a daily basis than this model’s predictions had forecasted — only 4,892 cases were reported on April 16, compared to 12,119 cases projected for that date. Assembly members set aside time at a budget hearing Monday to question the Newsom administration about the model and seek more details about its assumptions.

Rodger Butler, a spokesman for the California Health and Human Services Agency, cautioned that “there is considerable uncertainty” in the model’s predictions because we still don’t know enough about how the virus behaves and, without widespread testing, how many people are infected. “We are continuously refining our model with researchers and local public health offices,” Butler said. 

Which raises the next question:

What happens if you don’t have enough data, or the right data? 

This is what keeps public health experts up at night. 

Because testing has lagged so badly in the United States, “right now we don’t know how many people are infected,” said Karin Michels, professor and chair of the epidemiology department at UCLA’s School of Public Health. “The biggest unknown (for disease models) is the denominator. How many people out of the infected are actually dying or wind up in the ICU? We have no idea at this point.” 

Epidemiologists want to know more about when people are no longer infectious. They hope to learn more about who, once infected, is most likely to need hospitalization or a ventilator, to prevent overwhelming hospitals. True fatality rates aren’t one-size-fits-all; they will differ by age, gender, underlying illness and access to health care, among other factors. 

Epidemiologists also need to better understand how many people might have been infected but not show symptoms. New antibody tests now being rolled out can help answer that question, but not quickly, and some of these tests are proving inaccurate. Some public health experts say that preventable delays in widespread testing and a perceived chaotic federal response have prevented the kind of critical data gathering needed to get a handle on outbreaks in various regions of the country — and to provide the kind of intelligence needed before reopening the country.

What makes a model succeed in its predictions?

Disease modelers and mathematicians argue about this a lot. The quality of the data that goes into a disease model is important. The range of error in the model’s predictions are important, too. If early predictions of a model don’t measure up to reality, its later predictions may not as well.

The University of Washington’s coronavirus pandemic model, for example, which aimed to predict outbreaks based primarily on early data from China and later Europe, has had such a wide range of error in its predicted death rates that some epidemiologists have recommended that governments do not use it for planning. The model’s predictions of when cases will peak in various regions also have swung dramatically in different weeks — and rarely coincided with other models’ forecasts, prompting some experts’ concern about the model’s validity going forward. Some politicians are citing the model’s relatively optimistic forecasts as justification to open the country earlier than public health officials recommend.

The model’s developers say they are continually updating their model and have adjusted it to reflect regional differences in how daily death rates peak over time, and how social distancing policies vary by region.

Still, disease models are supposed to serve as a wake-up call prompting us to act. If our actions succeed in slowing infections and deaths, making the predictions inaccurate — that’s a good thing. 

What do public health experts wish people understood about coronavirus pandemic models?

Disease models are not perfect, and they can adapt as new data becomes available. Models “can help us think through different scenarios, but they shouldn’t be used as crystal balls,” Bansal said. “If we believe that a model’s prediction of 100,000 deaths is what will happen if we don’t act, then we do everything we can to prevent those 100,000 deaths.”

Also: they’re better for predicting short-term needs and outcomes, Michels said, such as how many ventilators a hospital might need next month, rather than next year: 

“I don’t think we can predict the fall yet. We only know the virus will still be around, so life will be complicated.”

CalMatters.org is a nonprofit, nonpartisan media venture explaining California policies and politics.

Pin it

Coronavirus Resources

  • 032720OutbreakCoronavirus
    April 20, 2020

    Tips for Spotting Fake News Stories — And Where to Find Sources You Can Trust

    Anytime there’s a significant news event — like a global pandemic, for example — you can expect misinformation to spread across the Internet. “Fake news” means stories that contain fabricated information, or information that’s based on rumor, shoddy methodology or a partisan agenda. With the…
  • Picture1
    April 17, 2020

    Recursos Alimentarios Durante COVID-19

    La alimentacion es una gran prioridad para muchos durante esta pandemia de COVID-19- cómo mantener a su familia alimentada en medio de despidos del trabajo, preocupaciones sobre salidas para conseguir comestibles y la posibilidad de transmisión por medio de los alimentos, todo mientras se trata de…
  • Groceries
    April 14, 2020

    COVID-19: Food Resources

    Food is top of mind for many during the COVID-19 pandemic — how to keep your family fed amid layoffs, concerns about grocery outings and food transmission, all while trying to maintain social distance. If you’re struggling to put food on the table, have questions about food safety or need help…
  • 200323 F BQ566 9001
    April 10, 2020

    COVID-19: Recursos Para Indocumentados y Sin Beneficios

    English version available here. A medida que la pandemia de coronavirus da vuelta la economía de la nación y deja a muchos sin trabajo, los inmigrantes indocumentados son particularmente vulnerables. En esta página encontrará recursos para ayudar a los miembros de la comunidad indocumentados y que…
  • 032720OutbreakCoronavirus
    April 07, 2020

    COVID-19: Resources for the Undocumented and Uninsured

    As the coronavirus pandemic upends the nation’s economy and leaves many without work, undocumented immigrants are particularly vulnerable. On this page you’ll find resources to help undocumented community members and the uninsured. UndocuFund for Disaster Relief in Sonoma County The UndocuFund,…
  • 032720OutbreakCoronavirus
    April 03, 2020

    COVID-19: Santa Clara County Resources

    Santa Clara County’s Public Health Department is providing detailed information about COVID-19 cases, deaths and hospital capacity on several data dashboards available online. The county has also assembled a variety of COVID-19 resources, as listed below and found at sccphd.org/coronavirus. Food…
  • 032720OutbreakCoronavirus
    Apr 03, 2020

    COVID-19: How to Help

    As the COVID-19 pandemic continues to take lives and strain resources, you might be wondering how you can help. Perhaps the most important thing you…
  • SR PD
    Mar 31, 2020

    Santa Rosa Police Department Mourns Loss of Detective

    Updated March 31, 2020, 4:00 p.m. The Santa Rosa Police Department reported today that Detective Marylou Armer passed away from complications from…
  • Medical
    Mar 31, 2020

    Coronavirus Resources

    The coronavirus pandemic has created new challenges for communities throughout the world. Whether you need help getting access to food, filing for…
  • 032720OutbreakCoronavirus
    Mar 30, 2020

    COVID-19: Financial Resources for Sonoma County Residents

    California and the nation have seen a surge in unemployment claims as the COVID-19 pandemic has forced companies to close their doors, leaving…
  • Library photo for website
    Mar 30, 2020

    Help the Sonoma County Library Tell the Story of Life During COVID-19

    The Sonoma County Library will be documenting life during the coronavirus pandemic with a special collection, and you’re invited to contribute. The…
  • 032920CalMattersEmptyRestaurant
    Mar 29, 2020

    California’s Shelter-In-Place Order, Explained

    By Byrhonda Lyons, CalMatters As President Donald Trump considers easing national restrictions by Easter, Californians are into their first week of…
  • 032920DowntownSantaRosa
    Mar 29, 2020

    Santa Rosa Outlines COVID-19 Support for Homeless

    The city of Santa Rosa says it’s following guidance from the U.S. Centers for Disease Control and Prevention to protect people experiencing…
  • gavin schools
    Mar 28, 2020

    Los Angeles Will Mirror New York As Coronavirus Surges, Newsom and Garcetti Warn

    By Judy Lin, Ben Christopher and Matt Levin, CalMatters Gov. Gavin Newsom and Los Angeles Mayor Eric Garcetti issued dire warnings Friday that the…
  • 032820CovidHandwashing
    Mar 28, 2020

    COVID-19: Sonoma County Resources for Seniors and Vulnerable Populations

    On March 17, Sonoma County’s health officer issued an order for all residents to shelter in place to help slow the spread of COVID-19. The order…
  • 032720CoronavirusResearch
    Mar 27, 2020

    Here’s What Happens to Science When California’s Researchers Shelter in Place

    By Rachel Becker, CalMatters As California officials desperately try to slow the spread of the novel coronavirus, Chris Miller is coaxing a sample of…

NorCal News

  • vaccine 5873170 1920
    February 24, 2021

    The County is Nervous about Blue Shield's Vaccine Takeover

    On March 7, Blue Shield of California will start administering Sonoma County’s vaccine rollout. The nonprofit insurer will take over the data collection and decide how many doses each provider receives. They’ll also streamline the sign-up process, making most appointments available through…
  • vaccine 5895477 1280
    February 19, 2021

    County Shifts Vaccine Priority to 65 and Up and Food Workers

    On Monday, residents 65 and older, along with food manufacturing, grocery store and restaurant workers will be eligible for a vaccine at one of the county-supported clinics. Prioritization will be given to those with server illnesses, such as cancer or kidney disease. The decision to expand…
  • vaccine 5926664 1280
    February 17, 2021

    The County Still Faces a Vaccine Shortage

    Two months into Sonoma County’s vaccine rollout, 19% of the adult population has received at least one dose. The county is keeping up with other Bay Area counties in vaccinating residents and has opened up dozens of clinics, but the biggest problem has been the same since day one: the county isn’t…
  • vaccine 4946480 640
    February 10, 2021

    The County Reaches for More Vaccine Data

    Officials say Sonoma is administering vaccine doses at a faster rate than similarly sized counties. On February 10, officials announced the county has vaccinated nearly 50 percent of its residents who are 75 and older. But because of holes in statewide and local data collection, knowing exactly…
  • final 4896425 640
    February 09, 2021

    The County Compromises on Eviction Limitations

    On February 9, Sonoma’s Board of Supervisors voted to place more limitations on evictions during COVID-19. The amendment limits evictions to extreme circumstances, like when landlords can prove their tenants pose an imminent threat or danger, or when they’re taking the property off the rental…
  • February 06, 2021

    Sonoma County Extends Stay-At-Home Order

    State public health officials have extended a Stay-Home Order for the 11-county Bay Area region, including Sonoma County. The move comes as COVID-19 cases continue to rise and ICU capacity for the larger Bay Area region remains below 15%. The order will remain in effect until the state’s four-week…
  • vaccine 5873170 1280
    Feb 03, 2021

    The County Promises an Equitable Vaccine Rollout

    Earlier this week Sonoma County reaffirmed its commitment to vaccinate the oldest seniors first, those 75 and older. Younger seniors were told to be…
  • corona 5174671 640
    Feb 03, 2021

    What We Need to Know: COVID in Sonoma County

    What are the current county restrictions? Sonoma County is currently in the most restrictive purple tier of the California’s Blueprint for a Safer…
  • Nurses protesting outside of Sutter Santa Rosa Regional Hospital. Photo courtesy of the California Nurses Association.
    Jan 31, 2021

    Santa Rosa Nurses Demand Safe Staffing

    UPDATE: Earlier this week California’s Department of Public Health halted the staffing waivers. The State says they will not accept any new…
  • injection 5722329 1920
    Jan 27, 2021

    Sonoma County Opens its First Clinic for Oldest Seniors

    Sonoma County is following the state’s guidance to prioritize seniors ages 75 and up in its vaccine rollout. While there’s progress and hope in the…
  • Student doing homeowork.
    Jan 21, 2021

    County Strategizes Reopening Schools

    Covid-19 is rampant in Sonoma County and spreading faster than ever, which means kids are still stuck at home. While vaccines are being rolled out,…
  • pbs
    Jan 13, 2021

    PBS Employee Makes Controversial Statements on Hidden Camera

    Julian Wyllie of CURRENT news reports in a story entitled "PBS Distances Itself from Former Staff Attorney Ensnared in Project Veritas Sting," that…
  • COVIDdec2020
    Dec 06, 2020

    Understanding the New Regional Stay-At-Home Orders

    Regional Stay Home Orders will go into effect within 24 hours in regions with less than 15% ICU availability, and prohibits private gatherings of any…
  • Screen Shot 2020 11 20 at 5.37.26 PM
    Nov 20, 2020

    Radio Special: Democracy In Santa Rosa's First District

    In 2020, for the first time, residents of Southwest Santa Rosa voted for a city council member to represent their community. The election gave more…
  • IMG 9357
    Nov 11, 2020

    Rohnert Park Welcomes Three New Council Members

    Rohnert Park has three new city council members. The wins also mean there will be more diversity on what was formerly an all-white council. One of…
  • Biden Harris AM
    Nov 09, 2020

    ‘She’s From Oakland!’ Photos Capture Bay Area Celebrations of Biden-Harris Win

    By Anne Wernikoff November 8, 2020 In the corner of California where Vice President-elect Kamala Harris grew up and launched her political career,…

NorCal News Radio

Science & Health News

Northern California
Public Media Newsletter

Get the latest updates on programs and events.