[Skip to Navigation]
Sign In
Table 1.  Demographic Characteristics of the Sample
Demographic Characteristics of the Sample
Table 2.  Thirty-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Compared With the Same Months in 2017-2019
Thirty-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Compared With the Same Months in 2017-2019
Table 3.  Distribution of Employment Status and 30-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Compared With the Same Months in 2017-2019 Separately by Employment Status
Distribution of Employment Status and 30-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Compared With the Same Months in 2017-2019 Separately by Employment Status
Table 4.  Pandemic-Associated Change in 30-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic in Subsamples Defined by State-Month Differences in the COVID-19 Death Rate and the Unemployment Rate Compared With 2017-2019a
Pandemic-Associated Change in 30-Day Estimated Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic in Subsamples Defined by State-Month Differences in the COVID-19 Death Rate and the Unemployment Rate Compared With 2017-2019a
Table 5.  Variation in Pandemic-Associated Change in Estimated 30-Day Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Among the Employed in Subgroups Defined by State-Month Differences and Sociodemographic Variablesa
Variation in Pandemic-Associated Change in Estimated 30-Day Prevalence of Clinically Significant Anxiety and Depression During the First 10 Months of the COVID-19 Pandemic Among the Employed in Subgroups Defined by State-Month Differences and Sociodemographic Variablesa
1.
Galea  S, Merchant  RM, Lurie  N.  The mental health consequences of COVID-19 and physical distancing: the need for prevention and early intervention.   JAMA Intern Med. 2020;180(6):817-818. doi:10.1001/jamainternmed.2020.1562PubMedGoogle ScholarCrossref
2.
Pfefferbaum  B, North  CS.  Mental health and the COVID-19 pandemic.   N Engl J Med. 2020;383(6):510-512. doi:10.1056/NEJMp2008017PubMedGoogle ScholarCrossref
3.
Cavicchioli  M, Ferrucci  R, Guidetti  M, Canevini  MP, Pravettoni  G, Galli  F.  What will be the impact of the COVID-19 quarantine on psychological distress? considerations based on a systematic review of pandemic outbreaks.   Healthcare (Basel). 2021;9(1):101. doi:10.3390/healthcare9010101PubMedGoogle ScholarCrossref
4.
Chu  IY, Alam  P, Larson  HJ, Lin  L.  Social consequences of mass quarantine during epidemics: a systematic review with implications for the COVID-19 response.   J Travel Med. 2020;27(7):taaa192. doi:10.1093/jtm/taaa192PubMedGoogle ScholarCrossref
5.
Shah  K, Kamrai  D, Mekala  H, Mann  B, Desai  K, Patel  RS.  Focus on mental health during the coronavirus (COVID-19) pandemic: applying learnings from the past outbreaks.   Cureus. 2020;12(3):e7405. doi:10.7759/cureus.7405PubMedGoogle ScholarCrossref
6.
Goldmann  E, Galea  S.  Mental health consequences of disasters.   Annu Rev Public Health. 2014;35:169-183. doi:10.1146/annurev-publhealth-032013-182435PubMedGoogle ScholarCrossref
7.
Majid  U, Hussain  SAS, Wasim  A, Farhana  N, Saadat  P.  A systematic map of non-clinical evidence syntheses published globally on COVID-19.   Disaster Med Public Health Prep. Published online July 22, 2021. doi:10.1017/dmp.2021.236PubMedGoogle ScholarCrossref
8.
Twenge  JM, Joiner  TE.  Mental distress among U.S. adults during the COVID-19 pandemic.   J Clin Psychol. 2020;76(12):2170-2182. doi:10.1002/jclp.23064PubMedGoogle ScholarCrossref
9.
Lucid Holdings. Academic research with Lucid. Accessed August 6, 2021. https://luc.id/academic-solutions/
10.
Kessler  RC, Barker  PR, Colpe  LJ,  et al.  Screening for serious mental illness in the general population.   Arch Gen Psychiatry. 2003;60(2):184-189. doi:10.1001/archpsyc.60.2.184PubMedGoogle ScholarCrossref
11.
National Center for Health Statistics. National Health Interview Survey. Accessed January 15, 2022. https://www.cdc.gov/nchs/nhis/index.htm
12.
American Association for Public Opinion Research. AAPOR reports on online panels. Accessed August 8, 2021. https://www.aapor.org/Education-Resources/Reports/Report-on-Online-Panels
13.
RAND Corporation. RAND American Life Panel (ALP). Accessed August 8, 2021. https://www.rand.org/research/data/alp.html
14.
Breslau  J, Finucane  ML, Locker  AR, Baird  MD, Roth  EA, Collins  RL.  A longitudinal study of psychological distress in the United States before and during the COVID-19 pandemic.   Prev Med. 2021;143:106362. doi:10.1016/j.ypmed.2020.106362PubMedGoogle ScholarCrossref
15.
Czeisler  MÉ, Lane  RI, Petrosky  E,  et al.  Mental health, substance use, and suicidal ideation during the COVID-19 pandemic—United States, June 24-30, 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(32):1049-1057. doi:10.15585/mmwr.mm6932a1PubMedGoogle ScholarCrossref
16.
Daly  M, Sutin  AR, Robinson  E.  Depression reported by US adults in 2017-2018 and March and April 2020.   J Affect Disord. 2021;278:131-135. doi:10.1016/j.jad.2020.09.065PubMedGoogle ScholarCrossref
17.
Ettman  CK, Abdalla  SM, Cohen  GH, Sampson  L, Vivier  PM, Galea  S.  Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic.   JAMA Netw Open. 2020;3(9):e2019686. doi:10.1001/jamanetworkopen.2020.19686PubMedGoogle ScholarCrossref
18.
McGinty  EE, Presskreischer  R, Han  H, Barry  CL.  Psychological distress and loneliness reported by US adults in 2018 and April 2020.   JAMA. 2020;324(1):93-94. doi:10.1001/jama.2020.9740PubMedGoogle ScholarCrossref
19.
United States Census Bureau. Measuring household experiences during the coronavirus pandemic. Accessed August 8, 2021. https://www.census.gov/data/experimental-data-products/household-pulse-survey.html
20.
Kroenke  K, Spitzer  RL, Williams  JB, Löwe  B.  An ultra-brief screening scale for anxiety and depression: the PHQ-4.   Psychosomatics. 2009;50(6):613-621. doi:10.1176/appi.psy.50.6.613PubMedGoogle ScholarCrossref
21.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System. Accessed August 8, 2021. https://www.cdc.gov/brfss/index.html
22.
Twenge  JM, McAllister  C, Joiner  TE.  Anxiety and depressive symptoms in U.S. Census Bureau assessments of adults: trends from 2019 to fall 2020 across demographic groups.   J Anxiety Disord. 2021;83:102455. doi:10.1016/j.janxdis.2021.102455PubMedGoogle ScholarCrossref
23.
United States Census Bureau. Experimental data products. Accessed August 8, 2021. https://www.census.gov/data/experimental-data-products.html
24.
United States Census Bureau. Household Pulse Survey technical documentation. Accessed August 8, 2021. https://www.census.gov/programs-surveys/household-pulse-survey/technical-documentation.html
25.
Peterson  S, Toribio  N, Farber  J, Hornick  D. Nonresponse bias report for the 2020 Household Pulse Survey. Accessed August 7, 2021. https://www2.census.gov/programs-surveys/demo/technical-documentation/hhp/2020_HPS_NR_Bias_Report-final.pdf
26.
Bradley  VC, Kuriwaki  S, Isakov  M, Sejdinovic  D, Meng  X-L, Flaxman  S.  Unrepresentative big surveys significantly overestimated US vaccine uptake.   Nature. 2021;600(7890):695-700. doi:10.1038/s41586-021-04198-4PubMedGoogle ScholarCrossref
27.
Sun  Y, Wu  Y, Bonardi  O,  et al.  Comparison of mental health symptoms prior to and during COVID-19: evidence from a living systematic review and meta-analysis.   medRxiv. Preprint posted online May 11, 2021. doi:10.1101/2021.05.10.21256920Google Scholar
28.
The Depressd Project. Research question 1: changes in mental health symptoms. Accessed August 8, 2021. https://www.depressd.ca/research-question-1-symptom-changes
29.
Kessler  RC, Chiu  WT, Hwang  IH,  et al.  Changes in prevalence of mental illness among US adults during compared with before the COVID-19 pandemic.   Psychiatr Clin North Am. 2022;45(1):1-28. doi:10.1016/j.psc.2021.11.013PubMedGoogle ScholarCrossref
30.
Wanberg  CR, Csillag  B, Douglass  RP, Zhou  L, Pollard  MS.  Socioeconomic status and well-being during COVID-19: a resource-based examination.   J Appl Psychol. 2020;105(12):1382-1396. doi:10.1037/apl0000831PubMedGoogle ScholarCrossref
31.
Santomauro  DF, Mantilla Herrera  AM, Shadid  J,  et al; COVID-19 Mental Disorders Collaborators.  Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic.   Lancet. 2021;398(10312):1700-1712. doi:10.1016/S0140-6736(21)02143-7PubMedGoogle ScholarCrossref
32.
Katz  BA, Yovel  I. Mood symptoms predict COVID-19 pandemic distress but not vice versa: an 18-month longitudinal study. Accessed August 7, 2021. https://osf.io/j8qab/
33.
Marroquín  B, Vine  V, Morgan  R.  Mental health during the COVID-19 pandemic: effects of stay-at-home policies, social distancing behavior, and social resources.   Psychiatry Res. 2020;293:113419. doi:10.1016/j.psychres.2020.113419PubMedGoogle ScholarCrossref
34.
Robinson  E, Sutin  AR, Daly  M, Jones  A.  A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020.   J Affect Disord. 2022;296:567-576. doi:10.1016/j.jad.2021.09.098PubMedGoogle ScholarCrossref
35.
Pitt  SC, Schwartz  TA, Chu  D.  AAPOR reporting guidelines for survey studies.   JAMA Surg. 2021;156(8):785-786. doi:10.1001/jamasurg.2021.0543PubMedGoogle ScholarCrossref
36.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—overview: BRFSS 2020. Accessed August 8, 2021. https://www.cdc.gov/brfss/annual_data/2020/pdf/overview-2020-508.pdf
37.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2020 summary data quality report. Accessed August 8, 2021. https://www.cdc.gov/brfss/annual_data/2020/pdf/2020-sdqr-508.pdf
38.
American Association for Public Opinion Research. Standard definitions, final dispositions of case codes and outcome rates for surveys. Accessed April 15, 2022. https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf
39.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2017 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2017/pdf/2017-sdqr-508.pdf
40.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2018 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2018/pdf/2018-sdqr-508.pdf
41.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2019 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2019/pdf/2019-sdqr-508.pdf
42.
Daly  M, Robinson  E.  Psychological distress and adaptation to the COVID-19 crisis in the United States.   J Psychiatr Res. 2021;136:603-609. doi:10.1016/j.jpsychires.2020.10.035PubMedGoogle ScholarCrossref
43.
Löwe  B, Wahl  I, Rose  M,  et al.  A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population.   J Affect Disord. 2010;122(1-2):86-95. doi:10.1016/j.jad.2009.06.019PubMedGoogle ScholarCrossref
44.
Smith  SM, Edwards  R, Duong  HC. Unemployment rises in 2020, as the country battles the COVID-19 pandemic. Accessed August 9, 2021. https://www.bls.gov/opub/mlr/2021/article/unemployment-rises-in-2020-as-the-country-battles-the-covid-19-pandemic.htm
45.
Wolfe  R, Harknett  K, Schneider  D. Inequalities at work and the toll of COVID-19. Health Affairs. Accessed August 9, 2021. https://www.healthaffairs.org/do/10.1377/hpb20210428.863621/full/
46.
US Centers for Disease Control and Prevention. United States COVID-19 cases and deaths by state over time. Accessed August 9, 2021. https://data.cdc.gov/Case-Surveillance/United-States-COVID-19-Cases-and-Deaths-by-State-o/9mfq-cb36
47.
US Bureau of Labor Statistics. Local area unemployment statistics. Accessed August 9, 2021. https://www.bls.gov/lau/
48.
Long  JS, Mustillo  SA.  Using predictions and marginal effects to compare groups in regression models for binary outcomes.   Sociol Methods Res. 2018;50(3):1284-1320. doi:10.1177/0049124118799374Google ScholarCrossref
49.
Williams  R.  Using the margins command to estimate and interpret adjusted predictions and marginal effects.   Stata J. 2012;12(2):308-331. doi:10.1177/1536867X1201200209Google ScholarCrossref
50.
Wolker  KM.  Introduction to Variance Estimation (Statistics for Social and Behavioral Sciences). 2nd ed. Springer; 2007.
51.
US Bureau of Labor Statistics. Civilian unemployment rate, seasonally adjusted. Accessed August 9, 2021. https://www.bls.gov/charts/employment-situation/civilian-unemployment-rate.htm
52.
Tjeltveit  A. COVID-19 and the National Suicide Prevention Lifeline. Accessed August 9, 2021. https://storymaps.arcgis.com/stories/063fbdbfb7c743b78e56abf79fc284b9
53.
Ahmad  FB, Anderson  RN.  The leading causes of death in the US for 2020.   JAMA. 2021;325(18):1829-1830. doi:10.1001/jama.2021.5469PubMedGoogle ScholarCrossref
54.
Falk  G, Romero  PD, Nicchitta  IA, Nyhof  EC. Unemployment rates during the COVID-19 pandemic. Congressional Research Service. Accessed September 1, 2021. https://sgp.fas.org/crs/misc/R46554.pdf
55.
National Center for Health Statistics. The 2020 increase in death rates were the highest ever recorded. Accessed August 9, 2021. https://www.cdc.gov/nchs/pressroom/podcasts/2021/20210611/20210611.htm
56.
Krueger  AB, Mueller  AI.  The lot of the unemployed: a time use perspective.   J Eur Econ Assoc. 2012;10(4):765-794. doi:10.1111/j.1542-4774.2012.01071.xGoogle ScholarCrossref
57.
Fernández-Alcántara  M, Kokou-Kpolou  CK, Cruz-Quintana  F, Pérez-Marfil  MN.  Editorial: new perspectives in bereavement and loss: complicated and disenfranchised grief along the life cycle.   Front Psychol. 2021;12:691464. doi:10.3389/fpsyg.2021.691464PubMedGoogle ScholarCrossref
58.
Erzen  E, Çikrikci  Ö.  The effect of loneliness on depression: a meta-analysis.   Int J Soc Psychiatry. 2018;64(5):427-435. doi:10.1177/0020764018776349PubMedGoogle ScholarCrossref
59.
Center on Budget and Policy Priorities. Tracking the COVID-19 economy’s effects on food, housing, and employment hardships. Accessed August 5, 2021. https://www.cbpp.org/sites/default/files/atoms/files/8-13-20pov.pdf
60.
Gould  E, Kassa  M. Young workers hit hard by the COVID-19 economy. Economic Policy Institute. Accessed August 9, 2021. https://files.epi.org/pdf/203139.pdf
61.
Leaune  E, Samuel  M, Oh  H, Poulet  E, Brunelin  J.  Suicidal behaviors and ideation during emerging viral disease outbreaks before the COVID-19 pandemic: a systematic rapid review.   Prev Med. 2020;141:106264. doi:10.1016/j.ypmed.2020.106264PubMedGoogle ScholarCrossref
62.
Tanaka  T, Okamoto  S.  Increase in suicide following an initial decline during the COVID-19 pandemic in Japan.   Nat Hum Behav. 2021;5(2):229-238. doi:10.1038/s41562-020-01042-zPubMedGoogle ScholarCrossref
63.
Yard  E, Radhakrishnan  L, Ballesteros  MF,  et al.  Emergency department visits for suspected suicide attempts among persons aged 12-25 years before and during the COVID-19 pandemic—United States, January 2019-May 2021.   MMWR Morb Mortal Wkly Rep. 2021;70(24):888-894. doi:10.15585/mmwr.mm7024e1PubMedGoogle ScholarCrossref
64.
Ahmad  F, Cisewski  J. Quarterly provisional estimates for selected indicators of mortality, 2019-quarter 1, 2021. Vital Statistics Rapid Release. Accessed August 9, 2021. https://www.cdc.gov/nchs/nvss/vsrr/mortality-dashboard.htm
65.
Schleimer  JP, McCort  CD, Shev  AB,  et al.  Firearm purchasing and firearm violence during the coronavirus pandemic in the United States: a cross-sectional study.   Inj Epidemiol. 2021;8(1):43. doi:10.1186/s40621-021-00339-5PubMedGoogle ScholarCrossref
66.
Rigby  E.  The COVID-19 economy, unemployment insurance, and population health.   JAMA Netw Open. 2021;4(1):e2035955. doi:10.1001/jamanetworkopen.2020.35955PubMedGoogle ScholarCrossref
67.
Kumar  S, Veldhuis  A, Malhotra  T.  Neuropsychiatric and cognitive sequelae of COVID-19.   Front Psychol. 2021;12:577529. doi:10.3389/fpsyg.2021.577529PubMedGoogle ScholarCrossref
68.
Gersons  BPR, Smid  GE, Smit  AS, Kazlauskas  E, McFarlane  A.  Can a ‘second disaster’ during and after the COVID-19 pandemic be mitigated?   Eur J Psychotraumatol. 2020;11(1):1815283. doi:10.1080/20008198.2020.1815283PubMedGoogle ScholarCrossref
69.
Raphael  B.  When Disaster Strikes: How Individuals and Communities Cope With Catastrophe. Basic Books; 1986.
70.
Wang  L, Valliant  R, Li  Y.  Adjusted logistic propensity weighting methods for population inference using nonprobability volunteer-based epidemiologic cohorts.   Stat Med. 2021;40(24):5237-5250. doi:10.1002/sim.9122PubMedGoogle ScholarCrossref
71.
Wiśniowski  A, Sakshaug  JW, Perez Ruiz  DA, Blom  AG.  Integrating probability and nonprobability samples for survey inference.   J Surv Stat Methodol. 2020;8(1):120-147. doi:10.1093/jssam/smz051Google ScholarCrossref
72.
Yang  S, Kim  JK, Song  R.  Doubly robust inference when combining probability and non-probability samples with high dimensional data.   J R Stat Soc Series B Stat Methodol. 2020;82(2):445-465. doi:10.1111/rssb.12354PubMedGoogle ScholarCrossref
73.
Prasad  K, McLoughlin  C, Stillman  M,  et al.  Prevalence and correlates of stress and burnout among US healthcare workers during the COVID-19 pandemic: a national cross-sectional survey study.   EClinicalMedicine. 2021;35:100879. doi:10.1016/j.eclinm.2021.100879PubMedGoogle ScholarCrossref
Original Investigation
Psychiatry
June 15, 2022

Estimated Prevalence of and Factors Associated With Clinically Significant Anxiety and Depression Among US Adults During the First Year of the COVID-19 Pandemic

Author Affiliations
  • 1Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts
  • 2Frank Batten School of Leadership & Public Policy, University of Virginia, Charlottesville
  • 3Department of Statistics, Harvard University, Cambridge, Massachusetts
  • 4Department of Biostatistics, Harvard Chan School of Public Health, Boston, Massachusetts
JAMA Netw Open. 2022;5(6):e2217223. doi:10.1001/jamanetworkopen.2022.17223
Key Points

Question  How much did clinically significant anxiety and depression increase among US adults during the first year of the COVID-19 pandemic?

Findings  In this survey study of more than 1.4 million respondents in the US Behavioral Risk Factor Surveillance System survey, responses to a screening question calibrated to a 4-item Patient Health Questionnaire score of 6 or greater suggested that aggregate prevalence of clinically significant anxiety and depression increased only modestly overall among US adults in 2020 compared with 2017 to 2019.

Meaning  This modest estimated aggregate increase could mask more substantial increases in key population segments (eg, first responders) and might have become larger in 2021 and 2022.

Abstract

Importance  Claims of dramatic increases in clinically significant anxiety and depression early in the COVID-19 pandemic came from online surveys with extremely low or unreported response rates.

Objective  To examine trend data in a calibrated screening for clinically significant anxiety and depression among adults in the only US government benchmark probability trend survey not disrupted by the COVID-19 pandemic.

Design, Setting, and Participants  This survey study used the US Centers for Disease Control and Prevention Behavioral Risk Factor Surveillance System (BRFSS), a monthly state-based trend survey conducted over the telephone. Participants were adult respondents in the 50 US states and District of Columbia who were surveyed March to December 2020 compared with the same months in 2017 to 2019.

Exposures  Monthly state COVID-19 death rates.

Main Outcomes and Measures  Estimated 30-day prevalence of clinically significant anxiety and depression based on responses to a single BRFSS item calibrated to a score of 6 or greater on the 4-item Patient Health Questionnaire (area under the receiver operating characteristic curve, 0.84). All percentages are weighted based on BRFSS calibration weights.

Results  Overall, there were 1 429 354 respondents, with 1 093 663 in 2017 to 2019 (600 416 [51.1%] women; 87 153 [11.8%] non-Hispanic Black; 826 334 [61.5%] non-Hispanic White; 411 254 [27.8%] with college education; and 543 619 [56.8] employed) and 335 691 in 2020 (182 351 [51.3%] women; 25 517 [11.7%] non-Hispanic Black; 250 333 [60.5%] non-Hispanic White; 130 642 [29.3%] with college education; and 168 921 [54.9%] employed). Median within-state response rates were 45.9% to 49.4% in 2017 to 2019 and 47.9% in 2020. Estimated 30-day prevalence of clinically significant anxiety and depression was 0.4 (95% CI, 0.0 to 0.7) percentage points higher in March to December 2020 (12.4%) than March to December 2017 to 2019 (12.1%). This estimated increase was limited, however, to students (2.4 [95% CI, 0.8 to 3.9] percentage points) and the employed (0.9 [95% CI, 0.5 to 1.4] percentage points). Estimated prevalence decreased among the short-term unemployed (−1.8 [95% CI, −3.1 to −0.5] percentage points) and those unable to work (−4.2 [95% CI, −5.3 to −3.2] percentage points), but did not change significantly among the long-term unemployed (−2.1 [95% CI, −4.5 to 0.5] percentage points), homemakers (0.8 [95% CI, −0.3 to 1.9] percentage points), or the retired (0.1 [95% CI, −0.6 to 0.8] percentage points). The increase in anxiety and depression prevalence among employed people was positively associated with the state-month COVID-19 death rate (1.8 [95% CI, 1.2 to 2.5] percentage points when high and 0.0 [95% CI, −0.7 to 0.6] percentage points when low) and was elevated among women compared with men (2.0 [95% CI, 1.4 to 2.5] percentage points vs 0.2 [95% CI, −0.1 to 0.6] percentage points), Non-Hispanic White individuals compared with Hispanic and non-Hispanic Black individuals (1.3 [95% CI, 0.6 to 1.9] percentage points vs 1.1 [95% CI, −0.2 to 2.5] percentage points and 0.7 [95% CI, −0.1 to 1.5] percentage points), and those with college educations compared with less than high school educations (2.5 [95% CI, 1.9 to 3.1] percentage points vs −0.6 [95% CI, −2.7 to 1.4] percentage points).

Conclusions and Relevance  In this survey study, clinically significant US adult anxiety and depression increased less during 2020 than suggested by online surveys. However, this modest aggregate increase could mask more substantial increases in key population segments (eg, first responders) and might have become larger in 2021 and 2022.

Introduction

Concerns about adverse mental health effects of COVID-19 have been raised since the beginning of the pandemic1,2 based on evidence for such outcomes in past infectious disease outbreaks3-5 and natural disasters.6 Many empirical papers subsequently investigated the association of the pandemic with mental health,7 and most concluded that the pandemic caused dramatic increases in anxiety and depression. However, such studies mostly compared online pandemic-era surveys with low or unreported response rates against prepandemic government benchmark probability surveys. These comparisons could be biased. For example, Twenge and Joiner8 surveyed 19 330 adults in April 2020 in an online nonprobability consumer panel9 using the same self-reported screening for serious mental illness (SMI)10 as the 2018 National Health Interview Survey (NHIS)11 and concluded that SMI prevalence increased 8-fold since the 2018 NHIS. Although the consumer survey was weighted to match the population on basic geographic and sociodemographic characteristics, it might have been quite different on psychological characteristics.12 The notion that these design differences could influence prevalence estimates is suggested by a survey carried out prior to the pandemic (early 2019) in the RAND American Life Panel (ALP),13 another online consumer panel with an unreported response rate. SMI had an estimated prevalence nearly 3 times as high as the NHIS estimate.14

Numerous other reports based on similar comparisons concluded that the pandemic caused massive increases in anxiety and depression.8,15-18 Included here were studies using the US Centers for Disease Control and Prevention (CDC) Household Pulse Survey (HPS),19 a US government trend survey started in April 2020 to track effects of COVID-19 on US residents. The HPS contains the 4-item Patient Health Questionnaire (PHQ-4) anxiety and depression screening scale,20 a scale also used in the NHIS and in a subsample of another important national government benchmark survey, the CDC Behavioral Risk Factor Surveillance System (BRFSS).21 Comparisons of HPS with 2018 NHIS and BRFSS found 3.0 to 5.0 elevated relative risk (RR) of PHQ-4 scores greater than 6.15,22

Importantly, the HPS, unlike the NHIS or BRFSS, is a Census Bureau Experimental Data Product23 used for rapid response to time-sensitive questions before more definitive results are available. It uses an online survey with only a 2% to 10% response rate.24 Census Bureau documentation states clearly that it is hazardous to compare HPS results with those in earlier benchmark government surveys because of the low HPS response rate.25 The potential biases of relying on a large sample (eg, 1 660 957 respondents in the 2020 HPS) with low a response rate was amply illustrated in a recent Nature report documenting that the HPS substantially overestimated early COVID-19 vaccine uptake compared with criterion standard data subsequently assembled by the CDC.26

More accurate before-during comparisons require either cohort studies (ie, the same individuals assessed over time) with high follow-up response rates or trend studies (ie, the same sampling and field procedures applied to different individuals) with high and comparable before-during response rates. Illustrating what a difference such designs can make, a worldwide review of data on prevalence of common mental disorders across 33 cohort studies with high follow-up response rates carried out both shortly before and in the first year of the pandemic27 concluded that general population mental health was not worse in 2020 than in pre–COVID-19 surveys.28 However, only 3 of the 33 studies were from the United States: a convenience sample of gender minority adults and 2 small samples of university students, all finding small increases in screening scale scores of anxiety or depression.29 Two reports from the RAND ALP panel also assessed respondents the year before and then again early in the pandemic and found similarly small increases in depression30 and SMI.14 These results are consistent with small increased prevalence of clinically significant anxiety and depression in the US adult population during 2020.29 A recent Lancet report based on a cross-national meta-analysis arrived at a similar conclusion31 but again with only 3 before-during US comparison studies with weak designs.30,32,33 A more recent meta-analysis using a larger number of mostly convenience samples came to a similar conclusion.34

Aggregation of results across such samples provides only a weak basis for drawing conclusions about the true pandemic effect on population mental health. As noted previously, US government benchmark trend surveys produce much more accurate information. However, most of these are face-to-face surveys that were disrupted by the pandemic in 2020. The BRFSS, in comparison, is a telephone survey that continued throughout 2020.21 The 2020 BRFSS microdata have recently been released, making it possible to estimate pandemic-associated changes in prevalence of clinically significant anxiety and depression in the first 10 months of the pandemic vs earlier years. We present such an analysis in this article, examining trends in the total adult population and subgroups.

Methods

The study followed the American Association for Public Opinion Research (AAPOR) reporting guideline for survey studies.35 Because all data were obtained from public sources, this study does not constitute human participant research and does not require institutional review board review or exemption according to the US Department of Health and Human Services (45 CFR §46).

Sample

The BRFSS is a collaboration between the CDC and US states to implement monthly telephone surveys of noninstitutionalized adults on prevalence-correlates of chronic conditions, risk behaviors, and outcomes of state policies21 based on a dual-frame landline and cell phone design.36 Complex calibration weights are used to adjust for discrepancies between the sample and population on a wide range of sociodemographic and geographic characteristics36 The median state-level response rate in 2020 was 47.9%,37 using the AAPOR R4 definition,38 very similar to 2017 to 2019 (45.9%-49.4%),39-41 the prepandemic years used for comparison. We focus on 335 691 respondents in the 50 states and District of Columbia surveyed in March to December 2020 compared with 1 093 663 respondents surveyed in the same months in 2017 to 2019.

Measures
Estimated Pandemic-Associated Prevalence of Clinically Significant Anxiety and Depression

Although the core BRFSS does not include anxiety or depression screening scales, a 2018 BRFSS module administered to 8724 participants included the PHQ-4, the same anxiety and depression screening scale used in the HPS and some other major online COVID-19 population surveys.15,42 Clinically significant anxiety and depression are conventionally estimated as a PHQ-4 score of 6 or greater.43 In a preliminary analysis, we found that responses to a core BRFSS question (“Now thinking about your mental health, which includes stress, depression, and problems with emotions, for how many days during the past 30 days was your mental health not good?”) had good concordance with this dichotomous version of the PHQ-4 (area under the receiver operating characteristic curve, 0.84) in the BRFSS module sample. We consequently dichotomized responses to the core BRFSS question at 15 to 30 days vs 0 to 14 days, the threshold that best equalized false positives and false negatives for a PHQ-4 score of 6 or greater (7.2% vs 6.2%) and used this dichotomy as the outcome in our analysis.

Sociodemographic Characteristics

Sociodemographic characteristics included gender (female, male, or missing), race and ethnicity (Hispanic, non-Hispanic Black, non-Hispanic White, other, or missing), education (less than high school or missing, high school graduate, some college, or college graduate), and employment status. Separate questions were asked about Hispanic ethnicity (“Are you Hispanic, Latino/a, or Spanish Origin?”) and race (“Which one or more of the following would you say is your race?”). The response options for race were American Indian or Alaskan Native, Asian, Black or African American, Pacific Islander, and White. Respondents could endorse any or all these responses. Other volunteered responses were field coded as “Other,” “Don’t know/Not sure,” and “Refused.” Responses were coded hierarchically for the current analysis into Hispanic, Non-Hispanic Black, those reporting only White, and all others. Importantly, given the dramatic increase in unemployment early in the pandemic,44 which might have induced a healthy worker effect, the BRFSS assessed long-term (≥12 months) unemployment (ie, unemployment occurring before the pandemic for 2020 respondents) separately from shorter-term unemployment. These sociodemographic characteristics were included in analyses based on a suggestion in the literature that they might be associated with anxiety and depression via increased risk of virus exposure.45

Time and Space Pandemic-Associated Variables

The public use BRFSS data set includes information about state of residence and month of survey, allowing respondents to be classified on state-month COVID-19 death rate46 and unemployment rate47 compared with 2017 to 2019. These scores were assigned to all BRFSS respondents for the month before the survey.

Statistical Analysis

We began by inspecting a cross-tabulation of bimonthly March to December anxiety and depression prevalence estimates in BRFSS 2020 vs 2017 to 2019 overall and in employment status subgroups. A modified Poisson regression model with robust variance estimation for a dichotomous outcome was then used to estimate pandemic-associated prevalence of clinically significant anxiety and depression within employment subsamples using dummy-coded variables for 2020 vs 2017 to 2019, controlling state, month, and sociodemographic characteristics. This model was then expanded to include interactions of the 2020 vs 2017 to 2019 indicator variable with sociodemographic characteristics. Temporal changes in prevalence were modeled as adjusted risk differences (ARDs)48 using postregression transformations that compared differences in mean estimated probabilities based on nonlinear models.49 Adjustments for spatial autocorrelation (ie, clustering by state) and calibration weights on SEs were made using the Taylor series linearization method.50 All analyses were carried out using Stata software version 16.1 (StataCorp). Statistical significance was set at P < .05, and all tests were 2-tailed.

Results
Sample Composition

Overall, there were 1 429 354 respondents, with 1 093 663 in 2017 to 2019 (600 416 [51.1%] women; 87 153 [11.8%] non-Hispanic Black; 826 334 [61.5%] non-Hispanic White; 411 254 [27.8%] with college education; and 543 619 [56.8] employed) and 335 691 in 2020 (182 351 [51.3%] women; 25 517 [11.7%] non-Hispanic Black; 250 333 [60.5%] non-Hispanic White; 130 642 [29.3%] with college education; and 168 921 [54.9%] employed) (Table 1). Compositional changes were very small, other than for a decrease in the proportion employed (1.9 percentage points; 54.9% vs 56.8%) and a significant increase in the proportion short-term unemployed (3.1 percentage points; 5.8% vs 2.7%) in 2020.

Estimated Prevalence of Clinically Significant Anxiety and Depression in 2017 to 2019 and 2020

Estimated prevalence of clinically significant anxiety and depression was 0.4 (95% CI, 0.0 to 0.7) percentage points higher in March to December 2020 than March to December 2017 to 2019 (12.4% vs 12.1%). However, this difference varied significantly by month (Table 2), with estimated prevalence significantly lower in March to April 2020 than March to April 2017 to 2019 (−0.8 [95% CI, −1.6 to −0.0] percentage points; 10.9% vs 11.7%), not meaningfully different in May to June (0.2 [95% CI, −0.5 to 0.9] percentage points; 12.5% vs 12.3%), and significantly higher by increasing proportions than in 2017 to 2019 between July and August 2020 (0.7 [95% CI, 0.1 to 1.3] percentage points; 12.6% vs 11.9%) and November-December 2020 (1.0 [95% CI, 0.4 to 1.5] percentage points; 13.4% vs 12.4%).

Variation by Employment Status

Inspection of sample composition by employment status showed, consistent with official government statistics,51 that short-term unemployment was twice as common in 2020 as in 2017-2019 (3.1 [95% CI, 2.9 to 3.2] percentage points; 5.8% vs 2.7%) whereas employment was significantly less common (−1.9 [95% CI, −2.4 to 1.3] percentage points; 54.9% vs 56.8%) (Table 3). Differences in other employment statuses were much smaller. Estimated prevalence of clinically significant anxiety and depression increased significantly only among the employed (0.9 [95% CI, 0.5 to 1.4] percentage points; 10.8% vs 9.8%) and students (2.4 [95% CI, 0.8 to 3.9] percentage points; 17.3% vs 14.9%). In comparison, the 2020 vs 2017 to 2019 estimated change in anxiety and depression prevalence was negative among the short-term unemployed (−1.8 [95% CI, −3.1 to −0.5] percentage points; 19.2% vs 21.0%) and those unable to work (−4.2 [95% CI, −5.3 to −3.2] percentage points; 31.0% vs 35.2%) and nonsignificant among the long-term unemployed (−2.1 percentage points; 20.7% vs 22.8%), homemakers (0.8 [95% CI, −0.3 to 1.9] percentage points; 11.7% vs 10.9%), and the retired (0.1 [95% CI, −0.6 to 0.8] percentage points; 7.4% vs 7.3%).

Time-Space Variation by Employment Status

Only 2 plausible interactions emerged from regression analyses comparing estimated pandemic-associated changes in prevalence of clinically significant anxiety and depression by employment status across sample quartiles defined by state-month COVID-19 death rates and unemployment rates (vs the same states-months in 2017-2019). Both these subgroup differences in ARD were among the employed: higher estimated increases in prevalence in state-months with elevated COVID-19 death rates and elevated unemployment rates (Table 4). However, only the first of these remained significant when both were considered together, with increases in prevalence highest in the quartile with the highest COVID-19 death rate (ARD, 1.8 [95% CI, 1.2 to 2.5] percentage points), lower in the 2 intermediate quartiles (high-average: ARD, 1.0 [95% CI, 0.7 to 1.4] percentage points; low-average: ARD, 1.1 [95% CI, 0.3 to 1.9] percentage points), and nonsignificant in the lowest quartile (ARD, −0.0 [95% CI, −0.7 to 0.6] percentage points).

We tested whether the association of employment and COVID-19 death rate varied by sociodemographic characteristics and found that there were differences only for gender (Table 5). The aggregate ARD differed significantly between women and men, was significant only among women (women: ARD, 2.0 [95% CI, 1.4 to 2.5] percentage points; men: 0.2 [95% CI, −0.1 to 0.6] percentage points) and varied significantly with the state-month COVID-19 death rate among women (high: ARD, 3.3 [95% CI, 2.3 to 4.2 percentage points]; low: ARD, 0.1 [−1.0 to 1.2] percentage points). The aggregate ARD also differed significantly across subgroups defined by race and ethnicity but was significant only among Non-Hispanic White respondents (ARD, 1.3% [95% CI, 0.6 to 1.9] percentage points; Hispanic respondents: 1.1 [95% CI, −0.2 to 2.5] percentage points; non-Hispanic Black respondents: 0.7 [95% CI, −0.1 to 1.5] percentage points) and varied significantly with the state-month COVID-19 death rate in that subsample (high: ARD, 2.6 [95% CI, 1.8 to 3.4] percentage points; low: ARD, 0.5 [95% CI, −0.4 to 1.5] percentage points). Finally, the aggregate ARD differed significantly across subgroups defined by level of education but was significant only among those with a college degree (college degree: ARD, 2.5 [95% CI, 1.9 to 3.1] percentage points; <high school: ARD, −0.6 [95% CI, −2.7 to 1.4] percentage points) and varied significantly with the state-month COVID-19 death rate in that subsample (high: ARD, 3.1 [2.3 to 4.0] percentage points; low: 1.7 [0.3 to 3.1] percentage points).

Sensitivity Analysis

As instability in the before-during comparisons could have occurred because of a considerably higher estimated prevalence of clinically significant anxiety and depression in 2019 than 2017-2018, analyses were replicated comparing 2020 separately with 2017 to 2018 and 2019. All key results—most notably, the estimated pandemic-associated increase in prevalence among the employed, the positive association of that increase with the state-month COVID-19 death rate, and significant estimated pandemic-associated decreases in prevalence among the unemployed and those unable to work—were replicated in the separate analyses (eTables 1-2 in the Supplement).

Discussion

The BRFSS results raise the possibility that 2020 US adult pandemic-associated increases in clinically significant anxiety and depression were much more modest than suggested in previous studies. This is indirectly consistent with trends in contacts with the National Suicide Prevention Lifeline, which decreased in nearly as many states as they increased in quarter 2 of 2020 compared with 2019 and in ways unassociated with the state COVID-19 death rate or unemployment rate.52 Adult suicide deaths also decreased slightly in 2020 vs 2019.53

These estimated pandemic-associated increases in clinically significant anxiety and depression were smaller than expected given the substantial 2020 increases54,55 in stressors known to cause clinically significant psychological distress, including job loss,56 death of loved ones,57 and social isolation,58 particularly among disadvantaged groups (eg, those with lower educational attainment and those belonging to minoritized racial and ethnic groups), given that exposure to these factors was elevated in these segments of the population.59,60 Only one of these stressors, job loss, was assessed in the BRFSS. Even more surprising was that prevalence was estimated to decrease among the unemployed and those unable to work. Importantly, these decreases occurred for both short-term and long-term unemployment, arguing against a healthy worker effect.

One plausible interpretation of this specification is that anxiety and depression were associated with risk of infection when going to work, which increased as the COVID-19 death rate increased. We investigated this possibility indirectly by examining subgroup variation based on the observation that “women, people of color, and those of lower socioeconomic status” were most likely “to hold frontline positions that require in-person work and the least likely to have paid sick leave.”45 This suggests that (1) the elevated ARD among the employed should be higher for women than men; for Hispanic, non-Hispanic Black, and people of other races and ethnicities than non-Hispanic White respondents; and for people with lower rather than higher education and (2) the magnitude of these differences should vary positively with state-month COVID-19 death rates. However, this difference was only significant when comparing women with men.

Early psychological resilience during other infectious disease outbreaks and natural disasters has sometimes given way to subsequent increases in psychopathology as the crises become more protracted. Such a pattern is typical, for example, for suicide rates in the early and later phases of long-lasting mass traumas.61 The same might have occurred in the second year of the COVID-19 pandemic. Indeed, preliminary evidence consistent with this possibility has already been reported in Japan.62 In addition, the trend in emergency department visits for suicide attempts in the United States has been increasing among adolescents.63 And significant increases occurred in late 2020 both in drug overdose deaths64 and in rates of fatal and nonfatal domestic violence.65

Although it is impossible to predict future trends with accuracy, there are some promising signs in the expansion of tele–mental health care and increased use of scalable interventions to address increasing demand for treatment of emotional problems. However, there are also uncertainties about the effects of reversals in federal safety net policies to reduce the financial impact of the pandemic on the most vulnerable segments of the population66 and lingering uncertainties about the duration of the pandemic and the possible long-term neuropsychiatric effects of infection.67 As noted previously, prior research suggests that prolongation of disasters and proliferation of secondary stressors can have severe negative effects on mental health.68,69

Public policy decisions require better and more timely data than those produced by the online surveys that have been the mainstay of research on pandemic-associated changes in anxiety and depression or by using responses to the single question we were forced to rely on in the BRFSS. Methods exist to generate considerably better estimates but require a commitment to developing durable calibration rules prior to the next mass trauma to link the results of high-quality probability surveys with the results of more practical online rapid response surveys.70-72 Importantly, these calibration rules need to be geared to the focus of the surveys. This means that calibration rules appropriate for online surveys to track, eg, likely voting preferences, could be quite different from those appropriate for online surveys to track changes in clinically significant psychopathology. One would hope that the appropriate federal agencies take steps to produce such durable calibration rules before the next time they are needed.

Limitations

This study has limitations. Our results are limited by reliance on responses to a single BRFSS question to estimate clinically significant anxiety and depression, although responses to that question had good concordance with a standard anxiety and depression screening scale. Another limitation is that the BRFSS response rate (53.3%), although considerably higher than the HPS (2%-10%), still would allow substantial bias. However, given that face-to-face benchmark government surveys were compromised during 2020, the BRFSS data are likely the best we will get for 2020. That said, it is noteworthy that the broad comparisons examined here do not rule out substantial increases in clinically significant anxiety and depression in smaller, but important, population segments, such as health workers,73 or population segments such as the homeless and those living in institutional settings not covered by the BRFSS. Also noteworthy is that our focus on clinically significant anxiety and depression (ie, calibration to PHQ-4 score of ≥6) leaves open the possibility of more substantial increases in less severe anxiety and depression.29 A final noteworthy limitation is that even though the BRFSS did not assess children, the high estimated pandemic-associated increase in prevalence of clinically significant anxiety and depression among students is consistent with administrative trend data63 suggesting that the effects of the pandemic on population mental health in 2020 were much more pronounced among youth than adults.

Conclusions

In this survey study, clinically significant US adult anxiety and depression increased less during 2020 than suggested by online surveys. However, this modest aggregate increase could mask more substantial increases in key population segments and might have become larger in 2021 and 2022.

Back to top
Article Information

Accepted for Publication: March 27, 2022.

Published: June 15, 2022. doi:10.1001/jamanetworkopen.2022.17223

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2022 Kessler RC et al. JAMA Network Open.

Corresponding Author: Ronald C. Kessler, PhD, Department of Health Care Policy, Harvard Medical School, 180 Longwood Ave, Ste 215, Boston, MA 02115-5899 ([email protected]).

Author Contributions: Dr Kessler had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Kessler, Ruhm, Puac-Polanco.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Kessler.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Hwang, Lee, Petukhova, Zaslavsky, Zubizarreta.

Administrative, technical, or material support: Kessler, Puac-Polanco, Sampson, Ziobrowski.

Supervision: Kessler, Ruhm, Sampson.

Conflict of Interest Disclosures: Dr Kessler reported receiving personal fees from Datastat, Inc; Holmusk; RallyPoint Networks, Inc; and Sage Therapeutics and holding stock options in Mirah, PYM, and Roga Sciences during the conduct of the study. Dr Ruhm reporting serving as a plaintiff’s consultant for ongoing opioid litigation outside the submitted work. Dr Zubizarreta reported receiving an award from the Patient-Centered Outcomes Research Institute during the conduct of the study. No other disclosures were reported.

Additional Contributions: The authors appreciate the helpful comments of Thomas G. McGuire, PhD (Department of Health Care Policy, Harvard Medical School), and Michael Schoenbaum, PhD (Division of Services and Intervention Research, National Institute of Mental Health), on an earlier version of the paper. Neither of these individuals was paid for their comments.

References
1.
Galea  S, Merchant  RM, Lurie  N.  The mental health consequences of COVID-19 and physical distancing: the need for prevention and early intervention.   JAMA Intern Med. 2020;180(6):817-818. doi:10.1001/jamainternmed.2020.1562PubMedGoogle ScholarCrossref
2.
Pfefferbaum  B, North  CS.  Mental health and the COVID-19 pandemic.   N Engl J Med. 2020;383(6):510-512. doi:10.1056/NEJMp2008017PubMedGoogle ScholarCrossref
3.
Cavicchioli  M, Ferrucci  R, Guidetti  M, Canevini  MP, Pravettoni  G, Galli  F.  What will be the impact of the COVID-19 quarantine on psychological distress? considerations based on a systematic review of pandemic outbreaks.   Healthcare (Basel). 2021;9(1):101. doi:10.3390/healthcare9010101PubMedGoogle ScholarCrossref
4.
Chu  IY, Alam  P, Larson  HJ, Lin  L.  Social consequences of mass quarantine during epidemics: a systematic review with implications for the COVID-19 response.   J Travel Med. 2020;27(7):taaa192. doi:10.1093/jtm/taaa192PubMedGoogle ScholarCrossref
5.
Shah  K, Kamrai  D, Mekala  H, Mann  B, Desai  K, Patel  RS.  Focus on mental health during the coronavirus (COVID-19) pandemic: applying learnings from the past outbreaks.   Cureus. 2020;12(3):e7405. doi:10.7759/cureus.7405PubMedGoogle ScholarCrossref
6.
Goldmann  E, Galea  S.  Mental health consequences of disasters.   Annu Rev Public Health. 2014;35:169-183. doi:10.1146/annurev-publhealth-032013-182435PubMedGoogle ScholarCrossref
7.
Majid  U, Hussain  SAS, Wasim  A, Farhana  N, Saadat  P.  A systematic map of non-clinical evidence syntheses published globally on COVID-19.   Disaster Med Public Health Prep. Published online July 22, 2021. doi:10.1017/dmp.2021.236PubMedGoogle ScholarCrossref
8.
Twenge  JM, Joiner  TE.  Mental distress among U.S. adults during the COVID-19 pandemic.   J Clin Psychol. 2020;76(12):2170-2182. doi:10.1002/jclp.23064PubMedGoogle ScholarCrossref
9.
Lucid Holdings. Academic research with Lucid. Accessed August 6, 2021. https://luc.id/academic-solutions/
10.
Kessler  RC, Barker  PR, Colpe  LJ,  et al.  Screening for serious mental illness in the general population.   Arch Gen Psychiatry. 2003;60(2):184-189. doi:10.1001/archpsyc.60.2.184PubMedGoogle ScholarCrossref
11.
National Center for Health Statistics. National Health Interview Survey. Accessed January 15, 2022. https://www.cdc.gov/nchs/nhis/index.htm
12.
American Association for Public Opinion Research. AAPOR reports on online panels. Accessed August 8, 2021. https://www.aapor.org/Education-Resources/Reports/Report-on-Online-Panels
13.
RAND Corporation. RAND American Life Panel (ALP). Accessed August 8, 2021. https://www.rand.org/research/data/alp.html
14.
Breslau  J, Finucane  ML, Locker  AR, Baird  MD, Roth  EA, Collins  RL.  A longitudinal study of psychological distress in the United States before and during the COVID-19 pandemic.   Prev Med. 2021;143:106362. doi:10.1016/j.ypmed.2020.106362PubMedGoogle ScholarCrossref
15.
Czeisler  MÉ, Lane  RI, Petrosky  E,  et al.  Mental health, substance use, and suicidal ideation during the COVID-19 pandemic—United States, June 24-30, 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(32):1049-1057. doi:10.15585/mmwr.mm6932a1PubMedGoogle ScholarCrossref
16.
Daly  M, Sutin  AR, Robinson  E.  Depression reported by US adults in 2017-2018 and March and April 2020.   J Affect Disord. 2021;278:131-135. doi:10.1016/j.jad.2020.09.065PubMedGoogle ScholarCrossref
17.
Ettman  CK, Abdalla  SM, Cohen  GH, Sampson  L, Vivier  PM, Galea  S.  Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic.   JAMA Netw Open. 2020;3(9):e2019686. doi:10.1001/jamanetworkopen.2020.19686PubMedGoogle ScholarCrossref
18.
McGinty  EE, Presskreischer  R, Han  H, Barry  CL.  Psychological distress and loneliness reported by US adults in 2018 and April 2020.   JAMA. 2020;324(1):93-94. doi:10.1001/jama.2020.9740PubMedGoogle ScholarCrossref
19.
United States Census Bureau. Measuring household experiences during the coronavirus pandemic. Accessed August 8, 2021. https://www.census.gov/data/experimental-data-products/household-pulse-survey.html
20.
Kroenke  K, Spitzer  RL, Williams  JB, Löwe  B.  An ultra-brief screening scale for anxiety and depression: the PHQ-4.   Psychosomatics. 2009;50(6):613-621. doi:10.1176/appi.psy.50.6.613PubMedGoogle ScholarCrossref
21.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System. Accessed August 8, 2021. https://www.cdc.gov/brfss/index.html
22.
Twenge  JM, McAllister  C, Joiner  TE.  Anxiety and depressive symptoms in U.S. Census Bureau assessments of adults: trends from 2019 to fall 2020 across demographic groups.   J Anxiety Disord. 2021;83:102455. doi:10.1016/j.janxdis.2021.102455PubMedGoogle ScholarCrossref
23.
United States Census Bureau. Experimental data products. Accessed August 8, 2021. https://www.census.gov/data/experimental-data-products.html
24.
United States Census Bureau. Household Pulse Survey technical documentation. Accessed August 8, 2021. https://www.census.gov/programs-surveys/household-pulse-survey/technical-documentation.html
25.
Peterson  S, Toribio  N, Farber  J, Hornick  D. Nonresponse bias report for the 2020 Household Pulse Survey. Accessed August 7, 2021. https://www2.census.gov/programs-surveys/demo/technical-documentation/hhp/2020_HPS_NR_Bias_Report-final.pdf
26.
Bradley  VC, Kuriwaki  S, Isakov  M, Sejdinovic  D, Meng  X-L, Flaxman  S.  Unrepresentative big surveys significantly overestimated US vaccine uptake.   Nature. 2021;600(7890):695-700. doi:10.1038/s41586-021-04198-4PubMedGoogle ScholarCrossref
27.
Sun  Y, Wu  Y, Bonardi  O,  et al.  Comparison of mental health symptoms prior to and during COVID-19: evidence from a living systematic review and meta-analysis.   medRxiv. Preprint posted online May 11, 2021. doi:10.1101/2021.05.10.21256920Google Scholar
28.
The Depressd Project. Research question 1: changes in mental health symptoms. Accessed August 8, 2021. https://www.depressd.ca/research-question-1-symptom-changes
29.
Kessler  RC, Chiu  WT, Hwang  IH,  et al.  Changes in prevalence of mental illness among US adults during compared with before the COVID-19 pandemic.   Psychiatr Clin North Am. 2022;45(1):1-28. doi:10.1016/j.psc.2021.11.013PubMedGoogle ScholarCrossref
30.
Wanberg  CR, Csillag  B, Douglass  RP, Zhou  L, Pollard  MS.  Socioeconomic status and well-being during COVID-19: a resource-based examination.   J Appl Psychol. 2020;105(12):1382-1396. doi:10.1037/apl0000831PubMedGoogle ScholarCrossref
31.
Santomauro  DF, Mantilla Herrera  AM, Shadid  J,  et al; COVID-19 Mental Disorders Collaborators.  Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic.   Lancet. 2021;398(10312):1700-1712. doi:10.1016/S0140-6736(21)02143-7PubMedGoogle ScholarCrossref
32.
Katz  BA, Yovel  I. Mood symptoms predict COVID-19 pandemic distress but not vice versa: an 18-month longitudinal study. Accessed August 7, 2021. https://osf.io/j8qab/
33.
Marroquín  B, Vine  V, Morgan  R.  Mental health during the COVID-19 pandemic: effects of stay-at-home policies, social distancing behavior, and social resources.   Psychiatry Res. 2020;293:113419. doi:10.1016/j.psychres.2020.113419PubMedGoogle ScholarCrossref
34.
Robinson  E, Sutin  AR, Daly  M, Jones  A.  A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020.   J Affect Disord. 2022;296:567-576. doi:10.1016/j.jad.2021.09.098PubMedGoogle ScholarCrossref
35.
Pitt  SC, Schwartz  TA, Chu  D.  AAPOR reporting guidelines for survey studies.   JAMA Surg. 2021;156(8):785-786. doi:10.1001/jamasurg.2021.0543PubMedGoogle ScholarCrossref
36.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—overview: BRFSS 2020. Accessed August 8, 2021. https://www.cdc.gov/brfss/annual_data/2020/pdf/overview-2020-508.pdf
37.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2020 summary data quality report. Accessed August 8, 2021. https://www.cdc.gov/brfss/annual_data/2020/pdf/2020-sdqr-508.pdf
38.
American Association for Public Opinion Research. Standard definitions, final dispositions of case codes and outcome rates for surveys. Accessed April 15, 2022. https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf
39.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2017 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2017/pdf/2017-sdqr-508.pdf
40.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2018 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2018/pdf/2018-sdqr-508.pdf
41.
US Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System—2019 summary data quality report. Accessed August 9, 2021. https://www.cdc.gov/brfss/annual_data/2019/pdf/2019-sdqr-508.pdf
42.
Daly  M, Robinson  E.  Psychological distress and adaptation to the COVID-19 crisis in the United States.   J Psychiatr Res. 2021;136:603-609. doi:10.1016/j.jpsychires.2020.10.035PubMedGoogle ScholarCrossref
43.
Löwe  B, Wahl  I, Rose  M,  et al.  A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population.   J Affect Disord. 2010;122(1-2):86-95. doi:10.1016/j.jad.2009.06.019PubMedGoogle ScholarCrossref
44.
Smith  SM, Edwards  R, Duong  HC. Unemployment rises in 2020, as the country battles the COVID-19 pandemic. Accessed August 9, 2021. https://www.bls.gov/opub/mlr/2021/article/unemployment-rises-in-2020-as-the-country-battles-the-covid-19-pandemic.htm
45.
Wolfe  R, Harknett  K, Schneider  D. Inequalities at work and the toll of COVID-19. Health Affairs. Accessed August 9, 2021. https://www.healthaffairs.org/do/10.1377/hpb20210428.863621/full/
46.
US Centers for Disease Control and Prevention. United States COVID-19 cases and deaths by state over time. Accessed August 9, 2021. https://data.cdc.gov/Case-Surveillance/United-States-COVID-19-Cases-and-Deaths-by-State-o/9mfq-cb36
47.
US Bureau of Labor Statistics. Local area unemployment statistics. Accessed August 9, 2021. https://www.bls.gov/lau/
48.
Long  JS, Mustillo  SA.  Using predictions and marginal effects to compare groups in regression models for binary outcomes.   Sociol Methods Res. 2018;50(3):1284-1320. doi:10.1177/0049124118799374Google ScholarCrossref
49.
Williams  R.  Using the margins command to estimate and interpret adjusted predictions and marginal effects.   Stata J. 2012;12(2):308-331. doi:10.1177/1536867X1201200209Google ScholarCrossref
50.
Wolker  KM.  Introduction to Variance Estimation (Statistics for Social and Behavioral Sciences). 2nd ed. Springer; 2007.
51.
US Bureau of Labor Statistics. Civilian unemployment rate, seasonally adjusted. Accessed August 9, 2021. https://www.bls.gov/charts/employment-situation/civilian-unemployment-rate.htm
52.
Tjeltveit  A. COVID-19 and the National Suicide Prevention Lifeline. Accessed August 9, 2021. https://storymaps.arcgis.com/stories/063fbdbfb7c743b78e56abf79fc284b9
53.
Ahmad  FB, Anderson  RN.  The leading causes of death in the US for 2020.   JAMA. 2021;325(18):1829-1830. doi:10.1001/jama.2021.5469PubMedGoogle ScholarCrossref
54.
Falk  G, Romero  PD, Nicchitta  IA, Nyhof  EC. Unemployment rates during the COVID-19 pandemic. Congressional Research Service. Accessed September 1, 2021. https://sgp.fas.org/crs/misc/R46554.pdf
55.
National Center for Health Statistics. The 2020 increase in death rates were the highest ever recorded. Accessed August 9, 2021. https://www.cdc.gov/nchs/pressroom/podcasts/2021/20210611/20210611.htm
56.
Krueger  AB, Mueller  AI.  The lot of the unemployed: a time use perspective.   J Eur Econ Assoc. 2012;10(4):765-794. doi:10.1111/j.1542-4774.2012.01071.xGoogle ScholarCrossref
57.
Fernández-Alcántara  M, Kokou-Kpolou  CK, Cruz-Quintana  F, Pérez-Marfil  MN.  Editorial: new perspectives in bereavement and loss: complicated and disenfranchised grief along the life cycle.   Front Psychol. 2021;12:691464. doi:10.3389/fpsyg.2021.691464PubMedGoogle ScholarCrossref
58.
Erzen  E, Çikrikci  Ö.  The effect of loneliness on depression: a meta-analysis.   Int J Soc Psychiatry. 2018;64(5):427-435. doi:10.1177/0020764018776349PubMedGoogle ScholarCrossref
59.
Center on Budget and Policy Priorities. Tracking the COVID-19 economy’s effects on food, housing, and employment hardships. Accessed August 5, 2021. https://www.cbpp.org/sites/default/files/atoms/files/8-13-20pov.pdf
60.
Gould  E, Kassa  M. Young workers hit hard by the COVID-19 economy. Economic Policy Institute. Accessed August 9, 2021. https://files.epi.org/pdf/203139.pdf
61.
Leaune  E, Samuel  M, Oh  H, Poulet  E, Brunelin  J.  Suicidal behaviors and ideation during emerging viral disease outbreaks before the COVID-19 pandemic: a systematic rapid review.   Prev Med. 2020;141:106264. doi:10.1016/j.ypmed.2020.106264PubMedGoogle ScholarCrossref
62.
Tanaka  T, Okamoto  S.  Increase in suicide following an initial decline during the COVID-19 pandemic in Japan.   Nat Hum Behav. 2021;5(2):229-238. doi:10.1038/s41562-020-01042-zPubMedGoogle ScholarCrossref
63.
Yard  E, Radhakrishnan  L, Ballesteros  MF,  et al.  Emergency department visits for suspected suicide attempts among persons aged 12-25 years before and during the COVID-19 pandemic—United States, January 2019-May 2021.   MMWR Morb Mortal Wkly Rep. 2021;70(24):888-894. doi:10.15585/mmwr.mm7024e1PubMedGoogle ScholarCrossref
64.
Ahmad  F, Cisewski  J. Quarterly provisional estimates for selected indicators of mortality, 2019-quarter 1, 2021. Vital Statistics Rapid Release. Accessed August 9, 2021. https://www.cdc.gov/nchs/nvss/vsrr/mortality-dashboard.htm
65.
Schleimer  JP, McCort  CD, Shev  AB,  et al.  Firearm purchasing and firearm violence during the coronavirus pandemic in the United States: a cross-sectional study.   Inj Epidemiol. 2021;8(1):43. doi:10.1186/s40621-021-00339-5PubMedGoogle ScholarCrossref
66.
Rigby  E.  The COVID-19 economy, unemployment insurance, and population health.   JAMA Netw Open. 2021;4(1):e2035955. doi:10.1001/jamanetworkopen.2020.35955PubMedGoogle ScholarCrossref
67.
Kumar  S, Veldhuis  A, Malhotra  T.  Neuropsychiatric and cognitive sequelae of COVID-19.   Front Psychol. 2021;12:577529. doi:10.3389/fpsyg.2021.577529PubMedGoogle ScholarCrossref
68.
Gersons  BPR, Smid  GE, Smit  AS, Kazlauskas  E, McFarlane  A.  Can a ‘second disaster’ during and after the COVID-19 pandemic be mitigated?   Eur J Psychotraumatol. 2020;11(1):1815283. doi:10.1080/20008198.2020.1815283PubMedGoogle ScholarCrossref
69.
Raphael  B.  When Disaster Strikes: How Individuals and Communities Cope With Catastrophe. Basic Books; 1986.
70.
Wang  L, Valliant  R, Li  Y.  Adjusted logistic propensity weighting methods for population inference using nonprobability volunteer-based epidemiologic cohorts.   Stat Med. 2021;40(24):5237-5250. doi:10.1002/sim.9122PubMedGoogle ScholarCrossref
71.
Wiśniowski  A, Sakshaug  JW, Perez Ruiz  DA, Blom  AG.  Integrating probability and nonprobability samples for survey inference.   J Surv Stat Methodol. 2020;8(1):120-147. doi:10.1093/jssam/smz051Google ScholarCrossref
72.
Yang  S, Kim  JK, Song  R.  Doubly robust inference when combining probability and non-probability samples with high dimensional data.   J R Stat Soc Series B Stat Methodol. 2020;82(2):445-465. doi:10.1111/rssb.12354PubMedGoogle ScholarCrossref
73.
Prasad  K, McLoughlin  C, Stillman  M,  et al.  Prevalence and correlates of stress and burnout among US healthcare workers during the COVID-19 pandemic: a national cross-sectional survey study.   EClinicalMedicine. 2021;35:100879. doi:10.1016/j.eclinm.2021.100879PubMedGoogle ScholarCrossref
×