Intended And Unintended Outcomes After FDA Pediatric Antidepressant Warnings: A Systematic Review
- Stephen B. Soumerai ([email protected]), Harvard University and Harvard Pilgrim Health Care Institute, Boston, Massachusetts.
- Ross Koppel, University of Pennsylvania, Philadelphia, Pennsylvania; and University at Buffalo, State University of New York, Buffalo, New York.
- Huseyin Naci, London School of Economics and Political Science, London, United Kingdom.
- Jeanne M. Madden, Northeastern University, Boston, Massachusetts; and Harvard University and Harvard Pilgrim Health Care Institute.
- Andra Fry, London School of Economics and Political Science.
- Alyssa Halbisen, Harvard Pilgrim Health Care Institute.
- Jesenia Angeles, Cósmica Consulting, LLC, Miami, Florida.
- Jonah Koppel, Drexel University, Philadelphia, Pennsylvania.
- Rachelle Rubin, Harvard Pilgrim Health Care Institute.
- Christine Y. Lu, University of Sydney and Northern Sydney Local Health District, Sydney, New South Wales, Australia; Harvard University and Harvard Pilgrim Health Care Institute.
Abstract
Since 2003, the Food and Drug Administration (FDA) has warned that antidepressants may be associated with suicidal thoughts and behaviors among youth. An FDA advisory in 2003 and a black-box warning in 2005 focused on children and adolescents younger than age eighteen. The FDA expanded the black-box warning in 2007 to include young adults. Both warnings were intended to increase physician monitoring of suicidal thoughts and behaviors. Our systematic review identified thirty-four studies of depression and suicide-related outcomes after these warnings; eleven of these studies met research design criteria established to reduce biases. The eleven studies examined monitoring for suicidal thoughts and behaviors, physician visits for depression, depression diagnoses, psychotherapy visits, antidepressant treatment and use, and psychotropic drug poisonings (a proxy for suicide attempts) and suicide deaths. We assessed possible spillover to adults not targeted by the warnings. The one study that measured intended physician monitoring of suicidal thoughts and behaviors did not find evidence of an increase. Multiple studies found significant unintended reductions in mental health care after the warnings. After these reductions, there were marked increases in psychotropic drug poisonings and suicide deaths. These findings support reevaluation of risks and benefits of the FDA’s black-box antidepressant warnings.
Depression is the leading cause of suicide,1 and suicide is the second-leading cause of death among youth and young adults ages 10–24.2 Evidence consistently demonstrates that access to mental health care, including psychotherapy and antidepressant medications, can improve outcomes among youth with depression.3,4
The Food and Drug Administration (FDA) is responsible for identifying and communicating possible drug risks to prescribers, patients, and the public. Risk communications are challenging because they can have both intended and unintended consequences. For example, FDA warnings contributed to intended reductions in aspirin use in children, which is a cause of Reye’s syndrome.5 In contrast, an FDA-commissioned 2013 systematic review found that a third of FDA warnings on medications had unintended consequences, including spillover to patients not targeted by the warnings, prescribing of substitute drugs, reductions in detection and treatment of disease, and adverse health outcomes.6
In October 2003, an FDA advisory warned that antidepressants may be associated with suicidality (a term that refers to suicidal thoughts and behaviors) among those younger than age eighteen soon after the initiation of treatment.7 In January 2005, the FDA required a permanent black-box warning of this risk on product labels and in television and print advertising for all antidepressant drugs. In May 2007, the FDA expanded the 2005 black-box warning to include young adults through age twenty-four;8 this broader warning remains in effect today. We refer to these three actions collectively as “the FDA warnings.”
Although the FDA warnings were intended to increase monitoring of suicidal thoughts and behaviors at the start of antidepressant drug treatment, the warnings may have the unintended effect of frightening both physicians and youth.9 A study published in 2016 found that two-thirds of youth with major depressive episodes did not seek any depression care, and the FDA warnings have the potential to reduce care seeking among this group.10 In addition, such warnings may result in fewer diagnoses and less-appropriate treatment of youth depression by clinicians, especially pediatricians and other primary care providers,11,12 who, at the time of the warnings, were the most frequent prescribers of antidepressants.13 The FDA recognized that the warnings could have the unintended effect of reducing the prescribing and use of antidepressants, thus possibly increasing depression and suicidality. According to a member of the FDA committee approving the black-box warning: “The black box warning is not meant to discourage the prescription of antidepressants. In fact, the warning refers to the hazard of untreated depression.”14
Nevertheless, the terminology used in the warnings, such as “suicidality,” could lead to the misperception that these drugs cause suicides.9,15 The black-box warning, which suggests a link between youth antidepressant use and suicidal thoughts and behaviors, is the same today as it was in 2005, and it appears widely on product labels and in television and print ads, patient drug information, and internet resources. Because these warning messages are ongoing, they may continue to affect patient and physician behaviors.
To evaluate the totality of credible evidence on the relationship between FDA antidepressant warnings and changes in specified care and outcomes among youth, we conducted the only comprehensive systematic review of the most rigorous quasi-experimental studies ever published on the topic, to our knowledge.16,17 Our study went beyond previous research to focus not only on studies investigating changes in antidepressant treatment and use among youth (the most studied outcome) but also on evidence regarding other outcomes after the warnings. These included the outcome targeted by the FDA—monitoring for youth suicidality—as well as several other potential outcomes: changes in physician visits for depression, depression diagnoses, psychotherapy visits, antidepressant treatment and use, and psychotropic drug poisonings (a proxy for suicide attempts) and suicide deaths.
Study Data And Methods
Our systematic review is reported in accordance with the 2020 PRISMA statement18 (see PRISMA table in online appendix 7),19 and our protocol was registered with PROSPERO on December 17, 2021 (Registration No. CRD42021261192).
Information Sources And Search Strategy
We searched the Medline Ovid, Embase Ovid, and PsycINFO Ovid databases using keywords, subject headings, and search operators for the concepts of FDA, boxed warnings, and antidepressants. The search covered the period between January 1, 2003, and October 31, 2022. We excluded animal studies, commentaries, editorials, and letters. Search results were exported to EndNote and deduplicated.
Eligibility Criteria
We identified thirty-four original investigations published in the peer-reviewed literature on changes in specified youth outcomes associated with the FDA’s antidepressant warnings, as well as potential spillover among two subpopulations not targeted by the warnings before the black-box warning was expanded in 2007: young adults (ages 18–24) and adults older than age 24.
Because it was not possible to randomize exposure to antidepressant warnings, the most rigorous studies available for inclusion in the review were those with quasi-experimental study designs. We judged the strength of study designs according to Cochrane systematic review and quasi-experimental design criteria.16,17,20 To focus on studies with the strongest possible quasi-experimental research designs, we limited the review to interrupted time series with more than five data points both before and after the antidepressant warnings and a minimum of fifty patient observations per time point, with or without control groups. We included only interrupted time series studies that controlled for baseline trends and numerous threats to internal validity, such as other changes in trends of study outcomes before the warnings (for example, physician visits for depression); changes in the study populations around the time of the warnings, such as age or illness progression that could confound study outcomes; and selection bias. All included studies estimated pre-post changes in the levels or trends of study outcomes immediately after the warnings. Intermediate-quality studies met our criteria for inclusion if they had more than five pre-warning measurement points and two to five post-warning points, and they controlled for baseline trends.21 We excluded studies that provided weak evidence, such as those with uncontrolled pre-post designs, studies including fewer than six pre-warning data points, and studies with post-only designs that could not measure pre-post change.17,22 Eleven of the thirty-four studies met the above criteria for inclusion in this systematic review.
Screening And Selection Process
One investigator screened article titles and abstracts. For quality control, two sets of 100 titles and abstracts were randomly selected and screened blindly by one other investigator each. During screening, any published studies investigating the warnings’ effects on care processes, such as mental health care, or on outcomes, such as suicidal behavior, were obtained for full-text review. Conflicting determinations were resolved by discussion. Two investigators then reviewed potentially relevant full-text articles according to the eligibility criteria described above.
Data Extraction
We extracted all figures from the included studies, as well as data on study populations, sample sizes, comparison groups (if reported), measures, validity of measures, results by outcome, immediate-level and slope changes in study outcomes after the warnings (95% confidence intervals or values), differences between predicted versus expected (counterfactual) values up to three years after the warnings, comparison outcomes (if reported), and conclusions. We used Cochrane’s risk-of-bias tool for interrupted time series studies20 to identify possible biases in the reviewed studies, such as a possible confounding co-intervention. We investigated potential biases to determine their implications and how to address them in our analysis. Details on our assessment of possible biases are in appendix 8.19 All data from eligible studies were extracted by one investigator and carefully reviewed by a second investigator. Any discrepancies were discussed and resolved.
Analysis
We collected data from the included studies on changes in reported trends after the FDA antidepressant warnings with respect to the single intended outcome of the policy: prescriber monitoring of suicidal thoughts and behaviors among youth after initiating antidepressant treatment.14 We also examined potential unintended outcomes, including reductions in physician visits for depression, depression diagnoses, psychotherapy visits, and antidepressant treatment and use, as well as increases in psychotropic drug poisonings and suicide deaths. We analyzed trends in unintentional injury deaths per 100,000 adolescents before and after the FDA antidepressant warnings as a comparison outcome for suicide deaths because unintentional injury deaths are unrelated to the stated goal of the FDA warnings. We summarized each study’s analyses of individual outcomes and categorized the reported outcomes as intended/desirable, unintended/adverse, and neutral. We considered adult subpopulations ages 18–24 and older than age 24 to be comparison groups because they were not targeted by the FDA warnings (2003, 2005). However, we collected outcome data on young adults (ages 18–24) and adults older than age 24, where available, to identify potential spillover to adult subpopulations.
Our summaries included outcome data by age, race and ethnicity, and provider type if these data were reported in the studies. We excluded specific outcomes if they were likely to be biased because of failure to account for large baseline differences in subgroup effects or floor effects when outcomes were so close to zero on the -axis that further reductions in a study outcome (such as use of antidepressants) were difficult to measure. In each case, we cited the excluded outcome measure and explained why it could have biased the results if it had been retained (see appendixes 4 and 5).19
Using extracted trend lines from the original studies, we modified some of the figures published with these studies to align the pre-post periods consistently across studies and reflect the implementation dates of the FDA advisory and black-box warning. Similarly, we modified axis minimum and maximum values, as needed, to improve visualization of trends if study group trends were too close to the floor of a graph.
The included studies were based on data from state Medicaid programs; death certificates for all US counties, captured in the Centers for Disease Control and Prevention Wide-Ranging Online Data for Epidemiologic Research (WONDER) database; nationwide managed care plan data sets; and nationally representative surveys.
Limitations
This review had several limitations. Although interrupted time series analysis is one of the strongest quasi-experimental designs to control for co-occurring interventions,16,17 the strength of the relationship between the FDA’s actions and reported outcomes in the reviewed studies varied according to the size and abruptness of changes in outcomes and possible co-interventions. The most important potential threat to the validity of this review and the reviewed studies was the possibility that events or forces other than the warnings contributed to increases in psychotropic drug poisonings and suicide deaths. Possible co-occurring events that might have confounded the outcomes of the warnings include increased social media use, the opioid epidemic, and the 2008 recession. We carefully considered each of these events and concluded that they were not likely to have been confounders, for several reasons. First, although the use of social media among youth7,8 may be associated with anxiety and depression,23 longitudinal data on the use of early social media platforms, such as Facebook, WhatsApp, and WeChat, suggest that it was minimal at the time of the FDA warnings.24 Use of social media increased substantially about five to twelve years after the start of the 2003 FDA advisory, thus making it implausible as a rival explanation. Second, although opioid use might be associated with some suicides, the longitudinal data on opioid-related deaths suggest that their trends were opposite to that of suicide death.25 When nationwide opioid deaths were increasing before the warnings, suicides were decreasing substantially. When opioid deaths flattened and then decreased after the warnings, suicide deaths increased. Thus, the opioid epidemic was unlikely to have confounded the association between the FDA warnings and increases in suicide deaths. Moreover, accidental injury deaths among adolescents, including those caused by drugs of abuse, declined after the warnings. Third, although thf008 recession has been associated with a small increase in middle-age adult suicide rates, meta-analyses26 have concluded that the recession was unlikely to have affected suicides in any other age group.
Our review identified only one study examining the FDA-intended effect on prescriber monitoring for suicidal thoughts and behaviors; the scarcity of published research on this outcome means that caution must accompany conclusions about such monitoring.
Finally, our review identified only one study examining changes in psychotropic drug poisonings after the FDA antidepressant warnings.7 The dearth of studies on this topic reflects the fact that diagnostic coding for suicide attempts is unreliable.27 Psychotropic drug poisonings account for a small subset of suicide attempts, and not all poisonings are with self-harm intent. Nevertheless, the sharp increases in psychotropic drug poisonings immediately after the warnings among adolescents and young adults, together with other studies included in this review that found increases in suicide deaths, suggest a possible association between the warnings and suicidal behavior.
Study Results
Our database searches identified 1,841 studies that included any discussion of the FDA antidepressant warnings. Of thirty-four studies examining the warnings’ outcomes, eleven met research design criteria and were included in the systematic review (see PRISMA table in appendix 7).19
Overview Of Included Studies
All eleven included studies measured changes in outcomes after the October 2003 FDA advisory or January 2005 black-box warnings. Six of these eleven studies used comparison outcomes or groups when they analyzed changes in outcomes after the FDA warnings. These included changes in unintentional injury deaths versus suicide deaths and changes in outcomes among children or adolescents versus in adults not targeted by the warnings (spillover outcomes). Appendix 1 summarizes outcomes of the pediatric warnings in all eleven included studies and provides full citations for each of the studies.19Exhibits 1–3, based on results from very large studies (with sample sizes greater than 100,000), focus on changes in outcomes among pediatric patients (the group targeted by the FDA warnings); these findings represent the strongest evidence of their impact. We also present results suggesting spillover among adults. No studies observed the direct effects of the 2007 expansion of the pediatric black-box warnings to young adults.
Major Findings For Pediatric Patients Targeted By The Warnings
After the FDA warnings, multiple studies reported substantial reductions in physician visits for depression and depression diagnoses (exhibit 1), reductions in antidepressant treatment and use (exhibit 2), and increases in psychotropic drug poisonings and suicide deaths (exhibit 3) among pediatric patients. These results provide evidence of substantial, immediate changes in unintended outcomes after the FDA warnings across different pediatric subpopulations and data sources. The findings show increasing rates of depression diagnosis and treatment and declines in rates of psychotropic drug poisonings and suicide deaths before the FDA warnings. The increased rates of adolescent suicide attempts and deaths after the warnings contrast with reductions in rates of unintentional injury deaths among adolescents during the study period, a comparison outcome (exhibit 3).16
Detailed Results By Outcome In Targeted And Nontargeted Populations
In the following section, we provide detailed descriptions of reported results by outcome category for pediatric populations (who were targeted by the FDA warnings) and adult populations (who were not targeted by the warnings). Overall, there were no reported findings indicating intended/desirable outcomes, thirty-five reported findings indicating unintended/adverse outcomes, and eight reported findings indicating neutral outcomes (exhibit 4).
Distinct outcomes examined within included studies | ||||
Outcomes | No. of studies examining outcome | No. of intended/desirable outcomesa | No. of unintended/adverse outcomesb | No. of neutral outcomesc |
Monitoring for suicidal thoughts and behaviors | 1 | 0 | 2 | 0 |
Physician visits for depression | 1 | 0 | 2 | 0 |
Depression diagnoses | 3 | 0 | 6 | 0 |
Psychotherapy visits | 1 | 0 | 1 | 0 |
Antidepressant treatment and use | 6 | 0 | 16 | 5 |
Psychotropic drug poisonings and suicide deaths | 3 | 0 | 8 | 3 |
Monitoring For Suicidal Thoughts And Behaviors:
One study, based on medical records for 27,370 pediatric patients, examined whether clinician monitoring for suicidal thoughts and behaviors when starting antidepressant treatment increased after the FDA warnings28 (appendix 1).19 The authors conducted an interrupted time series analysis with comparison series that included forty-seven monthly points before and twenty-five observations after the advisory. The two monitoring measures included the FDA’s recommended contact schedule of seven visits in the three months after treatment initiation and the less-stringent Healthcare Effectiveness Data and Information Set (HEDIS) measure specifying three contacts in these three months.28
Contrary to the intent of the warnings, fewer than 5 percent of pediatric patients were monitored in accordance with the FDA’s recommended contact schedule recommendations after the advisory; this low rate was unchanged from the rate before the warnings. Likewise, there was no increase in monitoring for suicidal thoughts and behaviors in pediatric patients, as defined in the HEDIS monitoring criteria. There was no increase in monitoring in a comparison group of adults who were not targeted by the warnings.
Physician Visits For Depression, Depression Diagnoses, Psychotherapy Visits:
Four well-designed studies11,29–31 including a total of more than twelve million patients found consistent evidence of sudden and substantial long-term declines in physician visits for depression and depression diagnoses after the FDA warnings (appendixes 1 and 2, exhibits 2A–2C).19 These studies showed increases in physician visits for depression and depression diagnoses in the years before the warnings and abrupt, sustained declines, ranging from 20 percent to 45 percent, in visits and diagnoses after the warnings. Some spillover occurred in comparison groups of adults, who were not targeted by the FDA warnings.11 One national study indicated that reduced diagnosis rates were concentrated among patients treated by pediatricians and other primary care physicians.11 Of the studies examining psychotherapy visits after the warnings, none found increases. One study found that depression visits decreased among White, Black, and Latino youth after the FDA warnings29 (appendix 2, exhibit 2.A).19
Antidepressant Treatment And Use:
Seven studies showed evidence that the FDA warnings were followed by abrupt reductions in antidepressant treatment and use, ranging from 20 percent to 50 percent.7,11,29,30,32–34 Most studies showed increasing use of antidepressants in the years before the FDA advisory, followed by abrupt and sustained reductions in use after the warnings. The warnings were associated with declines in rates of overall antidepressant use and treatment of newly diagnosed patients in managed care plans,11,27,30,31,34 large state Medicaid programs,29,32 and nationally representative surveys (appendixes 1 and 2, exhibits 3.A–3.K).19 Relative to the reported declines in antidepressant prescribing and use in the pediatric population, declines were smaller among adults not targeted by the warnings. Several studies showed larger reductions in antidepressant prescribing by generalists, including pediatricians, internists, and family practitioners, than by specialists.11,34 One study found that after a health maintenance organization attempted to increase monitoring of suicidality after the FDA advisory by requiring preauthorization of antidepressant refills, the proportion of new prescriptions that had any refills declined by about half, and the duration of use declined substantially, contrary to national guidelines.30
Two studies suggested modest substitution of an approved antidepressant for youth, fluoxetine, for other selective serotonin reuptake inhibitors (SSRIs) after the FDA warnings; however, this did not offset the overall decline in antidepressant treatment and use.29,33
Psychotropic Drug Poisonings And Suicide Deaths:
Three studies found evidence of declining or flat pre-warning trends in psychotropic drug poisonings (a proxy for suicide attempts) and suicide deaths, followed by abrupt increases in post-warning trends for these outcomes among adolescents who were targeted by the FDA advisory and black-box warning7,8,35 (appendixes 1 and 2, exhibits 4.A–4.F).19 No studies found intended/desirable decreases in psychotropic drug poisonings or suicide deaths. On the basis of forty-four quarterly time points from ten years of data in eleven US health plans,7 a rigorous study demonstrated a 21.7 percent abrupt increase in psychotropic drug poisonings by the second year after the 2005 black-box warning among 1.1 million adolescents and a 33.7 percent spillover increase in the same outcome among 1.4 million young adults who were included in the expanded black-box warning in 2007.7 Nonsignificant increases in psychotropic drug poisonings among a comparison group of adults not targeted by the warnings were one neutral outcome identified by our review.
A more recent study by Christine Lu and colleagues8 investigated adolescent and young adult suicide deaths in the US, using data validated by the Centers for Disease Control and Prevention (CDC) over the course of twenty-eight years before and after the 2005 black-box warning.7 These data suggest that increases in adolescent and young adult suicides exceeded expected trends by nearly 2,500 cases in the three years after the black-box warning among cohorts that averaged forty-three million adolescents and twenty-one million young adults per year. Consistent with results of other studies, pre-warning suicide rates began declining after 1990, soon after SSRIs became available. That trend reversed in 2004: The downward trend immediately flattened and then followed a curvilinear upward trend among adolescents and young adults after the 2005 FDA black-box warning. In contrast to the increased suicide rates described above,8 there were no simultaneous increases in a comparison outcome (accidental injury deaths among US youth).
A study published in 2008, based on data from the period 1996–2005 using the same CDC suicide data with two years of follow-up, suggested that there were significant increases in adolescent suicides among both males and females and both younger and older teens (ages 10–17 and 18–19), beginning in 2004.35
Discussion
The eleven studies in our systematic review show that the FDA pediatric antidepressant advisory in 2003 and black-box warning in 2005 were associated with unintended outcomes: reduced physician visits for depression, depression diagnoses, psychotherapy visits, and antidepressant treatment and use and increased psychotropic drug poisonings (a proxy for suicide attempts) and suicide deaths. Contrary to the FDA’s intent to increase physician monitoring of suicidal thoughts and behaviors of treated patients, a large longitudinal study suggests that this did not occur.28 Moreover, a study of eleven million youth in the four largest state Medicaid plans documented that total depression visits declined by almost half in the three years after the black-box warning, which suggests a likely reduction in monitoring of suicidal thoughts and behaviors in youth with depression.29
The reduction in physician visits for depression immediately after the warnings may be a stronger intermediate outcome than reduced antidepressant treatment and use in predicting suicidal behavior.36 Physician visits for depression, depression diagnoses, psychotherapy visits, and antidepressant treatment and use also declined among older populations not targeted by warnings, but to a lesser extent than among youth, who were the target of the warnings.
Primary care physicians, including pediatricians, who frequently provided youth depression treatment after the introduction of SSRIs (which are safer than the earlier tricyclic antidepressants)37 were more likely than specialists to reduce antidepressant treatment and depression diagnoses after the FDA warnings.11,34 This trend suggests a reduction in access to care among pediatric patients and fewer opportunities for suicide prevention.
Our findings suggest a reduction in access to care among pediatric patients and fewer opportunities for suicide prevention.
Conclusion
Rigorous evidence suggests that the FDA’s most serious ongoing youth antidepressant warnings have not had the intended outcome of increased monitoring for suicidal thoughts and behaviors. Instead, the warnings were associated with unintended reductions in physician visits for depression, depression diagnoses, antidepressant treatment and use, and psychotherapy visits, as well as increases in psychotropic drug poisonings and increased suicide deaths. It has been more than fifteen years since studies began documenting these outcomes, using the most rigorous quasi-experimental methods.34 Now, the overwhelming evidence suggests that the ongoing use of these warnings may result in more harms than benefits.
The overwhelming evidence suggests that the ongoing use of these warnings may result in more harms than benefits.
FDA officials should review the totality of evidence and err on the side of caution in acknowledging possible harms of the antidepressant warnings. High-quality studies support reevaluation and possible replacement of the FDA black-box warning with routine warnings in product labeling. Moreover, such warnings should be evaluated rigorously by independent scientists to yield objective evidence on their intended and unintended consequences.
ACKNOWLEDGMENTS
The authors are indebted to Samantha Fournier for the creation of graphical presentations of the data and coordination of the research team. The authors are solely responsible for the accuracy of the information presented in this article. Any views or opinions expressed in this article are solely those of the authors, and no endorsement of these views or opinions by the authors’ institutions is expressed or implied. This is an open access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) license, which permits others to distribute this work provided the original work is properly cited, not altered, and not used for commercial purposes. See https://creativecommons.org/licenses/by-nc-nd/4.0/. To access the authors’ disclosures, click on the Details tab of the article online.
NOTES
- 1 . Epidemiology of suicide and the psychiatric perspective. Int J Environ Res Public Health. 2018;15(7):1425. Crossref, Medline, Google Scholar
- 2 Centers for Disease Control and Prevention. Suicide prevention, health disparities in suicide [Internet]. Atlanta (GA): CDC; 2024 May 16 [cited
2024 Sep 16 ]. Available from: https://www.cdc.gov/suicide/disparities/index.html Google Scholar - 3 . Depression in adolescents. N Engl J Med. 2021;385(5):445–9. Crossref, Medline, Google Scholar
- 4 . Patient education: depression treatment options for children and adolescents (beyond the basics) [Internet]. Tehran: Medi Media; [last updated 2022 Oct 3; cited
2024 Sep 16 ]. Available from: https://www.medilib.ir/uptodate/show/4870 Google Scholar - 5 . Effects of professional and media warnings about the association between aspirin use in children and Reye’s syndrome. Milbank Q. 1992;70(1):155–82. Crossref, Medline, Google Scholar
- 6 A critical review of methods to evaluate the impact of FDA regulatory actions. Pharmacoepidemiol Drug Saf. 2013;22(9):986–94. Crossref, Medline, Google Scholar
- 7 Changes in antidepressant use by young people and suicidal behavior after FDA warnings and media coverage: quasi-experimental study. BMJ. 2014;348:g3596. Crossref, Medline, Google Scholar
- 8 . Increases in suicide deaths among adolescents and young adults following US Food and Drug Administration antidepressant boxed warnings and declines in depression care. Psychiatr Res Clin Pract. 2020;2(2):43–52. Crossref, Medline, Google Scholar
- 9 . The black box warning and its unintended consequences. Child Adolesc Psychopharmacol News. 2009;14(1):6–9. Crossref, Google Scholar
- 10 . National trends in the prevalence and treatment of depression in adolescents and young adults. Pediatrics. 2016;138(6):e20161878. Crossref, Medline, Google Scholar
- 11 . Persisting decline in depression treatment after FDA warnings. Arch Gen Psychiatry. 2009;66(6):633–9. Crossref, Medline, Google Scholar
- 12 Impact of publicity concerning pediatric suicidality data on physician practice patterns in the United States. Arch Gen Psychiatry. 2007;64(4):466–72. Crossref, Medline, Google Scholar
- 13 . A brief history of the development of antidepressant drugs: from monoamines to glutamate. Exp Clin Psychopharmacol. 2015;23(1):1–21. Crossref, Medline, Google Scholar
- 14 . The revised warning for antidepressants and suicidality: unveiling the black box of statistical analyses. Am J Psychiatry. 2007;164(12):1786–9. Crossref, Medline, Google Scholar
- 15 . FDA confirms antidepressants raise children’s suicide risk. Washington Post [serial on the Internet]. 2004 Sep 14 [cited
2024 Aug 13 ]. Available from: https://www.washingtonpost.com/wp-dyn/articles/A18791-2004Sep13.html Google Scholar - 16 . Quasi-experimentation: design and analysis issues for field settings. Boston (MA): Houghton Mifflin; 1979. Google Scholar
- 17 . Experimental and quasi-experimental designs for generalized causal inference. Boston (MA): Cengage Learning; 2002. Google Scholar
- 18 The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372(71):n71. Crossref, Medline, Google Scholar
- 19 To access the appendix, click on the Details tab of the article online.
- 20 Cochrane Effective Practice and Organisation of Care. What study designs can be considered for inclusion in an EPOC review and what should that be called? [Internet]. London: Cochrane EPOC; 2017 Aug 24 [cited
2024 Aug 13 ]. Available from: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/Resources-for-authors2017/what_study_designs_should_be_included_in_an_epoc_review.pdf Google Scholar - 21 A reanalysis of cluster randomized trials showed interrupted time-series studies were valuable in health system evaluation. J Clin Epidemiol. 2015;68(3):324–33. Crossref, Medline, Google Scholar
- 22 . How do you know which health care effectiveness research you can trust? A guide to study design for the perplexed. Prev Chronic Dis. 2015;12:E101. Crossref, Medline, Google Scholar
- 23 . Social media and depressive symptoms in childhood and adolescence: a systematic review. Adolesc Res Rev. 2017;2(4):315–30. Google Scholar
- 24 . The rise of social media [Internet]. Oxford: Our World in Data; 2019 Sep 18 [cited
2024 Aug 13 ]. Available from: https://ourworldindata.org/rise-of-social-media Google Scholar - 25 . Drug overdose deaths among adolescents aged 15–19 in the United States: 1999–2015 [Internet]. Hyattsville (MD): National Center for Health Statistics; 2017 Aug [cited
2024 Aug 13 ]. (NCHS Data Brief No. 282). Available from: https://www.cdc.gov/nchs/data/databriefs/db282.pdf Google Scholar - 26 . Suicide and the Great Recession of 2007–2009: the role of economic factors in the 50 U.S. states. Soc Sci Med. 2014;116:22–31. Crossref, Medline, Google Scholar
- 27 How complete are E-codes in commercial plan claims databases? Pharmacoepidemiol Drug Saf. 2014;23(2):218–20. Crossref, Medline, Google Scholar
- 28 Frequency of provider contact after FDA advisory on risk of pediatric suicidality with SSRIs. Am J Psychiatry. 2008;165(1):42–50. Crossref, Medline, Google Scholar
- 29 . A decline in depression treatment following FDA antidepressant warnings largely explains racial/ethnic disparities in prescription fills. Depress Anxiety. 2017;34(12):1147–56. Crossref, Medline, Google Scholar
- 30 . Trends in youth antidepressant dispensing and refill limits, 2000 through 2009. J Child Adolesc Psychopharmacol. 2012;22(1):11–20. Crossref, Medline, Google Scholar
- 31 . Spillover effects on treatment of adult depression in primary care after FDA advisory on risk of pediatric suicidality with SSRIs. Am J Psychiatry. 2007;164(8):1198–205. Crossref, Medline, Google Scholar
- 32 . Effect of regulatory warnings on antidepressant prescribing for children and adolescents. Arch Pediatr Adolesc Med. 2007;161(7):690–6. Crossref, Medline, Google Scholar
- 33 . The influence of FDA advisory information and black box warnings on individual use of prescription antidepressants. Rev Econ Househ. 2014;12(4):771–90. Crossref, Google Scholar
- 34 . Decline in treatment of pediatric depression after FDA advisory on risk of suicidality with SSRIs. Am J Psychiatry. 2007;164(6):884–91. Crossref, Medline, Google Scholar
- 35 . Suicide trends among youths aged 10 to 19 years in the United States, 1996–2005. JAMA. 2008;300(9):1025–6. Crossref, Medline, Google Scholar
- 36 The treatment of suicide and self-injurious behaviors in children and adolescents. Curr Treat Options Psychiatry. 2020;7(1):39–52. Crossref, Google Scholar
- 37 Selective serotonin reuptake inhibitors versus tricyclic antidepressants in young patients: a meta-analysis of efficacy and acceptability. Clin Ther. 2014;36(7):1087–1095.e4. Crossref, Medline, Google Scholar