Towards Outcome-Driven Patient Subgroups: A Machine Learning Analysis Across Six Depression Treatment Studies

David Benrimoh, Akiva Kleinerman, Toshi A. Furukawa, Charles F.Reynolds III, Eric J. Lenze, Jordan Karp, Benoit Mulsant, Caitrin Armstrong, Joseph Mehltretter, Robert Fratila, Kelly Perlman, Sonia Israel, Christina Popescu, Grace Golden, Sabrina Qassim, Alexandra Anacleto, Myriam Tanguay-Sela, Adam Kapelner, Ariel Rosenfeld, Gustavo Turecki

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Background: Major depressive disorder (MDD) is a heterogeneous condition; multiple underlying neurobiological and behavioral substrates are associated with treatment response variability. Understanding the sources of this variability and predicting outcomes has been elusive. Machine learning (ML) shows promise in predicting treatment response in MDD, but its application is limited by challenges to the clinical interpretability of ML models, and clinicians often lack confidence in model results. In order to improve the interpretability of ML models in clinical practice, our goal was to demonstrate the derivation of treatment-relevant patient profiles comprised of clinical and demographic information using a novel ML approach. Methods: We analyzed data from six clinical trials of pharmacological treatment for depression (total n = 5438) using the Differential Prototypes Neural Network (DPNN), a ML model that derives patient prototypes which can be used to derive treatment-relevant patient clusters while learning to generate probabilities for differential treatment response. A model classifying remission and outputting individual remission probabilities for five first-line monotherapies and three combination treatments was trained using clinical and demographic data. Prototypes were evaluated for interpretability by assessing differences in feature distributions (e.g. age, sex, symptom severity) and treatment-specific outcomes. Results: A 3-prototype model achieved an area under the receiver operating curve of 0.66 and an expected absolute improvement in remission rate for those receiving the best predicted treatment of 6.5% (relative improvement of 15.6%) compared to the population remission rate. We identified three treatment-relevant patient clusters. Cluster A patients tended to be younger, to have increased levels of fatigue, and more severe symptoms. Cluster B patients tended to be older, female, have less severe symptoms, and the highest remission rates. Cluster C patients had more severe symptoms, lower remission rates, more psychomotor agitation, more intense suicidal ideation, and more somatic genital symptoms. Conclusion: It is possible to produce novel treatment-relevant patient profiles using ML models; doing so may improve interpretability of ML models and the quality of precision medicine treatments for MDD.

Original languageEnglish
Pages (from-to)280-292
Number of pages13
JournalAmerican Journal of Geriatric Psychiatry
Volume32
Issue number3
Early online date22 Sep 2023
DOIs
StatePublished - Mar 2024

Bibliographical note

Publisher Copyright:
© 2023 American Association for Geriatric Psychiatry

Funding

DB conceptualized the study and analyses, supervised analyses, and wrote and revised the manuscript. AK ran the analyses, helped conceputalize the study, and contributed to writing and revising the manuscript. TF, CR, EL, JK, BM provided data, revised the manuscript, and advised on analyses. CA, JM, RF, KP helped prepare and preprocess datasets and revise the manuscript, and CA, JM and RF advised on analyses. JM performed some supplementary analyses. SI, CP, GG, SQ, AA, MTS helped revise the manuscript. AK advised on analyses and helped revise the manuscript. AR and GT provided supervision and revised the manuscript. The data used for this project was provided from the NIMH as well as by Dr. Furukawa and the University of Kyoto, as well as the IRL-GREY investigators and the University of Pittsburgh, for which we are very grateful. Data and/or research tools used in the preparation of this manuscript were obtained from the National Institute of Mental Health (NIMH) Data Archive (NDA). NDA is a collaborative informatics system created by the National Institutes of Health to provide a national resource to support and accelerate research in mental health. Dataset identifier(s): Sequenced Treatment Alternatives to Relieve Depression (STAR*D) #2148, Combining Medications to Enhance Depression Outcomes (CO-MED) #2158, Research Evaluating the Value of Augmenting Medication with Psychotherapy (REVAMP) #2153, Establishing Moderators/Biosignatures of Antidepressant Response - Clinical Care (EMBARC) MDD Treatment and Controls #2199. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or of the Submitters submitting original data to NDA. The authors do not have permission to share the data used in this project as it does not belong to them; those interested in using the data should contact the NIMH, the University of Pittsburgh, and the University of Kyoto. DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA were all employees, officers, shareholders, or contractors of Aifred Health when this work was done. JK is a member of an advisory board to Aifred Health and has received stock options. AK, AK and AR have all collaborated with Aifred Health in the past and have received honoraria. CR receives an honorarium from the American Association for Geriatric Psychiatry as editor of the American Journal of Geriatric Psychiatry; royalty income for intellectual property from the University of Pittsburgh (Pittsburgh Sleep Quality Index), from Oxford University Press, and from Up-to-Date; and consulting income from the University of Maryland, Weill Cornell College of Medicine, Washington University of Saint Louis, and the University of South Florida. TAF reports personal fees from Boehringer-Ingelheim, DT Axis, Kyoto University Original, Shionogi and SONY, and a grant from Shionogi, outside the submitted work; In addition, TAF has patents 2020-548587 and 2022-082495 pending, and intellectual properties for Kokoro-app licensed to Mitsubishi-Tanabe. EL reports grant support from the COVID early treatment fund, Fast grants, Janssen; consulting for Merck, IngenioRx, Prodeo, Pritikin ICR, Boehringer Ingelheim; and a patent pending for Sigma 1 agonists for COVID-19. Within the past five years, JK has received compensation for development and presentation of a (disease-state, not product-focused) webinar for Otsuka. He has served as scientific advisor (paid) to NightWare and Biogen and (with potential for equity) to AifredHealth. He receives compensation from Journal of Clinical Psychiatry and American Journal of Geriatric Psychiatry for editorial board service. Funding provided by ERA-PERMED supporting the IMADAPT project; the NRC via IRAP; and Aifred Health. DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA were all employees, officers, shareholders, or contractors of Aifred Health when this work was done. JK is a member of an advisory board to Aifred Health and has received stock options. AK, AK and AR have all collaborated with Aifred Health in the past and have received honoraria. CR receives an honorarium from the American Association for Geriatric Psychiatry as editor of the American Journal of Geriatric Psychiatry; royalty income for intellectual property from the University of Pittsburgh (Pittsburgh Sleep Quality Index), from Oxford University Press, and from Up-to-Date; and consulting income from the University of Maryland, Weill Cornell College of Medicine, Washington University of Saint Louis, and the University of South Florida. TAF reports personal fees from Boehringer-Ingelheim, DT Axis, Kyoto University Original, Shionogi and SONY, and a grant from Shionogi, outside the submitted work; In addition, TAF has patents 2020-548587 and 2022-082495 pending, and intellectual properties for Kokoro-app licensed to Mitsubishi-Tanabe. EL reports grant support from the COVID early treatment fund, Fast grants, Janssen; consulting for Merck, IngenioRx, Prodeo, Pritikin ICR, Boehringer Ingelheim; and a patent pending for Sigma 1 agonists for COVID-19. Within the past five years, JK has received compensation for development and presentation of a (disease-state, not product-focused) webinar for Otsuka. He has served as scientific advisor (paid) to NightWare and Biogen and (with potential for equity) to AifredHealth. He receives compensation from Journal of Clinical Psychiatry and American Journal of Geriatric Psychiatry for editorial board service. Funding provided by ERA-PERMED supporting the IMADAPT project; the NRC via IRAP; and Aifred Health.

FundersFunder number
CO-MED2158, 2153
EMBARC2199
ERA-PERMED
IngenioRx
Sequenced Treatment Alternatives2148
Washington University of Saint Louis
Weill Cornell College of Medicine
National Institutes of Health
National Institute of Mental Health
American Association for Geriatric Psychiatry
University of Pittsburgh
University of Maryland
University of South Florida
National Research Council Canada
Shionogi2022-082495, 2020-548587
Kyoto University

    Keywords

    • artificial intelligence
    • machine learning
    • major depression
    • subgroups

    Fingerprint

    Dive into the research topics of 'Towards Outcome-Driven Patient Subgroups: A Machine Learning Analysis Across Six Depression Treatment Studies'. Together they form a unique fingerprint.

    Cite this