May 24, 2018

Suicide prevention: Research network finds new way to predict risk

Led by KPWHRI scientists, study aims to target those who need interventions most

SEATTLE, May 24, 2018—Combining data from electronic health records with results from standardized depression questionnaires better predicts suicide risk in the 90 days following either mental health specialty or primary care outpatient visits, reports a team from the Mental Health Research Network, led by Kaiser Permanente research scientists.

The study, “Predicting Suicide Attempts and Suicide Death Following Outpatient Visits Using Electronic Health Records,” conducted in five Kaiser Permanente regions (Colorado, Hawaii, Oregon, California, and Washington), the Henry Ford Health System in Detroit, and the HealthPartners Institute in Minneapolis, was published today in the American Journal of Psychiatry.

Combining a variety of information from the past five years of people’s electronic health records and answers to questionnaires, the new models predicted suicide risk more accurately than before, according to the authors. The strongest predictors include prior suicide attempts, mental health and substance use diagnoses, medical diagnoses, psychiatric medications dispensed, inpatient or emergency room care, and scores on a standardized depression questionnaire.

“We demonstrated that we can use electronic health record data in combination with other tools to accurately identify people at high risk for suicide attempt or suicide death,” said first author Gregory E. Simon, MD, MPH, a Kaiser Permanente psychiatrist in Washington and a senior investigator at Kaiser Permanente Washington Health Research Institute.

In the 90 days following an office visit:

  • Suicide attempts and deaths among patients whose visits were in the highest 1 percent of predicted risk were 200 times more common than among those in the bottom half of predicted risk.
  • Patients with mental health specialty visits who had risk scores in the top 5 percent accounted for 43 percent of suicide attempts and 48 percent of suicide deaths.
  • Patients with primary care visits who had  scores in the top 5 percent accounted for 48 percent of suicide attempts and 43 percent of suicide deaths.

This study builds on previous models in other health systems that used fewer potential predictors from patients’ records. Using those models, people in the top 5 percent of risk accounted for only a quarter to a third of subsequent suicide attempts and deaths. More traditional suicide risk assessment, which relies on questionnaires or clinical interviews only, is even less accurate.

The new study involved seven large health systems serving a combined population of 8 million people in nine states. The research team examined almost 20 million visits by nearly 3 million people age 13 or older, including about 10.3 million mental health specialty visits and about 9.7 million primary care visits with mental health diagnoses. The researchers deleted information that could help identify individuals. They created two models: one for mental health specialty visits, and another for primary care outpatient visits.

“It would be fair to say that the health systems in the Mental Health Research Network, which integrate care and coverage, are the best in the country for implementing suicide prevention programs,” Dr. Simon said. “But we know we could do better. So several of our health systems, including Kaiser Permanente, are working to integrate prediction models into our existing processes for identifying and addressing suicide risk.”

Suicide rates are increasing

Suicide accounted for nearly 45,000 deaths in the United States in 2016—25 percent more than in 2000, according to the National Center for Health Statistics.

Other health systems can replicate this approach to risk stratification, according to Dr. Simon. Better prediction of suicide risk can inform decisions by health care providers and health systems. Such decisions include how often to follow up with patients, refer them for intensive treatment, reach out to them after missed or canceled appointments—and whether to help them create a personal safety plan and counsel them about reducing access to means of self-harm.

This work complements Kaiser Permanente’s ongoing efforts to emphasize the importance of mental health and wellness and its impact on total health—mind, body and spirit working in unison. For the last three years, the organization’s national public health awareness effort, Find Your Words, has focused on ending stigma around mental health conditions by encouraging people to people to break the silence around depression and other mental health conditions by engaging in honest conversations about these issues.  

Dr. Simon’s coauthors are Robert B. Penfold, PhD, Susan M. Shortreed, PhD, Eric Johnson, MS, and Rebecca Ziebell, of Kaiser Permanente Washington Health Research Institute; Jean M. Lawrence, ScD, of Kaiser Permanente Southern California; Frances L. Lynch, PhD, of Kaiser Permanente Northwest; Arne Beck, PhD, of Kaiser Permanente Colorado; Beth Waitzfelder, PhD, of Kaiser Permanente Hawaii; Brian Ahmedani, PhD, of Henry Ford Health System in Detroit; and Rebecca C. Rossom, MD, MS, of HealthPartners Institute in Minneapolis.

National Institute of Mental Health cooperative agreement U19 MH092201 supported this research.

About Kaiser Permanente Washington Health Research Institute

Kaiser Permanente Washington Health Research Institute (KPWHRI) improves the health and health care of Kaiser Permanente members and the public. The institute has conducted nonproprietary public-interest research on preventing, diagnosing, and treating major health problems since 1983. Government and private research grants provide our main funding. Follow KPWHRI research on TwitterFacebook, and LinkedIn, or subscribe to our free monthly newsletter. 

About Kaiser Permanente

Kaiser Permanente is committed to helping shape the future of health care. We are recognized as one of America’s leading health care providers and not-for-profit health plans. Founded in 1945, Kaiser Permanente has a mission to provide high-quality, affordable health care services and to improve the health of our members and the communities we serve. We currently serve more than 12.4 million members in eight states and the District of Columbia. Care for members and patients is focused on their total health and guided by their personal Permanente Medical Group physicians, specialists and team of caregivers. Our expert and caring medical teams are empowered and supported by industry-leading technology advances and tools for health promotion, disease prevention, state-of-the-art care delivery and world-class chronic disease management. Kaiser Permanente is dedicated to care innovations, clinical research, health education and the support of community health. For more information, go to: kp.org/share.

Additional KPWHRI Researchers

Robert Penfold, PhD

Senior Investigator
Kaiser Permanente Washington Health Research Institute

Susan M. Shortreed, PhD

Senior Biostatistics Investigator
Kaiser Permanente Washington Health Research Institute

Eric Johnson, MS

Senior Collaborative Biostatistician
Kaiser Permanente Washington Health Research Institute


Media contact

Caroline Liou
Caroline.X.Liou@kp.org
206-200-4512

After-hours media line: 206-448-4056

page-twitter-icon.png @KPWaResearch