Removal of social support and insulation information from clinical notes: demo and system performance
The demographic characteristics of the patients in the description cohort are detailed in Table 2. In particular, the patient composition in MSHS is younger and more varied than patients in WCM.
The analysis was performed using the gold standard, manually described data. Macro-average sensitivity, remembering, and F-SKORS are given in Table 3 to classify thin and rough grain SS and SI categories at grade levels.
In MSHS, RBS performed better than the LLM -based system for both thin and rough classification. For fine-grained categories, RBS has obtained a 0.90 macro-average F-Skoru compared to 0.62 for LLM. For coarse-grained classification, RBS had a 0.89 macro-average F-Skor against 0.89 for LLM.
In WCM, the RBS performed better for fine-grained classification with macro-average F-Skors against 0.82 against 0.82 to 0.82. Coarse-grained categories were similar, macro-average F-Skoru for RBS is 0.85, compared to 0.82 for flan. The performance of the zero display Flan-T5-XL model is given in the additional table S8.
Comparison with ICD codes: Si’s structured ICD codes (ICD-10: ‘Z60.2’, ‘V60.3’, ‘Z60.4’, ‘Z60.9’; ICD-9: ‘V60.3’, ‘V62.4’ [see Supplementary Table S9]). Without NLP pipelines, Si’s presence would otherwise miss both sites.
Authors:
(1) Braja Gopal Patra, Weill Cornell Medicine, New York, NY, USA and the first writers;
(2) Lauren A. Lepow, Icahn Sina Mountain, New York, NY, USA and the first writers;
(3) Praneet Kasi Reddy Jagadeesh gamble. Weill Cornell Medicine, New York, NY, USA;
(4) Veer Vekaria, Weill Cornell Medicine, New York, NY, USA;
(5) Mohit Manoj Sharma, Weill Cornell Medicine, New York, NY, USA;
(6) Prakash Adekkanattu, Weill Cornell Medicine, New York, NY, USA;
(7) Brian Fennessy, Icahn Sina Mountain, New York, NY, Faculty of Medicine in the USA;
(8) Gavin Hynes, Icahn Sina Mountain, New York, NY, Faculty of Medicine in the United States;
(9) Isotta Landi, Icahn Sina Mountain, New York, NY, Faculty of Medicine in the United States;
(10) Jorge A. Sanchez-Ruiz, Mayo Clinic, Rochester, Mn, USA;
(11) Euijung Ryu, Mayo Clinic, Rochester, Mn, USA;
(12) Joanna M. Biernacka, Mayo Clinic, Rochester, Mn, USA;
(13) Girish N. Nadkarni, ICAHN SINA Mountain, New York, NY, Faculty of Medicine in the USA;
(14) Ardesheer Talati, Columbia University Vagelos College, New York, NY, USA and New York State Psychiatry Institute, New York, NY, USA;
(15) Myrna Weissman, Columbia University Vagelos Doctors and Surgeons College, New York, NY, USA and New York State Psychiatry Institute, New York, NY, USA;
(16) Mark Olfson, Columbia University Vagelos Doctors and Surgeons College, New York, NY, USA, New York State Psychiatry Institute, New York, NY, USA and Columbia University Irving Medical Center, New York, NY, USA;
(17) J. John Mann, Columbia University Irving Medical Center, New York, NY, USA;
(18) Alexander W. Charney, Icahn Sina Mountain, New York, NY, Faculty of Medicine in the USA;
(19) Jyotishman Pathak, Weill Cornell Medicine, New York, NY, USA.
