@Article{信息:doi/10.2196/38178,作者=“Singh, Pulkit和Haimovich, Julian和Reeder, Christopher和Khurshid, Shaan和Lau, Emily S和Cunningham, Jonathan W和Philippakis, Anthony和Anderson, Christopher D和Ho, Jennifer E和Lubitz, Steven A和Batra, Puneet”,标题=“一个临床医生就是你所需要的——心脏磁共振成像测量提取:“深度学习算法开发”,期刊=“JMIR Med Inform”,年=“2022”,月=“Sep”,日=“16”,卷=“10”,号=“9”,页=“e38178”,关键词=“自然语言处理”;《变形金刚》;机器学习;心脏磁共振成像;临床结果;背景:心脏磁共振成像(CMR)是一种强大的诊断方式,可以提供心脏解剖和功能的详细定量评估。临床报告通常以非结构化文本形式存储在电子健康记录系统中,从临床报告中自动提取CMR测量值将有助于其在研究中的使用。现有的机器学习方法要么依赖于大量的专家注释,要么需要开发耗时且特定于开发环境的工程规则。目的:我们假设使用预训练的基于转换器的语言模型可以从临床文本中实现标签高效的数字提取,而不需要启发式或大量的专家注释。 Here, we fine-tuned pretrained transformer-based language models on a small quantity of CMR annotations to extract 21 CMR measurements. We assessed the effect of clinical pretraining to reduce labeling needs and explored alternative representations of numerical inputs to improve performance. Methods: Our study sample comprised 99,252 patients that received longitudinal cardiology care in a multi-institutional health care system. There were 12,720 available CMR reports from 9280 patients. We adapted PRAnCER (Platform Enabling Rapid Annotation for Clinical Entity Recognition), an annotation tool for clinical text, to collect annotations from a study clinician on 370 reports. We experimented with 5 different representations of numerical quantities and several model weight initializations. We evaluated extraction performance using macroaveraged F1-scores across the measurements of interest. We applied the best-performing model to extract measurements from the remaining CMR reports in the study sample and evaluated established associations between selected extracted measures with clinical outcomes to demonstrate validity. Results: All combinations of weight initializations and numerical representations obtained excellent performance on the gold-standard test set, suggesting that transformer models fine-tuned on a small set of annotations can effectively extract numerical quantities. Our results further indicate that custom numerical representations did not appear to have a significant impact on extraction performance. The best-performing model achieved a macroaveraged F1-score of 0.957 across the evaluated CMR measurements (range 0.92 for the lowest-performing measure of left atrial anterior-posterior dimension to 1.0 for the highest-performing measures of left ventricular end systolic volume index and left ventricular end systolic diameter). Application of the best-performing model to the study cohort yielded 136,407 measurements from all available reports in the study sample. We observed expected associations between extracted left ventricular mass index, left ventricular ejection fraction, and right ventricular ejection fraction with clinical outcomes like atrial fibrillation, heart failure, and mortality. Conclusions: This study demonstrated that a domain-agnostic pretrained transformer model is able to effectively extract quantitative clinical measurements from diagnostic reports with a relatively small number of gold-standard annotations. The proposed workflow may serve as a roadmap for other quantitative entity extraction. ", issn="2291-9694", doi="10.2196/38178", url="https://medinform.www.mybigtv.com/2022/9/e38178", url="https://doi.org/10.2196/38178", url="http://www.ncbi.nlm.nih.gov/pubmed/35960155" }
Baidu
map