Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable fromWednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST.我们为不便道歉提前this may cause you.

Who will be affected?

Advertisement

Accepted for/Published in:JMIR Medical Informatics

Date Submitted:Jul 4, 2022
Date Accepted:Nov 16, 2022
Date Submitted to PubMed:Nov 21, 2022

The final, peer-reviewed published version of this preprint can be found here:

State-of-the-Art Evidence Retriever for Precision Medicine: Algorithm Development and Validation

Jin Q, Tan C, Chen M, Yan M, Zhang N, Huang S, Liu X

State-of-the-Art Evidence Retriever for Precision Medicine: Algorithm Development and Validation

JMIR Med Inform 2022;10(12):e40743

DOI:10.2196/40743

PMID:36409468

PMCID:9801267

PM-Search: State-of-the-art Evidence Retriever for Precision Medicine: Algorithm Development and Validation

  • Qiao Jin;
  • Chuanqi Tan;
  • Mosha Chen;
  • Ming Yan;
  • Ningyu张;
  • Songfang Huang;
  • Xiaozhong Liu

ABSTRACT

Background:

Under the paradigm of Precision Medicine (PM), patients with the same disease can receive different personalized therapies according to their clinical and genetic features. These therapies are determined by the totality of all available clinical evidence, including results from case reports, clinical trials and systematic reviews. However, it is increasingly difficult for physicians to find such evidence from scientific publications, whose size is growing at an unprecedented pace.

Objective:

In this work, we propose the PM-Search system to facilitate the retrieval of clinical literature that contains critical evidence for or against giving specific therapies to certain cancer patients.

Methods:

The PM-Search system combines a Baseline Retriever that selects document candidates at large scale and an Evidence Re-ranker that finely reorders the candidates based on their evidence quality. The Baseline Retriever uses query expansion and keyword matching with the Elasticsearch retrieval engine, and the Evidence Re-ranker fits pre-trained language models to expert annotations that are derived from an active learning strategy.

Results:

The PM-Search system achieves the best performance in the retrieval of high-quality clinical evidence at the TREC PM Track 2020, outperforming the second-ranking systems by large margins (0.4780 v.s. 0.4238 for standard NDCG@30 and 0.4519 v.s. 0.4193 for exponential NDCG@30).

Conclusions:

We present PM-Search, a state-of-the-art search engine to assist the practicing of evidence-based PM. PM-Search uses a novel BioBERT-based active learning strategy that models evidence quality and improves the model performance. Our analyses show that evidence quality is a distinct aspect from the general relevance, and specific modeling of evidence quality beyond general relevance is required for a PM search engine.


Citation

Please cite as:

Jin Q, Tan C, Chen M, Yan M, Zhang N, Huang S, Liu X

State-of-the-Art Evidence Retriever for Precision Medicine: Algorithm Development and Validation

JMIR Med Inform 2022;10(12):e40743

DOI:10.2196/40743

PMID:36409468

PMCID:9801267

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved.This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.

Baidu
map