@文章{信息:doi/10.2196/38756，作者="Kolluri, Nikhil and Liu, Yunong and Murthy, Dhiraj"，标题="COVID-19错误信息检测:机器学习解决方案的信息大流行"，期刊="JMIR信息流行病学"，年="2022"，月=" 8月"，日="25"，卷="2"，数="2"，页数="e38756"，关键词="COVID-19;错误信息;机器学习;漏洞百出;infodemiology;infodemic管理;模型的性能;模型的准确性;背景:与COVID-19相关的错误信息的数量早已超过了事实核查员有效减轻其不良影响的可用资源。自动化和基于网络的方法可以有效地遏制网上的错误信息。 Machine learning--based methods have achieved robust performance on text classification tasks, including potentially low-quality-news credibility assessment. Despite the progress of initial, rapid interventions, the enormity of COVID-19--related misinformation continues to overwhelm fact checkers. Therefore, improvement in automated and machine-learned methods for an infodemic response is urgently needed. Objective: The aim of this study was to achieve improvement in automated and machine-learned methods for an infodemic response. Methods: We evaluated three strategies for training a machine-learning model to determine the highest model performance: (1) COVID-19--related fact-checked data only, (2) general fact-checked data only, and (3) combined COVID-19 and general fact-checked data. We created two COVID-19--related misinformation data sets from fact-checked ``false'' content combined with programmatically retrieved ``true'' content. The first set contained {\textasciitilde}7000 entries from July to August 2020, and the second contained {\textasciitilde}31,000 entries from January 2020 to June 2022. We crowdsourced 31,441 votes to human label the first data set. Results: The models achieved an accuracy of 96.55{\%} and 94.56{\%} on the first and second external validation data set, respectively. Our best-performing model was developed using COVID-19--specific content. We were able to successfully develop combined models that outperformed human votes of misinformation. Specifically, when we blended our model predictions with human votes, the highest accuracy we achieved on the first external validation data set was 99.1{\%}. When we considered outputs where the machine-learning model agreed with human votes, we achieved accuracies up to 98.59{\%} on the first validation data set. This outperformed human votes alone with an accuracy of only 73{\%}. Conclusions: External validation accuracies of 96.55{\%} and 94.56{\%} are evidence that machine learning can produce superior results for the difficult task of classifying the veracity of COVID-19 content. Pretrained language models performed best when fine-tuned on a topic-specific data set, while other models achieved their best accuracy when fine-tuned on a combination of topic-specific and general-topic data sets. Crucially, our study found that blended models, trained/fine-tuned on general-topic content with crowdsourced data, improved our models' accuracies up to 99.7{\%}. The successful use of crowdsourced data can increase the accuracy of models in situations when expert-labeled data are scarce. The 98.59{\%} accuracy on a ``high-confidence'' subsection comprised of machine-learned and human labels suggests that crowdsourced votes can optimize machine-learned labels to improve accuracy above human-only levels. These results support the utility of supervised machine learning to deter and combat future health-related disinformation. ", issn="2564-1891", doi="10.2196/38756", url="https://infodemiology.www.mybigtv.com/2022/2/e38756", url="https://doi.org/10.2196/38756" }