<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div class="" style="text-align: center;"><span class="" style="font-size: 14px;"><b class="">Call for participation: TREC Health Misinformation Track 2020</b></span></div>
<div class="" style="text-align: center;"><span class="" style="font-size: 14px;"><b class=""><br class="">
</b></span></div>
<div class="" style="text-align: center;"><span class="" style="font-size: 14px;"><b class=""><a href="https://trec-health-misinfo.github.io/" class="">https://trec-health-misinfo.github.io</a></b></span></div>
<div class=""><br class="">
</div>
<div class="">This year, we have focused the track specifically on misinformation related to COVID-19 and SARS-CoV-2, adopting a news corpus from January to April, 2020 as the basis for our test collection. As our understanding of the disease evolved over this
period some facts became better known. For example, at one point, it was suggested that Ibuprofen might worsen COVID-19. A retrieval effort undertaken today should avoid returning these articles, or else label them as potentially misleading.</div>
<div class=""><br class="">
</div>
<div class="">To participate in the track, you need to register by May 31 2020 at the following link:</div>
<div class=""><br class="">
</div>
<div class=""><a href="https://trec.nist.gov/pubs/call2020.html" class="">https://trec.nist.gov/pubs/call2020.html</a></div>
<div class=""><br class="">
</div>
<div class="">AIMS AND SCOPE</div>
<div class="">--------------------------</div>
<div class="">Misinformation represents a key problem when using search engines to guide any decision-making task: Are users able to discern authoritative from unreliable information and correct from incorrect information? This problem is further exacerbated
when the search occurs within uncontrolled data collections, such as the web, where information can be unreliable, misleading, highly technical, and can lead to unfounded escalations. Information from search-engine results can significantly influence decisions,
and research shows that increasing the amount of incorrect information about a topic presented in a Search Engine Result Page (SERP) can impel users to make incorrect decisions.</div>
<div class=""><br class="">
</div>
<div class="">In this context, the TREC 2020 Misinformation track fosters research on retrieval methods that promote reliable and correct information over misinformation. The track offers the following tasks:</div>
<div class=""><br class="">
</div>
<div class="">* Total Recall Task: The goal is to identify all the documents conveying incorrect information for a specific set of topics;</div>
<div class="">* Ad-hoc Retrieval Task: The goal is to design a ranking model that promotes credible and correct information over incorrect information;</div>
<div class="">* Evaluation Meta Task: The goal is to develop new evaluation methods that reflect the credibility and correctness of documents, as well as traditional relevance.</div>
<div class=""><br class="">
</div>
<div class="">GUIDELINES</div>
<div class="">------------------</div>
<div class="">* Corpus: CommonCrawl News crawl from January, 1st 2020 to April 30th, 2020 (<a href="https://commoncrawl.org/2016/10/news-dataset-available/" class="">https://commoncrawl.org/2016/10/news-dataset-available/</a>);</div>
<div class="">* Topics: on COVID-19 within the consumer health search domain (people seeking health advice online);</div>
<div class="">* Runs: runs may be either automatic or manual with the the standard TREC run format.</div>
<div class=""><br class="">
</div>
<div class="">Detailed guidelines on: <a href="https://trec-health-misinfo.github.io/" class="">https://trec-health-misinfo.github.io</a></div>
<div class=""><br class="">
</div>
<div class="">IMPORTANT DATES</div>
<div class="">-----------------------------</div>
<div class="">* Registration closes: May 31, 2020</div>
<div class="">* Runs due from participants: August 2020</div>
<div class="">* Evaluation results returned: October 2020</div>
<div class="">* Notebook paper due: October 2020</div>
<div class="">* TREC 2020 Conference: November 18-20, 2020</div>
<div class="">* Final paper due: February 2021</div>
<div class=""><br class="">
</div>
<div class="">ORGANIZERS</div>
<div class="">--------------------</div>
<div class="">* Charles Clarke, University of Waterloo</div>
<div class="">* Maria Maistro, University of Copenhagen</div>
<div class="">* Mark Smucker, University of Waterloo</div>
<div class="">* Guido Zuccon, University of Queensland</div>
<div class=""><br class="">
</div>
<div class="">CONTACT</div>
<div class="">--------------------</div>
<div class="">For more information or to ask questions, join the google group: <a href="https://groups.google.com/forum/#!forum/trec-decision-track" class="">https://groups.google.com/forum/#!forum/trec-decision-track</a></div>
<br class="">
</body>
</html>