{"id":13677,"date":"2019-12-16T16:25:33","date_gmt":"2019-12-17T00:25:33","guid":{"rendered":"https:\/\/educatorinnovator.org\/?p=13677"},"modified":"2019-12-16T16:25:33","modified_gmt":"2019-12-17T00:25:33","slug":"rating-news-sources-can-help-limit-the-spread-of-misinformation","status":"publish","type":"post","link":"https:\/\/educatorinnovator.org\/rating-news-sources-can-help-limit-the-spread-of-misinformation\/","title":{"rendered":"Rating News Sources Can Help Limit the Spread of Misinformation"},"content":{"rendered":"

Online misinformation has significant real-life consequences, such as measles outbreaks<\/a> and encouraging racist mass murderers<\/a>. Online misinformation can have political consequences as well.<\/p>\n

The problem of disinformation and propaganda misleading social media users was serious in 2016, continued unabated in 2018 and is expected to be even more severe in the coming 2020 election cycle<\/a> in the U.S.<\/p>\n

Most people think they can detect deception<\/a> efforts online, but in our recent research, fewer than 20% of participants<\/a> were actually able to correctly identify intentionally misleading content. The rest did no better than they would have if they flipped a coin to decide what was real and what wasn\u2019t.<\/p>\n

\"\"<\/p>\n

A sample headline with a rating from experts, as shown in our experiment. Kim et al., CC BY-ND<\/a><\/p>\n

\"\"<\/p>\n

Chart: The Conversation, CC-BY-ND Source: Moravec et al., 2018<\/a>. Get the data<\/a><\/p>\n

Both psychological<\/a> and neurological<\/a> evidence shows that people are more likely to believe and pay attention to information that aligns with their political views \u2013 regardless of whether it\u2019s true. They distrust and ignore posts that don\u2019t line up with what they already think.<\/p>\n

As information systems researchers, we wanted to find ways to help people discern true and false information \u2013 whether it confirmed what they previously thought or not, and even when it came from unknown sources. Fact-checking individual articles is a good start, but it can take days to do, so it usually isn\u2019t fast enough to keep up with how quickly news travels<\/a>.<\/p>\n

We set out to discover the most effective way to present a source\u2019s accuracy level to the public \u2013 that is, the way that would have the greatest effect on reducing the belief in, and spread of, disinformation.<\/p>\n

Expert or user ratings?<\/h4>\n

One alternative is a source rating<\/a> based on past articles that gets attached to every new article as it is published, much like Amazon or eBay seller ratings.<\/p>\n

The most useful ratings are those a person can use at the most relevant time \u2013 finding out about previous buyers\u2019 experiences with a seller when considering making an online purchase, for instance.<\/p>\n

When it comes to facts, though, there\u2019s another wrinkle. E-commerce ratings are typically done by regular users, people with firsthand knowledge from using the item or service.<\/p>\n

Fact-checking, on the other hand, has traditionally been done by experts like PolitiFact<\/a> because few people have the firsthand knowledge to rate news. By comparing user-generated ratings and expert-generated ratings, we\u2019ve found that different rating mechanisms influence users in different ways<\/a>.<\/p>\n

We conducted two online experiments, with a total of 889 participants. Each person was shown a group of headlines, some labeled with accuracy ratings from experts, others labeled with ratings from other users and the remainder with no accuracy ratings at all.<\/p>\n

We asked participants the extent to which they believed each headline and whether they would read the article, like it, comment or share it.<\/p>\n

\"\"<\/a><\/figure>\n
\"\"<\/a><\/p>\n

A sample headline with a rating from other users, as shown in our experiment.Kim et al., CC BY-ND<\/a><\/p>\n<\/figure>\n

Expert ratings of news sources had stronger effects on belief than ratings from nonexpert users, and the effects were even stronger when the rating was low, suggesting the source was likely to be inaccurate. These low-rated inaccurate sources are the usual culprits in spreading disinformation, so our finding suggests that expert ratings are even more powerful when users need them most.<\/p>\n

Respondents\u2019 belief in a headline influenced the extent to which they would engage with it: The more they believed an article was true the more likely they were to read, like, comment on or share the article.<\/p>\n

Those findings tell us that helping users mistrust inaccurate material at the moment they encounter it can help curb the spread of disinformation.<\/p>\n

Spillover effects<\/h4>\n

We also found that applying source ratings to some headlines made our respondents more skeptical<\/a> of other headlines without ratings.<\/p>\n

\"\"<\/a><\/p>\n

Facebook tried labeling headlines that were of dubious accuracy, but it didn\u2019t help curb the spread of disinformation. Kim et al.<\/p>\n<\/figure>\n

This finding surprised us because other methods of warning readers \u2013 such as attaching notices only to questionable headlines \u2013 have been found to cause users to be less skeptical of unlabeled headlines<\/a>. This difference is especially noteworthy since Facebook\u2019s warning flag had little influence on the users and was eventually scrapped<\/a>. Perhaps, source ratings can deliver what Facebook\u2019s flag couldn\u2019t.<\/p>\n

\"\"<\/a><\/p>\n

A NewsGuard rating warns Facebook users that the source may not be accurate or reliable. Screenshot by Antino Kim<\/p>\n<\/figure>\n

What we learned indicates that expert ratings provided by companies like NewsGuard<\/a> are likely more effective at reducing the spread of propaganda and disinformation than having users rate the reliability and accuracy<\/a> of news sources themselves. That makes sense, considering that, as we put it on Buzzfeed, \u201ccrowdsourcing \u2018news\u2019 was what got us into this mess in the first place<\/a>.\u201d<\/p>\n

\n

\"The
\nAuthors<\/strong><\/p>\n

Antino Kim<\/a>, Assistant Professor of Operations and Decision Technologies, Indiana University<\/a><\/em>; Alan R. Dennis<\/a>, Professor of Internet Systems, Indiana University<\/a><\/em>; Patricia L. Moravec<\/a>, Assistant Professor of Information, Risk and Operations Management, University of Texas at Austin<\/a><\/em>, and Randall K. Minas<\/a>, Associate Professor of Information Technology Management, University of Hawaii<\/a><\/em><\/p>\n

Feature Image\/ Pixel Embargo\/Shutterstock.com<\/a><\/p>\n

This article is republished from The Conversation<\/a> under a Creative Commons license. Read the original article<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Study shows that expert ratings of news sources had stronger effects on belief than ratings from non-expert users.<\/p>\n","protected":false},"author":34,"featured_media":13679,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[8],"tags":[],"acf":[],"_links":{"self":[{"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/posts\/13677"}],"collection":[{"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/users\/34"}],"replies":[{"embeddable":true,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/comments?post=13677"}],"version-history":[{"count":1,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/posts\/13677\/revisions"}],"predecessor-version":[{"id":13678,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/posts\/13677\/revisions\/13678"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/media\/13679"}],"wp:attachment":[{"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/media?parent=13677"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/categories?post=13677"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educatorinnovator.org\/wp-json\/wp\/v2\/tags?post=13677"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}