“We generate overall news source scores based on scores of individual articles (in the case of online news sources) or episodes (in the cases of podcasts, radio, TV, and video-based sources). Our current team of over 60 analysts, who are trained in our content analysis methodology, perform the ratings. Our analysts go through an initial 30 hours of training plus an additional 40 hours of ongoing training per year. Our analysts include academics, journalists, librarians, lawyers, military veterans, civil service professionals, and other professions that require high levels of rhetorical and analytical skills. Each individual article and episode is rated by a pod of at least three human analysts at the same time. Each pod is politically balanced, meaning it contains one person who self-identifies as being right-leaning, one as center, and one as left-leaning. Articles and episodes are rated in three-person live panels conducted in shifts over Zoom. Analysts first read each article and rate them on their own, then immediately compare scores. If there are discrepancies in the scores, they discuss and adjust scores if necessary. The three analysts’ ratings are averaged to produce the overall article rating. Sometimes articles are rated by larger panels of analysts for various reasons–for example, if there are outlier scores, the article may be rated by more than three analysts.
Sorry, comments are closed for this post.