Criticism of ratings systems
There is some public critique regarding accuracy and potential bias within Nielsen's rating system, including some concerns that the Nielsen ratings system is rapidly becoming outdated due to new technology such as smartphones, DVRs, tablet computers and Internet streaming services as preferred or alternative methods for television viewing. In June 2006, however, Nielsen announced a plan to revamp its entire methodology to include all types of media viewing in its sample. Since viewers are aware of being part of the Nielsen sample, it can lead to response bias in recording and viewing habits. Audience counts gathered by the self-reporting diary methodology are sometimes higher than those gathered by the electronic meters, eliminating any response bias.
Another criticism of the measuring system itself is that it is not random. A small fraction of the population is selected, and only those accepted are used as the sample size. In many local areas during the 1990s, the difference between a rating that kept a show on the air and one that would cancel it was so small as to be statistically insignificant. Yet, the show with the higher rating would survive. In addition, the Nielsen ratings encouraged a strong push for demographic measurements. This caused problems with households with multiple television sets or households where viewers would enter the simpler codes (usually their child's), raising questions about the demographic data quality. The situation further deteriorated as the popularity of cable television increased the number of viewable networks to the extent that the margin of error has increased because the sampling sizes are too small. Compounding matters is that of the sample data that is collected, advertisers will not pay for time shifted programs (those that are recorded for replay at a different time), rendering the "raw" numbers useless from a statistical point of view. In 2013, it was noted that Internet streams of television programs were still not counted because they had either no ads (such as Netflix) or totally different advertising (such as Hulu) than their television counterparts, effectively skewing the raw data on a show's popularity.
A related criticism of the Nielsen rating system is its lack of a system for measuring television audiences outside homes, such as college dormitories, transport terminals, bars, prisons and other public places where television is frequently viewed, often by large numbers of people in a common setting. In 2005, Nielsen announced plans to incorporate viewing by away-from-home college students into its sample. Internet television viewing is another rapidly growing market for which Nielsen ratings fail to account for viewers. iTunes, Hulu, YouTube, and some of the networks' own websites (such as ABC.com and CBS.com) provide full-length web-based programming, either subscription-based or ad-supported. Though websites can already track a site's popularity and the referring page, they cannot track viewer demographics. To both track this and expand their market research offerings, Nielsen purchased NetRatings in 2007. However, as noted in a February 2012 New York Times article, the computer and mobile streams of a program are counted separately from the standard television broadcasts, further degrading the overall quality of the sampling data. As a result, there was no way for NBC to tell if there was any overlap between the roughly 111.3 million traditional television viewers and 2.1 million live stream viewers of Super Bowl XLVII.
Responding to the criticism regarding accusations by several media executives (including Viacom CEO Phillippe Dauman and former Fox Entertainment Group chief operating officer Chase Carey) that it failed to count viewers watching television programs on digital platforms, Nielsen executive vice president of global product leadership Megan Clarken stated in an April 2015 summit by the Coalition for Innovative Media Measurement that the company can count digital viewers in audience and demographic reports but is unable to do so under the current set of rules devised by networks and advertising industries last revised in 2006. As such, Nielsen can only count viewership for television-originated broadcasts, and must exclude viewers who watch programs on digital platforms if the program does not have an identical advertising load or a linear watermark.
After Nielsen took over the contract for producing data on Irish advertising in 2009, agencies said that they were "disastrous" and claimed that the information produced by them is too inaccurate to be trusted by them or their clients.
In 2004, News Corporation retained the services of public relations firm Glover Park to launch a campaign aimed at delaying Nielsen's plan to replace its aging household electronic data collection methodology in larger local markets with its newer electronic People Meter system. The advocates in the public relations campaign claimed that data derived from the newer People Meter system represented a bias toward underreporting minority viewing, leading to a de facto discrimination in employment against minority actors and writers. However, Nielsen countered the campaign by revealing its sample composition counts. According to Nielsen Media Research's sample composition counts, as of November 2004, nationwide, African American households using People Meters represented 6.7% of the Nielsen sample, compared to 6.0% in the general population. Latino households represent 5.7% of the Nielsen sample, compared to 5.0% in the general population. By October 2006, News Corporation and Nielsen settled, with Nielsen agreeing to spend an additional $50 million to ensure that minority viewing was not being underreported by the new electronic people meter system.
Read the full text
In 2011, CBS and Nielsen proposed a model consisting of six viewer segments, which according to their empirical research, are more relevant for advertisers than older models based on gender and age. The segments are based on user behavior, motivations, and psychographics. It is argued that the model can increase reaching the desired audience and message recall and advertisement likeability.
