WASHINGTON -- For all the challenges facing pre-election polls -- and there are many -- the average accuracy of statewide surveys last year matched their performance in the last two off-year elections, according to a report released last week by the National Council on Public Polls (NCPP).
First established in 1969, NCPP includes many of the pollsters that conduct surveys for national media organizations. They have released annual reports on poll accuracy since 1997, focusing mostly on national surveys. They have produced reports on statewide poll accuracy since 2002.
NCPP's 2010 report considers 295 surveys conducted in the 20 days leading up to the election in races for Senate and Governor (HuffPost Pollster provided NCPP with poll data used in its analysis). As in past years, NCPP also tabulated accuracy scores for a smaller number of polls (202) conducted by each organization within the final week of the campaign. For each poll, they compared the margin separating the top two candidates in the vote count to the margin forecast by the poll. They divide these scores by two, NCPP explains, in order to allow comparisons between their error "candidate error" statistic and each poll's sampling margin of error.
In 2010, they found an average candidate error in 2010 of 2.4 percentage points for all of the polls examined, slightly more than in the presidential elections of 2008 (2.0%) and 2004 (2.2%), but the same as in 2002 (2.4%), the last off-year election for which NCPP scored polls more than a week before Election Day.
Some pollsters argue that the lower turnouts of off-year elections complicate their efforts to identify "likely voters" and lead to less accuracy. The NCPP data support that theory, particularly when looking at the final poll conducted by each organization. The final poll candidate errors were slightly smaller in 2004 (1.7%) and 2008 (1.8%) than in 2002 (2.3%), 2006 (2.0%), and the final-poll error for last year (2.1%) fell within the range of the last two off-year-elections.
Those average statistics, however, may mask a growing number of polls producing results outside their reported margin of error. This past year, NCPP reports, one in four final week polls (25%) "had results that fell outside the sampling margin of error of that survey." That compares to just 11% in 2006 and 16% in 2002.
NCPP's reports also help demonstrate the continuing trend away from live interviewer polls and toward automated telephone and internet panel surveys. This year, NCPP found that less than half (46%) of the 295 polls they examined were conducted by telephone using live interviewers, while a majority were conducted using an automated telephone methodology (41%), a combination of live and automated telephone methods (2%) or over the internet (9%).
In the Mood for Love review Harvey review Sleuth review The Man Who Shot Liberty Valance review Three Colors: Red review
No comments:
Post a Comment