Morning Jay: How to Read the Polls
6:00 AM, Aug 24, 2012 • By JAY COST
In every presidential cycle, there is a debate about partisan identification in polling. Conservatives complain about too few Republicans being sampled; pollsters, journalists, and liberals respond by saying it is inappropriate to weigh polls by party identification.
What to make of all this?
The primary issue relates to the population that polls are sampling. There are several populations to choose from, and we can conceive of this as a series of concentric circles.
The idea here is that each circle represents a different population that can be sampled – but with a twist. The adult population includes all other sub-populations, the registered voter population is smaller than the adult population but includes likely and actual voters, and so on. And of course we cannot poll the actual voters until after they have voted!
Each population is worth polling, albeit for different questions. For instance, if you want a gauge of “consumer confidence,” you naturally sample the adult population. If you want a measure of how voters think about the state of the economy, a poll of adults would not be your best bet.
The reason that polls become a partisan football is that the further out on the circles you move, the more Democratic the poll usually gets. Likely voter polls usually have fewer Democrats than registered voter polls, which have fewer Democrats than adult polls.
Thus, the conservative case against “oversampling” Democrats is not that a pollster has included more Democrats than he should have in his sample, but that the population he is sampling has more Democrats than will come out to vote on Election Day.
This is how pollsters can be honest brokers, employing best practices, and still produce polls that overestimate the Democratic standing.
So what is the solution? At first blush one might conclude that the best approach is just to move inward through the circles – from registered voters to likely voters. Yet this approach does not necessarily produce a clearer picture of the ultimate electorate. We are still quite far from Election Day and a large portion of the voting public has yet to engage, meaning that those polls could still be more Democratic than the actual electorate (or even more Republican)
Absent some panacea, we have to approach the polls with prudence. Above all, we have to remember that the population we care most about – the actual voters – cannot be polled. So, all polls must be examined with caution.
We also have to keep history in mind. Over the last quarter century, party identification on Election Day has actually been quite stable in presidential elections.
On average, Democrats have enjoyed a 3-point advantage going back to 1984; in most elections, the edge falls between D+1 and D+5. Some argue that there is a recent trend that favors the Democrats, as 2008 saw the highest Democratic advantage since 1980. On the other hand, 2004 saw the best Republican year in generations.
A lot of the movement in party identification from cycle to cycle is not the two sides “turning out their bases,” as is commonly assumed. Instead, it has to do with how the marginal partisans on both sides are reacting to the national political climate. Remember: Something like 35 percent of the population calls itself “independent,” but only about 10 percent has no party affiliation whatsoever. That means there are a lot of "hidden" partisans who can "emerge" in good years for their sides. For instance, in a good year for the GOP, regular Republican voters who often think of themselves as independent will call themselves Republicans, and so the percentage of Republicans in the electorate will rise. In a bad year for the GOP, they’ll call themselves independents and the percentage of Republicans will fall. Same goes for the Democrats.