How polling samples, margins and weighting work

The short answer

How polling samples, margins and weighting work

Read who was sampled, how respondents were reached, field dates, sample size, question wording and weighting. The reported margin is only one component of uncertainty.

This guide helps verify public political material. It does not infer a person’s motive from one post and does not treat disagreement as proof of deception.

The useful question is not only “what is the rule?” but also “who administers it, which document controls it, and when might it change?” That distinction prevents an accurate general explanation from becoming wrong advice in a particular election, chamber or policy setting.

Evidence review

What a political poll actually measures

A political opinion poll is a survey of a sample of people designed to estimate the views of a larger population, usually all enrolled voters or all Australian adults. The key insight is that a poll measures the opinions of the people who were actually surveyed, not the entire population directly. The poll result is an estimate, and like any estimate, it comes with uncertainty. The size of that uncertainty depends on how the sample was selected, how many people were surveyed, and how the results were adjusted to match the known characteristics of the population.

The sample is the group of people who actually respond to the poll. In modern political polling, samples are typically drawn from online panels, random digit dialling of telephone numbers, or a combination of both. The method by which people are contacted matters because different methods reach different kinds of people. A telephone poll using landline numbers will underrepresent younger people who primarily use mobile phones. An online panel may overrepresent people who are comfortable with technology and have the time to participate in surveys. No sampling method is perfect, and understanding the method is the first step in assessing how much weight to give a particular poll result.

Evidence review

Sample size and the margin of error

The margin of error is the most commonly reported measure of a poll uncertainty, but it is also one of the most misunderstood. The margin of error describes the range within which the true population value would fall in a certain percentage of samples, typically 95 per cent, assuming the poll used a genuinely random sample. For a simple random sample of about 1,000 people, the margin of error is approximately plus or minus three percentage points. This means that if 52 per cent of respondents say they support a particular party, the true level of support in the population is likely to be somewhere between 49 and 55 per cent.

The margin of error only accounts for one type of error: sampling error, which arises because only a subset of the population was surveyed rather than the whole population. It does not account for non-sampling errors such as people refusing to participate, people giving inaccurate answers, question wording effects, or errors in the weighting process. These non-sampling errors can be larger than the sampling error and can systematically bias poll results in one direction. A poll with a stated margin of error of three per cent may have a true uncertainty that is considerably larger once all sources of error are taken into account.

Evidence review

How weighting adjusts the raw data

After a poll is conducted, the raw results are almost never representative of the population in their unadjusted form. Some demographic groups are consistently harder to reach or less willing to participate in surveys. Younger people, people from non-English speaking backgrounds, and people with lower levels of education are often underrepresented in poll samples. To correct for this, pollsters apply weighting, a statistical technique that gives more weight to the responses of underrepresented groups and less weight to overrepresented groups so that the weighted sample matches the known demographic profile of the population.

Weighting typically adjusts for characteristics such as age, gender, geographic location, education level and sometimes past voting behaviour. The Australian Bureau of Statistics provides the census data that pollsters use as the benchmark for the population profile. Weighting is a necessary and legitimate statistical technique, but it relies on assumptions about how different demographic groups will vote. If the people within an underrepresented group who do respond to polls are not typical of that group as a whole, weighting will not fully correct the bias. The choice of which variables to weight by and how to implement the weighting can also affect the results, and different pollsters make different methodological choices.

Evidence review

Question wording and order effects

The way a question is worded can significantly affect the answers people give. A question that asks whether you approve or disapprove of the Prime Minister performance will produce different results from a question that asks you to rate the Prime Minister on a scale. The order in which questions are asked can also influence responses. Asking about party identification before asking about voting intention can prime respondents to answer the voting intention question in a party-consistent way. Polling organisations use standardised question wording and question order so that results can be compared over time, but these methodological details should be disclosed in the poll report.

The context in which a question is asked also matters. A poll conducted immediately after a major political event may capture a short-term reaction that fades within days. A poll conducted during a period of heightened media attention on a particular issue may reflect that momentary focus rather than settled public opinion. The field dates, which are the dates on which the poll was conducted, are therefore crucial information for interpreting the results. A poll with a long field period may average across a period in which public opinion was shifting, making the result less precise as a snapshot of any single point in time.

Evidence review

Beyond the headline: reading the full poll report

Responsible poll reporting includes more than the headline voting intention numbers. A proper poll report should disclose the polling organisation, the client who commissioned the poll, the dates the poll was in the field, the sample size, the sampling method, the mode of data collection, the question wording, the weighting variables used, and the margin of error. Without this information, it is impossible to assess the reliability of the poll. Media reports of polls often omit these methodological details in favour of the headline numbers, which is why readers should seek out the original poll report or the polling organisation technical notes.

Even with full methodological disclosure, no single poll should be treated as definitive. Polls are snapshots, not predictions, and they are subject to multiple sources of error that can cause different polls conducted at the same time to produce different results. Looking at the trend across multiple polls from different organisations over time provides a more reliable picture of public opinion than any single poll. Polling averages, such as those compiled by academic and media organisations, smooth out the random variation between individual polls. The Australian Electoral Commission maintains a Stop and Consider campaign that encourages voters to think critically about the political information they encounter, including opinion polls.

Evidence review

Why a poll is not an election prediction

It is tempting to treat opinion polls as forecasts of election results, but polls and elections are fundamentally different. A poll asks a sample of people how they would vote if an election were held today, whereas an election records how people actually do vote on a specific day after a campaign during which they have been exposed to policy announcements, debates and political advertising. The time between a poll and the next election can be months or years, during which voter preferences can change substantially. Polls taken well before an election have limited predictive value for the eventual result.

There are also systematic differences between what people tell pollsters and what they do in the polling booth. Some people decline to state a preference, either genuinely because they are undecided or because they do not wish to disclose their voting intention. How pollsters handle these undecided voters when reporting results varies between organisations and can significantly affect the reported party shares. Late swings in voting intention, strategic voting and the effect of preferential voting on the final result add further layers of complexity that a simple opinion poll cannot capture. For these reasons, polls should be treated as indicators of the political environment at a point in time, not as predictions of what will happen on election day.

Common questions

Before you rely on the answer