504 views
Clean Politics > Published by Alex Hern, January 27th 2012 at 12:29 pm

Salmond’s Scottish referendum is a textbook example of a leading question

Print Friendly

 

On Wednesday afternoon, Alex Salmond announced that the question the SNP would put to the Scottish people on 24 June 2014, the 700th anniversary of the battle of Bannockburn, would be:

Do you agree that Scotland should be an independent country?

As many picked up on, this question is may be “simple, straightforward and clear”, but it’s not quite as fair as Salmond suggests it is. By phrasing the question as “do you agree…” rather than the more neutral options of “do you agree or disagree…” or simply using “should”, there is likely to be a small but significant increase in the amount of people voting yes.

Referendum-questions-workbookTime and time again, textbooks on survey construction warn against phrasing questions the way the SNP have, because it will lead to biased responses.

The CDC lists leading questions in its catalog of survey biases (pdf):

Different wording of the same question can guide or direct respondents toward a different answer… The preferred phrasing is, “Do you agree or disagree that . . . ?”

Taylor-Powell (1996) writes:

Biased questions influence people to respond in a way that does not accurately reflect their positions. A question can be biased in several ways:

(1) when it implies that the respondent should be engaged in a particular behaviour;

(2) when the response categories are unequal or loaded in one direction;

(3) when words with strong positive or negative emotional appeal are used, such as “freedom,” “equality,” “boss,” “bureaucratic,” etc.

Here are some examples of biased questions:…

3. Do you agree that funding for Extension in your county should be increased?…

This is a leading question. A better question would state:

Do you agree or disagree that Extension funding should be increased?

And Janes (1999) warns questioners against leading questions, saying:

Let them tell you what they think.

Salmond is not the first referendum writer to phrase his question thus, however.

The wonderfully obfuscated question asked of Quebec in 1995 read:

Do you agree that Quebec should become sovereign after having made a formal offer to Canada for a new economic and political partnership within the scope of the bill respecting the future of Quebec and of the agreement signed on June 12, 1995?

While the question which decided Malta’s accession to the EU was:

Do you agree that Malta should become a member of the European Union in the enlargement that is to take place on 1 May 2004?

What else do these referendum questions have in common? They were all written by the group campaigning for a yes vote. The question may still be simple, straightforward and clear, but it’s looking less and less likely that it’s fair.

See also:

• Progressives need a positive vision for Scotland - Ed Jacobs, January 26th 2012

• Hughes makes the case for an English Parliament as Salmond faces fresh scrutiny - Ed Jacobs, January 23rd 2012

• Win or lose, Scottish independence referendum heralds a revolution in UK politics - Ed Jacobs, January 16th 2012

• SNP: Cam’s “economic uncertainty” argument is nonsense; we’ll stick to our timetable - Humza Yousaf MSP, January 9th 2012

• Referendum on Scottish independence? Time to ‘bring it on’ - Ed Jacobs, June 5th 2011

  • http://twitter.com/politicalplanet/status/162881695522103296 Political Planet

    Salmond’s Scottish referendum is a textbook example of a leading question: Alex Hern explains why the phrasing o… http://t.co/AGlXRF3A

  • http://twitter.com/patronpress/status/162882077677731840 Patron Press – #P2

    #UK : Salmond’s Scottish referendum is a textbook example of a leading question http://t.co/ZKla0cMu

  • http://twitter.com/pulpark/status/162882566158950400 Pulp Ark

    Salmond’s Scottish referendum is a textbook… http://t.co/2xeeGzzD #Clean_Politics #fair_election #fair_referendum #muslim #tcot #sioa

  • http://twitter.com/leftlinks/status/162886737880825856 leftlinks

    Left Foot Forward – Salmond’s Scottish referendum is a textbook example of a leading question http://t.co/0KxP9ZdK

  • http://twitter.com/strathearnrose/status/162888357280612352 Roseanna Cunningham

    MT @leftfootfwd: Salmond’s Scottish referendum a textbook example of leading q: http://t.co/E25T7XHC <good alternative by @CalMerc :-p >

  • http://twitter.com/catevallis/status/162894761085251584 Cate Vallis

    Salmond’s Scottish referendum is a textbook example of a leading question, writes @AlexHern: http://t.co/YLXNpv7r

  • http://politicalscrapbook.net/2012/01/independence-referendum-snp-question-do-you-agree-alex-salmond-gcse-higher-statistics/ Even children are taught Salmond “Do you agree” question is biased | Political Scrapbook

    [...] agree that Scotland should be an independent country?”Technical literature on survey design is clear that questions phrased in this way result in a “small but significant increase in the amount [...]

  • Charles Addison

    “Salmond is not the first referendum writer to phrase his question thus”

    The Devolution Referendum (set by Westminster) asked two questions:

    ”Do you agree that there should be a Scottish Parliament?” Yes/No.

    ”Do you agree that a Scottish Parliament should have tax raising powers?” Yes/No

    But suddenly, this is no longer acceptable as a model! Why didn’t you say earlier…

    There is a consultation (well, two consultations) going on so plenty of time to thrash this out. Submit your suggested wording.

  • http://twitter.com/dhothersall/status/162915933571137536 Duncan Hothersall

    "Salmond’s Scottish referendum is a textbook example of a leading question" http://t.co/q0Icg5XQ #indyref

  • http://twitter.com/georgeeaton/status/162915984498364417 George Eaton

    Great stuff from @leftfootfwd and @PSbook on Salmond's loaded referendum question http://t.co/5OjpcQun and http://t.co/Jy0inWYz

  • http://www.facebook.com/angelussullivan Stephen Sullivan

    “…Alex Salmond announced that the question the SNP would put to the Scottish people on 24 June 2014, the 700th anniversary of the battle of Bannockburn…”

    This statement is categorically false. More lies perpetuated by unionists.

    Alex Salmond announced the referendum will be held in Autumn 2014. Last time I checked June is in the summer not autumn. Blatant disregard for the facts here. Shameful.

  • http://twitter.com/beccamebabe/status/162928399445266432 Rebbecca Robertson

    "@georgeeaton:Great stuff from @leftfootfwd & @PSbook on Salmond's loaded referendum question http://t.co/RGWfJa1b and http://t.co/zo2yBNri&quot;

  • Anonymous

    Instead of petty whining about the wording, why don’t you advance a positive reason for Scotland to stay in the Union? Or is it because you _don’t_ have a positive reason for the Union that you are reduced to bickering about the wording? I mean it’s not exactly obfuscated, is it?

  • http://twitter.com/martinhinds/status/162983020842848257 Martin Hinds

    http://t.co/EC2xG6GV Interesting. I wonder if any Nats could find any reason not to make a small, reasonable and fair change to the Q.

  • http://www.leftfootforward.org/2012/01/look-left-27-01-12/ Look Left – The hate-filled Right hone in on their next target: Disabled people | Left Foot Forward

    [...] Left Foot Forward reported today: “The question may be “simple, straightforward and clear”, but it’s not quite as fair [...]

  • Anonymous

    “Do you agree or disagree that Scotland should be an independent country?”

    If that question were put instead of the one suggested by the Scottish Government, would a Yes vote mean that one agreed or disagreed? Voters would arguably be unsure. An unclear question would give an unclear answer, which would be disputed.

    Incidentally, even at this early stage the most recent opinion polling is showing Scottish support for independence to be moving up to the danger zone in which a majority becomes possible, while it is apparent that English opinion is against further substantial powers for the Scottish Parliament within the UK and would rather that Scotland left.

    The anglo-union would appear to be done for, which is the conclusion which other countries are beginning to come to.

  • http://www.facebook.com/profile.php?id=100001102865655 John Ruddy

    Thats why the Electoral Commission should decide on the question. They are the experts in looking at questions for reasons of ease of understanding, impartiality etc.

    Interesting YouGov poll in todays Daily Record – the SG’s preferred wording gives independence a 10% advantage.

  • http://twitter.com/amlmaciver/status/163239607721410560 Alastair MacIver

    "Salmond’s Scottish referendum is a textbook example of a leading question" http://t.co/q0Icg5XQ #indyref

  • http://twitter.com/Newsbot9 Newsbot9

    I’m sure you’re just fine with secret funding in referendums as well.

    Because, after all, it doesn’t make a mockery of democracy or anything, no. Or rather, your hatred of democracy is showing.

  • http://twitter.com/Newsbot9 Newsbot9

    So two rights make a wrong? Keep up the attack on democracy!

  • http://www.leftfootforward.org/2012/01/ed-miliband-to-outline-vision-of-a-fairer-union-scottish-independence-referendum-debate/ Miliband to outline vision of a fairer Union | Left Foot Forward

    [...] After Alex Hern wrote on Left Foot Forward on Friday of Alex Salmond’s proposed referendum question being a “textbook [...]

  • http://www.leftfootforward.org/2012/02/swinney-on-scotland-currency-%e2%80%93-more-questions-than-he-answers/ Swinney on Scotland currency – more questions than he answers? | Left Foot Forward

    [...] Salmond’s Scottish referendum is a textbook example of a leading question – Alex Hern, January 27th [...]

  • Anonymous

    The Meaning of Meaning and the Question Question:

    http://tinyurl.com/89d5sfu