Randomising answer order

Learn how to randomise answer orders to reduce order bias in your survey

Updated over a week ago

In Attest you have the option to randomise cards (text and questions), groups of cards, and/or answers, to suit the research you’re carrying out.

Randomising answers

Randomised answers are shuffled and shown to each respondent in a different order - to reduce order bias - and is enabled by default.

Unless you’re using a scale (e.g. 1-5 or very likely-very unlikely) you should aim to randomise answer options for single choice, multiple choice and ranked questions. This reduces the impact of respondents selecting the answers nearest the top of the list, as each respondent receives different answers at the top.

The Randomise answer toggle is automatically switched on for all question types, and you'll know answers are randomised by seeing an icon in each answer field. You will need to toggle it off if you are presenting the answer options as a scale - you'll find the toggle to switch this off within Answer Settings.

If you have randomised answers, you can Pin answers to set positions in the answer options using the Pin icon if you want that option to show in the same location for all respondents. This might be the case if you want a negative answer to always be pinned to the bottom of the options. For instance, here:

Randomising subjects

In grid questions, you can randomise the single and multiple choice answers, but you can also choose to randomise the order in which the question subjects are presented to respondents. As standard, Randomise subjects is toggled on, and you will need to un-toggle if you want the subjects to be presented in draft order. Again, you can Pin individual subjects to be presented in a certain place in the grid question if you wish.

Spotting randomisation in results

You can see which questions and answers are randomised in the results of your survey (or any survey shared with you). Randomised answers are displayed within the question Details.

Randomising answer and question order minimises order bias. Be aware that if your research tracks metrics over time, introducing randomisation to questions and answers that haven't previously been randomised may have a small impact on results as data quality will be improved.

If you have any other questions about when and how to use the randomisation features, or how these features affect ongoing trackers, get in touch via the in-platform live chat!

Did this answer your question?