Randomization

Randomization plays an important role in reducing bias in surveys. Generally, answers to survey questions should be randomized when they are inherently unordered, and the order of questions should be randomized when appropriate.

Questions that include a list of options will include a randomization setting. You can toggle randomization in the settings section of a question.

To randomize the order of questions on a page:

1. Click the options menu icon () that appears when hovering on a page in the navigation panel.
2. Flip the toggle labeled Randomize questions.

Questions will now be randomly ordered for each respondent, and an indicator will be shown next to the page name.

Note: The order of randomized questions is not saved in a respondent’s data record.

Page randomization is managed at the block level. Every question and page in a survey resides within a block. By default, all questions are added to a single block, but you can organize your survey into sections by placing pages in multiple blocks. Learn more about this in the Blocks article.

To randomize pages:

1. Hover over a block in the navigation panel and click the options menu icon ().
2. Flip the toggle labeled Randomize pages.

Once enabled, pages within the block will be presented in random order for each respondent. An indicator will appear next to the block name to show that randomization is active.

Note: The order of randomized pages is not saved in a respondent’s data record.

After your survey contains multiple question blocks, they can be grouped into a Block collection and randomized. To randomize blocks in a collection:

1. Hover over a collection in the navigation panel.
2. Click the options menu icon ().
3. Toggle on the Randomize blocks option.

Alternatively, the toggle is available in the middle editor section when the collection is selected.

Once enabled, blocks within the collection will be presented in random order for each respondent. An indicator will appear next to the collection name to show that randomization is active.

Note: The order of randomized blocks is not saved in a respondent’s data record.