Questionnaire Design & Respondent UX

Questionnaire design and respondent UX cover how questions, layout and interaction shape participant understanding, comfort, completion and response quality.

This category includes terms for question types and wording, response formats, accessibility and multilingual UX, consent phrasing, progress indicators, and strategies to reduce cognitive load and boost inclusive participation.

Acquiescence Bias

Acquiescence bias is the tendency for people to agree with statements or choose affirmative responses regardless of their true views. It commonly appears on agree/disagree scales and can distort survey findings, especially in multilingual or low-literacy settings.

Branching Logic

Branching logic (also called skip logic or conditional logic) shows or hides questions based on earlier answers so each participant only sees questions relevant to them. It creates personalised survey paths without needing multiple separate forms.

Classical Test Theory

Classical Test Theory (CTT) is a simple framework for thinking about measurement in surveys and tests: each observed score is modelled as a combination of a person's true score and random error. It provides practical ways to estimate reliability (how consistent a measure is) and to inspect items that may be performing poorly.

Closed-ended Questions

Closed-ended questions give respondents a fixed set of answer choices (e.g. yes/no, multiple choice, rating scale), making responses quick to answer and easy to compare. They are useful when you need quantifiable, consistent data across respondents and languages.

Cognitive Interviewing

Cognitive interviewing is a qualitative pre-test method that checks how people understand, interpret and answer survey questions. It helps designers find confusing wording, cultural mismatches and translation problems before a survey goes live.

Differential Item Functioning

Differential Item Functioning (DIF) happens when a survey question gives different kinds of respondents — who are otherwise similar on the thing you're measuring — systematically different chances of answering a particular way. In multilingual or multicultural surveys DIF is a common source of misleading group differences.

Double-barreled Question

A double‑barreled question asks about two (or more) things at once, so respondents can’t tell which part they’re answering. This creates ambiguous responses and unreliable data.

Item Response Theory

Item Response Theory (IRT) is a family of statistical models that link a person's unobserved trait (for example satisfaction, ability or attitude) to the probability they give a particular answer to a survey item. IRT describes each question by parameters such as difficulty and discrimination so you can build and compare reliable scales.

Leading Question

A leading question is worded in a way that suggests or encourages a particular answer, steering respondents instead of neutrally measuring their views. Leading questions bias results and reduce the reliability of your survey.

Likert Scale

A Likert scale is a common survey response format that asks people how much they agree or disagree (or how often/important) with a statement, usually on a 3–7 point scale. It’s used to measure attitudes, opinions and perceptions in a simple, comparable way.

Loaded Question

A loaded question is phrased to assume something or to push the respondent toward a particular answer, introducing bias into survey results. It combines facts and opinions or presumes behaviors or beliefs that may not be true for all respondents.

Matrix Questions

A matrix question (also called a grid question) shows a list of items as rows and a shared set of response options as columns so respondents can rate multiple items using the same scale. It saves space and creates consistent responses for similar questions.

Mobile-friendly Surveys

Mobile-friendly surveys are questionnaires designed to work smoothly on phones and tablets, using layouts and interactions that make completing forms easy on small screens. They prioritise fast loading, clear touch targets, short questions and simple navigation so people can respond anywhere.

Multiple Choice Questions

Multiple choice questions present respondents with a fixed list of answer options so they can select one or more answers. They’re one of the most common question types for clear, easy-to-analyse responses.

Nonresponse Bias

Nonresponse bias occurs when the people who don't answer a survey differ in meaningful ways from those who do, so the results no longer represent the whole population. It often arises when certain groups face barriers to responding—like language—so their views are underrepresented.

Open-ended Questions

Open-ended questions are survey prompts that invite participants to reply in their own words rather than choose from predefined answers. They capture free-text responses like explanations, suggestions and stories.

Paradata

Paradata are the metadata about how people interact with a survey—things like time spent on questions, page views, device type and navigation behavior. It records the survey-taking process (not the answers) and helps teams understand response quality and participant experience.

Pilot Testing

Pilot testing is a small-scale trial of a survey conducted before full launch to check question wording, flow, translations and technical behaviour. It helps find and fix problems so the final survey collects reliable, inclusive responses from all language communities.

Piping

Piping inserts answers a respondent already gave into later questions or messages so the survey reads like a conversation. It personalises surveys and reduces repetition by automatically reusing earlier responses.

Primacy Effect

The primacy effect is a cognitive bias where people are more likely to notice, remember, or choose items presented near the start of a list or sequence. In surveys, questions or response options shown earlier can get disproportionate attention or endorsement.

Progress Indicators

Progress indicators show respondents how far they are through a survey or form, using bars, counts or step labels. They set expectations and reduce drop‑out by communicating remaining effort.

Question Order Effects

Question order effects occur when the sequence of questions in a survey changes how respondents understand or answer later items. The order can shape responses through priming, memory, or comparison processes.

Question Wording

Question wording is the exact phrasing used to ask something in a survey or form. Clear, neutral wording helps people understand the question and gives you accurate, comparable answers across languages.

Questionnaire Design

Questionnaire design is the craft of writing and organising survey questions so they are clear, unbiased and easy for respondents to answer. Good design considers wording, order, response options and the participant experience — including language and cultural context.

Randomization

Randomization is the deliberate shuffling of question order, answer options or participant assignment in a survey to reduce bias and test different versions. It helps produce more reliable, fair results by preventing order effects and enabling simple experiments within a single survey.

Rating Scale

A rating scale is a question format that asks respondents to choose a position along a fixed continuum (usually numeric or labeled) to indicate intensity, agreement or satisfaction. It turns opinions into comparable data points for analysis.

Recency Effect

The recency effect is a cognitive bias where people are more likely to remember or choose items they saw most recently — typically the last items in a list or the most recent information presented. In surveys, it can skew responses toward later options or questions.

Respondent Experience

Respondent experience is the end-to-end experience a person has when completing a survey or form — from seeing the invitation to submitting answers in their preferred language. It covers clarity, accessibility, trust and ease of use.

Response Bias

Response bias is any systematic error that makes survey answers differ from respondents' true thoughts or from the target population, often because of how questions, language or the survey process influence who answers or what they say. It can come from wording, translation, mode, social pressure or non‑response.

Response Latency

Response latency is the time it takes for a participant to start or complete answering a question or survey. It’s used to spot confusion, engagement and language-specific friction in surveys.

Response Option Design

Response option design is the way answer choices are written, ordered and presented for a survey question so participants understand them and responses are comparable and meaningful. Good design balances clarity, accessibility and suitability for translation.

Reverse-coded Items

Reverse-coded items are survey questions worded in the opposite direction of the trait being measured so responses must be flipped (re-scored) before analysis. They’re used to reduce response bias but can introduce confusion if not handled carefully.

Scale Anchors

Scale anchors are the words or labels placed at the ends (and sometimes midpoints) of a rating scale that tell respondents what each point means. Clear, consistent anchors help people answer reliably and make results comparable across languages and groups.

Semantic Differential Scale

A semantic differential scale is a rating scale that asks respondents to position their opinion between two opposite adjectives (for example: helpful — unhelpful). It measures attitudes or feelings about a concept by capturing its connotative meaning across several bipolar dimensions.

Skip Logic

Skip logic (also called branching or conditional logic) routes respondents through different questions or sections based on their earlier answers. It keeps surveys shorter and more relevant by only showing each person the questions that apply to them.

Social Desirability Bias

Social desirability bias is the tendency for people to answer questions in a way that will be viewed favorably by others, rather than honestly. It can make respondents over-report 'good' behaviours and under-report 'embarrassing' or unpopular ones.

Survey Accessibility

Survey accessibility means designing surveys so people of different languages, abilities and technical access can understand and complete them. It covers clear wording, usable interfaces, assistive-technology support and multilingual delivery.

Survey Fatigue

Survey fatigue is the declining motivation or attention respondents show during a survey, leading to lower completion rates and poorer-quality answers. It shows up as dropouts, short or repeated answers, and skipped questions.

Usability Testing

Usability testing for surveys is the practice of observing real people as they read, navigate and complete a questionnaire to spot problems with wording, layout, language and flow. It shows whether participants understand questions and can finish the form without confusion or technical friction.

Visual Survey Design

Visual survey design is the use of layout, typography, icons and images to make a survey easy to understand and quick to complete. Good visual design guides participants through questions so language barriers, low literacy or small screens don’t block responses.