Question types guide: MCQ, hotspot, drag-and-drop and case-based items

Question types are the response formats a test item can use, such as multiple choice, hotspot, drag-and-drop or a short case with linked questions. This guide is for training providers who write scored assessments of professional skills. It is not about survey or form fields, which is what many pages for the same search describe.

The short answer: choose the simplest type that makes the learner show the skill in your learning objective, then check how it will be scored and whether every learner can answer it. Multiple choice covers most recall and judgment needs. Hotspot, drag-and-drop, ordering and case-based items earn their extra authoring time only when the skill itself involves locating, sorting, sequencing or deciding in context.

Below is a selection matrix for eight question types, tied to the 1EdTech QTI interaction list, plus one worked sample item per type. The samples are original and invented for illustration. They have not been piloted with learners.

Key takeaways

• Eight question types cover most professional-skills assessments: multiple choice, multiple response, matching, hotspot, drag-and-drop, ordering, short answer and case-based sets.
• Match the type to the verb in the learning objective: recall and understanding suit selected-response types, applying suits hotspot, drag-and-drop and ordering, and analyzing or evaluating suits case-based items.
• Decide the scoring rule before writing the item, because the rule changes the item’s difficulty and any pass mark set under a different rule stops applying.
• Drag-based items need a single-pointer alternative under WCAG 2.2 success criterion 2.5.7 unless dragging is essential, so plan a non-drag way to respond.

What are question types in an assessment, and which eight matter most?

Question types are the response formats an assessment item uses. For scored tests of professional skills, eight cover most needs: multiple choice, multiple response, matching, hotspot, drag-and-drop, ordering, short answer and case-based items. The first seven describe how the learner responds. Case-based describes how items are wrapped in a shared scenario.

The 1EdTech QTI 3.0 Best Practices and Implementation Guide (version 2.0, issued October 1, 2024) describes more than 20 interaction types in its section 3.2, including qti-choice-interaction, qti-hotspot-interaction, qti-gap-match-interaction and qti-order-interaction. QTI is, in 1EdTech’s words, a way of packaging and moving tests and questions from one application to another. Its names are a useful neutral vocabulary, because platforms label the same mechanic differently.

Case-based is not a QTI interaction. The guide describes sharing a stimulus, such as a passage, among several items, and that is how a case works in data terms: one scenario, several linked questions of any type. For the writing side of that format, see our guide to scenario-based multiple choice questions for professional training.

Which question types fit which skill level?

Match the type to the verb in your learning objective. Multiple choice, multiple response and matching suit remembering and understanding. Hotspot, drag-and-drop and ordering suit applying skills that involve locating, sorting or sequencing. Short answer removes the cueing that options provide. Case-based items suit analyzing and evaluating. These are authoring judgments, not research findings.

Table 1 maps each type to its closest QTI interaction, the levels of the revised Bloom’s taxonomy it suits (Remember, Understand, Apply, Analyze, Evaluate, Create, per Anderson and Krathwohl, 2001), and typical authoring effort.

Notice that the QTI descriptions name the task rather than a mouse gesture. The guide says an order interaction’s task is to “reorder the choices” and a gap-match interaction has gaps the candidate can fill from an associated set of choices. That distinction matters for accessibility, covered below.

Evidence for the interactive types is thinner than for multiple choice. A 2023 study in BMC Medical Education proposed 41 computer-based item types for health-professional licensing exams. Its authors expect hotspot items to beat simple click items because distractors are present, and expect drag-and-drop styles to prevent lucky guesses. They present both as expectations, and they state that sufficient validity and reliability should be established before national use.

How are the different question types scored?

Decide the scoring rule before you write the item. Single-answer items score right or wrong. Multiple response, matching, drag-and-drop, ordering and multi-region hotspot items can score all-or-nothing or with partial credit. Short answers need an accepted-answer list or a rubric. Case-based items are scored through the items inside them.

Table 2 lists the common scoring options for each type and the decision to settle before authoring begins.

The scoring rule is not a cosmetic choice. Betts, Muntean, Kim and Kao (2022) compared five scoring methods for select-all-that-apply items using about 2,243 items from a licensure computerized adaptive test. Items became easier in the order dichotomous, subset, Ripkey, plus/minus and true/false, and the authors found plus/minus and true/false the most promising. That was a licensure test, so treat it as a caution about difficulty, not a recommendation for classroom quizzes.

The same idea shows up in the standard. QTI’s response processing includes templates such as match_correct and map_response, and the guide’s example maps individual choices to point values within lower and upper bounds. If you change the rule after setting a pass mark, revisit the pass mark, as explained in our guide to setting cut scores for professional training courses.

Pro tip: Score a Pilot Both Ways. Before you commit to partial credit, score 20 saved learner responses under both rules in a spreadsheet and compare who passes. If the pass list changes, you have found a cut-score problem before learners did.

What accessibility cautions and common flaws does each type carry?

Every type has a typical failure. Multiple choice fails through weak distractors. Hotspot and drag-and-drop fail through dependence on a pointer. Matching adds memory load, ordering invites more than one defensible sequence, short answer penalizes valid answers you did not list, and case-based items add reading load. Plan a non-pointer way to respond for any pointer-based item.

Table 3 pairs each type with an accessibility caution and a flaw to check during review. The cautions marked as judgment are practical advice. The WCAG items are quoted from the standard.

For multiple choice, the best-documented flaws come from Haladyna, Downing and Rodriguez (2002), who validated a taxonomy of 31 item-writing guidelines using 27 testing textbooks and 27 research studies. Their guidance, as summarized in a secondary source, includes avoiding “all of the above,” using “none of the above” carefully, avoiding the complex Type K format, and building distractors from typical learner errors. Those guidelines address multiple choice, not hotspot or drag-and-drop.

On dragging, WCAG 2.2 success criterion 2.5.7 requires that functionality using a dragging movement can be achieved by a single pointer without dragging, unless dragging is essential. The criterion’s own Understanding document gives a sortable list as an example and suggests adjacent up and down controls. A sequencing item rarely needs the drag gesture itself, so build in a button alternative. Whether WCAG binds your organization depends on the laws and contracts that apply to you, so have an accessibility specialist review your delivery.

What does a sample item look like for each question type?

Each sample below is an original item written for this guide. It is invented and unpiloted, so use it as a template for form, not as validated content. Every sample names the objective and the key, and says what the format adds. Read them together to see how the same professional content changes when the response format changes.

Multiple choice, multiple response and matching samples

Sample 1: Multiple choice (Remember). Objective: identify the document used to propose a scope change. Item: Which document is used to formally propose a change to an approved project scope?

• A. Status report
• B. Change request
• C. Risk register
• D. Lessons-learned log

Key: B. The format works because each distractor is a real project document a learner might confuse with it.

Sample 2: Multiple response (Understand). Objective: list what a support handover note must contain. Item: A support agent hands an open ticket to the next shift. Select the THREE items the handover note must include.

• A. The customer’s issue and its impact
• B. The steps already tried
• C. The next action and any deadline promised to the customer
• D. The agent’s opinion of the customer
• E. The agent’s own break schedule

Key: A, B, C. Stating the count in the stem keeps the scoring rule fair. Without it, learners cannot tell whether to stop at two answers or four.

Sample 3: Matching (Understand). Objective: use assessment vocabulary correctly. Item: Match each term to its definition.

• Terms: Distractor, Cut score, Blueprint, Discrimination index
• Definitions: (1) The score that separates pass from fail; (2) A wrong option written to attract learners with a specific misconception; (3) A plan showing how many items cover each topic; (4) A statistic comparing how stronger and weaker learners answered an item; (5) The share of learners who answered correctly

Key: Distractor to 2, Cut score to 1, Blueprint to 3, Discrimination index to 4. Definition 5 is an extra so the last pair cannot be found by elimination.

Hotspot, drag-and-drop and ordering samples

Sample 4: Hotspot (Apply). Objective: read a performance chart against a target. Item: The image shows a sample line chart of monthly revenue with a horizontal target line. Click the first month in which revenue falls below the target. Key: the region around month 7 on the invented chart. Format value: the learner must read the graphic, which a text option list would describe for them. Alternative: a labeled list of months for learners who cannot use a pointer.

Sample 5: Drag-and-drop (Understand). Objective: classify tasks by project phase. Item: Drag each task into its phase: Initiating, Planning, Executing, Closing. Tasks: Draft the project charter; Build the schedule; Hold weekly status meetings; Archive the project files. Key: charter to Initiating, schedule to Planning, status meetings to Executing, archive to Closing. Alternative: a dropdown beside each task. Score per correct placement and decide whether a phase can hold more than one task.

Sample 6: Ordering (Apply). Objective: sequence a customer-escalation response. Item: Put these steps in order: Confirm the outcome and follow up; Acknowledge the customer’s concern; Propose a resolution; Gather the facts. Key: Acknowledge, Gather, Propose, Confirm. Check with reviewers that no other sequence is defensible, then supply up and down buttons for non-drag input.

Short answer and case-based samples

Sample 7: Short answer (Remember). Objective: name the responsibility-assignment tool. Item: In one to three words, name the project tool that records who is Responsible, Accountable, Consulted and Informed for each task. Accepted answers: RACI, RACI matrix, RACI chart. The accepted list is the real work here. Add misspellings that appear in pilot responses.

Sample 8: Case-based (Analyze and Evaluate). Objective: interpret evidence and choose a proportionate response. Case: A training provider’s support lead sees learner complaints about the online exam rise from 12 to 25 in the two weeks after a platform update. Of the 25, 18 mention the timer. The update moved the timer from the top bar into a menu. Pass rates and exam length did not change.

Item 8a: Which conclusion do the facts support best?

• A. The timer move is the most likely driver of the extra complaints and needs checking.
• B. The exam has become harder, because complaints doubled.
• C. The exam is too long, because learners mention the timer.
• D. Nothing can be concluded, because pass rates did not change.

Key: A. B and C each contradict a stated fact, and D confuses complaints with results.

Item 8b: Which first step is most proportionate?

• A. Roll back the whole update for every client.
• B. Ask several of the 18 learners what the timer change stopped them doing, then test a visible-timer option.
• C. Add 15 minutes to every exam.
• D. Reply to complaints that the timer is unchanged.

Key: B. Note that 8b is scored independently of 8a, so a learner who misreads the evidence can still earn the second point.

Pro tip: Tag Item Type as Its Own Field. Record the question type beside topic and objective in the item bank. Later, item analysis can show whether one format is consistently too easy or fails to separate stronger from weaker learners, which is a format finding rather than a topic finding.

How do you choose a question type for a learning objective?

Start from the objective’s verb, pick the least costly type that makes the learner perform that verb, then test the choice against scoring, accessibility and delivery limits. Add a more complex type only when a simpler one would let learners succeed without having the skill.

Step 1: Underline the verb. “Identify” and “name” point to multiple choice or short answer. “Locate” points to hotspot. “Sort” and “sequence” point to drag-and-drop and ordering. “Diagnose” and “decide” point to case-based items.

Step 2: Try the cheapest type first. If a multiple choice item with plausible distractors makes learners demonstrate the verb, stop there. Authoring and review time is the scarcest resource in most training companies, and your item bank needs reviewed items more than clever ones.

Step 3: Check the response path. List how a keyboard-only learner and a screen reader user would answer the item. If the answer is “they cannot,” add an alternative or choose a different type.

Step 4: Write the scoring rule and accepted answers. If you cannot state the rule in one sentence, the item is not ready.

Step 5: Pilot, then analyze. Sit the item with a few learners, fix ambiguity, and check difficulty and discrimination after the first real cohort.

What should you do next?

Take one existing assessment and list each item’s type and the verb in its objective. Mismatches, such as recall items for an “apply” objective, are your first rewrites. Use Table 1 as the guide and change no more than a handful of items at a time.

Then test every type you plan to use in the platform you will deliver on. Check keyboard operation, how partial credit is reported, and whether items export in a standard such as QTI. SimpliAssess’s published FAQ lists multiple choice, true/false, fill-in-the-blank, essay and open-ended questions and says question formats can be customized, but its published pages do not name hotspot, drag-and-drop or ordering types or QTI, so ask any vendor to demonstrate the types you need. The SimpliAssess FAQ is the page to compare.

Frequently asked questions

What are the main question types in an online assessment?

The main types are multiple choice, multiple response, matching, hotspot, drag-and-drop, ordering, short answer and essay, with case-based sets wrapped around any of them. Some platforms add numeric, fill-in-the-blank and file-upload types. The 1EdTech QTI 3.0 guide lists more than 20 interaction types, so no single platform’s menu is the complete list.

What is the difference between multiple choice and multiple response?

Multiple choice has one correct option, while multiple response has two or more. The difference matters for scoring, because a multiple response item can score all-or-nothing or with partial credit. Betts and colleagues (2022) found that the scoring method changes how hard these items are, so decide the rule before writing the item.

When should you use a hotspot question?

Use a hotspot question when the skill is locating or identifying something in an image, such as a chart, screen or diagram. Do not use it when a text option would test the same thing. Provide a non-pointer way to respond, and describe the image so that it is identified for assistive technology.

Are drag-and-drop questions accessible?

Not by default. WCAG 2.2 success criterion 2.5.7 requires a single-pointer alternative to dragging unless dragging is essential, and criterion 2.1.1 requires keyboard operation. Ask your platform vendor to demonstrate keyboard and screen reader use for each drag-based type, and keep a dropdown or button alternative ready.

Are case-based questions better than multiple choice?

No, they serve a different purpose. Case-based items wrap questions in a shared scenario and suit analyzing and evaluating, but they take longer to write, read and review. A mix works better than all cases. Use multiple choice for facts that must be known exactly and cases for judgment.

How many options should a multiple choice question have?

Three is adequate, according to the Haladyna, Downing and Rodriguez (2002) guidelines, which advise writing as many effective choices as you can. Do not pad an item with a weak fourth option just to match a house style. Every distractor should be plausible and based on a typical learner error.

Do you need QTI to use different question types?

No. QTI is 1EdTech’s format for packaging and moving tests and questions from one application to another. You need it only if you plan to import an existing item library or move items between platforms. Check whether your platform imports and exports QTI, and which interactions it supports, before you build a large item bank.