Presentation
MDD22 - Moderation Matters: Because Anyone Can Read a Script
SessionPoster Session 2
DescriptionWhen preparing for a human factors study there are many things to take into consideration. It can be easy to get so caught up in the study methodology that a key factor is overlooked…the study participant and how to communicate with them. Good moderation sets the tone for a HF study and allows the study participants to be in the mindset as if they were in a real-life scenario. It can seem simple to read off a script and ask the same questions to everyone, and oftentimes this may be just fine, but it is our position that this activity should be rooted in a higher-level understanding of the user, characteristics of the unique user group(s), and other related variables (e.g., education or reading levels, cognitive impairments, etc.).
On occasion, the agency has been known to comment on human factors validation test protocols and submissions due to the use of ‘leading language’. Therefore, finding the perfect balance between describing the scenarios and asking questions while not giving too much information is crucial. In this poster, we will reflect on well-done moderation techniques, common mistakes we have seen, and tips and tricks to successfully moderate any session (without frustrating you or the participant) and how to prevent unnecessary study artifacts.
Our poster will focus on the following themes:
Defining and understanding your user, and their unique needs: What factors about the intended user(s) (i.e., study participant in these instances) could impact device use to even their general understand of the product, context of use, etc. and therefore you should know about communicating with participants in your study? Do you have to adjust your moderator guide/script for each specific user group?
The first step is understanding the user(s). Before drafting your moderator guide, it’s vital to deeply grasp the intended user(s) of the device or system. This includes who and how it will be used, the tasks users will perform, and factors affecting user behavior. This understanding forms the basis for crafting a moderator guide that can help a participant mimic real-world application.
Adapting and adjusting to unique participants: No matter how well-crafted your moderator script is, there are always some participants that seem to need extra attention. This can be true for children, older adults, individuals with lower reading levels, and those with cognitive impairments. How can we ensure that our descriptions and prompts are being understood as we intend? How do we know that participants understand our questions and can provide us with insightful feedback? While you may want the moderator script to be followed to a “T,” you may also need to be able to adjust or adapt according to a specific participant’s needs. We’ll provide some advice on this.
Mitigating for potential study artifacts: If your study participant is not understanding the scenario prompts, or your verbiage doesn’t sound ‘familiar’ to some degree, you may see study artifacts crop up in your findings, which can distract from the real use problems (i.e., “I didn’t actually activate the autoinjector because I didn’t think the device would really work” or “I didn’t know what you were asking because I don’t know that word”). It is crucial that participants understand the purpose of the study, the context of use, and relevant details to help them feel comfortable and immersed so that they can act as naturally as possible.
On occasion, the agency has been known to comment on human factors validation test protocols and submissions due to the use of ‘leading language’. Therefore, finding the perfect balance between describing the scenarios and asking questions while not giving too much information is crucial. In this poster, we will reflect on well-done moderation techniques, common mistakes we have seen, and tips and tricks to successfully moderate any session (without frustrating you or the participant) and how to prevent unnecessary study artifacts.
Our poster will focus on the following themes:
Defining and understanding your user, and their unique needs: What factors about the intended user(s) (i.e., study participant in these instances) could impact device use to even their general understand of the product, context of use, etc. and therefore you should know about communicating with participants in your study? Do you have to adjust your moderator guide/script for each specific user group?
The first step is understanding the user(s). Before drafting your moderator guide, it’s vital to deeply grasp the intended user(s) of the device or system. This includes who and how it will be used, the tasks users will perform, and factors affecting user behavior. This understanding forms the basis for crafting a moderator guide that can help a participant mimic real-world application.
Adapting and adjusting to unique participants: No matter how well-crafted your moderator script is, there are always some participants that seem to need extra attention. This can be true for children, older adults, individuals with lower reading levels, and those with cognitive impairments. How can we ensure that our descriptions and prompts are being understood as we intend? How do we know that participants understand our questions and can provide us with insightful feedback? While you may want the moderator script to be followed to a “T,” you may also need to be able to adjust or adapt according to a specific participant’s needs. We’ll provide some advice on this.
Mitigating for potential study artifacts: If your study participant is not understanding the scenario prompts, or your verbiage doesn’t sound ‘familiar’ to some degree, you may see study artifacts crop up in your findings, which can distract from the real use problems (i.e., “I didn’t actually activate the autoinjector because I didn’t think the device would really work” or “I didn’t know what you were asking because I don’t know that word”). It is crucial that participants understand the purpose of the study, the context of use, and relevant details to help them feel comfortable and immersed so that they can act as naturally as possible.
Event Type
Poster Presentation
TimeTuesday, April 14:45pm - 6:15pm EDT
LocationFrontenac Foyer