Design Decision #3 – How Do I evaluate the design of the module?
There were two options to consider to conduct the data collection – via online survey or face-to-face interview. Creswell (2012) explains that a web-based questionnaire is a method where extensive data can be collected quickly from participants anytime, anywhere. Thus, from discussions with the academic advisor and the sponsor, it was decided that the implementation of online surveys would be suitable. This was an appropriate decision due to the occurrence of the COVID-19 pandemic. The participants will be able to complete the surveys while at home.
The type of survey design chosen for this study was the cross-sectional, which “examine[s] current attitudes, beliefs, opinions, or practices” (Creswell, 2012, p. 377). The pre-module survey includes demographic questions to get participants comfortable Both surveys includes open-ended questions, while the post-module survey includes yes/no/please explain questions. Creswell (2012) states that by utilizing open-ended questions in qualitative research, it allows the participants to present their most unrestricted perspective.
Rugg and Petre (2007) indicate that if the list of questions does not address the significant concerns, proper responses will not be obtained. The user experience and needs, and the TPACK framework informed the development of the survey questions to capture the perception towards usability of the module and answer the research questions.
After a discussion with the academic advisor, an additional question to confirm participant’s consent was then added to both surveys.
Both surveys were designed on the Microsoft Forms platform because it is user-friendly, easy to use for survey design and it formats responses in an Excel spreadsheet for easier initial analysis.
References:
Creswell, J. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Boston, MA: Pearson. Retrieved on January 4, 2020, from http://basu.nahad.ir/uploads/creswell.pdf
Rugg, G., & Petre, M. (2007). A Gentle Guide to Research Methods. McGraw-Hill Education