{"id":1178,"date":"2022-07-14T11:33:25","date_gmt":"2022-07-14T15:33:25","guid":{"rendered":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/?p=1178"},"modified":"2022-07-14T11:41:26","modified_gmt":"2022-07-14T15:41:26","slug":"reflection-on-the-rubric-creation-process","status":"publish","type":"post","link":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/reflection-on-the-rubric-creation-process\/","title":{"rendered":"Reflection on the Rubric Creation Process"},"content":{"rendered":"<p><img decoding=\"async\" data-src=\"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-content\/uploads\/sites\/199\/2022\/07\/pexels-ono-kosuki-5999812-scaled.jpg\" alt=\"\" width=\"2560\" height=\"1707\" class=\"alignnone size-full wp-image-1180 lazyload\" data-srcset=\"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-content\/uploads\/sites\/199\/2022\/07\/pexels-ono-kosuki-5999812-scaled.jpg 2560w, https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-content\/uploads\/sites\/199\/2022\/07\/pexels-ono-kosuki-5999812-1280x854.jpg 1280w, https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-content\/uploads\/sites\/199\/2022\/07\/pexels-ono-kosuki-5999812-980x653.jpg 980w, https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-content\/uploads\/sites\/199\/2022\/07\/pexels-ono-kosuki-5999812-480x320.jpg 480w\" data-sizes=\"(min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) and (max-width: 1280px) 1280px, (min-width: 1281px) 2560px, 100vw\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 2560px; --smush-placeholder-aspect-ratio: 2560\/1707;\" \/><br \/>\n<em>Image taken from Pexels.com<\/em><\/p>\n<p>Team D (London Coronica, Emma Keating, Karen McMurray, and myself) created a rubric with the intended goal of providing an objective assessment of a digital learning resource by 1) identifying its effectiveness for learning (Shelton, 2010) and 2) measuring its appropriateness (both in pedagogy and practice) to support, and, when possible, enhance teaching and learning (Hamilton et al., 2016).<\/p>\n<p>Evaluating the appropriateness and effectiveness of a digital resource was a significant challenge for our team. Notably, the task of narrowing down our performance criteria and listing the quality indicators we wanted to see demonstrated. This was particularly hard because measures had to be general enough across tasks and performances to properly assess a wide range of digital resources.<\/p>\n<p>Overall, I am happy with our final product. Still, if I could do it again, I would create a separate evaluation rubric explicitly tailored to the content and scope of a particular resource type. For example, create one for mobile apps, online courses, e-portfolios, etc. However, I realize that 1) it may not be realistic to assume one could create rubrics that fully convey all criteria assessors believe should be demonstrated, and 2) rubric creation is highly dependent on the creators&#8217; epistemological position (Bates, 2015). Therefore, there are seemingly endless ways in which one could construct a quality evaluation rubric. Essentially, there&#8217;s no one &#8216;right&#8217; way, just varying degrees of better or worse.<\/p>\n<p>Ultimately, teaching and learning is a complex, ill-structured domain (Koehler &amp; Mishra, 2009). And even digital learning resources deemed &#8220;high quality&#8221; still need to be used appropriately and with purpose to be effective (Bates, 2015).<\/p>\n<p><em>References<\/em><\/p>\n<p>Anstey, L., &amp; Watson, G. (2018). Rubric for e-Learning tool evaluation by Centre for Teaching and Learning, Western University. Retrieved from: https:\/\/teaching.uwo.ca\/pdf\/elearning\/Rubric-for-eLearning-Tool-Evaluation.pdf<\/p>\n<p>Bates, A.W. (2019). Teaching in a Digital Age \u2013 Second Edition. Tony Bates Associates Ltd. https:\/\/pressbooks.bccampus.ca\/teachinginadigitalagev2\/<\/p>\n<p>Hamilton, E., Rosenberg, J., &amp; Akcaoglu, M. (2016). The substitution augmentation modification redefinition (SAMR) model: A critical review and suggestions for its use. TechTrends, 60(5), 433\u2013441. Retrieved from: https:\/\/newcollegedurhamhe.files.wordpress.com\/2018\/03\/the-samr-model-a-critical-review.pdf<\/p>\n<p>Illinois Online Network (2019). Quality Online Course Initiative Rubric (QOCI) [PDF]. The University of Illinois. Retrieved from: https:\/\/uofi.app.box.com\/s\/afuyc0e34commxbfn9x6wsvvyk1fql8p<\/p>\n<p>Koehler, M. &amp; Mishra, P. (2009). What is Technological Pedagogical Content Knowledge (TPACK)?. Contemporary Issues in Technology and Teacher Education, 9(1), 60-70. Retrieved from: https:\/\/www.learntechlib.org\/primary\/p\/29544\/<\/p>\n<p>Shelton, K. (2010). A Quality Scorecard for the Administration of Online Education Programs: A Delphi Study, University of Nebraska. Retrieved from: https:\/\/anitacrawley.net\/Resources\/Articles\/sheltondissertation.pdf<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Image taken from Pexels.com Team D (London Coronica, Emma Keating, Karen McMurray, and myself) created a rubric with the intended goal of providing an objective assessment of a digital learning resource by 1) identifying its effectiveness for learning (Shelton, 2010) and 2) measuring its appropriateness (both in pedagogy and practice) to support, and, when possible, [&hellip;]<\/p>\n","protected":false},"author":199,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[1,10],"tags":[],"class_list":["post-1178","post","type-post","status-publish","format-standard","hentry","category-contact","category-lrnt527"],"_links":{"self":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/posts\/1178","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/users\/199"}],"replies":[{"embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/comments?post=1178"}],"version-history":[{"count":6,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/posts\/1178\/revisions"}],"predecessor-version":[{"id":1186,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/posts\/1178\/revisions\/1186"}],"wp:attachment":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/media?parent=1178"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/categories?post=1178"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0205\/wp-json\/wp\/v2\/tags?post=1178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}