Showing posts with label instructional technology. Show all posts
Showing posts with label instructional technology. Show all posts

Thursday, July 10, 2025

Building Fortress-Level Assessment Security: What 591 Accounting Faculty Taught Us About Online Assessment Integrity

 Picture this: You've just finished designing what you think is a bulletproof online course, complete with engaging content and thoughtful assessments. But then that nagging voice in the back of your head whispers, "How do I know students aren't just Googling or ChatGPTing their way through my carefully crafted exams?"

If you're an instructional designer who's ever lost sleep over assessment security, you're not alone. A comprehensive study by researchers Nas Ahadiat and Mohamed I. Gomaa surveyed 591 accounting faculty across 921 U.S. universities to understand perceptions of security and integrity in online assessments. While their focus was accounting education, their findings offer a treasure trove of insights for any of us designing secure online assessments.


🔍 The Security Hierarchy: What Faculty Really Think

The research revealed a clear "trust hierarchy" when it comes to assessment security, and the results might surprise you with how stark the differences are.

🥇 Face-to-Face Assessments: The Trusted Champion Traditional classroom assessments remain the undisputed favorite among faculty for security. An impressive 54% of faculty rated face-to-face delivery as "most secured," while only 1% considered it "most unsecured." This overwhelming confidence speaks to the power of physical presence and direct supervision that many of us take for granted when designing in-person experiences.

🥈 Hybrid Courses: The Strategic Middle Ground Here's where things get interesting for us as instructional designers. Hybrid delivery emerged as a compelling compromise, with 35% of faculty rating it as "secured" or "most secured." What makes this approach so appealing is that it offers significantly more security than fully online options while maintaining much of the convenience that makes online education attractive. It's a thoughtful balance that doesn't force educators to choose between accessibility and integrity.

🥉 Synchronous Online: The Power of Presence When faculty had to choose between online delivery methods, synchronous options won decisively. The research showed that real-time, live online assessments were perceived as significantly more secure than their asynchronous counterparts. There's something about the immediacy and live monitoring capability that creates accountability and reassurance for faculty. It captures some of the supervisory benefits of face-to-face delivery, even when mediated through technology.

📱 Asynchronous Online: The Trust Gap Challenge Asynchronous assessments faced the biggest credibility hurdle in the study. Only 12% of faculty rated this delivery mode as "secured" or "most secured," while a concerning 35% considered it "unsecured" or "most unsecured." For those of us designing online learning experiences, this represents our biggest challenge—and our biggest opportunity to innovate around security and integrity measures.

Susan Smith Nash, Ph.D.

🎯 Beyond Accounting: Security Strategies for Every Subject

While this study focused on accounting, the principles apply beautifully across disciplines. Here's how to fortress-fy your assessments:

📊 Data-Heavy Subjects (Statistics, Economics, Analytics)

The Challenge: Easy to find formulas and solutions online 

The Solution:

  • Use unique, real-world datasets for each assessment
  • Require students to show their work process, not just final answers
  • Implement timed assessments with randomized question pools
  • Consider hybrid proctoring for high-stakes exams

🧬 STEM Fields (Biology, Chemistry, Physics)

The Challenge: Standard problems with readily available solutions 

The Solution:

  • Create scenario-based problems using current events or local contexts
  • Use virtual labs with unique parameters for each student
  • Implement peer review components that require original thinking
  • Design multi-step problems where each answer builds on the previous

📚 Literature and Writing Courses

The Challenge: AI writing tools and essay mills 

The Solution:

  • Focus on personal reflection and analysis rather than summary
  • Use discussion forums for peer interaction and idea development
  • Implement portfolio-based assessment with draft iterations
  • Require students to connect readings to personal or local experiences

🏛️ Social Sciences (Psychology, Sociology, Political Science)

The Challenge: Widely available information and opinions online 

The Solution:

  • Use current events that post-date available study materials
  • Require primary source analysis with specific citation requirements
  • Implement case study analysis with local or regional focus
  • Design collaborative projects that require real-world interaction

🛡️ The Arsenal: Top Security Tools Faculty Recommend

The study revealed faculty preferences for different security strategies:

  • Live Proctoring: The Heavy Artillery
  • 84% rated as "secured" or "most secured"
  • Best for high-stakes assessments
  • Implementation tip: Reserve for final exams or certification tests to manage costs

Remote Proctoring (ProctorU): The Smart Compromise

  • 74% positive rating
  • More scalable than live proctoring
  • Implementation tip: Provide clear tech requirements and practice sessions

Plagiarism Detection (Turnitin): The Safety Net

  • 78% positive rating for written work
  • Implementation tip: Use as both detection and deterrent tool

Hybrid Delivery: The Goldilocks Solution

  • Best of both worlds approach
  • Implementation tip: Conduct major assessments on-campus, everything else online

💡 Smart Implementation Strategies

Start with Risk Assessment

  • Not every quiz needs Fort Knox-level security. Categorize your assessments:
  • Low stakes: Weekly quizzes, participation checks → Minimal security needed
  • Medium stakes: Module exams, major assignments → Moderate security measures
  • High stakes: Final exams, certification tests → Maximum security protocols

Build Security into Learning Design

Instead of bolting security onto existing assessments, weave it into your instructional design:

  • Scaffolded assessments: Build knowledge progressively so cheating becomes harder
  • Application-focused questions: Test understanding, not memorization
  • Personalized content: Use student location, interests, or program focus in questions

The Transparency Approach

  • Be upfront about security measures:
  • Explain why academic integrity matters in their field
  • Share consequences of dishonesty in professional practice
  • Make security measures feel supportive rather than punitive

🔮 Looking Forward: Emerging Trends

The research highlighted some fascinating patterns:

  • AACSB-accredited programs showed higher confidence in security measures
  • Graduate programs were more concerned about asynchronous security than undergraduate programs
  • Public institutions favored face-to-face assessments more than private institutions

These patterns suggest that institutional culture and student population significantly impact security needs and perceptions.

🎯 Your Action Plan

Ready to level up your assessment security? Here's your starter toolkit:

This Week:

  • Audit your current assessments using the risk categories above
  • Identify which delivery mode best fits each assessment type
  • Research institutional resources for proctoring and plagiarism detection

This Month:

  • Pilot one hybrid assessment approach
  • Create a question bank with randomizable elements
  • Develop clear academic integrity policies for your courses

This Semester:

  • Implement differentiated security based on assessment stakes
  • Gather student feedback on security measures
  • Analyze any integrity incidents to refine your approach

🐕 The Bottom Line

The research from these 591 accounting faculty confirms what many of us suspected: there's no one-size-fits-all solution to online assessment security. The key is matching your security strategy to your specific context—your subject matter, student population, institutional resources, and assessment stakes.

Remember, the goal isn't to create an adversarial relationship with students, but to design assessments so robust and engaging that cheating becomes both difficult and pointless. When students are genuinely learning and applying knowledge to meaningful problems, academic integrity often takes care of itself.

What security strategies have worked best in your online courses? Have you noticed differences between synchronous and asynchronous assessments? Share your experiences in the comments below!

________________________________________

About the Research: This post is based on "Online accounting education: How to improve security and integrity of students' performance assessments" by Nas Ahadiat and Mohamed I. Gomaa, published in the Journal of Instructional Pedagogies, Volume 24. The study surveyed 591 accounting faculty across 921 universities in the United States.

Tags: #OnlineAssessment #AcademicIntegrity #InstructionalDesign #ELearning #AssessmentSecurity #OnlineEducation #Proctoring

Posted to E-Learning Corgi by Susan Smith Nash, Ph.D. 


Saturday, July 09, 2022

How will Moodle 4.0 affect Human Logic and other Moodle Partners?

 Moodle 4.0 has been released and it represents a tremendous breakthrough. The upgrade has focused on improving the user experience while keeping the best of the legacy resources and activities, as well as the overall framework. 

The result is a dynamic, revitalized platform that can energize learning programs so that students are more engaged and more likely to succeed. It's also a big "plus" for certificate programs and applied learning because bridging theory and application is easier than ever. 


Moodle 4.0 offers an almost infinite range of new opportunities for interaction, assessment, and commercialization of training and education

What does Moodle 4.0 mean to award-winning Moodle partners such as Human Logic? Human Logic, based in Dubai, United Arab Emirates, has earned a great reputation for corporate e-learning as well as providing integrated solutions for universities and technical institutes. 

The first thing that the new interface assures is that students can more easily keep track of their work, see what is coming up, and to interact with their fellow students, collaborators, and instructors. That is a very important aspect, particularly in highly technical collaborative training for industries such as energy, manufacturing, and supply chain management. 

The new interface and user experience (upgraded dashboards, redesigned mobile interface, etc.), is fantastic for young learners because it makes it easier for them to work with their parents and tutors as well as their core teachers. 

Finally, the fact that Moodle is open source means that it's possible to customize solutions so that they align with the specific goals and mission of the organization and the learners. 

Please stay tuned! This will be one of many articles about the fantastic capabilities in Moodle 4.0! 

Susan Nash

Susan Smith Nash, Ph.D. 


Monday, February 08, 2016

Interview with Syreena Mortimer, Instructional Designer: Innovators in E-Learning Series

How can you bulletproof yourself in a quickly evolving world?  One of the best ways is to continually evolve by reinventing yourself.  But how? That is where the instructional designer does his or her magic.

The world of the instructional designer is challenging, constantly evolving, a wonderful place to express your creativity in a way that builds human capital through effective training, education, and knowledge transfer. 

Welcome to an interview with Syreena Mortimer, an instructional designer who has recently earned her Instructional Design Certification from Rollins College. 

1.  What is your name and your relationship to e-learning?
My name is Syreena Mortimer and I am an instructional designer.

Syreena Mortimer
2.  How did you become interested in instructional design?
I became friends with an instructional designer several years ago. She told me all about her job and introduced me to other instructional design contacts. They each shared unique perspectives about their job roles in academic, federal, and commercial projects. I was really inspired by the all of the different ways they shared information with their learners. Because I was looking for a way to expand my career, I realized that instructional design is a rapidly expanding field with many opportunities. My background is in library science and I wanted to explore ways to organize content and teach others, so I decided to pursue the Instructional Design Certificate at Rollins College.

3.  What are some of the uses of instructional design that excite you?
I love to teach others, so I get really excited when I get to chunk and structure content to make it more accessible to learners.



4.  When you worked on your certificate at Rollins College, what were some of the aspects that were most interesting to you?  What were the courses that you took?

I took six courses for my Instructional Design Certificate at Rollins College: Introduction to Instructional Design, Learner Motivation and Engagement, Learning in the Connected Age, Learning Technologies, Introduction to eLearning, and a Capstone class.

I was particularly interested in the Learner Motivation and Engagement course because I was exposed to the key concepts of learning psychology. I studied some thought-provoking theories and applied them in my daily life for designing learning, working in a team, and setting personal goals. The capstone course was the most useful to me because we created and enhanced our professional portfolios- something crucial for an instructional design career!

5.  How did you use your instructional design knowledge gained from the program?
The knowledge that I gained from the program directly supported my job interview performance as well as my daily work.  I was familiar with instructional design terms and processes, able discuss learning theories, and was ready to share my portfolio. In my daily work, I use these skills to contribute to my team instructional design team in order to create, develop, and implement web-based training.






6.  What sorts of opportunities have you been able to explore as an instructional designer?
I’ve had fun working on different types of projects over the past couple of years. I had an informal internship with an instructional design mentor at a publishing company, and I helped her create quick reference guides. We also interviewed stakeholders in order to update training guides. When I worked for a consulting company, I got to participate in planning meetings about the instructional design process for a commercial client, and then I was staffed on a military client. I traveled onsite to meet with client representatives and worked with a small team to create web-based training. I will be transitioning into the hospitality industry to be a learning designer, where I will create and conduct in-person and online trainings.



 


7.  What is the most enjoyable experience that you've had so far in designing instruction?
There have been many enjoyable experiences! One that stands out is when I learned how to use an eLearning authoring tool by watching videos online, and then I taught my team members how to use the tool- all within two weeks. When I taught them, first I shared an example of the end product, then demonstrated the development steps, and then I had the learners practice alone (with feedback for any questions). The training was a success and my team members were able to create mini-presentations using the tool within 1 hour.

8.  Please list the cloud-based apps you find most useful and fun.

Marvel App: great for collaborative prototyping
http://marvelapp.com/

Thing Link: fun and easy way to make pictures interactive
http://www.thinglink.com/

Creatley: design diagrams and charts
http://creately.com/

Prezi: create engaging presentations
http://prezi.com/

Canva: make infographics, posters, advertisements, and other graphic designs
http://www.canva.com/

Monday, October 20, 2014

Interview with Jeff Kissinger, Rollins College Certificate in Instructional Design: Innovators in Instructional Design Series

The need for innovative instructional design that works in many different types of organizational settings for many different types of learners is surging now with the advent of mobile devices. Welcome to an interview with Jeff Kissinger, Rollins College. Jeff designs and administers new programs in one of the nation's most innovative college, which is known for its passionate approach to instruction and learner engagement.

What is your name and your relation to elearning?
Hi, my name is Jeff Kissinger, Jeff, and what is my relation to eLearning?  Well, at my core I am a curious learner and teacher, always have been.  I am fascinated by how we make sense of the world around us, interact with each other, and attempt to gain novel insights.  eLearning, to me, is connected learning, which I suppose one could easily say of all learning; that it doesn’t happen in isolation and is always situated.  But, for the sake of the topic and this question, and your blog Susan, eLearning might be considered connected, social, omnipresent learning enabled by various technologies and ecosystems.


My relation to eLearning is quite simply my love of teaching, learning, and tools and creative ideas that serve these. I began to develop a true passion and connoisseurship for this convergence many, many years ago teaching students with exceptionalities applying adaptive technologies for their diverse needs at an urban high school in Orlando.  I got to see first-hand how creative uses of tools and technologies could enable higher student learning and outcomes, but more so than that how it changed their lives.  From that teaching experience alone I knew that I had to always be striving for better understanding, competence, and capacity to help create the best learning opportunities possible.  So, again, to me, I see eLearning as a shortcut to describe the learning in our connected age, whether formal or informal, and where modality is not the predominant defining factor.
  
What do you consider your core philosophy of elearning?

My philosophy of elearning, and simply learning, is based on a solid foundation of open access to knowledge, critique, and creation.  I began my career teaching English in a rural area of Florida but truly began to develop a connoisseurship at the nexus of pedagogy and technology while teaching students with exceptionalities in an urban high school.  This experience planted the seed for a life-long thirst to uncover, explore, and share novel learning affordances of emerging teaching/learning practices and technologies.

At the core of these inquiries is a focus on Connectivism and the omnipresent social layer of our modern existence and the necessary literacies we must continuously hone.   In my teaching, regardless of context or modality, I see the world through a multidisciplinary lens, where technology and tools serve the learners and seek to improve how we learn. 

How do you decide what kinds of instructional technology to use?  
Drawing on my resourceful, scrappy years teaching in special education I was always searching for creative ways to enhance student learning opportunities with whatever tools and technology I could get my hands on.  Ironically, in those days most of us wanted more PC-based tools, and I had a bunch of hand-me-down Apple LCIII’s in my adaptive technology classroom/lab.  So, I learned early on to use what I had, in the best possible way, however what this helped me fine-tune in my own teaching was to focus on the learner and not the tool.

The tool will present itself if you have this non-technocentric lens.  This perspective has served me and my students well over the years guiding key decisions in instructional technology selection and application.  I guess the other thing I would say, and why I feel Apple technologies align so well with teaching and learning is that the tools need to become common and fold into everyday life and use.  We can’t have environments and tools that create needless cognitive overload or distractions that get in the way of why we are here, which is to learn, create, share, discover…

Where do you think that elearning is going?  I think when one looks out on the learning landscape we see plate tectonics shifting.   There is a mad gold rush within ed tech, and it seems like there are new ideas and tools popping up daily, which I love.  The challenge will be to make sense of it all, in a sober fashion, to best serve learners.

Practically speaking, I see analytics beginning to emerge in useful ways, a continued move to learner-centeredness, and a unbundling and disaggregation of resources, services, and paths.  Designs, practices, and enabling technologies that foster this organic unbundling of available learning options, focusing on competencies and more authentic higher levels of learning and assessment, will be the successful models that emerge and persist.   

What is Rollins College's new Certificate in Instructional Design? Who is it for?  
The Rollins College Instructional Design program is a learning experience comprised of 5 online courses and a capstone course that is offered in a 6 month sequence.  Designed for adult learners by expert practitioners and leaders in the learning and training field.  These courses are taught by faculty and leaders from higher education, k12, and workplace training.

The learning outcomes are:
  • Apply project management principles for local and virtual workgroups
  • Develop connoisseurship for learning technologies along with current and burgeoning theories and practices
  • Effectively employ technology in the design, development, management, and evaluation of knowledge creation
  • Participate in the professional growth of the learning design and training communities of practice.
  • Develop and practice a reflective commitment of continuous improvement to creating quality learning opportunities
6. Create an instructional program for a defined population and purpose
The topics covered include: instructional alignment, learning motivation and engagement, assessment, mobile and social learning, eLearning, learning technologies, analytics, and authoring. 

Why now? What makes this ID certificate unique?
The Rollins College Instructional Design curriculum has been a labor of love and has been a culmination of my and my colleague’s years of experience teaching and learning.  What we looked out at the ID job market we saw a misalignment with programs, degrees, and certificates.  We wanted to create an experience for learning professionals, or those seeking to break into these careers, that gave them the foundational knowledge to make effective learning design decisions that produced tangible outcomes.

Employing practical, authentic learning activities and assessments, the curriculum is designed to serve professionals in workplace training, k12, and higher education.  Unlike many of the ID programs we saw, which were heavily technocentric and didactic, we designed a set of learning experiences that we would have wanted years ago that affords graduates the confidence, skill set, and connoisseurship to be successful. 



Blog Archive