top of page
Search
Writer's pictureClaire Brady

Slow your roll Higher ed, AI detectors are not effective... yet

We are now entering week 8 of our Blog series "GenAI: More Than Just a Fancy Spellchecker" launching on Mondays throughout May & June. In this series, we dig into how you can use Generative AI tools like Google Gemini, ChatGPT, & You.ai (& others) to supercharge their executive workflow and communications. Last week, we explored the best videos about Generative AI that YouTube has to offer and this week we explore the current state of AI detection technologies. We hope that you are enjoying this blog series as much as we are!


As artificial intelligence (AI) continues to advance, its applications in higher education have grown exponentially. As a Higher Ed Consultant specializing in AI technologies, our conversations generally start with the impact of Generative AI in the classroom (cheating, plagiarism, protecting quality teaching/learning etc) and evolve into how to embrace innovative uses of AI WHILE mitigating and planning for supporting students and faculty with AI literacy efforts. One area that has garnered significant attention in the media lately is AI-powered plagiarism detection. However, despite the promise of these technologies, in my opinion, they have yet to prove their effectiveness.


According to a recent article by Inside Higher Ed, another AI plagiarism detector has entered the edtech market from powerhouse Coursera, raising questions about the reliability and accuracy of such tools. The article highlights that while AI detectors aim to identify unoriginal content, they often fall short in distinguishing between genuine student work and AI-generated text.


One of the primary challenges is the sophistication of AI-generated content. Tools like ChatGPT and others produce text that is coherent, contextually relevant, and increasingly difficult to differentiate from human writing. Current AI detectors struggle to keep pace with these advancements.


This disparity between AI's capabilities and the limitations of current detection systems leads to inaccuracies:


False positives: Students get penalized for original work flagged as plagiarism.


False negatives: AI-generated content goes undetected, undermining academic integrity.

Beyond these issues, AI detectors often rely on algorithms that fail to capture the nuances of creative and critical thinking – hallmarks of good academic work.


As a result, these algorithms may:


Misinterpret originality: Innovative or unconventional approaches specific to certain disciplines might be misinterpreted as plagiarism.


Lack transparency and accountability: Many AI detectors function as "black boxes," offering no explanation for their decisions. This opacity raises concerns about potential bias, accuracy, and fairness in student evaluation.


While AI plagiarism detectors hold potential, they are not yet effective enough to be relied upon in higher education. As technology evolves, it is essential for educators and institutions to remain vigilant, seeking balanced and comprehensive approaches to maintaining academic integrity. Until then, a cautious approach to AI detection tools is warranted, emphasizing the need for human oversight and continuous improvement in these technologies.


I will keep you all updated as these technologies improve and I feel more confident recommending them to my clients and to our readers.


Image source: Alamy.com

18 views0 comments

Kommentare


bottom of page