‘But there is a difference between recognising AI use and proving its use. So I tried an experiment. … I received 122 paper submissions. Of those, the Trojan horse easily identified 33 AI-generated papers. I sent these stats to all the students and gave them the opportunity to admit to using AI before they were locked into failing the class. Another 14 outed themselves. In other words, nearly 39% of the submissions were at least partially written by AI.‘

Article archived: https://web.archive.org/web/20251125225915/https://www.huffingtonpost.co.uk/entry/set-trap-to-catch-students-cheating-ai_uk_691f20d1e4b00ed8a94f4c01

  • Alaknár@sopuli.xyzEnglish
    37·
    3 hours ago

    Let me tell you why the Trojan horse worked. It is because students do not know what they do not know. My hidden text asked them to write the paper “from a Marxist perspective”. Since the events in the book had little to do with the later development of Marxism, I thought the resulting essay might raise a red flag with students, but it didn’t.

    I had at least eight students come to my office to make their case against the allegations, but not a single one of them could explain to me what Marxism is, how it worked as an analytical lens or how it even made its way into their papers they claimed to have written. The most shocking part was that apparently, when ChatGPT read the prompt, it even directly asked if it should include Marxism, and they all said yes. As one student said to me, “I thought it sounded smart.”

    Christ…

    • rumba@lemmy.zipEnglish
      46·
      2 hours ago

      ". My hidden text asked them to write the paper “from a Marxist perspective”

      Freshmen.

      That’s a dangerous proof.

      He could have said to write from a zagnoore brandle-frujt perspective. Some would have scanned the assignment, ignored the part they didn’t understand, and kept chooching right along. Many students would rather try to figure it out than sound stupid in class or risk the spotlight of social interaction.

      Interrogating each of them on the material is the only safe way.

      • SippyCup@lemmy.ml
        1·
        8 minutes ago

        The Trojan worked because the students who read the assignment would not have seen the reference to Marxism. Only by copy pasting the text in to another field would that show up.

      • Jankatarch@lemmy.world
        1·
        13 minutes ago

        Honestly interrogating each one on the material would be best but costly. Some classes have 80 students and professors have more than one class.

        Also rest of the article says he asked students objecting accusations to tell what Marxism is and they admitted afterwards.

        Apparently chatgpt asked “are you sure you want marxist perspective” as topic is older and not that directly related to marxism. One said they picked yes because quote on quote “it sounded smart.”