I Got Outsmarted by Snapchat AI

As a history teacher, I've embraced that my role isn't about guarding facts. Admitting when I'm wrong in front of the class is second nature to me. But this week, Snapchat AI outsmarted me—something I didn’t see coming!

I’m all about experimenting with my students. I observe their actions & knowledge in order to inform future lessons. While some teachers like to plan everything ahead, I believe in watching how students naturally approach tasks first. Here is an example of why: in the first week of class I give my students a simple task. Research factual information about the League of Nations using any means they choose. 

Before I get up and instruct on research methods, shouldn’t I first watch them do it organically in my classroom? As students start the task of finding names, dates, and historical examples I observe HOW they are looking these up.

For years, the routine was predictable: open a new tab in Chrome, hit Google, and paste the exact question.

That may well be the most popular method, but fewer and fewer young people use Google Search. Heck, fewer even use a web browser or search engine at all!

What other ways are students researching? I knew some would use AI tools like Chat GPT, which a handful chose. But the most common platform my students use AI tools on is…Snapchat! 

To my surprise, an anonymous survey showed that Snapchat's AI was the most popular AI tool among my students—and Chat GPT was third.

As my students were struggling with a specific question, one asked me: “Are you sure there were 48 founding member states in the League of Nations, NOT 42?”

To which I confidently replied: “Yes, I’m sure.”

Credit to this student, because he challenged me (respectfully), to which all history teachers know what happens next: I’ll show you my source, you show me yours!

Mine: Wikipedia (as long as it cites a reliable source, yes, I’m a fan)

His: Snap AI. -Say what?

We prompted it with context around our topic, the question, and how my source said 48 states, while Snap AI was saying 42.

Perplexity bluntly answered with: “42 is broadly recognized as the correct number.” Ouch, but why was I getting 48 from Wikipedia? We prompted it to explain how and why I was wrong. It had a great explanation: 42 members founded the League in January of 1920, but the number of members grew to 48 by the END of 1920. That actually made perfect sense, and upon re-reading my source, Perplexity was right!

Does this mean Snapchat’s AI is a good research tool? Should we have trusted an AI search engine like Perplexity to fact check our disagreement? Should students still be using search engines like Google in 2024?

I’m less sure than ever that I know the answer to any of these questions, but I’m excited to explore them with my students this school year! And hopefully not get proven wrong by Snapchat AI every week like I did the first week of class.

How about you? Have you ever been proven “wrong” by AI tools in school? 

Are you using AI to research? I’d love to hear your experiences as a college student in the comments!

If you are curious how to use AI for your own studies 👉  I create resources around AI for college students 

🔗 Check my ACE College With AI Course: https://aaronmakelky.com

📺 Subscribe to my channel: Aaron Makelky on YouTube

🎥 Here is the video of the lesson from class that day