Afleveringen


  • In September, the Toddle team organised "AI for AussieEd", a week-long series of professional development sessions for teachers, which had thousands of attendees for the virtual sessions.

    This episode "Driving Innovation in Australian Schools" was part of the week, and brings you the experiences of three educators, in conversation with podcast hosts Dan and Ray

    The guests are:

    Rachel Saunders, Primary School Learning Leader at Concordia College in Adelaide Ryan Elwell, Director of Digital Pedagogies & Online Safety Education at the ACT Education Directorate Matt Heinrich, Director of Learning Technologies and ICT at St Michaels Grammar School in Melbourne

    It was a great discussion, and because it was recorded as a live webinar, we had lots of audience questions coming in online, so in the second half of the episode, you're going to hear questions coming in the chat from live listeners.

    As usual, hosts Dan and Ray brought along their own contributions to the discussion:

    Dan came with his deep pedagogical knowledge and insightful education conversation.

    Ray brought his Buzzword Bingo card

  • This week's episode has a lot more news than research. But the research that we spend a bit of time on is the insights on how students in Australian universities are using AI. Really good insights for any educator or leader!

    News

    AI Detectors Falsely Accuse Students of Cheating—With Big Consequences
    https://www.bloomberg.com/news/features/2024-10-18/do-ai-detectors-work-students-face-false-cheating-accusations

    Empowering Education Leaders Toolkit
    https://tech.ed.gov/education-leaders-ai-toolkit/

    TEQSA Guidance for universities
    Danny Liu video https://bit.ly/students-ai

    Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said
    https://www.independent.co.uk/news/openai-ap-san-francisco-experts-microsoft-b2635996.html

    More than a quarter of new code at Google is generated by AI - The Verge
    https://www.theverge.com/2024/10/29/24282757/google-new-code-generated-ai-q3-2024

    Apple are launching their first devices with Apple Intelligence
    https://www.wsj.com/video/series/joanna-stern-personal-technology/full-interview-apples-software-chief-craig-federighi-on-future-of-iphone-ai/756B8727-5FFB-422C-AE63-C4600272BD94?msockid=0a3b30f5f88b6061226e245bf9b96140

    Watch out for the Earning reports: Google just released and Microsoft do this week too. Always have a listen to these to find out about the momentum in AI.
    Alphabet Q3 earnings call: CEO Sundar Pichai's remarks
    Microsoft Fiscal Year 2025 First Quarter Earnings Conference Call


    Research

    A Systematic Mapping Review at the Intersection of Artificial Intelligence and Self-Regulated Learning A call for increased theoretical grounding focus on motivation and diversifying context
    https://www.researchgate.net/publication/382870027


    Students perspectives on AI in higher education
    Project website: https://aiinhe.org
    Survey highlights: https://aiinhe.org/wp-content/uploads/2024/10/aiinhe_surveyinsights.pdf
    Guidance for students: https://itali.uq.edu.au/files/31707/how-students-use-ai-guide-students.pdf
    Guidance for academics: https://itali.uq.edu.au/files/31702/How-students-talk-about- gen-ai-guide-academics.pdf

  • Zijn er afleveringen die ontbreken?

    Klik hier om de feed te vernieuwen.

  • Series 10, Episode 3

    This week's episode is an interview with Dr Anna Denejkina, who's an interdisciplinary researcher and Associate Director at The Insight Centre. We discuss her research on youth engagement with generative AI. The conversation explores the multifaceted impact of AI technology in education, addressing benefits such as upskilling and accessibility, as well as concerns related to academic misconduct, job displacement, and misinformation. Key themes include gender disparity in confidence using AI, the importance of critical and empathetic thinking, and the evolving landscape of education assessments. The dialogue also highlights issues of loneliness, anxiety, and the growing equity gap driven by differences in AI adoption across various educational institutions.

    Anna talks about her previous research on Young People's Perception and Use of Generative AI, which is a collaboration between The Insight Centre and YouthInsight. Here's a good summary article at The Research Society, and the full research here

    We also mentioned the STEM tracker research, which is published by the Dept of Industry here

    You can find all of Anna's research publications here

  • This week we cover a range of AI in Education related news and academic research papers. Here's all the links you need to read more about each of the topics we dicussed:

    News

    Australia's Voluntary AI Safety Standard

    In September the Australian Government published:

    Voluntary AI Safety Standard (68pg): https://www.industry.gov.au/publications/voluntary-ai-safety-standard

    Proposals paper for introducing mandatory guardrails for AI in high-risk settings: https://consult.industry.gov.au/ai-mandatory-guardrails

    Stanford's STORM

    https://storm.genie.stanford.edu/

    Students give English HSC exam an F over use of image with ‘hallmarks’ of AI

    https://www.theguardian.com/australia-news/2024/oct/16/nsw-hsc-english-exams-2024-ai-image-paper-1

    Investigation into the use of ChatGPT by a Child Protection worker - Office of the Victorian Information Commissioner

    https://ovic.vic.gov.au/regulatory-action/investigation-into-the-use-of-chatgpt-by-a-child-protection-worker/

    Research Papers

    To what extent is ChatGPT useful for language teacher lesson plan creation?
    https://arxiv.org/abs/2407.09974

    Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks
    https://arxiv.org/abs/2407.09573

    The Life Cycle of Large Language Models: A Review of Biases in Education
    https://arxiv.org/abs/2407.11203

    The Future of Learning: Large Language Models through the Lens of Students
    https://arxiv.org/abs/2407.12723

    How to Mitigate the Dependencies of ChatGPT-4o in Engineering Education
    https://arxiv.org/abs/2407.12693

    StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions
    https://arxiv.org/abs/2407.12423

    Apostles, Agnostics and Atheists: Engagement with Generative AI by Australian University Staff
    https://eprints.qut.edu.au/252079/

  • Welcome to the first Episode of Series 10, where we are going to take some time to review some of the fundamental changes we're going to be seeing as AI becomes more pervasive.

    In this Episode we're taking a different approach, with Dan and Ray using Google's NotebookLM to create AI-delivered mini-podcasts about each other, which leads to a discussion about the backgrounds of both hosts, and a discussion about how this new AI might be used in education.

    Obviously, both Dan and Ray conclude that AI won't replace them...yet!

    For your own experiments, you can find NotebookLM at https://notebooklm.google.com/

    The two mini podcasts in this episode were produced by simply feeding NoteBookLM with the hosts LinkedIn profiles (in PDF format - available as a download from any individual's LinkedIn page).

    We'd love to hear how you're using NotebookLM, and other AI tech, in your work. The easiest way to get hold of us is via our LinkedIn page https://www.linkedin.com/company/ai-in-education-podcast/

    And if you're enjoying the podcast, would now be a good time to leave a review in your podcast app - whether you're using Apple Podcasts, Google Podcasts or Spotify, we'd love it if you left a rating and review.

  • This week we're joined by the brains behind South Australia's EdChat chatbot. It was the first state in Australia to start pilot a custom built generative AI chatbot for their schools, and we spent some time with the team to understand the success story.

    In the podcast, we heard from Simon Chapman (Director of Digital Architecture and Operations) and Cody Little (AI Technical specialist), both from the Department for Education South Australia

    Find out more about the South Australia Department AI approach: Artificial intelligence (AI) in schools – information for parents and carers (education.sa.gov.au) and details on their trial - Nation-leading trial in SA schools to focus on the safe use of AI (education.sa.gov.au)

    Microsoft have written a case study on their News Centre here: Learning in the AI era: How South Australia’s Department for Education is empowering students and teachers with AI in the classroom - Microsoft Australia News Centre Video of their amazing work: Department for Education South Australia | Reimagine Education 2024 9 News report : Artificial intelligence set to shake-up South Australian high schools (9news.com.au) AI Safety - AI content safety Towards the end of the episode we also talked about Career chat: SA Career Chat
  • Unbelievably, it's our 5th Anniversary (AI-nniversary?) and to mark the milestone of an AI podcast that's had more pivots than a robot's legs, and more chat than a chatbot, we've pulled together some of the top episodes from the 108 episodes of the podcast so far, and got the band back together (regretfully, we were unable to persuade Beth Worral, who co-hosted in 2022-2023, to come back for our party podcast - she'd reached escape velocity), so you'll hear Dan, Ray and Lee reminiscing like old men in a shed.

    Great Guests & Top Episodes

    Our very first guest - Microsoft's Troy Waller in AI for Accessibility in 2019

    Our most listened episode from 2019 and very first external guest - the brilliant Dr David Kellerman in Using AI to personalise learning at UNSW Sydney

    Our top 2020 episode was A Brief History of AI, which looked backin to the human obsession with creating artificial replicas of themselves. When did it start, who started it, what is the AI winter and how did it accelerate so quickly in the last 10 years. (And even faster in the last 4 years since?)

    In 2021, another great guest topped our episode charts, with Feel the force: Emerge to the future with Sly Lee as Sly talked about his work around VR and AR and the mergeing of physical and virtual worlds

    For 2022, it was the Christmas edition that hit the heights, with all four co-hosts - Beth, Lee, Dan & Ray - together for the quizzically named Christmas, Infinite Monkeys and everything

    By 2023, we were back on solid pedagogy again, with the episode AI - The fuel that drives insight in K12 with Travis Smith (the kind of title a marketing manager would love?)

    And, although we've not yet reached the end of 2024 and we've got some great episodes ahead, the top episode this far is University of Sydney and the future of assessment with Danny Liu and Adam Bridgman

    We also had fond memories of:

    The AI in Popular Culture episode from 2020 Martin O'Sullivan's tales from Turing House School in From AI Detectors to Heartwarming Help: Two Tales of AI in a school Elle Graham (aka Woodes) in Music, Creativity and Minecraft with Woodes Practical lessons from chatbot land with The Search for the Education Holy Grail in NSW, with the stories shared by Dan Hart and Michelle Michael
  • News

    This week's news we rushed through includes "Study Buddy or Influencer?", the Australian Parliamentary Inquiry into the use of Gen AI in the Australia Education System
    https://www.aph.gov.au/Parliamentary_Business/Committees/House/Employment_Education_and_Training/AIineducation/Report

    NSW EduChat has been extended for all teachers in all New South Wales Schools - https://www.innovationaus.com/nsw-teachers-to-get-time-saving-genai-tool/
    Learn more about the NSW EduChat chatbot in the first episode of Series 9

    Microsoft announced Copilot Wave 2
    https://www.microsoft.com/en-us/microsoft-365/blog/2024/09/16/microsoft-365-copilot-wave-2-pages-python-in-excel-and-agents/

    OpenAI's new model o1-preview came out - and it's much, much better and logical reasoning and maths
    Find out what people think by looking at what Ethan Mollick is saying about it (and, as I suggest on the podcast, keenly watch Dan Hart's posts as he's benchmarking it now in the context of EduChat)

    Google released a podcast-generator as part of NotebookLM, which turns any kind of paper/book etc into a short podcast. To find out what it's like I gave it the top research paper from the podcast last time and you can compare it versus me! There's a quick demo review by Ethan here and you can login and have a play directly here: https://notebooklm.google.com/ (it has two main uses, because on top of this autopodcast, it's original purpose was to allow you give it a pile of documents and it can work with all of them at the same time for q&a, summaries etc)

    Research

    Here's the links to all nine papers we discussed in this week's episode:

    Generative AI in Real-World Workplaces
    https://www.microsoft.com/en-us/research/uploads/prodnew/2024/07/Generative-AI-in-Real-World-Workplaces.pdf

    Can Large Language Models Make the Grade?
    https://dl.acm.org/doi/10.1145/3657604.3664693

    PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection
    https://arxiv.org/abs/2406.16288

    The global landscape of academic guidelines for generative AI and Large Language Models
    https://arxiv.org/abs/2406.18842

    "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline
    https://arxiv.org/abs/2406.18512

    Perceived Impact of Generative AI on Assessments: Comparing Educator and Student Perspectives in Australia, Cyprus, and the United States
    https://www.sciencedirect.com/science/article/pii/S2666920X24000729

    Jill Watson: Scaling and Deploying an AI Conversational Agent in Online Classrooms
    https://dilab.gatech.edu/publications/jill-watson-scaling-and-deploying-an-ai-conversational-agent-in-online-classrooms/
    https://dilab.gatech.edu/test/wp-content/uploads/2024/05/ITS2024_JillWatson_paper.pdf

    Integrating AI in College Education: Positive yet Mixed Experiences with ChatGPT
    https://arxiv.org/abs/2407.05810

    The AI Companion in Education: Analyzing the Pedagogical Potential of ChatGPT in Computer Science and Engineering
    https://arxiv.org/abs/2407.05205

  • This week's guest is Professor Phillip Dawson, who is Co-Director of the Centre for Research in Assessment and Digital Learning at Deakin University in Australia.

    In addition to Phill's website, we recommend following Phill on LinkedIn, or Twitter, where shares a lot of his work on the future of assessment, and also his passion project - The Peer Revue - where Phill combines his passion for academic research with his work in Improv Comedy. Every month he hosts a research who talks about their professional research, which is then turned into comedy gold by his improv team at The Improv Conspirancy Theatre (highly recommend keeping an eye out for this if you're in Melbourne)

    You can find Phill's research papers here on Google Scholar, and his LinkedIn feed has his books and his contributions to other advice and consultations in the education sector

    Phil mentions a number of researchers and their work in the podcast. Here's the links:

    James Reason's work on the Swiss Cheese model for failure of complex systems "The contribution of latent human failures to the breakdown of complex systems"
    You can either read the original research paper or this easier to grasp Wikipedia article "The Swiss Cheese Mode"

    Kiata Rundle's work on then applying this to academic integrity - you can find all of her papers on Google Scholar

    Alfie Kohn "Punished by Rewards" - https://www.mv.helsinki.fi/home/hotulain/Punished.pdf

    Phill mentioned Deci & Ryan's work, so here's a good place to start reading on Self-Determination Theory

    And here's a starting point if you need it for reading about Vygotsky's Zone of Proximal Development

    Then Phill mentioned the book Thanks for the Feedback, but Stone & Heen, which is on Amazon here

  • Series 9, Episode 9 - Homework and Sex News How do people actually use ChatGPT?

    How do people use ChatGPT? We analyzed real AI chatbot conversations - The Washington Post

    Make AI tools to reduce teacher workloads, tech companies urged

    https://www.theguardian.com/education/article/2024/aug/28/make-ai-tools-to-reduce-teacher-workloads-tech-companies-urged

    New AI in Teams - and it's all free

    https://www.linkedin.com/posts/miketholfsen_ai-edtech-microsoftteams-activity-7236817645625335809-08OC

    https://aka.ms/TeamsEDUAIQuickGuide

    Research Papers Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course

    https://arxiv.org/abs/2407.05216

    Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classrooms

    https://arxiv.org/abs/2406.07571

    Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam

    https://arxiv.org/abs/2406.09671

    Generative AI Can Harm Learning

    https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486

    ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering

    https://www.tandfonline.com/doi/epdf/10.1080/22054952.2024.2372154

    How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence

    https://arxiv.org/abs/2406.14769

    Analyzing Large Language Models for Classroom Discussion Assessment

    https://arxiv.org/abs/2406.08680

    Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics

    https://arxiv.org/abs/2406.11858

    ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

    https://arxiv.org/abs/2406.14765

    70B-parameter large language models in Japanese medical question-answering

    https://arxiv.org/abs/2406.14882

    I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education

    https://arxiv.org/abs/2406.14871

    Large Language Models in Student Assessment: Comparing ChatGPT and Human Graders

    https://arxiv.org/abs/2406.16510

  • This week we hear from Professor Rose Luckin, from University College London and Educate Ventures Research

    In the podcast, Rose mentioned the 1% project in Finland from 2020 - here's some reporting on it

    Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the AI Readiness Online Course for teachers


    Rose also has a monthy newsletter "The Skinny on AI for Education" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education.

  • News TEQSA's new paper on Academic Integrity & AI

    The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action

    https://www.teqsa.gov.au/sites/default/files/2024-08/evolving-risk-to-academic-integrity-posed-by-generative-artificial-intelligence.pdf

    State of Generative AI in the Enterprise: An Australian Perspective

    https://www.deloitte.com/au/en/services/consulting/analysis/state-generative-ai-enterprise.html

    Research A review on the use of large language models as virtual tutors

    https://arxiv.org/abs/2405.11983

    Jill Watson: A Virtual Teaching Assistant powered by ChatGPT

    https://arxiv.org/abs/2405.11070

    An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownership

    https://arxiv.org/abs/2405.13890

    Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teams

    https://arxiv.org/abs/2405.13024

    Large Language Models as Partners in Student Essay Evaluation

    https://arxiv.org/abs/2405.18632

    Grade Like a Human: Rethinking Automated Assessment with Large Language Models

    https://arxiv.org/abs/2405.19694

    Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing

    https://arxiv.org/abs/2405.19691

    Experiences from Integrating Large Language Model Chatbots into the Classroom

    https://arxiv.org/abs/2406.04817

    Delving into ChatGPT usage in academic writing through excess vocabulary

    https://arxiv.org/abs/2406.07016

    Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysis

    https://arxiv.org/abs/2406.06254

  • BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per haps we can share an untold story, or you can tell us yours!

    August

    19 August - Melbourne - Ray

    Melbourne EdTech Summit

    Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities

    21 August - Sydney - Ray - Free event

    The Future of Human AI - IATD

    If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom

    23 August - Sydney - Dan

    AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today

    Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.

    September

    3 September - Online - Dan - Free event

    Build a Bot in Copilot Studio

    Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.

    4 September - Christchurch, NZ - Ray

    NZ Tertiary ICT Conference

    For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!

    12-13 September - Adelaide - Ray

    HE FEST 24

    Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"

    16-19 September - Online - Dan and Ray - Free event

    Toddle's AI for AussieEd online event

    The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording

  • In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices.

    Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn
    AI for Education site: AI for Education
    AI prompt library: Prompt Library
    Webinar archive: AI Webinars for Educators
    Free resources for teachers: Downloadable Resources

    00:00 Guest Introduction: Amanda Bickerstaff
    01:17 Amanda's Background and Journey
    02:53 The Role of AI in Education
    04:56 Challenges and Misconceptions in AI Adoption
    06:05 Building AI Literacy and Addressing Fears
    12:51 The Future of Personalised Learning
    22:13 Exciting Developments and Final Thoughts
    30:29 Conclusion and Closing Remarks

  • Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here:

    News

    California’s proposed law against AI replacing human professors

    https://www.universityworldnews.com/post.php?story=20240702214317879

    Animated AI Teaching Assistants Coming to Morehouse

    https://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/07/09/animated-ai-tas-are-coming-morehouse

    Khanmigo for all!

    https://x.com/khanacademy/status/1813665014911316237

    Sign up for Khanmigo for Teachers in English: blog.khanacademy.org/khanmigo-world

    Open AI
    https://techcrunch.com/2024/08/07/this-week-in-ai-openais-talent-retention-woes/

    Research Papers

    SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS?

    https://library.iated.org/view/BAUME2024SUM

    Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you don’t have access, I'd suggest asking the author, Matthias Baume from TUM, if he's happy to share a copy

    The great detectives: humans versus AI detectors in catching large language model-generated medical writing

    https://edintegrity.biomedcentral.com/articles/10.1007/s40979-024-00155-6

    Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University

    Dino Samartzis, Rush University Medical Center

    Leveraging Large Language Model as Simulated Patients for Clinical Education

    https://arxiv.org/abs/2404.13066

    Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1∗ 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co.

    Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT

    https://arxiv.org/abs/2404.15310

    "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses

    https://arxiv.org/abs/2404.17443

    Bruno Pereira Cipriano and Pedro Alves

    Lusofona University, COPELABS, Lisbon, Portugal

    Math Multiple Choice Question Generation via Human-Large Language Model Collaboration

    https://arxiv.org/abs/2405.00864

    Jaewook Lee, Andrew Lan - University of Massachusetts Amherst

    Digory Smith, Simon Woodhead - Eedi

    ChatGPT in Data Visualization Education: A Student Perspective

    https://arxiv.org/abs/2405.00748

    Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA

    A Careful Examination of Large Language Model Performance on Grade School Arithmetic

    https://arxiv.org/abs/2405.00332

    Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Models

    https://arxiv.org/abs/2404.19713

    Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre

    Outsmarting Artificial Intelligence in the Classroom—Incorporating Large Language Model-Based Chatbots into Teaching

    https://publications.aaahq.org/iae/article/doi/10.2308/ISSUES-2023-064/12560

    Juliane Wutzler, Worms University of Applied Sciences

    University Students’ Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysis

    https://www.sciencedirect.com/science/article/pii/S2666920X24000468

    Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage

  • This episode of the AI in Education podcast features an interview with Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College in Sydney.

    Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students.

    Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback.

    When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages.

    Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are:

    EduTech Expo, in Melbourne on 14th August
    The Educator to Entrepreneur pipeline: Making your idea a solution The AI in Education Conference, at Western Sydney University on 23rd August
    AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today
  • In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.

    Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.

    Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here

    Some of the resources that the team talked about in the episode are below:

    NSWEduChat landing page: NSWEduChat

    NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)

    NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)

    Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.

    Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.

    Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.

    Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.

    Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.

    Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book

    NSW DoE Future Frontiers landing page: Education for a Changing World

  • From AI Detectors to Heartwarming Help: Two Tales of AI in a school

    Series 8 Episode 11

    In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's school—one highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education.

    00:00 Introduction

    02:32 Martin's Background and School

    03:50 AI in Education: Martin's Journey

    05:59 Challenges with AI Detectors

    09:23 Emotional Impact on Students

    11:45 Reflections on AI in Assessment

    We discussed two assessment topics that have been in previous episodes:

    Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2 The AI Assessment Scale research - in Series 8 Episode 7

    22:34 Heartwarming Story: AI Robot for Student

    There's more reporting on this story on the BBC website

    27:10 Conclusion and Final Thoughts

  • Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week NEWS Victorian "Generative Artificial Intelligence Policy" for government schools.

    https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy

    Meeting the AI Skills Boom

    https://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf

    LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made it

    https://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver

    A class above: UNSW Sydney uses AI to power personalised paths to student success

    https://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/

    Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers?

    https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23

    GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education

    https://arxiv.org/abs/2403.19148

    Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concerns

    https://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414

    Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Framework

    https://osf.io/preprints/edarxiv/adxuq

    How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

    https://arxiv.org/pdf/2405.00970

    AI Conversational Agent Design for Supporting Learning and Well-Being of University Students

    https://osf.io/preprints/edarxiv/w4rtf

    The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities

    https://osf.io/preprints/edarxiv/y52ew

    The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances

    https://osf.io/preprints/osf/qy8zd

    The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Work

    https://osf.io/preprints/edarxiv/x3dct

    Is ChatGPT Transforming Academics' Writing Style?

    https://arxiv.org/abs/2404.08627

    Can AI Provide Useful Holistic Essay Scoring?

    https://osf.io/preprints/osf/7xpre

    Read the excellent article about this paper in the Heching Report

    Best Practices for Using AI When Writing Scientific Manuscripts

    https://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544

    A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study

    https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354

  • Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview Dan Ingvarson, a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload. 00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts