Afleveringen
-
This week we hear from Professor Rose Luckin, from University College London and Educate Ventures Research
In the podcast, Rose mentioned the 1% project in Finland from 2020 - here's some reporting on it
Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the AI Readiness Online Course for teachers
Rose also has a monthy newsletter "The Skinny on AI for Education" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education. -
News TEQSA's new paper on Academic Integrity & AI
The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action
https://www.teqsa.gov.au/sites/default/files/2024-08/evolving-risk-to-academic-integrity-posed-by-generative-artificial-intelligence.pdf
State of Generative AI in the Enterprise: An Australian Perspectivehttps://www.deloitte.com/au/en/services/consulting/analysis/state-generative-ai-enterprise.html
Research A review on the use of large language models as virtual tutorshttps://arxiv.org/abs/2405.11983
Jill Watson: A Virtual Teaching Assistant powered by ChatGPThttps://arxiv.org/abs/2405.11070
An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownershiphttps://arxiv.org/abs/2405.13890
Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teamshttps://arxiv.org/abs/2405.13024
Large Language Models as Partners in Student Essay Evaluationhttps://arxiv.org/abs/2405.18632
Grade Like a Human: Rethinking Automated Assessment with Large Language Modelshttps://arxiv.org/abs/2405.19694
Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writinghttps://arxiv.org/abs/2405.19691
Experiences from Integrating Large Language Model Chatbots into the Classroomhttps://arxiv.org/abs/2406.04817
Delving into ChatGPT usage in academic writing through excess vocabularyhttps://arxiv.org/abs/2406.07016
Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysishttps://arxiv.org/abs/2406.06254
-
Zijn er afleveringen die ontbreken?
-
BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per haps we can share an untold story, or you can tell us yours!
August
19 August - Melbourne - Ray
Melbourne EdTech Summit
Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities
21 August - Sydney - Ray - Free event
The Future of Human AI - IATD
If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom
23 August - Sydney - Dan
AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today
Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.
September
3 September - Online - Dan - Free event
Build a Bot in Copilot Studio
Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.
4 September - Christchurch, NZ - Ray
NZ Tertiary ICT Conference
For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!
12-13 September - Adelaide - Ray
HE FEST 24
Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"
16-19 September - Online - Dan and Ray - Free event
Toddle's AI for AussieEd online event
The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording
-
In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices.
Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn
AI for Education site: AI for Education
AI prompt library: Prompt Library
Webinar archive: AI Webinars for Educators
Free resources for teachers: Downloadable Resources00:00 Guest Introduction: Amanda Bickerstaff
01:17 Amanda's Background and Journey
02:53 The Role of AI in Education
04:56 Challenges and Misconceptions in AI Adoption
06:05 Building AI Literacy and Addressing Fears
12:51 The Future of Personalised Learning
22:13 Exciting Developments and Final Thoughts
30:29 Conclusion and Closing Remarks -
Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here:
News
Californiaâs proposed law against AI replacing human professorshttps://www.universityworldnews.com/post.php?story=20240702214317879
Animated AI Teaching Assistants Coming to Morehousehttps://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/07/09/animated-ai-tas-are-coming-morehouse
Khanmigo for all!https://x.com/khanacademy/status/1813665014911316237
Sign up for Khanmigo for Teachers in English: blog.khanacademy.org/khanmigo-world
Open AI
https://techcrunch.com/2024/08/07/this-week-in-ai-openais-talent-retention-woes/Research Papers
SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS?https://library.iated.org/view/BAUME2024SUM
Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you donât have access, I'd suggest asking the author, Matthias Baume from TUM, if he's happy to share a copy
The great detectives: humans versus AI detectors in catching large language model-generated medical writinghttps://edintegrity.biomedcentral.com/articles/10.1007/s40979-024-00155-6
Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University
Dino Samartzis, Rush University Medical Center
Leveraging Large Language Model as Simulated Patients for Clinical Educationhttps://arxiv.org/abs/2404.13066
Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1â 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co.
Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPThttps://arxiv.org/abs/2404.15310
"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courseshttps://arxiv.org/abs/2404.17443
Bruno Pereira Cipriano and Pedro Alves
Lusofona University, COPELABS, Lisbon, Portugal
Math Multiple Choice Question Generation via Human-Large Language Model Collaborationhttps://arxiv.org/abs/2405.00864
Jaewook Lee, Andrew Lan - University of Massachusetts Amherst
Digory Smith, Simon Woodhead - Eedi
ChatGPT in Data Visualization Education: A Student Perspectivehttps://arxiv.org/abs/2405.00748
Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA
A Careful Examination of Large Language Model Performance on Grade School Arithmetichttps://arxiv.org/abs/2405.00332
Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Modelshttps://arxiv.org/abs/2404.19713
Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre
Outsmarting Artificial Intelligence in the ClassroomâIncorporating Large Language Model-Based Chatbots into Teachinghttps://publications.aaahq.org/iae/article/doi/10.2308/ISSUES-2023-064/12560
Juliane Wutzler, Worms University of Applied Sciences
University Studentsâ Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysishttps://www.sciencedirect.com/science/article/pii/S2666920X24000468
Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage
-
This episode of the AI in Education podcast features an interview with Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College in Sydney.
Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students.
Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback.
When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages.
Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are:
EduTech Expo, in Melbourne on 14th August
The Educator to Entrepreneur pipeline: Making your idea a solution The AI in Education Conference, at Western Sydney University on 23rd August
AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today -
In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.
Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.
Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here
Some of the resources that the team talked about in the episode are below:
NSWEduChat landing page: NSWEduChat
NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)
NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)
Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.
Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.
Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.
Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.
Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.
Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book
NSW DoE Future Frontiers landing page: Education for a Changing World
-
From AI Detectors to Heartwarming Help: Two Tales of AI in a school
Series 8 Episode 11
In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's schoolâone highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education.
00:00 Introduction
02:32 Martin's Background and School
03:50 AI in Education: Martin's Journey
05:59 Challenges with AI Detectors
09:23 Emotional Impact on Students
11:45 Reflections on AI in Assessment
We discussed two assessment topics that have been in previous episodes:
Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2 The AI Assessment Scale research - in Series 8 Episode 722:34 Heartwarming Story: AI Robot for Student
There's more reporting on this story on the BBC website
27:10 Conclusion and Final Thoughts
-
Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week NEWS Victorian "Generative Artificial Intelligence Policy" for government schools.
https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy
Meeting the AI Skills Boomhttps://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf
LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made ithttps://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver
A class above: UNSW Sydney uses AI to power personalised paths to student successhttps://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/
Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers?https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23
GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Educationhttps://arxiv.org/abs/2403.19148
Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concernshttps://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414
Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Frameworkhttps://osf.io/preprints/edarxiv/adxuq
How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responseshttps://arxiv.org/pdf/2405.00970
AI Conversational Agent Design for Supporting Learning and Well-Being of University Studentshttps://osf.io/preprints/edarxiv/w4rtf
The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilitieshttps://osf.io/preprints/edarxiv/y52ew
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performanceshttps://osf.io/preprints/osf/qy8zd
The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Workhttps://osf.io/preprints/edarxiv/x3dct
Is ChatGPT Transforming Academics' Writing Style?https://arxiv.org/abs/2404.08627
Can AI Provide Useful Holistic Essay Scoring?https://osf.io/preprints/osf/7xpre
Read the excellent article about this paper in the Heching Report
Best Practices for Using AI When Writing Scientific Manuscriptshttps://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544
A real-world test of artificial intelligence infiltration of a university examinations system: A âTuring Testâ case studyhttps://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354
-
Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview Dan Ingvarson, a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload. 00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts
-
Content warning! This episode talks about an academic research paper titled "ChatGPT is bulls**t", and we've not edited the word out - in fact, we've gone to town with it, talking about the different types of it (in the strictest academic sense). So you may not want to play this in the car on your school run!
The news item discussed is:
Student crafts elaborate AI scheme to pass university exam, gets arrestedhttps://cybernews.com/news/turkish-student-found-using-ai-arrested/
This week's papers discussed are:
Developing evaluative judgement for a time of generative artificial intelligencehttps://www.tandfonline.com/doi/full/10.1080/02602938.2024.2335321
Prompting Large Language Models for Zero-shot Essay Scoring via Multi-trait Specializationhttps://arxiv.org/abs/2404.04941
Working Alongside, Not Against, AI Writing Tools in the Composition Classroom: a Dialectical Retrospectivehttps://uen.pressbooks.pub/teachingandgenerativeai/chapter/working-alongside-not-against-ai-writing-tools-in-the-composition-classroom-a-dialectical-retrospective/
GPT versus Resident Physicians â A Benchmark Based on Official Board Scoreshttps://ai.nejm.org/doi/pdf/10.1056/AIdbp2300192
Evaluating General Vision-Language Models for Clinical Medicinehttps://www.medrxiv.org/content/10.1101/2024.04.12.24305744v1
Re-evaluating GPT-4âs bar exam performancehttps://link.springer.com/article/10.1007/s10506-024-09396-9
Automated Social Science: Language Models as Scientist and Subjects
https://arxiv.org/abs/2404.11794
Large language models cannot replace human participants because they cannot portray identity groups
https://arxiv.org/abs/2402.01908
I also mentioned the article about the the Infinite Focus Group, which is here:
https://www.ai-mindset.ai/ai-mindset-newsletter/the-infinite-focus-group
The impact of large language models on university studentsâ literacy developmenthttps://www.tandfonline.com/doi/epdf/10.1080/07294360.2024.2332259?needAccess=true
Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essayshttps://www.sciencedirect.com/science/article/pii/S2666920X24000109
Feedback sources in essay writing: peer-generated or AI-generated feedback?https://link.springer.com/article/10.1186/s41239-024-00455-4
ChatGPT is bullshithttps://link.springer.com/epdf/10.1007/s10676-024-09775-5?sharing_token=0CIhP_zo5-plierRq8kkDPe4RwlQNchNByi7wbcMAY77xTOWyddkW01qGFs1m5zuuoZGBctVlsJF8SbYqcxWi-XzgEYEPiw7xwWi4bMYXJ_1JARDrER9JGdWZOW-UGSkrk_tXPjPh-XWvFNoiFzNlnDUUUEBAztiX9PtP2p6jfI%3D
-
Wow, this week we have a bumper episode with more resources than a GPT factory! Any time we get a guest making their second appearance, and therefore enter our Hall of Fame, then we officially dub them "Friend of the Show". And so this week, we've got Friend of the Show Leon Furze sharing his experiences and expertise.
Here are the links and posts related to our conversation with Leon around assessment.
Leon's blog - for all the updates and posts that he is working on https://leonfurze.com/blog
Leons's free e-Book on assessment can be found here: https://mailchi.mp/leonfurze/assessment (free ebook on assessment)
Leon Furze Linkedin profile is here if you want to follow his stream of thoughts, and to connect with him: Leon Furze - Furze Smith Consulting | LinkedIn
The Artificial Intelligence Assessment Scale (AIAS) paper we discussed can be found here: https://open-publishing.org/journals/index.php/jutlp/article/view/810
The online course around practical AI strategies:
https://practicalaistrategies.com/p/practical-ai-strategies
And, even better, he's given listeners a discount code that will save you 25% of the cost. Just use the magic word 'AIPODCAST'
The blog post we mentioned a couple of times during the episode:
https://leonfurze.com/2024/05/27/dont-use-genai-to-grade-student-work/
Leons new book and course can be also found on his main site here:
https://practicalaistrategies.com/
-
This week we set the episode timer for 15 minutes, and managed to get through just five papers before the buzzer went off! So we have plenty more papers to discuss in future episodes...
ENHANCING K-12 STUDENTSâ PERFORMANCE IN CHEMISTRY THROUGH CHATGPT-POWERED BLENDED LEARNING IN THE EDUCATION 4.0 ERAhttps://library.iated.org/view/ORTIZDEZARATE2024ENH
Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot studyhttps://bera-journals.onlinelibrary.wiley.com/doi/pdfdirect/10.1111/bjet.13454
ChatGPT âcontaminationâ: estimating the prevalence of LLMs in the scholarly literaturehttps://arxiv.org/abs/2403.16887
Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewshttps://arxiv.org/abs/2403.07183
Large language models are able to downplay their cognitive abilities to fit the persona they simulatehttps://journals.plos.org/plosone/article?id=10.1371/journal.pone.0298522
-
Assessment - Chris Goodall
In this episode of the AI Education Podcast, host Dan converses with Chris Goodall, the head of digital education at the Bourne Education Trust in England. They discuss the integration of AI into education, how it can be used to enhance teaching and learning processes, and the impact of personalized AI tools on students and educators.
The conversation covers practical applications of AI, the ongoing need for teacher and student adaptation to new technologies, as well as ethical considerations and future possibilities for AI in education.
Chris Goodalls Linkedin profile here: Chris Goodall | LinkedIn
Practical Advice for embedding IT in school: Embedding AI use in school
-
Research Update - 31st May 2024
Honestly folks, we've been trying to keep. We really have. But we have so much great content in the fortnightly (or is it bi-weekly?) interviews, that we've had to bite the bullet and switch to weekly podcasts, so that we can still fit in the Research Updates!
Going forwards you'll get a longer interview-style podcast once every two weeks, and a shorter 15-20 minute "Research Update" podcast every two weeks. Filling your Fridays with AI in Education podcast joy!
Here's the links to all the research papers discussed this week:
Remote Proctoring: Understanding the Debatehttps://link.springer.com/referenceworkentry/10.1007/978-3-031-54144-5_150#DOI
Large language model-powered chatbots for internationalizing student support in higher educationhttps://arxiv.org/abs/2403.14702
ChatGPT in Veterinary Medicine: A Practical Guidance of Generative Artificial Intelligence in Clinics, Education, and Researchhttps://arxiv.org/abs/2403.14654
Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalographyhttps://arxiv.org/abs/2403.16687
An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Projecthttps://arxiv.org/abs/2403.18679
An MIT Exploration of Generative AIhttps://mit-genai.pubpub.org/
MIT - Massachusetts Institute of Technology - have just published a series of really interesting papers about the impact of generative AI on a number of industries, and dive into the implications for society, education, human interaction and other areas. I actually think the whole set are interesting - and they're really easy to get - you can read them on the web, or get a PDF, an ebook, or even an audio book of every one!
We talked about the 3 education ones:
When Disruptive Innovations Drive Educational Transformation: Literacy, Pocket Calculator, Google Translate, ChatGPThttps://mit-genai.pubpub.org/pub/6chtnd56/release/3?readingCollection=0e231e9c
Generative AI and K-12 Education: An MIT Perspectivehttps://mit-genai.pubpub.org/pub/4k9msp17/release/1?readingCollection=0e231e9c
Generative AI and Creative Learning: Concerns, Opportunities, and Choiceshttps://mit-genai.pubpub.org/pub/gj6eod3e/release/2?readingCollection=0e231e9c
-
This week we continue our series on Assessment and AI. Ray talks with Jason Lodge from The University of Queensland, and who must have the longest business card in Australia, as he's Associate Professor of Educational Psychology in School of Education and Deputy Associate Dean in the Faculty of Humanities, Arts and Social Sciences!
The conversation talks about the challenges of assessment, and the options for rethinking assessment - and then we go deeper into Jason's views on the future of learning and assessment.
Jason's a great guest to share his experiences, as during 2023 he was on the TEQSA group of experts that came together to produce a report on assessment for Australian universities, Assessment reform for the age of artificial intelligence
https://www.teqsa.gov.au/guides-resources/resources/corporate-publications/assessment-reform-age-artificial-intelligence
Working on policy and guidance in an area where technology is developing so rapidly - and students are racing ahead of institutions, was interesting and Jason talks about the group dynamic. One of the interesting notes he talks about is the mindset: "The mantra we kept returning to is that we weren't trying to develop a map, but a compass. This is the direction we think we might need to head here."
-
AI and the Future of Assessment: Transforming Educational Practices
Episode Overview: In this episode of the AI Education Podcast, hosts Dan and Ray, alongside guests Adam Bridgman and Danny Liu, dive into the evolving landscape of academic assessment in the age of artificial intelligence. Recorded in the University of Sydney's own studios, this discussion explores the significant shifts in assessment strategies and the integration of AI in educational settings.
Guest Introductions:
Professor Adam Bridgeman: Pro Vice Chancellor Educational Innovation at the University of Sydney - focused on enhancing teaching quality across the university. [University bio] Professor Danny Liu: Professor of Educational Technologies - dedicated to empowering educators to improve their teaching methods through innovative technologies. [University page - LinkedIn page]Key Topics Discussed:
The Persistence of Traditional Assessment Models: Despite the push to digital platforms during the COVID-19 pandemic, traditional assessment methods have largely remained unchanged, continuing the practice of replicating physical exam environments online. AI's Role in Rethinking Assessment: The guests discuss how AI challenges the conventional reasons for assessments, advocating for a paradigm shift towards assessments that truly measure student understanding and application of knowledge. Two-Lane Assessment Approach: Adam introduces a dual-lane strategy for assessment: Lane One: Ensures the rigorous verification of student competencies necessary in professional fields. Lane Two: Uses AI to foster skill development in using technology effectively, moving beyond traditional assessment forms to embrace innovative educational practices. Implementation Challenges and Solutions: The transition to new assessment models is recognised as a gradual process, needing careful planning and support for educators in rethinking their assessment strategies. Inclusivity and Access to Technology: Ensuring equitable access to AI tools for all students is highlighted as a critical aspect of the evolving educational landscape, emphasizing the need to support diverse student backgrounds and technological proficiencies. Future Outlook: The discussion concludes with reflections on the potential long-term impacts of AI on educational practices, the necessity of ongoing adaptation by educational institutions, and the importance of preparing students for a future where AI is seamlessly integrated into professional and everyday contexts.Further Reading:
We recommend these three articles from the team, that give more detail on the topics discussed
Where are we with generative AI as semester 1 starts?
What to do about assessments if we canât out-design or out-run AI?
Embracing the future of assessment at the University of Sydney -
It's time to start a new series, so welcome to Series 8!
This episode is the warm up into the series that's going to be focused on Assessment. We'll interview some fascinating people about what's happening in school and university assessment, how we might think differently about assessing students, and what you can be thinking about if you're a teacher.
There's no shownotes, links or anything else for your homework for this episode - just listen and enjoy!
Dan and Ray
-
The season-ending episode for Series 7, this is the fifteenth in the series that started on 1st November last year with the "Regeneration: Human Centred Educational AI" episode. And it's an unbelievable 87th episode for the podcast (which started in September 2019).
When we come back with Series 8 after a short break for Easter, we're going to take a deeper dive into two specific use cases for AI in Education. The first we'll discuss is Assessment, where there's both a threat and opportunity created by AI. And the second topic is AI Tutors, where there's more of a focus on how we can take advantage of the technology to help improve support for learning for students.
This episode looks at one key news announcement - the EU AI Act - and a dozen new research papers on AI in education.
News
EU AI Act
https://www.europarl.europa.eu/news/en/press-room/20240308IPR19015/artificial-intelligence-act-meps-adopt-landmark-law
The European Parliament approved the AI Act on 13 March and there's some stuff in here that would make good practice guidance. And if you're developing AI solutions for education, and there's a chance that one of your customers or users might be in the EU, then you're going to need to follow these laws (just like GDPR is an EU law, but effectively applies globally if you're actively offering a service to EU residents).
The Act bans some uses of AI that threaten citizen's rights - such as social scoring and biometric identification at mass level (things like untargeted facial scanning of CCTV or internet content, emotion recognition in the workplace or schools, and AI built to manipulate human behaviour) - and for the rest it relies on regulation according to categories.
High Risk AI systems have to be assessed before being deployed and throughout their lifecycle.
In the High Risk AI category it includes critical infrastructure (like transport and energy), product safety, law enforcement, justice and democratic processes, employment decision making - and Education. So decision making using AI in education needs to do full risk assessments, maintain usage logs, be transparent and accurate - and ensure human oversight. Examples of decision making that would be covered would be things like exam scoring, student recruitment screening, or behaviour management.General generative AI - like chatgpt or co-pilots - will not be classified as high risk, but they'll still have obligations under the Act to do things like clear labelling for AI generated image, audio and video content ; make sure there's it can't generate illegal content, and also disclose what copyright data was used for training.
But, although general AI may not be classified as high risk, if you then use that to build a high risk system - like an automated exam marker for end-of-school exams, then this will be covered under the high risk category.All of this is likely to become law by the middle of the year, and by the end of 2024 prohibited AI systems will be banned - and by mid-2025 the rules will start applying for other AI systems.
Research
Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges
Another huge month. I spent the weekend reviewing a list of 350 new papers published in the first two weeks of March, on Large Language Models, ChatGPT etc, to find the ones that are really interesting for the podcastarXiv:2401.08664
A Study on Large Language Models' Limitations in Multiple-Choice Question AnsweringarXiv:2401.07955
Dissecting Bias of ChatGPT in College Major RecommendationsarXiv:2401.11699
Evaluating Large Language Models in Analysing Classroom DialoguearXiv:2402.02380
The Future of AI in Education: 13 Things We Can Do to Minimize the Damagehttps://osf.io/preprints/edarxiv/372vr
Scaling the Authoring of AutoTutors with Large Language Modelshttps://arxiv.org/abs/2402.09216
Role-Playing Simulation Games using ChatGPThttps://arxiv.org/abs/2402.09161
Economic and Financial Learning with Artificial Intelligence: A Mixed-Methods Study on ChatGPThttps://arxiv.org/abs/2402.15278
A Study on the Vulnerability of Test Questions against ChatGPT-based Cheatinghttps://arxiv.org/abs/2402.14881
Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPThttps://meridian.allenpress.com/atej/article/19/1/42/498456
Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPThttps://meridian.allenpress.com/atej/article/19/1/42/498456
RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Educationhttps://arxiv.org/abs/2403.08272
Comparison of the problem-solving performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Korean emergency medicine board examination question bankhttps://journals.lww.com/md-journal/fulltext/2024/03010/comparison_of_the_problem_solving_performance_of.48.aspx?context=latestarticles
Comparing the quality of human and ChatGPT feedback of studentsâ writinghttps://www.sciencedirect.com/science/article/pii/S0959475224000215
-
This week we talked with Professor Danny Liu and Dr Joanne Hinitt, of The University of Sydney, about the Cogniti AI service that's been created in the university, and how it's being used to support teaching and learning.
Danny is a molecular biologist by training, programmer by night, researcher and academic developer by day, and educator at heart. He works at the confluence of educational technology, student engagement, artificial intelligence, learning analytics, pedagogical research, organisational leadership, and professional development. He is currently a Professor in the Educational Innovation team in the DVC (Education) Portfolio at the University of Sydney.
Here's Danny's academic profile. If you want to follow Danny's future work you can find him on LinkedIn and TwitterJoanne is a Lecturer in Occupational Therapy, and her primary area of interest is working with children and their families who experience difficulties participating in occupations related to going to school. She has extensive clinical experience working within occupational therapy settings, providing services for children and their families. Her particular interest is working collaboratively with teachers in the school setting and she completed her PhD in this area.
Here's Joanne's academic profileFurther reading on the topics discussed in the podcast
Cogniti's website is at https://cogniti.ai/
Articles about the topics discussed:
How Sydney educators are building âAI doublesâ of themselves to help their students, Dec 2023
AI as an authentic and engaging teaching tool for occupational therapy students, Oct 2023
Meet âMrs Sâ: a classroom teacher who helps budding occupational therapists hone their skills, Oct 2023
Recorded talks
Using Cogniti to design for Diversity, Feb 2023
- Laat meer zien
