sheen.bot logo

← Industry News

Educators Propose Grading Student-AI Dialogue and Using AI to Train Teacher Observation

Nov 18, 2026·Sheen Robotics
Educators Propose Grading Student-AI Dialogue and Using AI to Train Teacher Observation
Image: EdSurge

Researchers and educators are exploring new models that assess students' conversational reasoning with AI tutors and use machine learning to speed up feedback on teacher noticing skills.

To prevent learners from treating artificial intelligence solely as a shortcut for answers, Mike Kentz of AI Friction Labs is advocating for teachers to assess students' dialogue with AI rather than just their final submissions. Highlighting a study in which middle schoolers offered an inquiry-based AI math tutor rarely used it, Kentz developed a framework to grade the chat itself. His method caps interactions at around ten exchanges to keep grading manageable, involves learners in establishing criteria by comparing strong and weak chats, incorporates pre- and post-reflections, and prompts students to teach concepts such as tangent lines to a confused AI classmate.

Concurrently, researchers are testing whether AI can accelerate feedback for educators. At Rowan University, Molly Fisher is leading research into 'professional noticing'—the practice of observing student actions, interpreting their underlying comprehension, and determining pedagogical next steps. Starting in spring 2027, Fisher's team plans to train AI models on human-scored teacher responses to classroom video footage, aiming to return observational feedback reports to educators within a single day. Fisher stresses that teachers must remain skeptical of model outputs and exercise caution regarding the student data they upload.

These initiatives signal a shift in ed-tech away from treating AI purely as an answer engine and toward capturing the reasoning process itself. Evaluating chat histories treats prompt design and iterative inquiry as core analytical competencies, paralleling the early days of composition studies before standards for grading essays were formalised.

Source: EdSurge

#artificial intelligence#assessment#edtech#teacher training#pedagogy

More Industry News