Activity Bank
Two coaches and a principal sort strips about AI in classroom observations and write guardrails on sticky notes.

All activities Professional learning

Two Drafts of Feedback

Coaches score a human-written and an AI-drafted feedback note on the same lesson transcript, then set the ground rules for when AI belongs in observation, if it belongs at all.

Print handouts

Overview

Generative AI can turn a lesson transcript into a tidy feedback note in seconds, and some coaching platforms now offer to do it automatically. Coaches in this session read a short fictional transcript, score two unlabeled feedback drafts against a quality checklist, and guess which one a chatbot wrote. The reveal sets up the harder conversation: consent, student privacy, transparency with the teacher, and the line between an AI draft and a coach's judgment.

Objectives

  • Participants will score feedback against criteria (specific, evidence-based, tied to the teacher's goal, one actionable next step) rather than by how polished it sounds.
  • Participants will identify at least one claim in AI-drafted feedback that the transcript does not support.
  • Participants will sort observation-related AI uses by the consent, privacy, and transparency conditions each requires and draft a disclosure statement for teachers.

Materials

On paper

  • Handout A: Lesson Transcript and Two Feedback Drafts (1 per person)
  • Handout B: Feedback Quality Checklist (2 per person, one per draft)
  • Handout C: AI in Observation Sort (1 set per table, cut apart), plus a sorting mat
  • Highlighters in two colors

On screen

  • Facilitator device and projector
  • Optional: a generative AI chatbot your district approves, used only by the facilitator on the projector with the fictional transcript

Before you start

  1. Print Handout A double-sided so the transcript and both drafts stay together.
  2. Cut Handout C into strips and clip one set per table with a mat showing the three category headings.
  3. If you plan the live demo, test your prompt on the fictional transcript first and save the output in case the network fails. Never demo with a real teacher's or student's data.

Step by step

  1. 10–4 min

    Hook

    Which one did a person write?

    Project the first two sentences of Draft X and Draft Y side by side. Ask everyone to vote with a hand: "Which draft came from a chatbot?" Don't reveal. Say: "Hold that guess. By the end, you'll see why the more important question is not who wrote it, but whether it's true and useful to this teacher."

    Facilitator noteRooms usually split or lean toward the more polished draft as the human one. Either way, the guess isn't the learning.

  2. 24–16 min

    Explore

    Read the lesson, then score both drafts

    Everyone reads the transcript on Handout A and highlights, in one color, every moment where a student explains their thinking. Then pairs score Draft X and Draft Y separately with Handout B. For every "Yes," they must point to a line in the transcript that proves it. Pairs write their guess about authorship at the bottom of each checklist.

    Facilitator noteLook-for: pairs who go back to the transcript to check a claim in the feedback. That is the same verification habit we want teachers to teach with AI outputs.

  3. 316–24 min

    Model

    The reveal and the trace

    Reveal that Draft Y was AI-drafted from the transcript and the teacher's goal. Model tracing its claims out loud: "It praises the turn-and-talk at the start. Let me find it. There is no turn-and-talk in the transcript." Then trace Draft X the same way and name its flaw too: specific and accurate, but it offers three next steps when a teacher can act on one. Ask: "Which draft would help Mr. Delgado more on Monday, and what would you change in each?"

    Facilitator noteDon't let this become "AI bad, human good." Draft Y also caught the short wait time, which is real. The point is that the coach owns every sentence the teacher reads.

  4. 424–36 min

    Practice

    Sort the uses: consent, privacy, transparency

    Tables sort the Handout C strips onto three categories: Reasonable with consent and disclosure, Only with added guardrails, and Don't do it. For every strip in the middle column, the table must name the guardrail on a sticky note (for example, "remove student names first" or "teacher sees the AI draft and the coach's edits"). Then tables compare with the facilitator key.

    Facilitator noteExpect debate on recording video for AI analysis. Surface who has to consent: the teacher, and, when students can be heard or seen, the district's policy on student recordings and families. When in doubt, it belongs in the middle or right column.

  5. 536–45 min

    Apply

    Write the feedback Mr. Delgado deserves

    Pairs write a new three-sentence note: one specific strength with evidence, one observation tied to his goal, and one next step. Digital path: the facilitator projects an approved chatbot, pastes the fictional transcript, and asks for a draft; pairs then mark which sentences they would keep, fix, or delete and why. Unplugged path: pairs revise Draft Y by hand into something they would sign.

    Facilitator noteAsk a pair or two to read their note aloud. Listen for whether the next step is something he can try in one lesson.

  6. 645–50 min

    Reflect

    Our disclosure sentence

    Each person finishes this on the back of Handout B: "When I use AI in my coaching, I will tell teachers…" Invite three people to share. Close with the coaching question: "If you used AI to draft feedback, what would change in teacher practice that wouldn't have changed otherwise?"

    Facilitator noteStrong disclosure sentences name what data goes in, who sees the draft, and who makes the final call.

Paper or screen

Unplugged

Run the whole session on paper: the transcript, both drafts, the checklist, and the sort carry every step. In the Apply step, pairs revise Draft Y by hand instead of watching a live AI draft. Revising a machine draft on paper makes the coach's editorial judgment very visible.

Digital

Project the transcript and the drafts, and put the checklist in a shared form so you can show the room's scores for each draft live. For the Apply step, the facilitator runs an approved chatbot on the projector with the fictional transcript only. In a virtual session, run the sort as a drag-and-drop board with three columns.

Does it need a screen? The live AI draft shows coaches how fast and how confident the output is, including invented details, which is exactly what they need to see before any platform offers to automate it. The paper path teaches the scoring and ethics equally well.

Evidence of learning

What you should be able to see or collect if it worked.

  • Every "Yes" on Handout B is backed by a specific transcript line, and pairs flag Draft Y's invented turn-and-talk.
  • Middle-column strips on the sort each carry a named guardrail, not just "be careful."
  • Revised feedback notes contain one next step tied to Mr. Delgado's stated goal.
  • Disclosure sentences name what data goes into the tool and who makes the final decision.

Adaptations

Campus leaders
Add a strip on using AI summaries in formal appraisal and discuss why coaching feedback and evaluation records need different rules.
Higher Ed
Use the same structure for peer observation of teaching. Add a strip on sending lecture recordings with student voices to an external AI service.
Teacher PLCs
Teachers score the drafts as the recipient: "Which would I want to receive?" Then write what they would want a coach to disclose.

Standards connections

Coaches trace AI-drafted feedback against a transcript and sort observation AI uses by consent and privacy, modeling data protection students also learn.

UDL 3.0
8.18.38.5

See how all activities align

Reflect

  • How effectively am I supporting teachers in improving their instructional practices? (Coach ELE guiding question)
  • What would a teacher need to know before trusting feedback I drafted with AI?
  • Where in my observation process could student data end up in a tool it shouldn't?

Take it to your students

Before your next observation, share your disclosure sentence with the teacher and agree on whether any AI tool will touch the notes. After the debrief, ask the teacher which single sentence of your feedback they acted on.

Pairs well with