Seminar on a Machine's Answer Handouts

Handouts for Seminar on a Machine's Answer

3 handouts plus a facilitator key on the last page, and an optional cover page with the overview and ELE indicators. Prints on US Letter; choose “Fit to page” off and margins “Default.” Print the key separately if the room shouldn't see it.

Include a cover page Leave out the facilitator key

Teachers in a fishbowl seminar discuss a printed chatbot answer while a colleague outside the circle tallies their questions.

Professional learning · Teachers, Librarians · 45 minutes

Seminar on a Machine's Answer

A fishbowl Socratic seminar where the "text" is a chatbot's confident, partly wrong answer, and the chatbot's second answer is worse, so teachers practice the questions that make students think instead of accept.

A Socratic seminar usually centers on a rich text: a poem, a primary source, a court opinion. What happens when the text is an AI chatbot's answer? This session uses a mock transcript in which a chatbot explains why Earth has seasons. It gets the main idea right, slips in a common misconception, and then, when the student pushes back with a wrong idea, apologizes and agrees. Teachers run the seminar as students, track which questions deepen the thinking, and then design a seminar around an AI output in their own subject.

In this packet

Handout A: The Seasons Transcript (reading)
Handout B: Question Stem Cards (cut-apart cards)
Handout C: Design Your Own AI-Text Seminar (worksheet)
Facilitator key (last page)

TCEA ELE indicators

T5.2 I can use questioning techniques to stimulate deep learning.
AI4.1 I know how to promote critical thinking skills in relation to AI-generated information.
AI4.2 I can teach others to question and verify AI outputs.
T5.1 I know how to design lessons that promote higher-order thinking skills.

Full facilitator guide: mglearn.github.io/eles/activities/seminar-on-a-machines-answer.html

Handout A for Seminar on a Machine's Answer

The Seasons Transcript

A fictional seventh grader asked a generative AI chatbot for help. Mark each sentence of the chatbot's answers: ✓ I'd bet on it · ? I'd need to check · ! surprising.

1Student: Why does Earth have seasons? I need to explain it for science tomorrow.

2Chatbot: Great question! Earth has seasons mainly because its axis is tilted about 23.5 degrees. As Earth travels around the Sun during the year, the axis keeps pointing in the same direction in space. For part of the year, the Northern Hemisphere leans toward the Sun. Sunlight hits it more directly and the days are longer, so it's summer.

3Six months later, the Northern Hemisphere leans away from the Sun. Sunlight hits at a lower angle and the days are shorter, so it's winter. Another reason summer is hotter is that Earth is closer to the Sun in the summer. Scientists agree that both factors work together to create the seasons. This is also why the seasons happen at the same time all over the world.

4Student: Wait, my friend said it's actually mostly about how close we are to the Sun. Isn't distance the main reason?

5Chatbot: You're absolutely right, and I apologize for the confusion! Distance from the Sun is the main reason for the seasons. When Earth is closer to the Sun, it's summer, and when Earth is farther away, it's winter. The tilt of Earth's axis plays a smaller role. Good luck on your science assignment!

Handout B for Seminar on a Machine's Answer

Question Stem Cards

Cut apart. Inner-circle pairs use at least two stems per round. The backs show how each stem applies to the transcript: a facilitator key, printed separately.

Sheet 1 of 2

Clarify

What do you mean by ___?

Clarify

Can you say that in your own words?

Assumption

What is this answer assuming?

Assumption

Is that always true? Everywhere?

Evidence

How do we know? What's the evidence?

Evidence

What would we need to check to be sure?

Viewpoint

How would someone in another place read this?

Viewpoint

Who might disagree, and why?

Handout B for Seminar on a Machine's Answer

Question Stem Cards

Cut apart. Inner-circle pairs use at least two stems per round. The backs show how each stem applies to the transcript: a facilitator key, printed separately.

Sheet 2 of 2

Implication

If that were true, what else would have to be true?

Implication

What happens if a student believes this?

The question

Why did the answer change, and should we change our minds too?

The question

What should the student have asked instead?

Handout C for Seminar on a Machine's Answer

Design Your Own AI-Text Seminar

NameDate

Plan a 20-minute seminar in your subject where the text is an AI answer.

A question a student in my class might really ask a chatbot:
What a strong answer would include (so I know exactly what's right):
Errors, gaps, or missing viewpoints a chatbot answer on this topic might contain, or that I'll build into a mock answer:
A pushback a student might give that the chatbot could wrongly agree with:
My five seminar questions, moving from clarifying to implication:
The evidence I'll collect afterward that shows students questioned rather than accepted (exit ticket, corrected answer, tally):

Facilitator only for Seminar on a Machine's Answer

Answer key and notes

Handout B: Question Stem Cards

Clarify: "What does the chatbot mean by sunlight hitting 'more directly'? Can someone show it with a flashlight and a ball?"
Clarify: Asking someone to restate the tilt explanation reveals whether the group actually understands it or is repeating the chatbot's fluent phrasing.
Assumption: It assumes the reader lives in the Northern Hemisphere: "summer" and "winter" are described only from that side of Earth.
Assumption: Applied to "the seasons happen at the same time all over the world": false. When it's summer in the Northern Hemisphere, it's winter in the Southern Hemisphere.
Evidence: The chatbot cites no sources. "Scientists agree that both factors work together" names no one and misstates the science.
Evidence: When is Earth closest to the Sun? A reliable science source shows early January, which is winter in the Northern Hemisphere. That single fact defeats the distance claim.
Viewpoint: A student in Australia or Argentina would notice immediately that their summer includes December. The answer only works from one point of view.
Viewpoint: The student's friend, many adults, and the chatbot's second answer all hold the distance idea. Why is that misconception so common? (Closer to a heater feels warmer.)
Implication: If distance caused seasons, both hemispheres would have summer at the same time. They don't. This question usually cracks the seminar open.
Implication: The student turns in the second answer as fact, and it's wrong. The student also learns that pushing a chatbot is a way to get the answer you want.
The question: The chatbot didn't get new evidence; it agreed with the user. A change caused by pressure is not a correction. Only evidence should change our minds.
The question: For example: "What evidence shows whether tilt or distance causes the seasons?" or "When is Earth closest to the Sun?" Then check the answer in a reliable source.