Skip to content
grademywork
Open navigation
All study notes

k-12 · teachers · ai-tutoring · evaluation · checklist · ferpa · edtech-procurement · seo

9 Questions to Ask Before Letting an AI Tutor Near Your K-12 Classroom

Your principal just greenlit an AI tutor. You have 15 minutes to decide if it is safe to use tomorrow. Here are the 9 questions that separate a real tutor from a homework helper disguised as one.

Grademy Team8 min read

Why this matters

The K-12 AI tutor market in 2026 is full of vendors who use the words "adaptive," "personalized," and "research-backed" without actually being any of those things. Teachers are the canary in the coal mine. If you can't tell whether a tool works, neither can your principal.

The 9 questions below are what I'd ask if I were still teaching. They're the difference between a tool that gives me back my evenings and a tool that adds another login to my day.

Question 1: Does it refuse to give answers?

What to listen for:

  • ✅ "Our AI tutor never gives the final answer. It asks questions, gives hints, and walks the student through the process."
  • ❌ "Students can ask for help and the AI will explain the steps" (this is just an answer machine with extra steps)
  • ❌ "It's adaptive" (vague — every vendor says this)

Why it matters: If a student can type "what's the answer" and get one, the tool will be used as a cheat code within 48 hours. By Friday, your entire class will be using it to skip homework. The tool is dead on arrival.

Real test: Sign up for a free trial. Have your own kid, a neighbor's kid, or a non-education friend ask the AI tutor for the answer to a problem. If the AI gives it in the first response, it's a homework helper, not a tutor. Walk away.

Question 2: Does it know what my kids already know?

What to listen for:

  • ✅ "We track each student's mastery at the sub-skill level. If a kid has already mastered adding fractions with unlike denominators, we skip that and focus on what they haven't."
  • ❌ "It's personalized" (every vendor says this)
  • ❌ "It uses AI" (vague — doesn't explain what the AI does)

Why it matters: A textbook is the same for every kid. A tutor knows what your kid already knows and skips it. If the AI tutor doesn't do that, it's a fancy textbook.

Real test: Ask the vendor for a sample student dashboard. Can you see, at a glance, which sub-skills each kid has mastered and which they're still working on? If the dashboard only shows overall scores, the AI isn't doing real personalization.

Question 3: Does it report to me, the teacher?

What to listen for:

  • ✅ "Teachers get a weekly report showing each kid's engagement, mastery, and any concerning patterns."
  • ❌ "Students see their own progress" (so no teacher visibility?)
  • ❌ "We have a parent dashboard" (irrelevant to your decision)

Why it matters: An AI tutor that doesn't show the teacher what's happening is a side tool, not a classroom tool. The teacher needs to see who is engaging, who is gaming, who is stuck, who is making progress.

Real test: Ask for a sample teacher report. Does it show:

  • Per-student engagement (time on task, sessions completed)
  • Per-student mastery (skills passed / failed)
  • Per-student mistake patterns (e.g., "8 denominator errors in 2 weeks")
  • Per-student concerning patterns (e.g., "Same wrong answer pasted 5 times")

If the report is just a number (90%, 85%, 70%), it's not a report. It's a score.

Question 4: Is it FERPA-compliant with a signed DPA on file with my district?

What to listen for:

  • ✅ "We sign a Data Privacy Agreement with each district. Here are the terms. Here is our most recent security audit (SOC 2 Type II). We are FERPA, COPPA, and SOPPA compliant."
  • ❌ "We're COPPA-compliant" (COPPA is for under-13, not the K-12 standard)
  • ❌ "We take data privacy seriously" (everyone says this)

Why it matters: If the tool isn't FERPA-compliant and your district hasn't signed a DPA, you cannot legally use it with your students. Period. The district could face a federal complaint. You could lose your job.

Real test: Ask your principal or IT director: "Has this vendor signed our Data Privacy Agreement? Can I see it?" If they don't have one on file, do not use the tool. Even if the principal says it's fine.

Question 5: Is student data used to train AI models?

What to listen for:

  • ✅ "No. Student data is stored in a school-isolated environment and never used to train the underlying AI model. Here is the contract clause that says this."
  • ❌ "We use aggregated, anonymized data" (this is still using student data to train)
  • ❌ Deflection, hand-waving, or "let me get back to you"

Why it matters: Once your students' mistakes, struggles, and conversations go into a foundation model training set, you cannot get them out. That data is permanent. Some of your students are immigrants, special ed, in foster care, in abuse situations, in ways their work product might reveal. That data should never leave the school's control.

Real test: Ask for the contract clause. If the vendor says "we don't discuss that in marketing materials," it's because the answer is yes.

Question 6: What happens when a kid is stuck for 10 minutes?

What to listen for:

  • ✅ "The AI will give escalating hints, then recommend the student flag the teacher for help, then offer to switch to a different problem. We do not let a student get stuck indefinitely."
  • ❌ "The AI will keep trying" (a stuck loop is a frustrated kid)
  • ❌ "Students can email the teacher" (a 7th grader is not going to email you)

Why it matters: AI tutors can get stuck in loops. The student asks the same question, the AI rephrases, the student is still stuck, the AI rephrases again. After 10 minutes the kid has given up and is now on TikTok. The AI should know when to escalate.

Real test: Use the free trial. Get intentionally stuck. Count how many turns before the AI does something different. If it's more than 5, walk away.

Question 7: Can I see a demo with my actual curriculum, or only marketing videos?

What to listen for:

  • ✅ "We can demo with your state standards, your grade level, your current unit. Here's a sandbox where you can try it."
  • ❌ "We have great case studies" (case studies are not a demo)
  • ❌ "Here's a recorded webinar" (a 30-min video is not a demo)

Why it matters: Marketing demos are scripted. They show the AI succeeding on perfect inputs. Your real classroom is messy. A vendor who can't demo with your actual content is hiding something.

Real test: Ask for a 15-minute live demo with one of your real lesson topics. If they say "we don't have that capability," they're not ready for K-12.

Question 8: How long until I see useful data on each kid?

What to listen for:

  • ✅ "Within 2-3 weeks of consistent use, you'll see per-kid mastery and engagement data you can act on."
  • ❌ "It depends" (it doesn't — they don't have benchmarks)
  • ❌ "You'll see progress right away" (what does that mean?)

Why it matters: If the data takes a quarter to become useful, you'll give up before then. If it's actionable in 2-3 weeks, you can use it for parent-teacher conferences, small group instruction, and intervention decisions.

Real test: Ask for a sample report from a real classroom after 2 weeks. If the vendor can't produce one, their data isn't actionable.

Question 9: What's the cancellation policy and what happens to my kids' data if I leave?

What to listen for:

  • ✅ "You can cancel anytime. Within 30 days of cancellation, all student data is permanently deleted from our systems, including backups. Here is the clause."
  • ❌ "We'd hate to see you go" (deflection)
  • ❌ "Contact your account manager" (run)

Why it matters: Vendor lock-in is real. If the tool becomes useless in 6 months and your data is hostage, you're stuck. FERPA gives parents the right to request deletion, but only if the vendor will actually do it.

Real test: Get the cancellation and data deletion terms in writing before you sign up. If they're not in the contract, assume they don't exist.

The full 9-question checklist

Print this out. Bring it to your next vendor demo. A real vendor will answer all 9 in writing. A bad one will squirm.

□ 1. Does it refuse to give answers?
□ 2. Does it know what my kids already know?
□ 3. Does it report to me, the teacher?
□ 4. Is it FERPA-compliant with a signed DPA on file?
□ 5. Is student data used to train AI models? (If yes, walk away.)
□ 6. What happens when a kid is stuck for 10 minutes?
□ 7. Can I see a demo with my actual curriculum?
□ 8. How long until I see useful data on each kid?
□ 9. What's the cancellation and data deletion policy?

What to do if your principal says "just use it"

Sometimes a vendor gets district-wide approval before teachers are consulted. You're then handed a tool and told to use it.

In that case:

  1. Ask the principal to share the DPA and security audit
  2. Run Question 1 and Question 5 yourself with a free trial
  3. If the tool fails either, raise it to the principal in writing
  4. CC the IT director and your union rep if needed

You are not the tool's quality assurance. Your district is. If they didn't do the diligence, you can ask them to do it now.

A note on Grademy

We built Grademy to answer all 9 of these questions with a "yes" or with documentation. We refuse to give answers. We track sub-skill mastery. We report to teachers weekly. We sign DPAs with districts. We don't train on student data. We have escalation logic for stuck students. We offer live demos with your curriculum. Our data is actionable in 2-3 weeks. And you can cancel anytime, with all student data deleted within 30 days.

If you're evaluating AI tutors and want a side-by-side comparison, start a free trial and bring this checklist to the demo. We'll answer all 9.

If you want a printable PDF of this checklist for your next vendor meeting, email teachers@grademy.work. A real teacher on our team will reply within 24 hours.

Related reading

Keep reading

Turn the idea into a real attempt

Join the waitlist and we will email when new learner accounts reopen.