AI learning: testing comparison
This course uses an AI assistant as a tutor for one technical comparison: RSpec versus Minitest in a Rails app that runs RSpec. Each lesson pairs a prompt with a realistic AI answer. It then checks that answer against installed gem source and commands run in the app. The answers include an accurate comparison, a translation with an overstated structural claim, a mislabeled assertion and a false conclusion built from true facts. The course closes with a five-question checklist for checking an AI tutor's technical claims.
What you'll learn
- ✓Reading an AI comparison answer for checkable facts and opinions stated as conclusions
- ✓Checking an AI translation of an RSpec matcher and a context block into Minitest
- ✓Tracing assert_difference to ActiveSupport instead of the plain minitest gem
- ✓Separating a library being installed from it being wired into the code that runs
- ✓Applying a five-question checklist to an AI tutor's technical claims
An AI tutor is worth it once you can check its answers
"Should I use RSpec or Minitest?" is the kind of question an AI coding assistant answers instantly, and on a comparison this well documented it's usually right. This app's course "Minitest: model & assertions" already worked out the answer for this codebase. RSpec is what this app runs: 206 spec…
Read the full lesson free →Curriculum
7 lessonsAn AI tutor is worth it once you can check its answers
Introduces using an AI assistant as a tutor for RSpec versus Minitest and checking its answers against code.
A first prompt: what an AI says about RSpec versus Minitest
A short comparison prompt returns accurate facts, plus one opinion line about neither framework being a wrong choice.
Asking an AI to translate a real RSpec example into Minitest
An AI translates an include matcher correctly with assert_includes but overstates how a context block maps to Minitest.
Checking an AI's claim about assert_difference against the source
An AI calls assert_difference a Minitest assertion, though it comes from ActiveSupport and fails without Rails.
The plausible, wrong answer this app's testing course already caught
An AI chains true facts about ActiveRecord::TestFixtures into the false claim that this app already includes it.
A short checklist for verifying what an AI tutor tells you
A five-question checklist for AI technical claims, applied to a new claim about FactoryBot inside Minitest.
Putting it together: an AI tutor, and the ground truth to check it against
Reviews the four AI answers, where each check came from, and which kinds of claims need a second look.