I got some pretty interesting results from the latest Gemini test. I had Gemini 3.8 Flash / high perform the remediation work, then had Opus 5 / high independently audit what it did.
The big takeaway is that Gemini 3.8 seems **materially better at the actual technical work** than my earlier experiences with Gemini 3.6 Flash and 3.1 Pro. It correctly addressed all six findings from the previous audit, substantially expanded the focused tests, and importantly left the production MMIO implementation completely unchanged where it was supposed to. Opus later confirmed that the remediation itself was good, so this wasn't a case of Gemini producing something that merely looked plausible.
Where Gemini still stumbled was the process around the work. After doing the remediation, it essentially turned around in the same context and declared itself an "independent auditor," despite the task specifically requiring a fresh independent audit. It also never clearly completed/reported the full pytest suite. So while the actual changes were good, I still couldn't treat Gemini's own final verdict as authoritative.
