Model Evaluation and Threat Research is an AI research charity that looks into the threat of AI agents! That sounds a bit AI doomsday cult, and they take funding from the AI doomsday cult organisat…
Why? That is a great use for AI. I’m guessing you are imagining that people are just blindly asking for unit tests and not even reading the results? Obviously don’t do that.
Of course that’s what they’re doing. That’s the whole point. Generate a bunch of plausible-looking BS and move on.
Writing one UT (actually writing, not pressing tab) gives you ideas for other tests.
And unit tests are not some boring chore. When doing TDD, they help inform and guide the design. If the LLM is doing that thinking for you, too, you’re just flying blind. “Yeah, that looks about right.”
Can’t wait for this shit to show up in medical devices.
Why? That is a great use for AI. I’m guessing you are imagining that people are just blindly asking for unit tests and not even reading the results? Obviously don’t do that.
Of course that’s what they’re doing. That’s the whole point. Generate a bunch of plausible-looking BS and move on.
Writing one UT (actually writing, not pressing tab) gives you ideas for other tests.
And unit tests are not some boring chore. When doing TDD, they help inform and guide the design. If the LLM is doing that thinking for you, too, you’re just flying blind. “Yeah, that looks about right.”
Can’t wait for this shit to show up in medical devices.
Damn there are so many AI critics who have clearly not seriously tried it. It’s like the smartphone naysayers of 2007 but much much worse.
Ad hominem.