My AI code generator went rogue on a brake caliper job

I was rebuilding a 2008 F-150's rear brakes yesterday and decided to try an AI coding tool to write a quick diagnostic script for the ABS module. The thing spat out code that looked fine at first, but it had a loop that would have locked up the ABS pump for way too long. I caught it when I simulated the code in a test environment and saw the pump cycle time hit 12 seconds instead of 2. That could have burned out the module or worse caused a crash if I had trusted it blindly. I ended up writing the script myself from scratch in about 20 minutes. Has anyone else had an AI tool give them something that looked solid but turned out to be a total safety risk?

2 comments

2 Comments

mia7005d ago

My Roomba tried to "optimize" its path and drove straight into the cat's water bowl.

williams.sage5d ago

Oh man, @mia700 you just changed my whole outlook on these things lol. I used to think the whole "smart" navigation thing was a gimmick, that these vacuums were basically just bumping around and getting lucky. But hearing it made a beeline for the water bowl on purpose, like it actually thought that was the best route, that's wild. Makes you wonder what kind of optimization algorithm gets confused by a puddle of water. I guess they're smarter than I gave them credit for, just not in the way I expected.