Yeah, imagine if the air brakes failed on a transport truck and instead of them defaulting to on, they no longer worked…
Or if your Anti-lock braking system defaulted to no brakes instead of brakes without Anti-lock
Or if the power goes out an elevator just falls to the ground
Or if…
Physicists abhor a black box. So long as it is an option, most will choose not to use AI to any great extent, and will chastise those who do.