When I ask my accountant a question, I've already done my reading and know what a correct answer should look like. If I end up surprised then I will be doing further reading, and perhaps get back to her with some follow-up questions. When I walk in to buy a TV and ask the spotty kid which one to purchase, likewise I've done my homework and already have some views. Even with my doctor - I well understand that Dr Google is not a helpful thing, but I will read and seek knowledge and work to understand what my doctor says. I tend not to just accept *anything* at face value.
AI is a useful tool in the hands of a skilled subject-matter expert. In the hands of a neophyte you may as well be walking into a bar after midnight seeking opinions.
What would it take for me to trust an AI? About the same for me to just blindly trust a human.
Note we do make exceptions where we don't have much choice -- airline pilots for example. I'm sitting back swilling my G&T where the T stands for Trust :)