I really hope people remember why they don’t let you use a calculator in elementary school and apply that to AI.

You need to know the fundamentals of the topic to make effective use of a tool. If you know nothing on the subject then you can’t instruct the tool correctly to produce a good product