Given how it “learns”, asking for the same homework questions people have asked for on stack overflow a thousand times already would likely give a decent answer.
Asking it something new will produce plausible looking gibberish.
It has no idea which is which. It doesn’t know where the limits of its knowledge lie. It just knows that the answer looks like code and is very confident, and that any follow up issues can be dealt with by outputting more nonsense code and an excuse.
Given how it “learns”, asking for the same homework questions people have asked for on stack overflow a thousand times already would likely give a decent answer.
Asking it something new will produce plausible looking gibberish.
It has no idea which is which. It doesn’t know where the limits of its knowledge lie. It just knows that the answer looks like code and is very confident, and that any follow up issues can be dealt with by outputting more nonsense code and an excuse.