Ask HN: Have people started to see cracks in the ChatGPT answers with time

Context: I have a co-worker who is used to execute the suggested scripts from Chat-gpt with high confidence. Lately one of the scripts to use Github API was not working and he asked me to debug. Turns out, Github had changed/updated the attribute names in the output and they no longer matched with the Chat-Gpt provided script. Hard part, this individual is really good engineer, however he/she was low on confidence about how to debug the Chat-gpt provided script