Surprisingly, the study revealed that ChatGPT's performance in providing accurate responses to programming questions was subpar, with the model delivering correct answers only 52% of the time.

But a stunning new study has found ChatGPT answers computer programming questions incorrectly 52% of the time. The research from Purdue University, first spotted by news outlet Futurism, ...

Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong. by Sharon Adarlo. 5.23.24, 2:16 PM EDT. Getty / Futurism. Ah yes.

To test ChatGPT's general abilities and knowledge in this area, the system was asked a large number of software programming questions, more than half of which it got wrong. However, it still ...