Gaming PC

Researchers Chart Alarming Decline in ChatGPT Response Quality

Over the past few months, there has been a surge of anecdotal evidence and general tweets about poor quality ChatGPT responses. A team of researchers from Stanford University and the University of California, Berkeley decided to devise a metric to determine whether there was genuine degradation and to quantify the magnitude of the detrimental changes. Simply put, ChatGPT’s quality improvement was certainly not envisioned.

Three prominent scholars – Matei Zaharia, Linjiao Cheng and James Zhou – were behind the recently published research paper How will ChatGPT’s behavior change over time? (PDF) Earlier today, Zaharia, a computer science professor at the University of California, Berkeley, tweeted: Share your findings. He surprisingly found, “His GPT -4 success rate for ‘Is this number prime? %,” he emphasized.

Related Articles

Back to top button