ChatGPT exploded onto the scene late last year, dazzling people with its human-like conversational abilities, and the release of latest version prompted a crypto rally and calls for a pause in development. But according to a new study, the leading AI bot’s skills may actually be on the decline.

Researchers at Stanford and UC Berkeley systematically analyzed different versions of ChatGPT from March and June 2022. They developed rigorous benchmarks to evaluate the model’s competency in math, coding, and visual reasoning tasks. The results of ChatGPT’s performance over time were not good.

The tests revealed a startling drop-off in performance between versions. On a math challenge of determining prime numbers, ChatGPT solved 488 out of 500 questions correctly in March, an accuracy of 97.6%. However, in June, ChatGPT only managed to get 12 questions right, plunging to 2.4% accuracy.

The decline was especially steep in the chatbot’s software coding abilities.

Go to Source to See Full Article
Author: Jose Antonio Lanz

Did you like this?
Tip BTC Newswire with Cryptocurrency

Donate Bitcoin to BTC Newswire

Scan to Donate Bitcoin to BTC Newswire
Scan the QR code or copy the address below into your wallet to send some bitcoin:

Donate Bitcoin Cash to BTC Newswire

Scan to Donate Bitcoin Cash to BTC Newswire
Scan the QR code or copy the address below into your wallet to send bitcoin:

Donate Ethereum to BTC Newswire

Scan to Donate Ethereum to BTC Newswire
Scan the QR code or copy the address below into your wallet to send some Ether:

Donate Litecoin to BTC Newswire

Scan to Donate Litecoin to BTC Newswire
Scan the QR code or copy the address below into your wallet to send some Litecoin:

Donate Monero to BTC Newswire

Scan to Donate Monero to BTC Newswire
Scan the QR code or copy the address below into your wallet to send some Monero:

Donate ZCash to BTC Newswire

Scan to Donate ZCash to BTC Newswire
Scan the QR code or copy the address below into your wallet to send some ZCash:

BTC NewswireAuthor posts

BTC Newswire Crypto News at your Fingertips

Comments are disabled.