As previously reported, new research reveals inconsistencies in ChatGPT models over time. A Stanford and UC Berkeley study analyzed March and June versions of GPT-3.5 and GPT-4 on diverse tasks. The results show significant drifts in performance, even over just a few months.

For example, GPT-4’s prime number accuracy plunged from 97.6% to 2.4% between March and June due to issues following step-by-step reasoning. GPT-4 also grew more reluctant to answer sensitive questions directly, with response rates dropping from 21% to 5%. However, it provided less rationale for refusals.

Both GPT-3.5 and GPT-4 generated buggier code in June compared to March. The percentage of directly executable Python snippets dropped substantially because of extra non-code text.

While visual reas

Go to Source to See Full Article
Author: Liam ‘Akiba’ Wright

Did you like this?
Tip BTC Newswire with Cryptocurrency

• Bitcoin
• Bitcoin Cash
• Ethereum
• Litecoin
• Monero
• ZCash

Donate Bitcoin to BTC Newswire

Scan the QR code or copy the address below into your wallet to send some bitcoin:

Donate via Installed Wallet Copy

[X] Click Here to Hide Donation Details

Donate Bitcoin Cash to BTC Newswire

Scan the QR code or copy the address below into your wallet to send bitcoin:

Donate via Installed Wallet Copy

[X] Click Here to Hide Donation Details

Donate Ethereum to BTC Newswire

Scan the QR code or copy the address below into your wallet to send some Ether:

Donate via Installed Wallet Copy

[X] Click Here to Hide Donation Details

Donate Litecoin to BTC Newswire

Scan the QR code or copy the address below into your wallet to send some Litecoin:

Donate via Installed Wallet Copy

[X] Click Here to Hide Donation Details

Donate Monero to BTC Newswire

Scan the QR code or copy the address below into your wallet to send some Monero:

Donate via Installed Wallet Copy

[X] Click Here to Hide Donation Details

Donate ZCash to BTC Newswire

Scan the QR code or copy the address below into your wallet to send some ZCash:

Copy ZCash Address

[X] Click Here to Hide Donation Details