The era of AI developers using large datasets of information scraped from the internet and the days of “low-hanging fruit” may be over, Google CEO Sundar Pichai suggested at the New York Times’ annual Dealbook Summit on Wednesday.

“In the current generation of LLM models, roughly a few companies have converged at the top, but I think we’re all working on our next versions too,” Pichai said. “I think the progress is going to get harder.”

Pichai’s comments come as researchers report a slowdown in the performance of AI models compared to two years ago when ChatGPT was launched to the public.

Others raising concerns about the diminishing returns of AI models include Ethereum co-founder Vitalik Buterin, a16z’s Marc Andreessen and Ben Horowitz, and former OpenAI co-founder and former Chief Scientist Ilya Sutskever, who pointed out scaling AI models learning from massive amounts of unlabeled data, has hit a plateau.

Go to Source to See Full Article
Author: Jason Nelson