{"id":1824,"date":"2024-12-22T13:27:53","date_gmt":"2024-12-22T04:27:53","guid":{"rendered":"https:\/\/skanto.co.kr\/?p=1824"},"modified":"2024-12-25T13:40:58","modified_gmt":"2024-12-25T04:40:58","slug":"is-the-tech-industry-already-on-the-cusp-of-an-a-i-slowdown","status":"publish","type":"post","link":"https:\/\/skanto.co.kr\/?p=1824","title":{"rendered":"Is the Tech Industry Already on the Cusp of an A.I. Slowdown?"},"content":{"rendered":"\n
\n

Companies like Open AI and Google are running out of the data used to train artificial intelligence systems. Can new methods continue years of rapid progress?<\/p>\n<\/blockquote>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Demis Hassabis, one of the most influential artificial intelligence experts in the world, has a warning for the rest of the tech industry: Don\u2019t expect chatbots to continue to improve as quickly as they have over the last few years.<\/p>\n\n\n\n

A.I. researchers have for some time been relying on a fairly simple concept to improve their systems: the more data culled from the internet that they pumped into large language models<\/a> \u2014 the technology behind chatbots \u2014 the better those systems performed.<\/p>\n\n\n\n

But Dr. Hassabis, who oversees Google DeepMind, the company\u2019s primary A.I. lab, now says that method is running out of steam simply because tech companies are running out of data.<\/p>\n\n\n\n

Interviews with 20 executives and researchers showed a widespread belief that the tech industry is running into a problem many would have thought was unthinkable just a few years ago: They have used up most of the digital text available on the internet<\/span>.<\/p>\n\n\n\n

Not everyone in the A.I. world is concerned. Some, like OpenAI\u2019s chief executive, Sam Altman, say that progress will continue at the same pace, albeit with some twists on old techniques. Dario Amodei, the chief executive of the A.I. start-up Anthropic, and Jensen Huang, Nvidia\u2019s chief executive, are also bullish.<\/p>\n\n\n\n

Researchers called Dr. Kaplan\u2019s findings published in 2020 \u201cthe Scaling Laws<\/strong>.\u201d Just as students learn more by reading more books, A.I. systems improved as they ingested increasingly large amounts of digital text culled from the internet, including news articles, chat logs and computer programs.<\/p>\n\n\n\n

The problem is, neither the Scaling Laws nor Moore\u2019s Law are immutable laws of nature. They\u2019re simply smart observations. One held up for decades. The others may have a much shorter shelf life. Google and Dr. Kaplan\u2019s new employer, Anthropic<\/a>, cannot just throw more text at their A.I. systems because there is little text left to throw.<\/p>\n\n\n\n

\"\"\/
Demis Hassabis oversees Google DeepMind, the company\u2019s primary A.I. lab<\/figcaption><\/figure>\n\n\n\n

Dr. Hassabis said that existing techniques would continue to improve A.I. in some ways. But he said he believed that entirely new ideas were needed to reach the goal that Google and many others were chasing: a machine that could match the power of the human brain.<\/p>\n\n\n\n

Ilya Sutskever, who was instrumental in pushing the industry to think big as a researcher at both Google and OpenAI before leaving OpenAI to create a new start-up this spring<\/a>, made the same point during a speech last week<\/a>. \u201cWe\u2019ve achieved peak data, and there\u2019ll be no more,\u201d he said. \u201cWe have to deal with the data that we have. There\u2019s only one internet.\u201d<\/p>\n\n\n\n

\"\"\/
We\u2019ve achieved peak data, and there\u2019ll be no more,\u201d said Ilya Sutskever, the former chief scientist of OpenAI.<\/figcaption><\/figure>\n\n\n\n

Dr. Hassabis and others are exploring a different approach. They are developing ways for large language models to learn from their own trial and error. By working through various math problems, for instance, language models can learn which methods lead to the right answer and which do not. In essence, the models train on data that they themselves generate. Researchers call this \u201csynthetic data<\/a>.\u201d<\/p>\n\n\n\n

OpenAI recently released a new system called OpenAI o1 that\u00a0was built this way<\/a>. But the method only works in areas like math and computing programming, where there\u00a0is a firm distinction between right and wrong<\/a>.<\/span> \u201cThese methods only work in areas where things are empirically true, like math and science, the humanities and the arts, moral and philosophical problems are much more difficult.\u201d said Dylan Patel, chief analyst for the research firm SemiAnalysis.<\/p>\n\n\n\n

During a call with analysts last month, Mr. Huang, Nvidia\u2019s chief executive, was asked how the company was helping customers work through a potential slowdown and what the repercussions might be for its business. He said that evidence showed there were still gains being made, but that businesses were also testing new processes and techniques on A.I. chips.<\/p>\n\n\n\n

2024.12.19 New York Times<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Companies like Open AI and Google are running out of the data used to train artificial intelligence systems. Can new methods continue years of rapid progress? Demis Hassabis, one of the most influential artificial intelligence experts in the world, has a warning for the rest of the tech industry: Don\u2019t expect chatbots to continue to improve as quickly as they have over the last few years. A.I. researchers have for some time been relying on a fairly simple concept to…<\/p>\n

Read More Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","footnotes":""},"categories":[7],"tags":[48],"class_list":["post-1824","post","type-post","status-publish","format-standard","hentry","category-7","tag-ai"],"_links":{"self":[{"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/posts\/1824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1824"}],"version-history":[{"count":2,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/posts\/1824\/revisions"}],"predecessor-version":[{"id":1872,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=\/wp\/v2\/posts\/1824\/revisions\/1872"}],"wp:attachment":[{"href":"https:\/\/skanto.co.kr\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/skanto.co.kr\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}