Machine Learning Times
Machine Learning Times
EXCLUSIVE HIGHLIGHTS
Panic Over DeepSeek Exposes AI’s Weak Foundation On Hype
 Originally published in Forbes The story about DeepSeek has disrupted...
AI Drives Alphabet’s Moonshot To Save The World’s Electrical Grid
 Originally published in Forbes Note: Ravi Jain, Chief Technology Officer...
Why Alphabet’s Clean Energy Moonshot Depends On AI
 Originally published in Forbes Note: Ravi Jain, Chief Technology Officer...
Predictive AI Only Works If Stakeholders Tune This Dial
 Originally published in Forbes I’ll break it to you gently:...
SHARE THIS:

1 year ago
New Theory Suggests Chatbots Can Understand Text

 
Originally published in Quanta Magazine, Jan 22, 2024. 

Artificial intelligence seems more powerful than ever, with chatbots like Bard and ChatGPT capable of producing uncannily humanlike text. But for all their talents, these bots still leave researchers wondering: Do such models actually understand what they are saying? “Clearly, some people believe they do,” said the AI pioneer Geoff Hinton in a recent conversation with Andrew Ng, “and some people believe they are just stochastic parrots.”

This evocative phrase comes from a 2021 paper co-authored by Emily Bender, a computational linguist at the University of Washington. It suggests that large language models (LLMs) — which form the basis of modern chatbots — generate text only by combining information they have already seen “without any reference to meaning,” the authors wrote, which makes an LLM “a stochastic parrot.”

These models power many of today’s biggest and best chatbots, so Hinton argued that it’s time to determine the extent of what they understand. The question, to him, is more than academic. “So long as we have those differences” of opinion, he said to Ng, “we are not going to be able to come to a consensus about dangers.”

New research may have intimations of an answer. A theory developed by Sanjeev Arora of Princeton University and Anirudh Goyal, a research scientist at Google DeepMind, suggests that the largest of today’s LLMs are not stochastic parrots. The authors argue that as these models get bigger and are trained on more data, they improve on individual language-related abilities and also develop new ones by combining skills in a manner that hints at understanding — combinations that were unlikely to exist in the training data.

To continue reading this article, click here.

 

6 thoughts on “New Theory Suggests Chatbots Can Understand Text

  1. Pingback: New theory proposes chatbots' ability to comprehend text #AIUnderstanding

  2. The new theory proposes that chatbots, particularly those utilizing key advancements like Ozempic in South Africa, have the capability to comprehend and interpret text effectively. By leverag ” https://buyxanaxuk.org/ ” these chatbots may demonstrate an enhanced ability to grasp the nuances of language, providing users with a more sophisticated and personalized interaction experience.

     
  3. Artificial intelligence has advanced greatly, with chatbots like Bard and ChatGPT producing text that seems humanlike. However, researchers like Geoff Hinton and Emily My Results ATT Bender debate whether these models truly understand their output or just mimic language patterns.

     
  4. Inside the My Account section of your EZ Pass NY login, you can check your payment history, replenish your account, and change other private data as well. Having trouble accessing it? Use the NY EZ Pass login for seamless account management. E-ZPass in New York

     
  5. Level Devil is an engaging puzzle-platformer that challenges players with uniquely designed levels filled with intricate obstacles and tricky enemies. Each stage requires a blend of strategy, timing, and skill, encouraging players to think critically and adapt their approach. The game’s vibrant graphics and captivating gameplay create an immersive experience that keeps players coming back for more. With its well-crafted challenges and increasing difficulty, Level Devil tests both individual abilities and teamwork, making it a thrilling adventure for all ages.

     

Leave a Reply