Large language models’ ability to generate text also lets them plan and reason
1 year, 8 months ago

Large language models’ ability to generate text also lets them plan and reason

The Economist  

Listen to this story. Modern large language models can generate them all, though homework-shirkers should beware: the models may get some facts wrong, and are prone to flights of fancy that their creators call “hallucinations”. An LLM trained on large amounts of text, says Nathan Benaich of Air Street Capital, an AI investment fund, “basically learns to reason on the basis of text completion”. P a LM - E, created by researchers at Google, uses an “embodied” LLM, trained using sensor data as well as text, to control a robot. Dr Liang notes that today’s LLM s, which are based on the so-called “transformer” architecture developed by Google, have a limited “context window”—akin to short-term memory.

World Text Ai Models Liang Researchers Llm Gpt Llm S Dr Liang  models  gpt  s  text  plan  language  generate  trained  ability  researchers  large  reason  world  ai  llm  created  lets

Discover Related