How Large Language Models Like ChatGPT Work
Clip: Season 51 Episode 5 | 1m 44sVideo has Closed Captions
It’s not always easy to tell the difference between writing by a human and ChatGPT.
By recognizing patterns in billions of words, these models can make guesses at the next word in a sentence but to do that well, the AI also has to understand the sentence.
National Corporate funding for NOVA is provided by Carlisle Companies. Major funding for NOVA is provided by the NOVA Science Trust, the Corporation for Public Broadcasting, and PBS viewers.
How Large Language Models Like ChatGPT Work
Clip: Season 51 Episode 5 | 1m 44sVideo has Closed Captions
By recognizing patterns in billions of words, these models can make guesses at the next word in a sentence but to do that well, the AI also has to understand the sentence.
How to Watch NOVA
NOVA is available to stream on pbs.org and the free PBS App, available on iPhone, Apple TV, Android TV, Android smartphones, Amazon Fire TV, Amazon Fire Tablet, Roku, Samsung Smart TV, and Vizio.
Buy Now
NOVA Labs
NOVA Labs is a free digital platform that engages teens and lifelong learners in games and interactives that foster authentic scientific exploration. Participants take part in real-world investigations by visualizing, analyzing, and playing with the same data that scientists use.Providing Support for PBS.org
Learn Moreabout PBS online sponsorship- [Narrator] ChatGPT, it allows users to engage in a dialogue with a machine that seems uncannily human.
It was first released in 2018, but it was a subsequent version that became a global sensation in late 2022.
- This promises to be the viral sensation that could completely reset how we do things.
- Cranking out entire essays in a matter of seconds.
- [Narrator] Not only did it wow the public, it also caught artificial intelligence innovators off guard.
- It surprised me a lot that they're able to do things that we didn't think they could do simply by learning to imitate how humans respond.
And I thought this kind of abilities would take many more years or decades.
- [Narrator] ChatGPT is a large language model.
LLMs start by consuming massive amounts of text, books, articles, and websites, which are publicly available on the internet.
By recognizing patterns in billions of words, they can make guesses at the next word in a sentence.
That's how ChatGPT generates unique answers to your questions.
If I ask for a haiku about the blue sky, it writes something that seems completely original.
- If you're good at predicting this next word, it means you're understanding something about the sentence, what the style of the sentence is, what the feeling of the sentence is, and you can't tell whether this was a human or a machine.
Video has Closed Captions
Explore the promise and perils of new A.I. technologies. (26s)
The Birth of Artificial Intelligence
Video has Closed Captions
The origins of modern AI can be traced back to World War II. (3m 24s)
How A.I. is fighting wildfires
Video has Closed Captions
Firefighters are using AI to find wildfires before they explode. (1m 34s)
How Deepfakes Manipulate Reality
Video has Closed Captions
Deepfakes are getting more convincing and easier to make. (4m 22s)
Providing Support for PBS.org
Learn Moreabout PBS online sponsorshipNational Corporate funding for NOVA is provided by Carlisle Companies. Major funding for NOVA is provided by the NOVA Science Trust, the Corporation for Public Broadcasting, and PBS viewers.