Skip to playerSkip to main content
  • 2 days ago
How GPT models work

Category

🤖
Tech
Transcript
00:00GPT smart looks like, but it is actually a word of a super predictor.
00:05Curious how?
00:06Okay, first run down.
00:08GPT is a lot of texts from books, websites, chats, and words.
00:14It is a token name in numbers.
00:16Training during this time, it is a lot of next token predicts from the next token.
00:21When it is wrong, it adjusts the internal weights.
00:26Secret sauce is attention.
00:28Model is a model.
00:30That is a way of saying, which is the best way of past words, next words, next words to be the most important matter.
00:34Like sentence in a laser focus.
00:37When you ask something, it is a possible next token score.
00:42It is the most likely chain, which is a following reply.
00:48We can fine tune it or add rules.
00:52It is safer or more on topic.
00:55Bottom line.
00:57This is crazy scale prediction.
00:58Human thought.
01:00Human thought.
01:00Not it.
01:00It is smartly use.
01:02Use.
01:02Gary.
Be the first to comment
Add your comment

Recommended

1:09