ChatGPT Part 1 (S04E03)

The Technium

ChatGPT is a language model by OpenAI which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.

00:00 S04E03 ChatGPT Part 1
02:58 What is ChatGPT?
06:17 Lineage of ChatGPT
10:01 General Reasoning from Training on Code
25:13 Reinforcement Learning from Human Feedback
29:37 Dumb compute, stacked high
42:00 Talking to an Alien Intelligence
45:14 What's it good at and bad at?
56:05 The XY problem
01:03:36 GPT in Education
01:13:26 Eating High Status Jobs, Fulfilling Latent Demand

Links:
- https://chat.openai.com/
- https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulator#Simulators
- http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- https://xyproblem.info/

===== About “The Technium” =====
The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.
Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!

===== Socials =====
WEBSITE: https://technium.transistor.fm/
SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7
APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545