Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning

Unsupervised Learning

Content provided by Redpoint Ventures and By Redpoint Ventures. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Redpoint Ventures and By Redpoint Ventures or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

1+ y ago 43:24

MP3•Episode home

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.

0:00 intro

01:06 Aran’s background

02:58 starting work on gpt-j

05:49 gathering data for Lion and gpt-j

08:51 history of EleutherAI

11:16 open vs. closed-source models

19:06 how will open-source models be used going forward

21:33 thought cloning

25:51 building AI models that understand video

29:35 one model to rule them all

31:58 influence of academia in the LLM space

34:33 over-hyped/under-hyped

38:01 Aran’s thoughts on AGI

With your co-hosts:

@jasoncwarner

- Former CTO GitHub, VP Eng Heroku & Canonical

@ericabrescia

- Former COO Github, Founder Bitnami (acq’d by VMWare)

@patrickachase

- Partner at Redpoint, Former ML Engineer LinkedIn

@jacobeffron

- Partner at Redpoint, Former PM Flatiron Health

@jordan_segall

- Partner at Redpoint

50 episodes

#Tech #Redpoint Ventures #Artificial Intelligence