Best PyTorch Podcasts (2024)

1
TORCH_TRACE and tlparse 15:28

2M ago15:28

15:28

TORCH_TRACE and tlparse are a structured log and log parser for PyTorch 2. It gives useful information about what code was compiled and what the intermediate build products look like.By PyTorch

1
Discover Hot AI Start-Up Elemental Cognition 40:59

2M ago40:59

40:59

New The Pulse of AI podcast, Season 6, Episode 142! Sign-up for our newsletter at www.thepulseofai.com Podcast host Jason Stoughton is joined by Vice President of Intelligent Applications at Elemental Cognition, Erdem Ozcan. With a Phd in Computer Science and over 20 years of experience, including as co-founder of Automat.ai, which developed Conver…

1
Higher order operators 17:10

2M ago17:10

17:10

Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also u…

1
Inductor - Post-grad FX passes 24:07

2M ago24:07

24:07

The post-grad FX passes in Inductor run after AOTAutograd has functionalized and normalized the input program into separate forward/backward graphs. As such, they generally can assume that the graph in question is functionalized, except for some mutations to inputs at the end of the graph. At the end of post-grad passes, there are special passes th…

1
In the Age of AI Responsible Innovation is Important. 30:58

2M ago30:58

30:58

New Pulse of AI podcast, Season 6, Episode 141. On this podcast I am joined by Gaurab Bansal, executive director of Responsible Innovation Labs, an industry coalition making it easy for founders to lead and win with responsible innovation. I wanted to have him on the podcast because as AI accelerates it is important for founders, and all of us in t…

1
CUDA graph trees 20:50

3M ago20:50

20:50

CUDA graph trees are the internal implementation of CUDA graphs used in PT2 when you say mode="reduce-overhead". Their primary innovation is that they allow the reuse of memory across multiple CUDA graphs, as long as they form a tree structure of potential paths you can go down with the CUDA graph. This greatly reduced the memory usage of CUDA grap…

1
Min-cut partitioner 15:56

3M ago15:56

15:56

The min-cut partitioner makes decisions about what to save for backwards when splitting the forward and backwards graph from the joint graph traced by AOTAutograd. Crucially, it doesn't actually do a "split"; instead, it is deciding how much of the joint graph should be used for backwards. I also talk about the backward retracing problem.…

1
AOTInductor 17:30

4M ago17:30

17:30

AOTInductor is a feature in PyTorch that lets you export an inference model into a self-contained dynamic library, which can subsequently be loaded and used to run optimized inference. It is aimed primarily at CUDA and CPU inference applications, for situations when your model export once to be exported once while your runtime may still get continu…

1
Tensor subclasses and PT2 13:25

4M ago13:25

13:25

Tensor subclasses allow you to add extend PyTorch with new types of tensors without having to write any C++. They have been used to implement DTensor, FP8, Nested Jagged Tensor and Complex Tensor. Recent work by Brian Hirsh means that we can compile tensor subclasses in PT2, eliminating their overhead. The basic mechanism by which this compilation …

1
Numenta Is Making Artificial Intelligence Better With Neuroscience 44:00

4M ago44:00

44:00

Pulse of AI Podcast Season 6 Episode 140 On this podcast, one of the last episodes of season 6, I am joined by Subutai Ahmad, CEO of Numenta. Numenta is in many ways a uniquely Silicon Valley company. It was founded by tech luminaries and has spent the last 17 years doing deep neuroscience research with the goal of better understanding the brain so…

1
Compiled autograd 18:07

4M ago18:07

18:07

Compiled autograd is an extension to PT2 that permits compiling the entirety of a backward() call in PyTorch. This allows us to fuse accumulate grad nodes as well as trace through arbitrarily complicated Python backward hooks. Compiled autograd is an important part of our plans for compiled DDP/FSDP as well as for whole-graph compilation.…

1
PT2 extension points 15:54

5M ago15:54

15:54

We discuss some extension points for customizing PT2 behavior across Dynamo, AOTAutograd and Inductor.By PyTorch

1
Gen AI is driving changes in digital marketing and AKKIO is leading the way! 20:18

5M ago20:18

20:18

The Pulse of AI New Podcast Episode, Season 6, Episode 139. Follow at www.thepulseofai.com. Podcast host Jason Stoughton is joined by Co-Founder and Co-CEO of Akkio, Jon Reilly, to talk about how Artificial Intelligence is changing the digital marketing landscape and how AKKIO empowers digital marketers. Using GPT-4 Akkio allows teams to clean data…

1
Inductor - Define-by-run IR 12:06

5M ago12:06

12:06

Define-by-run IR is how Inductor defines the internal compute of a pointwise/reduction operation. It is characterized by a function that calls a number of functions in the 'ops' namespace, where these ops can be overridden by different handlers depending on what kind of semantic analysis you need to do. The ops Inductor supports include regular ari…

1
Unsigned integers 13:07

5M ago13:07

13:07

Traditionally, unsigned integer support in PyTorch was not great; we only support uint8. Recently, we added support for uint16, uint32 and uint64. Bare bones functionality works, but I'm entreating the community to help us build out the rest. In particular, for most operations, we plan to use PT2 to build anything else. But if you have an eager ker…

1
Inductor - IR 18:00

5M ago18:00

18:00

Inductor IR is an intermediate representation that lives between ATen FX graphs and the final Triton code generated by Inductor. It was designed to faithfully represent PyTorch semantics and accordingly models views, mutation and striding. When you write a lowering from ATen operators to Inductor IR, you get a TensorBox for each Tensor argument whi…

1
Dynamo - VariableTracker 15:55

5M ago15:55

15:55

I talk about VariableTracker in Dynamo. VariableTracker is Dynamo's representation of the Python. I talk about some recent changes, namely eager guards and mutable VT. I also tell you how to find the functionality you care about in VariableTracker (https://docs.google.com/document/d/1XDPNK3iNNShg07jRXDOrMk2V_i66u1hEbPltcsxE-3E/edit#heading=h.i6v7gq…

1
Conversation with CEO of Lightning AI about the Evolution from PyTorch Lightning to their New Flagship Lightning AI Studios Product 27:25

6M ago27:25

27:25

The Pulse of AI New Podcast Season 6 Episode 138 Jason Stoughton is joined by Founder and CEO Will Falcon of Lightning AI to talk about their new flagship product called Lightning AI Studios. Lightning AI is the company behind popular PyTorch Lightning and they describe their new flagship product as an "operating system" for AI development and is a…

1
Using AI to Improve Pipeline Generation to Increase Revenue with Revsure AI's CEO 28:30

7M ago28:30

28:30

Season 6 Episode 137 CEO of Revsure AI, Deepinder Singh Dhingra, joins podcast host Jason Stoughton to talk about how Revsure AI is applying AI to help companies accelerate and improve pipeline generation to both increase revenue and to deliver better revenue predictability. Revsure AI has raised a seed round and is growing fast. To get the latest …

1
The Future of AI Agents with Voiceflow CEO Braden Ream 39:47

7M ago39:47

39:47

Season 6 Episode 136 Voiceflow CEO Braden Ream joins host Jason Stoughton to talk about the current state of AI Agents and how Voiceflow is challenging the status quo and upending the industry. Recently off a Series A Voiceflow is doing some really work in the space. Follow Jason Stoughton as he talks to leaders in the AI industry, start-up founder…

1
Discovering Hot Edge AI Start-Up Axelera AI with CEO Fabrizio Del Maffeo 36:28

7M ago36:28

36:28

Season 6 Ep: 135 Join Jason Stoughton as he sits down with exciting start-up Axelera AI's CEO and Co-Founder Fabrizio Del Maffeo and talk about why Edge AI is so hot, what the future looks like and why the industry loves Axelera's Metis™ AI platform – a holistic hardware and software solution for AI interference at the edge – enables computer visio…

1
Discovering the Scale by the Bay Conference with Founder Dr. Alexy Khrabrov 26:27

7M ago26:27

26:27

New Podcast Season Six Episode 134! Scale by the Bay is a conference for developers and a place to network with industry leaders and AI insiders and to roll up your sleeves and dig deep into topics. Dr. Alexy Khrabrov joins host Jason Stoughton to talk about this years event, the state of AI, some of the cutting edge workshops they will host (i.e. …

1
Rochan Sankar, CEO of Enfabrica, Fresh Off a Recent $125 Million Series B Raise, and Their Goals to Ramp Their Accelerated Compute Fabric Solutions 32:00

8M ago32:00

32:00

New Podcast Episode Season 6 #133! Rochan Sankar, Founder, CEO and President of Enfabrica joins podcast host Jason Stoughton to talk about their Accelerated Compute Fabric Solutions, the challenges and opportunities in the AI market today and why they were able to raise $125 million in a Series B with Nvidia as part of the investment group. Sign up…

1
AI and the Creative Process with Author Nina Schuyler 46:41

9M ago46:41

46:41

New podcast Season 6 EP. 132 Nina Schuyler, author of Afterword, joins host Jason Stoughton to talk about her new book and how AI is impacting the the writing process today and how it might impact writing in the future. With Hollywood writers on strike, in large part due to their concern that AI might replace them, there is no better time to cut th…

1
Founder of AI First Early Stage VC Firm Zetta Venture Partners Says AI Makes this a Great Time to be an Entrepreneur 41:37

10M ago41:37

41:37

New Podcast Episode, Season 6, Episode 131 Mark Gorenberg, Founder and Managing Director of Zetta Venture Partners and current Chair of the Board of Trustees of the Massachusetts Institute of Technology Corporation and a member of the MIT Executive Committee, joins host Jason Stoughton to talk about his path to becoming a VC almost 30 years ago and…

1
Paige is the leader in the use of AI in Oncology 38:50

10M ago38:50

38:50

New podcast episode season six episode 131. Jason Stoughton is joined by Dr. Thomas Fuchs, Department Chair of Artificial Intelligence and Human Health at Mt. Sinai and Founder of Paige, to talk about AI in medicine and healthcare and the amazing things Paige is doing to empower pathologists and transform oncology. AI holds the promise of transform…

1
Soar is building AI to help you make more good decisions and maximize your time on earth. 1:24:30

11M ago1:24:30

1:24:30

Latest Season Six Pulse of AI Podcast Episode 130. On this podcast I am joined by Paul Allen. Paul has founded 8 companies in his career, including Ancestry.com. Paul’s current company, Soar.com is building a personal AI assistant for each person who wants to make more good decisions and maximize their time on earth. The foundation for this AI syst…

1
Crossing Minds is using AI to Revolutionize Personalized Recommendations without using Personal Data 35:59

11M ago35:59

35:59

New Pulse of AI Season Six Podcast Episode! On this podcast Host Jason Stoughton is joined by hot AI start-up Crossing Minds founder and CEO Alexandre Robicquet to talk about their breakthrough in behavior-based recommendations, which enable businesses to provide highly relevant recommendations to each user within a couple of clicks - all without u…

1
Working at DeepMind with Aleksa Gordic 1:49:49

11M ago1:49:49

1:49:49

Aleksa Gordic is an ex-software/ML engineer at Microsoft & DeepMind with a broad background across the "whole stack" - maths, electronics, software engineering, algorithms, ML & deep learning (computer vision, natural language processing (NLP), geometric DL, reinforcement learning (RL)...), web, mobile, etc. He is a Top Linkedin Voice in AI for 202…

1
Julia and Data Science with Bogumil Kaminski 2:07:59

12M ago2:07:59

2:07:59

Season 2 episode 2 of The Minhaaj Podcast this week brings on the child prodigy and genius co-creator of dataframes.jl package for Julia, Dr Bogumił Kamiński. Bogumil learned C language without owning a computer from library books at the age of 16 in a small Polish town. In post-communist Poland he went on to study applied problems in management an…

1
AI Drives the Software-Defined Heterogeneous Computing Era 8:08

12M ago8:08

8:08

By Dr. Sakyasingha Dasgupta. The rapid development of artificial intelligence (AI) applications has created enormous demand for high-performance and energy-efficient computing systems. However, traditional homogeneous architectures based on Von Neumann processors face challenges in meeting the requirements of AI workloads, which often involve massi…

1
Multimodal Generative AI on Energy-Efficient Edge Processors 6:30

12M ago6:30

6:30

By Dr. Sakyasingha Dasgupta. Edge computing will grow exponentially in the next few years, as more and more devices and applications demand low-latency, high-performance, and privacy-preserving computation at the edge of the network. However, one of the biggest challenges facing edge computing is handling the increasing complexity and diversity of …

1
Efficient Edge AI Chips with Reconfigurable Accelerators 7:56

12M ago7:56

7:56

By Nikolay Nez. DNA IP and MERA are a potent combination, reducing the hardware-specific knowledge OEMs would otherwise need to power AI applications efficiently. Much of the AI inference conversation focuses on delivering as many operations as quickly as possible. Massive GPU-based implementations can find homes in data centers with practically un…

1
再構成可能なアクセラレータを搭載した効率的なエッジAIチップ 10:30

12M ago10:30

10:30

DNA IPとMERAの強力なコンビネーションで、ユーザーがAIアプリケーションを効率的に動かすためのハードウエア固有の特別な知識習得の必要性を減らすことができます。 AI推論の話題の多くは、できるだけ早く多くの処理を提供することに焦点が当てられています。データセンターのように実質的に無制限の電力と冷却を備えた施設では、GPUベースの大きなシステムを実装することが可能です。しかし、データセンター以外の場所（広義では「エッジ」）にある組み込みシステムの制約が加わると、サイズ、重量、電力、利用率を考慮してスケーリングされた、より効率的なエッジAIチップが不可欠となります。EdgeCortix Dynamic Neural Accelerator (DNA) プロセッサアーキテクチャは、カスタムA…

1
Connecting Edge AI Software with PyTorch, TensorFlow Lite, and ONNX Models 6:31

12M ago6:31

6:31

By Antonio Nevado. Data scientists and others may have concerns moving PyTorch, TensorFlow, and ONNX models to edge AI software applications – MERA makes it easy and is model-agnostic. PyTorch, TensorFlow, and ONNX are familiar tools for many data scientists and AI software developers. These frameworks run models natively on a CPU or accelerated on…

1
What is edge AI inference doing for more devices? 7:05

12M ago7:05

7:05

By Jeffrey Grosman. AI inference is a common term - but what is edge AI inference? EdgeCortix provides an answer in terms of workloads, efficiency, and applications. Artificial intelligence (AI) is changing the rules for many applications. Teams train AI models to recognize objects or patterns, then run AI inference using those models against incom…

1
AI powered self serving BI with Ryan Janssen & Paul Blankely - Zenlytic 1:59:07

1y ago1:59:07

1:59:07

Ryan is an entrepreneur, data scientist, engineer, and former VC. He is the co-founder and CEO of Zenlytic, a SaaS business that makes a next-generation AI-powered BI tool that uses LLMs and Semantic layers. He previously co-founded Ex Quanta AI Studio, a full-service data consultancy.Ryan started his career as a software developer in his native Ca…

1
Augment AI is Doing Amazing Things in the Personal Assistant Space 51:06

1y ago51:06

51:06

Podcast Season 6 Episode 126 with Augment AI. Twitter @thepulseofai Many would agree that the holy grail of AI is to build a truly amazing personal assistant that acts as our highly competent Chief of Staff and that supercharges our output and eases the pain points across our entire personal and professional ecosystem. And because it is the holy gr…

1
Conversation with Hot AI Start-up Galilileo's Co-Founder Yash Sheth 29:59

1y ago29:59

29:59

Podcast: Jason Stoughton speaks with Yash Sheth, Co-Founder of hot AI start-up Galileo. Galileo is building the first ML data intelligence platform for data scientists working with unstructured data. If you are working with unstructured data, or want to join a company that is seeking to define and own the space, then check out Galileo. They have a …

1
Latest Pulse of AI Podcast with Guest Udi Cohen, Co-Founder and CEO, Vendict 29:22

1y ago29:22

29:22

Latest Season 6 Pulse of AI Podcast = Full Length version Udi Cohen, Co-Founder and CEO, of hot AI start-up Vendict joins Jason Stoughton to talk about his start-up, the new buzz around AI, why regulation is important and how we should approach it, and much more. To keep up with the latest subscribe to the podcast and follow Jason Stoughton @thepul…

1
New Pulse of AI Podcast with Guest Ashray Malhotra, Co-Founder and CEO Rephrase AI 29:32

1y ago29:32

29:32

New Pulse of AI Podcast (season 6)! Ashray Malhotra, Co-Founder and CEO, of hot AI start-up Rephrase AI joins Pulse of AI podcast host Jason Stoughton to talk about his start-up. Rephrase AI creates avatars and hyper-personalized videos at scale to businesses. The Pulse of AI is in its 6th season and host Jason Stoughton interviews insiders in the …

1
Podcast Conversation with Founder and CEO of Hot AI Start-Up Seek AI, Sarah Nagy 40:09

1y ago40:09

40:09

Astrophysicist, Wall Street quant, data scientist and now Founder and CEO of Seek AI, Sarah Nagy founded Seek AI to solve the core pain point that she, and thousands of other data scientists, experience everyday and is now focused on revolutionizing how employees across the organization interact with, and benefit from, data. Seek AI is a hot early …

1
Latest Pulse of AI Podcast with Special Guest Josh Tobin, Co-Founder/CEO at Gantry 36:21

1y ago36:21

36:21

Podcast Season 6! Josh Tobin joins me on this podcast to talk about the really interesting stuff they are doing at Gantry. In addition, as on every Pulse of AI podcast, we talk about numerous topics in AI and especially Generative AI since it is the topic de jour, but mostly because Josh spent critical time working at OpenAI so he has some interest…

1
Opensource Licensing for LLMs 24:00

1y ago24:00

24:00

In this episode we discuss licensing and commercial use for large language models. How does open source licensing affect you as an entrepreneur or decision maker? How do you navigate the line that separates commercial vs non-commercial use? Join our Discord to participate in the discussion: https://discord.gg/94xbKyTX…

1
GPT4, AI Transforming Business, the Future of Applications 13:49

1y ago13:49

13:49

Should AI already be transforming your business? And what does all of this mean for the future of applications? In this episode, we discuss GPT-4 and how the emergence of an increasingly closed-source AI ecosystem can be damaging for the entire industry.By Lightning AI

1
A new wave of AI-based products and the resurgence of personal applications 35:57

1+ y ago35:57

35:57

In this episode, Luca and I talk about Sarah Guo's advice to AI Entrepreneurs, Aligning models to customer needs, Luca's predictions about the future of AI and Programing without Programming, or Automation for Everyone. Also, if you want to learn more, check out our Read Log: https://lightningai.notion.site/The-AI-Buzz-with-Luca-and-Josh-Episode-5-…

1
ChatGPT + Bing and How to start an AI company in 3 easy steps. 35:26

1+ y ago35:26

35:26

In this episode, Luca and I talk about ChatGPT + Bing, Google vs Microsoft, Artificially learning high order logic, and how to start an AI company in 3 easy steps. Also, if you want to learn more, check out some of our sources here: https://lightningai.notion.site/Readlog-21-Feb-2023-eb0f44e895ce4c81b5777e6360f1324e…

1
Unbacked SymInts 21:31

1+ y ago21:31

21:31

This podcast goes over the basics of unbacked SymInts. You might want to listen to this one before listening to https://pytorch-dev-podcast.simplecast.com/episodes/zero-one-specialization Some questions we answer (h/t from Gregory Chanan): - Are unbacked symints only for export? Because otherwise I could just break / wait for the actual size. But m…

1
Zero-one specialization 21:07

1+ y ago21:07

21:07

Mikey Dagistes joins me to ask some questions about the recent recent composability sync https://www.youtube.com/watch?v=NJV7YFbtoR4 where we discussed 0/1 specialization and its implications on export in PT2. What's the fuss all about? What do I need to understand about PT2 to understand why 0/1 specialization is a thing?…

1
Constitutional AI, Emergent Abilities and Foundation Models 33:43

1+ y ago33:43

33:43

In this episode, Luca and Josh talk about Constitutional AI, a way to get models to train themselves not to say bad words, Emergent Abilities and Foundation Models.By Lightning AI

Podcasts Worth a Listen

PyTorch Podcasts

Podcasts Worth a Listen

Quick Reference Guide