Go offline with the Player FM app!
Pete Warden - On launching "AI in a Box" and building a hardware edge AI company - #24
Manage episode 380617317 series 2838288
What's "AI in a Box"? Pete Warden joins the show to share a new project he recently launched that encapulates Language Transcription/Translation and Question Answering capabilities into a wallet-sized board running locally without internet, as well as stories and learnings from building his new company, Useful Sensors, after 7 years of leading the tensorflow mobile project at Google.
Pete is the CEO of Useful Sensors. After founding his own company Jetpac and selling it to Google in 2014, he became a staff research engineer at Google, where he led the TensorFlow Mobile team. Pete is also the author of two well-received books: "Public Data Sources" and "Big Data Glossary" and builder of OpenHeatMap.
Show Notes:
- AI in a Box crowdfunding: https://www.crowdsupply.com/useful-sensors/ai-in-a-box
- Pete's blog: https://petewarden.com/
- Useful Sensors: https://usefulsensors.com/
Stay in touch:
✉️ Subscribe to our newsletter: https://softwaremisadventures.com
👋 Send feedback or say hi: hello@softwaremisadventures.com
Segments:
[0:00:00] Failing and trying again, experiential learning
[0:03:13] AI-in-a-box demo
[0:07:28] Animatronics?
[0:10:12] Privacy and trust
[0:12:04] Talk to your appliances
[0:15:22] How to fit the LLM into such a small chip?
[0:16:50] Quantization
[0:20:07] Disposable ML frameworks
[0:24:33] Updating model on shipped hardware
[0:28:34] LLMs with specialized domain knowledge
[0:30:08] Founding Useful Sensors
[0:37:07] scaling training vs inference
51 episodes
Manage episode 380617317 series 2838288
What's "AI in a Box"? Pete Warden joins the show to share a new project he recently launched that encapulates Language Transcription/Translation and Question Answering capabilities into a wallet-sized board running locally without internet, as well as stories and learnings from building his new company, Useful Sensors, after 7 years of leading the tensorflow mobile project at Google.
Pete is the CEO of Useful Sensors. After founding his own company Jetpac and selling it to Google in 2014, he became a staff research engineer at Google, where he led the TensorFlow Mobile team. Pete is also the author of two well-received books: "Public Data Sources" and "Big Data Glossary" and builder of OpenHeatMap.
Show Notes:
- AI in a Box crowdfunding: https://www.crowdsupply.com/useful-sensors/ai-in-a-box
- Pete's blog: https://petewarden.com/
- Useful Sensors: https://usefulsensors.com/
Stay in touch:
✉️ Subscribe to our newsletter: https://softwaremisadventures.com
👋 Send feedback or say hi: hello@softwaremisadventures.com
Segments:
[0:00:00] Failing and trying again, experiential learning
[0:03:13] AI-in-a-box demo
[0:07:28] Animatronics?
[0:10:12] Privacy and trust
[0:12:04] Talk to your appliances
[0:15:22] How to fit the LLM into such a small chip?
[0:16:50] Quantization
[0:20:07] Disposable ML frameworks
[0:24:33] Updating model on shipped hardware
[0:28:34] LLMs with specialized domain knowledge
[0:30:08] Founding Useful Sensors
[0:37:07] scaling training vs inference
51 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.