Go offline with the Player FM app!
Announcements from AWS re:Invent | The Gestalt IT Rundown: November 29, 2023
Manage episode 386545703 series 2134755
Amazon announced that they will be using Nvidia's NVSwitch to create new rackscale AI platforms. This allows customers to use Nvidia technology like Grace Hopper or build something using AWS Nitro DPUs and Elastic Fabric Adapaters. That last combination doesn't use InfiniBand and moves to Ethernet. Two new chips are coming out from the Amazon labs. The first is Graviton4, the latest generation of Arm processor. Graviton4 has 50% more cores and 75% more memory bandwidth. This version of Graviton is based on the Demeter Neoverse V2 core. On the AI front Amazon also announced the next revision of their AI acceleration chip, Trainium2. This update has a 4x performance increase from the first generation and allows for liquid cooling. Trainium2 is designed to be deployed in clusters of 16 chips. In the data space, AWS made news with the GA of Bedrock, which enables customers to run foundational ML models from companies like Anthropic, Meta, and of course AWS itself. But many companies are worried about hallucination and want to include their own data in these models. That's what AWS is delivering with Guardrails, and what AWS partners are leaning into as well. This and more on this week's Gestalt IT Rundown.
0:00 - Welcome to the Rundown
1:18 - DAOS Foundation Launched for Object Storage
4:57 - Autonomous Purple Team annouced by Skyhawk at AWS re:Invent
8:26 - Couchbase's Capella Columnar Service Revealed
10:59 - Hackers Were Inside NXP For Two Years Before Detection
14:47 - AWS re:Invent Announcements
15:26 - NVSwitch For AI Nodes
20:46 - ARM V2 for Graviton4 and Trainium2
25:22 - AWS Guardrails for Bedrock
30:10 - The Weeks Ahead
33:10 - Thanks for Watching
Follow our Hosts on Social Media
Tom Hollingsworth: https://www.twitter.com/NetworkingNerd
Stephen Foskett: https://www.twitter.com/SFoskett
Follow Gestalt IT
Website: https://www.GestaltIT.com/
Twitter: https://www.twitter.com/GestaltIT
LinkedIn: https://www.linkedin.com/company/Gestalt-IT
Tags: #Rundown, AI, #AWSreinvent, #AWS, #Storage, @SkyhawkCloudSec, @Couchbase, #Capella, #Data, #Security, #NXP, #China, @AWS, @NVIDIA, #GraceHopper, @Arm, #Graviton4, #Bedrock, @NetworkingNerd, @SFoskett, @GestaltIT,
294 episodes
Manage episode 386545703 series 2134755
Amazon announced that they will be using Nvidia's NVSwitch to create new rackscale AI platforms. This allows customers to use Nvidia technology like Grace Hopper or build something using AWS Nitro DPUs and Elastic Fabric Adapaters. That last combination doesn't use InfiniBand and moves to Ethernet. Two new chips are coming out from the Amazon labs. The first is Graviton4, the latest generation of Arm processor. Graviton4 has 50% more cores and 75% more memory bandwidth. This version of Graviton is based on the Demeter Neoverse V2 core. On the AI front Amazon also announced the next revision of their AI acceleration chip, Trainium2. This update has a 4x performance increase from the first generation and allows for liquid cooling. Trainium2 is designed to be deployed in clusters of 16 chips. In the data space, AWS made news with the GA of Bedrock, which enables customers to run foundational ML models from companies like Anthropic, Meta, and of course AWS itself. But many companies are worried about hallucination and want to include their own data in these models. That's what AWS is delivering with Guardrails, and what AWS partners are leaning into as well. This and more on this week's Gestalt IT Rundown.
0:00 - Welcome to the Rundown
1:18 - DAOS Foundation Launched for Object Storage
4:57 - Autonomous Purple Team annouced by Skyhawk at AWS re:Invent
8:26 - Couchbase's Capella Columnar Service Revealed
10:59 - Hackers Were Inside NXP For Two Years Before Detection
14:47 - AWS re:Invent Announcements
15:26 - NVSwitch For AI Nodes
20:46 - ARM V2 for Graviton4 and Trainium2
25:22 - AWS Guardrails for Bedrock
30:10 - The Weeks Ahead
33:10 - Thanks for Watching
Follow our Hosts on Social Media
Tom Hollingsworth: https://www.twitter.com/NetworkingNerd
Stephen Foskett: https://www.twitter.com/SFoskett
Follow Gestalt IT
Website: https://www.GestaltIT.com/
Twitter: https://www.twitter.com/GestaltIT
LinkedIn: https://www.linkedin.com/company/Gestalt-IT
Tags: #Rundown, AI, #AWSreinvent, #AWS, #Storage, @SkyhawkCloudSec, @Couchbase, #Capella, #Data, #Security, #NXP, #China, @AWS, @NVIDIA, #GraceHopper, @Arm, #Graviton4, #Bedrock, @NetworkingNerd, @SFoskett, @GestaltIT,
294 episodes
Tüm bölümler
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.