Announcements from AWS re:Invent | The Gestalt IT Rundown: November 29, 2023

Gestalt IT Rundown

Amazon announced that they will be using Nvidia's NVSwitch to create new rackscale AI platforms. This allows customers to use Nvidia technology like Grace Hopper or build something using AWS Nitro DPUs and Elastic Fabric Adapaters. That last combination doesn't use InfiniBand and moves to Ethernet. Two new chips are coming out from the Amazon labs. The first is Graviton4, the latest generation of Arm processor. Graviton4 has 50% more cores and 75% more memory bandwidth. This version of Graviton is based on the Demeter Neoverse V2 core. On the AI front Amazon also announced the next revision of their AI acceleration chip, Trainium2. This update has a 4x performance increase from the first generation and allows for liquid cooling. Trainium2 is designed to be deployed in clusters of 16 chips. In the data space, AWS made news with the GA of Bedrock, which enables customers to run foundational ML models from companies like Anthropic, Meta, and of course AWS itself. But many companies are worried about hallucination and want to include their own data in these models. That's what AWS is delivering with Guardrails, and what AWS partners are leaning into as well. This and more on this week's Gestalt IT Rundown.

0:00 - Welcome to the Rundown

1:18 - DAOS Foundation Launched for Object Storage

4:57 - Autonomous Purple Team annouced by Skyhawk at AWS re:Invent

8:26 - Couchbase's Capella Columnar Service Revealed

10:59 - Hackers Were Inside NXP For Two Years Before Detection

14:47 - AWS re:Invent Announcements

15:26 - NVSwitch For AI Nodes

20:46 - ARM V2 for Graviton4 and Trainium2

25:22 - AWS Guardrails for Bedrock

30:10 - The Weeks Ahead

33:10 - Thanks for Watching

Follow our Hosts on Social Media

Tom Hollingsworth: ⁠⁠https://www.twitter.com/NetworkingNerd⁠⁠

Stephen Foskett: ⁠⁠https://www.twitter.com/SFoskett⁠⁠

Follow Gestalt IT

Website: ⁠⁠https://www.GestaltIT.com/⁠⁠

Twitter: ⁠⁠https://www.twitter.com/GestaltIT⁠⁠

LinkedIn: ⁠⁠https://www.linkedin.com/company/Gestalt-IT

Tags: #Rundown, AI, #AWSreinvent, #AWS, #Storage, @SkyhawkCloudSec, @Couchbase, #Capella, #Data, #Security, #NXP, #China, @AWS, @NVIDIA, #GraceHopper, @Arm, #Graviton4, #Bedrock, @NetworkingNerd, @SFoskett, @GestaltIT,