Show notes are at https://stevelitchfield.com/sshow/chat.html
…
continue reading
Content provided by CCC media team. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by CCC media team or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
Unleashing the Power of GenAI with Edge Ecosystem Analytics and Kubernetes Orchestration (osc24)
MP4•Episode home
Manage episode 427701815 series 2475293
Content provided by CCC media team. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by CCC media team or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** about this event: https://c3voc.de
…
continue reading
1827 episodes
MP4•Episode home
Manage episode 427701815 series 2475293
Content provided by CCC media team. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by CCC media team or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.** In this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge. Key Topics: - Overview of **Large Language Models (LLMs)** - Scope for **Edge Computing** in AI revolution - Benefits over privacy concerns by **localization of LLMs** - Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics** - Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher & K3s** - Challenges while deploying **GenAI applications at the Edge** This short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and **AI Agents.** about this event: https://c3voc.de
…
continue reading
1827 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.