#87 A/B testing controversies and generative AI (with Shaun McGirr @ Dataiku)

The Measure Pod

Full show notes, transcript and (NEW!) AI chatbot - https://bit.ly/461QORs.

00:00:00 Intro.
00:00:32 Data expert discusses A-B testing and generative AI.
00:05:03 Different perspectives on data science.
00:09:34 Be holistic in data analysis.
00:14:16 Experimentation is both science and art.
00:18:02 Value of experimentation in CRO.
00:25:55 Data democratization is essential.
00:29:53 AI has the potential to revolutionize data analytics.
00:33:39 Data people should focus on efficiency.
00:36:18 Promote better question asking.
00:40:39 Data analysts need to adapt or risk being left behind.
00:44:56 Data perfection is a myth.

-----

Episode Summary:

In this week's episode of The Measure Pod, we dive into a fascinating conversation with Shaun McGirr, a data expert at Dataiku and former Crap Talks presenter. We explore the world of A/B testing, experimentation, and the future of analysts' roles as generative AI becomes more prevalent. Shaun shares his thoughts on the controversy surrounding A/B testing and the importance of considering other methods of learning about the world. We discuss the challenges and potential of using generative AI in the data analytics space, and how it can revolutionize the way we work with data. Grab your headphones and stap in for an insightful and thought-provoking discussion on the evolving landscape of data science and experimentation!

-----

Quotes of the Episode:

"We very commonly hear, oh, I can't do anything interesting with data or AI or predicting anything until I've got all my data perfect. It's a myth subscribed to by people who have never actually worked with data. Because if you have, you know it's never perfect and you still have to make a decision happen." - Shaun

"What if you provided an interface that helped people ask the right questions or at least better questions? And if they had no questions, they could be suggested questions and they could pick the questions that they liked the most, and then the job of data people to make LLMs useful is to do prompt engineering, right? To take the small human questions right? Put more context around them." - Shaun

"It still requires human curiosity." - Shaun

-----

About The Measure Pod:

The Measure Pod is a weekly podcast hosted by veteran practitioners of the marketing and product analytics industry. Join Dan and Dara from Measurelab, Bhav from CRAP Talks and the occasional guest on their quest to make sense of the analytics industry, and have some fun along the way.

-----

If you liked this episode, don't forget to subscribe to The Measure Pod on your favorite podcast platform and leave us a review. Let's make sense of the analytics industry together!

The post #87 A/B testing controversies and generative AI (with Shaun McGirr @ Dataiku) appeared first on Measurelab.