podcast
details
.com
Print
Share
Look for any podcast host, guest or anyone
Search
Showing episodes and shows of
Rommil Santiago's Experiment Nation
Shows
Experiment Nation: The Podcast
S4E15 - Product Experimentation: How to get Product Managers to Experiment ft. Shagun Aulakh
How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways: 1- Leadership advocacy is critical for embedding experimentation practices in a highly matrixed organization. 2 - Prioritize education and internal PR to influence and persuade teams to embrace experimentation. 3- Define success metrics for your experimentation program and map out a long-term plan for evolving maturity. 5 - Identify champions within the organization to inspire and motivate other teams to adopt experimentation practices. 5 - Democratize insights and...
2024-06-07
49 min
Experiment Nation: The Podcast
S4E13 - Use automation to build optimal flow states with Shawn David
Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial specially to them. We explored the impacts on company culture that menial tasks can cause and discussed some of the pitfalls with new technologies as well as lessons to keep in mind while reviewing new tools and technologies.
2024-05-25
52 min
Experiment Nation: The Podcast
S4E10 - Don't A/B Test?! featuring Solomon Kahn
CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn Solomon's email: solomon.kahn@gmail.com Original YouTube Video: https://www.youtube.com/watch?v=vqPylhO3ePU Original LinkedIn Post: https://www.linkedin.com/posts/solomonkahn_the-case-against-ab-testing-yes-i-know-activity-7184577272685719552-hFAB Ron's reply: https://www.linkedin.com/posts/ronnyk_abtesting-experimentguide-abtestingissues-activity-7185060367054565376-cAU9
2024-04-27
35 min
Experiment Nation: The Podcast
S4E1 - How to build a community around experimentation with Rommil Santiago
Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
2024-02-23
40 min
Experiment Nation: The Podcast
S3E7 - The Best CROs start with RESEARCH - With Rommil Santiago
Does exactly what it says on the tin. #research #conversion #optimization
2023-03-11
02 min
Experiment Nation: The Podcast
S3E6 - Pragmatists will grow the CRO industry - not purists - with Matt Scaysbrook
Our industry can be damning of those doing things ""imperfectly"" - but it seems not to draw the distinction between those doing things imperfectly through ignorance (who can be educated) and those doing things imperfectly through lack of a better option (who need to be helped to show the value to decision-makers). This attitude has a negative impact on new entrants to the industry and sets completely the wrong tone for the next generation. The greater the participation in the industry, the stronger it will become - the wider that participation, the more ideas (and the more diverse those id...
2023-03-04
18 min
Experiment Nation: The Podcast
S3E5 - How to be good at coding A/B tests with Jeroen Wiersma
How to be a good test coder with Jeroen Wiersma
2023-02-25
31 min
Experiment Nation: The Podcast
S3E4 - The CRO Survival guide with Carlos Trujillo
In this session, I want to cover the most strategic actions that a new Experimentation Strategist (or Program Manager) can execute during their first three months in the role to increase trust among the stakeholders and clients. I will share this based on my experience working with clients such as Miro, Procore, The Bouqs, and Gympass, among others. About the speaker Carlos has over nine years of experience working in online marketing and mass media. As an agency founder, he has led web development and conversion optimization projects for more than 80 brands in multiple regions and verticals. It has pr...
2023-02-18
11 min
Experiment Nation: The Podcast
S3E3: Stop wasting time by having principles with Rommil Santiago
You don't have to A/B test everything. Be smart by having guiding principles. #conversionrateoptimization #experimentation #ecommerce
2023-02-10
03 min
Experiment Nation: The Podcast
S3E2: The top 3 things CROs forget to do with Alexandra Matheny
Many optimizers are good at using data to craft hypotheses. Great optimizers, however, build data-driven segments, analyze by business goals (not just test KPIs), and importantly, propose how to take action on campaign results. About the speaker Alexandra leads Product Marketing at Kameleoon. She loves storytelling as a way of demonstrating a product’s values and benefits to customers. Chapters --- 0:00 - Introduction 3:41 - Great experimenters consolidate their customer data for precise and persistent segmentation 6:40 - Great experimenters analyze by meaningful business goals and draw actionable conclusions 8:05 - Great experimenters take action on their experimentation results 10:29 - Coming to full...
2023-02-04
12 min
Experiment Nation: The Podcast
S3E1: The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini #experimentation #conversionrateoptimization #growth
2023-01-28
44 min
Experiment Nation: The Podcast
S2E41: How to adopt a CRO mindset for life optimization with Ruben de Boer
Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.
2022-12-09
48 min
Experiment Nation: The Podcast
S2E40: How to build a customer journey map with Anthony Wallace
Creating a customer journey map can help stakeholders better understand the customer’s experience, and helps ensure that all stakeholders are working towards the same goal. It can also help identify potential areas of improvement, and provide insights into how customers interact with your product, service, or organization.
2022-12-03
21 min
Experiment Nation: The Podcast
S2E39: How to land a great job in CRO (and earn what you’re worth) with Tracy Laranjo
When looking for a job, it’s important to have a clear idea of what you’re looking for in terms of type of work, salary, benefits, and work culture. You should also have a general understanding of your skills and experience, and be able to articulate to potential employers why you’d be a good fit for the job. Tracy Laranjo walks you through the things you need to know to land that dream job and get the salary you deserve.
2022-11-19
26 min
Experiment Nation: The Podcast
S2E38: Why good form design is important and common form optimization myths with Alun Lucas
Form optimization is the process of improving the structure and design of a web form to make it more user-friendly and efficient. This includes streamlining the form’s layout, making it easier to understand and fill out, and adding features such as auto-fill, pre-filled fields, and error handling. Alun Lukas shares how optimizing forms helps to reduce user frustration and abandonment, increase conversions, and improve the overall user experience.
2022-11-12
41 min
Experiment Nation: The Podcast
S2E37: Pre-test planning: The Red-Headed Stepchild of Experimentation with Haley Carpenter
Teams are horrible at this! They have no idea it should happen, and if they do, they're usually lost and the approach is terrible. When you break it down, it's really not difficult. This shouldn't be a black box anymore. I will cover the following: (1) What each of the test planning aspects are and how to do them including MDE and duration estimates, (2) CXL's pre-test calculator unless our new Optimizely one is live by the time I record, (3) how to turn pre-test calculations into a testing roadmap, and (4) how to determine when a business can't test or when a sw...
2022-11-05
34 min
Experiment Nation: The Podcast
S2E36: Why Focus on Skeptical First-time Buyers? With Rishi Rawat
Skeptical first-time buyers need to be given the utmost priority in order to make them feel comfortable and secure with their purchase. This may include providing detailed product or service information, offering multiple payment options, providing customer service support, and offering warranties or guarantees for their purchase. Rishi shares his thoughts on how to win over this critical customer segment.
2022-10-22
18 min
Experiment Nation: The Podcast
S2E35: My quick and dirty approach to creating a Learning Agenda (aka the BADR method) with Rommil Santiago
Stop testing randomly. Have a plan.
2022-10-08
05 min
Experiment Nation: The Podcast
S2E34: Online Dialogue's Ton Wesseling shares his thoughts on how CRO will probably die
CRO is a process of optimizing a website or landing page to maximize the percentage of visitors to convert into paying customers. It involves testing different elements of the website to determine what works best for increasing conversions. As long as businesses value increasing their conversion rate, CRO will remain an important part of online marketing and web design - but it may not exist as a profession one day. Our new podcast host, Richard Joe, asks Ton about the culture of Experimentation, and how we CRO will die...one day.
2022-10-01
59 min
Experiment Nation: The Podcast
S2E33: Test before you build anything or you'll waste time course-correcting with Rommil Santiago
There’s a lot of talk about how to find things to test, how to analyze tests and the importance of iterating on tests. This week, I was thinking about how I could add something a little different to the conversation and decided to share my thoughts about when to run a test - particularly when building products.
2022-09-16
03 min
Experiment Nation: The Podcast
S2E32: Not every insight is derived from an A/B Test with Daniela Marquez
Curiosity needs to be a driver in every experimenter’s toolkit. What is going on in the head of my customer? What is really their job-to-be-done? When buying flowers, we typically think of the standard occasions: Mother’s Day, Valentine’s Day, new baby & sympathy. But if we were to structure our ecommerce website on those occasions alone, we may be addressing the majority, but we’d be missing out on the real motivation behind the purchase as well as other reasons people buy flowers. By deconstructing the customer’s journey of buying flowers, we discovered a piece of data that w...
2022-09-09
10 min
Experiment Nation: The Podcast
S2E31: 3 ways to be a better Experimentation leader with Rommil Santiago
Even if you are the best Experimenter at your company, unless you are able to nurture a culture of Experimentation - you’ll end up constantly fighting uphill battles. Here are a few quick pointers on how to be a better Experimentation leader.
2022-09-02
02 min
Experiment Nation: The Podcast
S2E30: What Hawaiian Pizza can teach us about creating a more inclusive CRO industry with Rommil Santiago
Pineapple on pizza. If you ever want to have a heated debate with a group of people, ask them if pineapple belongs on pizza. Now let’s replace pizza with CRO and pineapple with “best practices” (or whatever topic CROs are angry about on LinkedIn these days).
2022-08-20
04 min
Experiment Nation: The Podcast
S2E29: How Europe leverages AI for optimization with Noémie Sauvage
Watch this session on Youtube: https://youtu.be/JqT95k7eG_8
2022-08-13
13 min
Experiment Nation: The Podcast
S2E28: How Wordle proves that Experimentation works with Rommil Santiago
About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-08-06
03 min
Experiment Nation: The Podcast
S2E27: Pizza Dough CRO with Simon Clark
Based on a brand new obsession (thanks to the pandemic) for homemade pizza, I would like to talk about how optimisation is just like cooking that perfect pie. You can have all of the tools in the world, but do you have the experienced chef and the right ingredients. Sure, you can cook up a quick Margherita in under an hour, but does it taste good. But, what if you left the dough to rise for a few days? Well, you’d get a much better flavour, and a smooth experience. Optimisation and Pizza Making are the same and I wi...
2022-07-30
20 min
Experiment Nation: The Podcast
S2E26: Can you run tests on sites with little traffic? With Rommil Santiago
About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-07-23
04 min
Experiment Nation: The Podcast
S2E25: How to verify your data truly reflects user behaviour with Florent Buisson
Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It's the book he wished he had when he started in analytics. In this episode, he shares: Plus other statistical concepts explained in a way even a five-year-old could understand.Why intuition can actually be a good thing in data analytics If you need to know R or Python to understand your users Why and when causal analytics are important -- Florent Buisson is a behavioral economist with 10 years of...
2022-07-16
31 min
Experiment Nation: The Podcast
S2E24: How do I change people’s attitudes towards Experimentation? With Rommil Santiago
About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-07-09
02 min
Experiment Nation: The Podcast
S2E23: How to make a better sandwich: An introduction to multivariate testing with Danielle Gunraj
A/B Testing can be intimidating to the uninitiated, but it doesn’t have to be! I want to introduce testing concepts via a real-world scenario that we can all relate to: Dessert. I’ll cover what an MVT is, hypotheses, independent variables, dependent variables, results (of course), and design flaws. And if you need any more convincing, I have four words for you: Monte Cristo Bread Pudding.
2022-07-02
11 min
Experiment Nation: The Podcast
S2E22: Choosing the right A/B testing tool with Product for Product
Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there. Whether you're in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more. **This episode, nor those of Product for Product, are endorsements of any of the discussed tools.** Listen to Product for Product: spreaker.com/show/product-for-product Find Matt on LinkedIn: /in/mattgreenanalytics Find Moshe on LinkedIn: /in/mikanovsky
2022-06-25
27 min
Experiment Nation: The Podcast
S2E21: Experiment Cartography - Building the Perfect Roadmap with Kenya Davis and Krissy Tripp
You can do better than testing button colors, but how do you decide what to test when, and what type of test to run? Roadmapping. This session teaches you to be the GPS navigator, helping your team optimize experimentation routes. On this journey, you will identify how each path can drive desired impacts by turning a formidable trek into a series of attainable milestones. Presented by Kenya Davis, Microsoft Digital Analytics Planning Program Manager, and Evolytics Decision Science Director Krissy Tripp.
2022-06-19
25 min
Experiment Nation: The Podcast
Experiment Nation: The Podcast Trailer
Experiment Nation: The Podcast is a show on which we share Interviews with Experimenters from around the world, opinion pieces, and recent presentations with you - the experimentation community. We hope you enjoy the show, let’s get to it. If you enjoy our content, consider signing up for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-06-17
00 min
Experiment Nation: The Podcast
S2E20: How to rally your team around Voice of Customer research with Tracy Laranjo
Tracy is a Toronto-based growth marketer with a knack for conversion optimization. In a past life she’s QA tested “adult” eBooks and helped make it easier for Canadians to write their wills online. Tracy is also one of the co-hosts of the Experiment Nation podcast where she chats with optimizers at the top of their game. Beyond the 9-5, you can catch her knitting, crushing empires in Civ6, or napping with her cats.
2022-06-12
13 min
Experiment Nation: The Podcast
S2E19: How do you respond to someone who says, “Let’s not experiment, it just slows us down. Can’t we just put it on our webpage?” with Rommil Santiago
About this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-06-11
02 min
Experiment Nation: The Podcast
S2E18: Johann Van Tonder on how to conquer 4 common ideation pitfalls with research-backed methods
eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions. Find Johann on Twitter: @amaclickclick Learn more about AWA Digital: awa-digital.com
2022-06-04
37 min
Experiment Nation: The Podcast
S2E17: Developing a Culture of Testing/Experimentation with Anil Batra
Anil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and an MBA from the University of Washington, Seattle. He is the founder of https://academy.optizent.com – A Digital Analytics training and education company.
2022-05-28
19 min
Experiment Nation: The Podcast
S2E16: When is it OK to run 2 A/B tests simultaneously on a site? Is it ever OK? With Rommil Santiago
About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-05-21
04 min
Experiment Nation: The Podcast
S2E15: Where are the users? with Moshe Mikanovsky
When experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users.
2022-05-14
14 min
Experiment Nation: The Podcast
How do I make the most impact in my role when I only own optimization for a small part of the user journey? With Rommil Santiago
About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.
2022-05-07
03 min
Experiment Nation: The Podcast
Using Chi-Square Analysis for A\B\N Tests with W. Scott Sanders
Although the two sample proportion test is well known within the marketing experimentation community, there are a host of categorical data analysis techniques that are amenable to the analysis of A\B test data. This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation. Specifically, we discuss how to 1) test a\b\n experiments without inflating Type I error after multiple comparisons, 2) analyze tests with more than dichotomous outcome variables and 3) the process for calculating goodness-of-fit and tests-of-independence. Simple guidelines will be provided regarding test assumptions and use case scenarios.
2022-05-02
24 min
Experiment Nation: The Podcast
Sina Fak on why CRO is not a person but a multidisciplinary Experimentation team
Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO. Learn more about ConversionAdvocates: https://conversionadvocates.com/ Find Sina Fak on LinkedIn: https://www.linkedin.com/in/sinafak/
2022-03-31
39 min
Experiment Nation: The Podcast
How to make a customer-centric diagnosis with Marion Ravel
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-02-18
12 min
Experiment Nation: The Podcast
Reducing the cost of running an experimentation program with Tasin Reza
We know that the key skillsets you need for any successful CRO / Experimentation program are: Research, Design, Development and QA. Whilst larger companies who can afford to hire all of those skilled people, for smaller companies, it becomes a big challenge. So much so, many companies exhaust their options of running smaller tests and then stop doing all kind of experimentation work. In this session, I will be covering the areas where the companies can reduce their cost of experimentation, things that they will need to consider and increase their profitability of running a successful experimentation program. ...
2022-02-12
17 min
Experiment Nation: The Podcast
What 13 Years of A/B Testing Revealed with Rishi Rawat
Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”. Learn more about Rishi's work at frictionless-commerce.com.
2022-02-05
48 min
Experiment Nation: The Podcast
What’s the best time to send an email with Deborah O'Malley
A lot of research and data analysis has gone in to answering this question. But yet, there’s no clear, definitive answer. In attempt to resolve this question once-and-for-all, this session will present and interesting and surprising answer. Applying the results from a real-life A/B test case study, digital marketers will be prompted to think not only about email send time, but also their audience and how both aspects impact conversions. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-02-05
18 min
Experiment Nation: The Podcast
The challenges nobody talks about with Taz Risma
Finally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-01-29
10 min
Experiment Nation: The Podcast
Where I started: Dennis van der Heijden
Welcome to "Where I Started", the interview mini-series in which we get behind the scenes and find out how some of today's experimenters got into CRO. This should be a fun little project that Ontrack Digital started with Experiment Nation to give you a bit of a getaway from all those test results. But also it can be a source of inspiration for those of you that want to get started in CRO and don't really know which path to take. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter...
2022-01-29
04 min
Experiment Nation: The Podcast
We Need More ART in CRO with Jimmy Barber
This session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. There’s so much data, and we often find ourselves simply staring at metrics looking for “+” or “-” to make decisions. The objective of this session is to draw on thinking strategies from physics, of how to approach CRO differently, without any real “data”, to then gleam positive impacts to CRO. Finally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-01-22
08 min
Experiment Nation: The Podcast
Moving Beyond Spaghetti Testing with Haley Carpenter
The success of your testing program depends on the quality of your hypotheses. But too many experimentation programs lack the processes and frameworks to move from spaghetti testing to strategic experimentation. Haley shares two practical frameworks to help you form better hypotheses and objectively rank test ideas. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-01-15
11 min
Experiment Nation: The Podcast
What is product growth? Creating & Navigating the path to product growth with Aditi Gupta
Aditi Gupta covers the creation of a growth roadmap/ how to build alignment with stakeholders/ creating an org-wide impact. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-01-07
07 min
Experiment Nation: The Podcast
Where I started: Shiva Manjunath
Welcome to "Where I Started", the interview mini-series in which we get behind the scenes and find out how some of today's experimenters got into CRO. This should be a fun little project that Ontrack Digital started with Experiment Nation to give you a bit of a getaway from all those test results. But also it can be a source of inspiration for those of you that want to get started in CRO and don't really know which path to take. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter...
2022-01-04
04 min
Experiment Nation: The Podcast
Speero's Experimentation Maturity Audit with Edgar Spongolts
Speero's Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency's Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation --- If you looked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ
2022-01-04
45 min
Experiment Nation: The Podcast
Creating an experimentation program that’s more than A/B testing with Annika Thompson and Paul Randall
Too often experiments are squandered. But if you put customer problems first and design the right type of test you can ensure every experiment is valuable to your business. The following talk will give your experimentation programs guardrails to make sure you’re not testing for testing sake. In this session Annika and Paul will share; How to map out business goals and customer problems. How to pick the right type of experiment. e.g when to use tree testing, copy testing, 5 second tests, A/B tests etc. How to gain insights faster and deliver more effective experiments. ...
2022-01-01
20 min
Experiment Nation: The Podcast
Best practices might be killing your experimentation culture – 3 reasons why with Ana Catarina Cizilio
Experiment Nation: The Conference Reloaded Everybody is doing it, so you have to do it too, right? As my mom used to say: you’re not everyone! Best practices are not experimentation and you should know that. I want to prove to you this is the easy way, but it’s not the right way for a healthy, profitable and experiment-oriented business. These tactics don’t last long. In this session, we will discuss why, statically, best practices don’t work. It’s fun to know about the competitors, their results and ideas. It may generate new ideas and g...
2021-12-25
08 min
Experiment Nation: The Podcast
Ripple Benefits: CRO as the foundation of other digital marketing efforts with Spencer Gray
Experiment Nation: The Conference Reloaded CRO should be the foundation that all of your other digital marketing efforts rests upon. Through what we call our ‘Ripple Benefits’, I’d love to showcase just how CRO not only improves your conversion rates, but your SEO, Content Marketing, Paid Ads, and more. Testing is key and should be the foundation that drives where your efforts are focused. - ----- If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https...
2021-12-18
13 min
Experiment Nation: The Podcast
Aiven’s Petra Lylander on experimentation documentation and processes
Petra Lylander is a growth marketer who developed the experimentation process at Helsinki-based SaaS company, Aiven. In this episode she talks about process documentation for experimentation and how to get other teammates to care about it. ------ If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https://lnkd.in/g6rM8w25
2021-12-14
29 min
Experiment Nation: The Podcast
How to "Hack" Experimentation with Anthropology with Eden Bidani
Experiment Nation: The Conference Reloaded AKA Why you should approach research like an Anthropologist How ethnographic research helps you understand *why* people think the way they think (not just *what* they think or how they respond to triggers) to create more meaningful hypotheses and experiments. ------ If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https://lnkd.in/g6rM8w25
2021-12-11
09 min
Experiment Nation: The Podcast
Experimentation post-conversion: Switching from buying journey to customer journey with Juliana Jackson
Experiment Nation: The Conference Reloaded Experimentation post-conversion or how to switch from buying journey to customer journey.
2021-12-03
29 min
Experiment Nation: The Podcast
Five things that piss me off about eCommerce and how to fix them with Jon Ivanco
Experiment Nation: The Conference Reloaded A quick and dirty guide to pointing out bad practices that create friction to the customer when brands practice the company journey instead of the customer journey.
2021-11-27
18 min
Experiment Nation: The Podcast
CRO não é um profissional e sim um processo (participação especial André Gillich)
Nesse episódio nosso convidado André Gillich, Head of CRO, compartilha sua experiência na Jussi crescendo a cultura de experimentação, começando pela nova abordagem em que “CRO não é um profissional e sim um processo.”Exploramos o impacto da cultura “Agil” e o desafio do foco em outputs não outcomes.Fechamos o podcast de forma prática compartilhando iniciativas tomadas em nossas empresas para acelerar a flywheel de experimentação. Edição: João Pedro AlencarReferências citadas: Mestre GP https://www.mestregp.com.br/ Product arena https://productarena.io/ It takes a flywheel to fly https://www.micros...
2021-11-25
38 min
Product for Product Management
EP 29 - A/B Testing Kickoff with Rommil Santiago
Welcome to the new series on products for Product Managers: A/B Testing! In this episode, Matt and Moshe are joined by Rommil Santiago to discuss the use of A/B testing tools to experiment different product solutions.Rommil is a Product Lead - Experimentation, Personalization, and Analytics Platform at Loblaw Digital, and the Founder and Owner of Experiment Nation.Experiment Nation is a community of conversion rate optimizers, product managers, and data analysts from all over the world who are connected by their passion for experimentation.As product managers, we strive to build...
2021-11-22
46 min
Experiment Nation: The Podcast
Specsavers’ Steph Le Prevost on growing a top UK CRO program
Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.
2021-11-20
43 min
Experiment Nation: The Podcast
The Science of Business with Jonny Longden
Experiment Nation: The Conference Reloaded CRO, experimentation, A/B testing, research, analytics: these things are all parts of a whole which never really gets discussed. What we’re doing is replicating the scientific method in a business context, and yet we can’t see the wood for the trees. Our industry is focused on the individual elements of what we do and how we do it, but not why we do it and the overall philosophy for it. This is part of the reason that businesses don’t give it the traction it deserves; senior business leaders are not...
2021-11-13
19 min
Experiment Nation: The Podcast
Strategies are not made every day, improvements are with Siddhartha Kathpalia
Experiment Nation: The Conference Reloaded We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q7
2021-11-08
21 min
Experiment Nation: The Podcast
Global experimentation: Problem-solving at scale with Melanie Kyrklund
Experiment Nation: The Conference Reloaded We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q7
2021-11-06
09 min
Experiment Nation: The Podcast
Change management for Experimentation Culture – Do’s and Don’ts with Ruben de Boer
Experiment Nation: The Conference Reloaded As conversion specialists and data analysts, we strive for experimentation- and validation-driven culture. To be successful, it is essential to understand that your job is not just to run A/B tests. A large proportion of our work should be dedicated to change management. However, change is hard. In his presentation, Ruben will discuss the importance of change management guided by an understandable model that you can start using today. He will explain the model step-by-step, using the knowledge you already have. You will find many examples of things you should and sh...
2021-10-30
19 min
Experiment Nation: The Podcast
How to use data to find hidden insights about customers & opportunities for optimization with Sina Fak
Experiment Nation: The Conference Reloaded We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q7
2021-10-24
19 min
Experiment Nation: The Podcast
Microsoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programs
Tim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.
2021-10-23
46 min
Experiment Nation: The Podcast
Tips on running a Test-to-Learn Experimentation Program with Shiva Manjunath
Experiment Nation: The Conference Reloaded Shiva will run through WHY you want to be running an experimentation program based on insight generation and not simply ‘winning’. He’ll also show you how to structure tests to support the growth of an insight-driven experimentation program.
2021-10-15
35 min
Experiment Nation: The Podcast
Seven lessons from running 22,000 AB tests with Ayat Shukairy
Experiment Nation: The Conference Reloaded The average success rate of most AB testing programs hovers around 12%. Yep, for every 100 experiments you run, only 12 of them will generate an increase in conversions. That is worse than a coin toss. Too many companies start AB testing hoping that it will deliver a great increase in conversions. A few months later, they are bitterly disappointed. In this session, I will share the lessons we learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing pr...
2021-10-06
26 min
Experiment Nation: The Podcast
Migrando para a área de experimentação vindo do Jornalismo (participação especial Fabricio Migues)
Hoje começamos um novo papo em nosso podcast: como migrar para a área de experimentação? Nosso convidado especial é Fabricio Migues, CRO Manager na Small World Financial Services, conta pra gente como foi sair da área de jornalismo e relações públicas e adentrar na experimentação, como aproveitar seus aprendizados e conhecimentos da área de comunicação dentro de CRO e como isso o tem ajudado. Edição: João Pedro Alencar Referências citadas no episódio: Referência citada da minha parte https://www.exp-growth.com/ https://open.spotify.com/episode/4d3Prnlc0VIf...
2021-10-05
44 min
Experiment Nation: The Podcast
Women in experimentation: What holds us back? With Bithika Mehra
Experiment Nation: The Conference Reloaded Why is it that all through school, girls outperform boys but that equation is flipped in the corporate world? Are there factors in our nurture (and possibly nature) that play against us? How do these factors play out in the experimentation space? In this session – recommended for women in experimentation and those working with them – Bithika will help identify blind spots and hopes to help women and teams reach their true potential.
2021-10-03
19 min
Experiment Nation: The Podcast
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers. Follow Shanelle on Twitter: @shanelle_mullin
2021-09-18
34 min
Experiment Nation: The Podcast
Adventures in Experimentation: Is my company doing CRO right?
There's no single answer as Conversion Optimization and Experimentation continue to evolve and find fit in the digital era. What resonates with us is, if you're constantly testing and celebrating performance instead of delivery, you're likely to be on the right path of doing it right. In this episode, Marion Ravel, Eden Bidani, and Positive John shared different angles, from e-commerce, copywriting, and product, to structuring and thinking through CRO. Books mentioned: Emotional Design — https://www.amazon.com/Emotional-Design-Love-Everyday-Things/dp/0465051367 Working Backwards: https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595
2021-09-18
27 min
Experiment Nation: The Podcast
Série - Estruturando uma área de CRO na sua empresa - episódio 3 (Participação especial André Vieira)
Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre: Qual o ponto de partida para começar a investir em CRO? Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos A qual área CRO melhor pertence dentro de uma empresa? Edição do podcast por João Pedro (https://www.linkedin.com/in/joaopedroalencar/) Referências citadas ao longo do ep: Looptimize: https://looptimize.com.br/ Online Dialogue: https://onlinedialogue.com/ How to measure anythi...
2021-08-23
40 min
Experiment Nation: The Podcast
Comment mesurer le ROI de mon programme d’expérimentation?
Hosted by Marion Ravel and Mathieu Fauveaux
2021-08-13
35 min
Experiment Nation: The Podcast
Série: Estruturando uma área de CRO na sua empresa - episódio 2
Nesse segundo episódio, falamos sobre gatilhos que fazem empresas procurarem o CRO e desafios para se começar a trabalhar com a área. Discutimos sobre entendimento geral de experimentação em uma empresa sobre o produto "estar pronto" para ser otimizado. Fiquem à vontade para contribuir. Editor: https://www.linkedin.com/in/jo%C3%A3o-pedro-de-queiroz-alencar-1852a518b/ Referências: Agende uma mentoria com John no GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski Podcast com Ron Kohavi: https://www.abtasty.com/blog/1000-experiments-club-ronny-kohavi/ Auditoria de maturidade de experimentação com base no artigo The Evolution of Continuous Experimentation in Software Pro...
2021-07-31
26 min
Experiment Nation: The Podcast
Dexter's Joris Bryon on Common Practices, Starting a CRO agency, and how to spot a CRO imposter
Tracy Laranjo asks Dexter's Joris Bryon about How we need to stop saying Best practices and start saying Common Practices His tips on starting a CRO agency and working with a partner And how to spot a CRO imposter
2021-07-10
43 min
Experiment Nation: The Podcast
Série: Estruturando uma área de CRO na sua empresa - episódio 1
Nesse primeiro episódio da série, vamos discutir como caímos no mundo de Otimização de Conversão (CRO), algumas experiências até posições atuais e diferentes perspectivas entre exatas/humanas e seus benefícios. Editor: João Pedro Alencar https://bit.ly/3jt4BLu Materiais comentados no episódio: Learning how to learn from the Awesome Dr. Barbara Oakley: https://bit.ly/3h2AAk1 Making websites win, free audiobook on Spotify >> https://spoti.fi/3qzRYzX CXL Conversion Optimization minidegree >> https://bit.ly/3Aid9em Trustworthy Online Controlled Experiments: A Practical Guide to A/B Tes...
2021-06-30
29 min
Experiment Nation: The Podcast
CR-No: Making your CRO program go faster
Rommil, Kenya, and Shiva discuss the challenges of speeding up a CRO program, as well as some of the ways they overcome them.
2021-06-05
30 min
Experiment Nation: The Podcast
Adventures in Experimentation: A deep-dive into CRO tools
Positive John and Marion talk about their favorite CRO tools, how they evaluate them, and how to get clients to pay for them.
2021-05-09
41 min
Experiment Nation: The Podcast
Product Experimentation: Building a competency and fluency with data (Part 2)
Jaya and Sid chat with Moshe Mikanovsky, a Product Manager with over 30 years of experience, about the importance of getting closer to the data by getting familiar with data tools and working with business intelligence. This episode was edited by Jin Yang. She is the co-founder of Mindset Masters. Mindset Masters works with professionals in all industries to encourage high school and university students to develop a growth mindset. If you are interested in speaking in one of their online workshops, please reach out at any time at contact.mindsetmasters@gmail.com.
2021-04-10
28 min
Experiment Nation: The Podcast
Product Experimentation: Building a competency and fluency with data (Part 1)
Jaya and Sid chat about building competency with and a fluency with data to get a better idea of what's happening with systems and how products are helping customers. Mentioned in this episode: Ravi Mehta's Product Competency Toolkit: https://www.ravi-mehta.com/product-manager-skills/
2021-04-02
19 min
Experiment Nation: The Podcast
Specsavers' Melanie Kyrklund on How to run a high-impact optimization program
In this episode, Rommil and Tracy interview Melanie Kyrklund from Specsavers on how to run a high-impact optimization program, how to align the program with a product's vision, and how she likes black licorice.
2021-03-27
24 min
Experiment Nation: The Podcast
CR-No: Addressing the lack of direction and primary calls to action on pages
This week, Siobhan Solberg, Kenya Davis, Shiva Manjunath and Eddie Aguilar talk about how to address the lack of direction and primary calls to action on pages. This episode was edited by Zohaib. Zohaib is an audio engineer, music producer and DJ from Karachi who now lives in Toronto. You can find this profiles here: https://soundcloud.com/saazbyzoi https://www.facebook.com/saazbyzoi https://www.instagram.com/zoi_music/?hl=en
2021-03-20
26 min
Experiment Nation: The Podcast
CR-No: How to manage stakeholders and HiPPOs
In this episode, our panel discusses how to manage stakeholders and HiPPOs. What do we do with them when they don't agree with our results? How do we get ahead of issues? On the panel: Shiva Manjunath Eddie Aguilar Kenya Davis Siobhan Solberg
2021-03-12
22 min
Experiment Nation: The Podcast
Adventures in Experimentation: The importance of the voice of customer to conversion optimization - as well as to the entire business
Eden and Positive John speak about how recording your sessions with clients helps reduce the need for taking notes, how qualitative research is key to not just CRO but for all things business, and how no one likes pop-up surveys except for Positive John. Useful resources mentioned in the episode: https://www.notion.so/User-Psych-framework-applied-on-LinkedIn-s-conversion-funnel-3bf3cdfc4aa54c2c9191f403157ed317
2021-03-01
38 min
Experiment Nation: The Podcast
Audio version: Widerfunnel’s Chris Goward on how Experimenters need to focus less on the tools and more on strategy
This is the audio version of our recent interview with Widerfunnel’s Chris Goward.
2021-02-23
07 min
Experiment Nation: The Podcast
Product Experimentation: Aligning the need to deliver and the need to learn with OKRs
Jaya and Sid explore: What does a good product experiment look like Aligning the need to deliver and the need to learn with OKRs Why aren’t companies adopting the practice
2021-02-19
25 min
Experiment Nation: The Podcast
Experiment Nation: The Podcast
Rommil & Tracy interview the very best Experimenters from around the world!
2021-02-18
00 min
Experiment Nation: The Podcast
CR-No: Balancing between optimizing the entire customer journey vs. just the website
On today’s panel, we have Siobhan Solberg from Raze Shiva Manjunath from Gartner Kenya Davis from Evolytics Eddie Aguilar from Circle media labs In this episode the panel discusses: Balancing between optimizing the entire funnel vs focusing only on the website Bringing segmentation into the mix Their beef with Google optimize
2021-02-05
24 min
Experiment Nation: The Podcast
What you need to know about SEO Experimentation
On today's episode, we interview Twilio's Justin Coons and talk about: Not only can you run experiments for SEO, but you also should Which is better, short-form content or long-form content What metrics to optimize for when running SEO Experiments
2021-01-30
22 min
Experiment Nation: The Podcast
Point/Counterpoint - Exploring different experiment prioritization frameworks
On today's episode of Point/Counterpoint, Trish leads Patrick and Marion through a discussion about: Their CRO New Year's resolutions, and the pros and cons of several experiment prioritization frameworks such as PIE (https://www.widerfunnel.com/pie-framework/) PXL (https://cxl.com/blog/better-way-prioritize-ab-tests/) Hotwire's framework (https://blog.optimizely.com/2015/05/05/how-to-prioritize-ab-testing-ideas/)
2021-01-24
23 min
Experiment Nation: The Podcast
Product Experimentation: Start with me, take a chance, be ready for failure
Jaya and Siddharth explore how Experimentation fits into the Product Development Life Cycle, how to work with challenging stakeholders, share stories about how they've leveraged Experiments to generate results.
2021-01-16
26 min
Experiment Nation: The Podcast
Adventures in Experimentation: How do you answer the question, "How many experiments should I run?"
On today’s episode, John Ostrowski and Eden Bidani talk about: How they respond when someone asks them how many experiments they should run What they've done when a test breaks in production Why John keeps a personal list of shame If you enjoy today’s episode. and you think we’ve earned it - please consider subscribing!
2021-01-11
36 min
Experiment Nation: The Podcast
CR-No: Experiments should be backed by hypotheses - leave your best practices for your processes
Today's episode features: Eddie Aguilar Kenya Davis Shiva Manjunath Siobhan Solberg The panel talks about: How best practices in CRO should only apply to approaches and workflows and not necessarily what you should test. The danger of copying others’ "best practices". Enjoy!
2020-12-28
30 min
Experiment Nation: The Podcast
The anniversary episode: A conversation with Rommil that's only a bit about Experimentation
It's been one year since Experiment Nation started interviewing Experimenters from around the world, can you believe it? For this special episode, the tables are turned! Experiment Nation's new Canadian co-host, Shannon (aka the "Russian Giant"), interviews Rommil for a change of pace. We talk about escape rooms, raising children, and wearing lab coats. We hope you enjoy it! And yes, we promise to go back to talking more about Experimentation soon - pinky swear. On that note - we're looking for more Interviewers and podcast co-hosts to join us. Shannon and I cannot cover the world...
2020-12-04
37 min
Experiment Nation: The Podcast
Conversion Rate Optimization, Best Practices, and Other Terribly Named Things
In this episode, we speak with Gartner's Shiva Manjunath about the world of CRO: what it means, what it doesn't mean, and the important role that humour and politics play in it. As a bonus, we learn how his lack of enthusiasm about medicine helped him become the person he is today and what he really thought about last season's NHL playoffs. We're still working through the audio setup. We'll get it right one day, swear.
2020-12-04
27 min
Experiment Nation: The Podcast
Running Experiments on Personalization, Machine Learning, and AI with Munir Al-Dajani
Experiment Nation finally has a podcast and we couldn't think of a better way to kick it off than having a great in-depth conversation with Munir Al-Dajani about how to run Experiments on Personalization, some of the ethical aspects of Personalization, and the differences between Machine Learning and AI.
2020-11-22
42 min