Shows
Experiment Nation: The PodcastS4E15 - Product Experimentation: How to get Product Managers to Experiment ft. Shagun AulakhHow do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways:
1- Leadership advocacy is critical for embedding experimentation practices in a highly matrixed organization.
2 - Prioritize education and internal PR to influence and persuade teams to embrace experimentation.
3- Define success metrics for your experimentation program and map out a long-term plan for evolving maturity.
5 - Identify champions within the organization to inspire and motivate other teams to adopt experimentation practices.
5 - Democratize insights and...2024-06-0749 min
Experiment Nation: The PodcastS4E13 - Use automation to build optimal flow states with Shawn DavidLearn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial specially to them. We explored the impacts on company culture that menial tasks can cause and discussed some of the pitfalls with new technologies as well as lessons to keep in mind while reviewing new tools and technologies.
2024-05-2552 min
Experiment Nation: The PodcastS4E10 - Don't A/B Test?! featuring Solomon KahnCEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic.
Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn
Solomon's email: solomon.kahn@gmail.com
Original YouTube Video: https://www.youtube.com/watch?v=vqPylhO3ePU
Original LinkedIn Post: https://www.linkedin.com/posts/solomonkahn_the-case-against-ab-testing-yes-i-know-activity-7184577272685719552-hFAB
Ron's reply: https://www.linkedin.com/posts/ronnyk_abtesting-experimentguide-abtestingissues-activity-7185060367054565376-cAU92024-04-2735 min
Experiment Nation: The PodcastS4E1 - How to build a community around experimentation with Rommil SantiagoKoalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
2024-02-2340 min
Experiment Nation: The PodcastS3E7 - The Best CROs start with RESEARCH - With Rommil SantiagoDoes exactly what it says on the tin.
#research #conversion #optimization2023-03-1102 min
Experiment Nation: The PodcastS3E6 - Pragmatists will grow the CRO industry - not purists - with Matt ScaysbrookOur industry can be damning of those doing things ""imperfectly"" - but it seems not to draw the distinction between those doing things imperfectly through ignorance (who can be educated) and those doing things imperfectly through lack of a better option (who need to be helped to show the value to decision-makers). This attitude has a negative impact on new entrants to the industry and sets completely the wrong tone for the next generation. The greater the participation in the industry, the stronger it will become - the wider that participation, the more ideas (and the more diverse those id...2023-03-0418 min
Experiment Nation: The PodcastS3E5 - How to be good at coding A/B tests with Jeroen WiersmaHow to be a good test coder with Jeroen Wiersma2023-02-2531 min
Experiment Nation: The PodcastS3E4 - The CRO Survival guide with Carlos TrujilloIn this session, I want to cover the most strategic actions that a new Experimentation Strategist (or Program Manager) can execute during their first three months in the role to increase trust among the stakeholders and clients. I will share this based on my experience working with clients such as Miro, Procore, The Bouqs, and Gympass, among others. About the speaker Carlos has over nine years of experience working in online marketing and mass media. As an agency founder, he has led web development and conversion optimization projects for more than 80 brands in multiple regions and verticals. It has pr...2023-02-1811 min
Experiment Nation: The PodcastS3E3: Stop wasting time by having principles with Rommil SantiagoYou don't have to A/B test everything. Be smart by having guiding principles. #conversionrateoptimization #experimentation #ecommerce2023-02-1003 min
Experiment Nation: The PodcastS3E2: The top 3 things CROs forget to do with Alexandra MathenyMany optimizers are good at using data to craft hypotheses. Great optimizers, however, build data-driven segments, analyze by business goals (not just test KPIs), and importantly, propose how to take action on campaign results. About the speaker Alexandra leads Product Marketing at Kameleoon. She loves storytelling as a way of demonstrating a product’s values and benefits to customers. Chapters --- 0:00 - Introduction 3:41 - Great experimenters consolidate their customer data for precise and persistent segmentation 6:40 - Great experimenters analyze by meaningful business goals and draw actionable conclusions 8:05 - Great experimenters take action on their experimentation results 10:29 - Coming to full...2023-02-0412 min
Experiment Nation: The PodcastS3E1: The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima YassiniHaving mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini #experimentation #conversionrateoptimization #growth2023-01-2844 min
Experiment Nation: The PodcastS2E41: How to adopt a CRO mindset for life optimization with Ruben de BoerLife optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.2022-12-0948 min
Experiment Nation: The PodcastS2E40: How to build a customer journey map with Anthony WallaceCreating a customer journey map can help stakeholders better understand the customer’s experience, and helps ensure that all stakeholders are working towards the same goal. It can also help identify potential areas of improvement, and provide insights into how customers interact with your product, service, or organization.2022-12-0321 min
Experiment Nation: The PodcastS2E39: How to land a great job in CRO (and earn what you’re worth) with Tracy LaranjoWhen looking for a job, it’s important to have a clear idea of what you’re looking for in terms of type of work, salary, benefits, and work culture. You should also have a general understanding of your skills and experience, and be able to articulate to potential employers why you’d be a good fit for the job. Tracy Laranjo walks you through the things you need to know to land that dream job and get the salary you deserve.2022-11-1926 min
Experiment Nation: The PodcastS2E38: Why good form design is important and common form optimization myths with Alun LucasForm optimization is the process of improving the structure and design of a web form to make it more user-friendly and efficient. This includes streamlining the form’s layout, making it easier to understand and fill out, and adding features such as auto-fill, pre-filled fields, and error handling. Alun Lukas shares how optimizing forms helps to reduce user frustration and abandonment, increase conversions, and improve the overall user experience.2022-11-1241 min
Experiment Nation: The PodcastS2E37: Pre-test planning: The Red-Headed Stepchild of Experimentation with Haley CarpenterTeams are horrible at this! They have no idea it should happen, and if they do, they're usually lost and the approach is terrible. When you break it down, it's really not difficult. This shouldn't be a black box anymore. I will cover the following: (1) What each of the test planning aspects are and how to do them including MDE and duration estimates, (2) CXL's pre-test calculator unless our new Optimizely one is live by the time I record, (3) how to turn pre-test calculations into a testing roadmap, and (4) how to determine when a business can't test or when a sw...2022-11-0534 min
Experiment Nation: The PodcastS2E36: Why Focus on Skeptical First-time Buyers? With Rishi RawatSkeptical first-time buyers need to be given the utmost priority in order to make them feel comfortable and secure with their purchase. This may include providing detailed product or service information, offering multiple payment options, providing customer service support, and offering warranties or guarantees for their purchase. Rishi shares his thoughts on how to win over this critical customer segment.2022-10-2218 min
Experiment Nation: The PodcastS2E35: My quick and dirty approach to creating a Learning Agenda (aka the BADR method) with Rommil SantiagoStop testing randomly. Have a plan.2022-10-0805 min
Experiment Nation: The PodcastS2E34: Online Dialogue's Ton Wesseling shares his thoughts on how CRO will probably dieCRO is a process of optimizing a website or landing page to maximize the percentage of visitors to convert into paying customers. It involves testing different elements of the website to determine what works best for increasing conversions. As long as businesses value increasing their conversion rate, CRO will remain an important part of online marketing and web design - but it may not exist as a profession one day.
Our new podcast host, Richard Joe, asks Ton about the culture of Experimentation, and how we CRO will die...one day.2022-10-0159 min
Experiment Nation: The PodcastS2E33: Test before you build anything or you'll waste time course-correcting with Rommil SantiagoThere’s a lot of talk about how to find things to test, how to analyze tests and the importance of iterating on tests. This week, I was thinking about how I could add something a little different to the conversation and decided to share my thoughts about when to run a test - particularly when building products.2022-09-1603 min
Experiment Nation: The PodcastS2E32: Not every insight is derived from an A/B Test with Daniela MarquezCuriosity needs to be a driver in every experimenter’s toolkit. What is going on in the head of my customer? What is really their job-to-be-done? When buying flowers, we typically think of the standard occasions: Mother’s Day, Valentine’s Day, new baby & sympathy. But if we were to structure our ecommerce website on those occasions alone, we may be addressing the majority, but we’d be missing out on the real motivation behind the purchase as well as other reasons people buy flowers. By deconstructing the customer’s journey of buying flowers, we discovered a piece of data that w...2022-09-0910 min
Experiment Nation: The PodcastS2E31: 3 ways to be a better Experimentation leader with Rommil SantiagoEven if you are the best Experimenter at your company, unless you are able to nurture a culture of Experimentation - you’ll end up constantly fighting uphill battles. Here are a few quick pointers on how to be a better Experimentation leader.2022-09-0202 min
Experiment Nation: The PodcastS2E30: What Hawaiian Pizza can teach us about creating a more inclusive CRO industry with Rommil SantiagoPineapple on pizza. If you ever want to have a heated debate with a group of people, ask them if pineapple belongs on pizza. Now let’s replace pizza with CRO and pineapple with “best practices” (or whatever topic CROs are angry about on LinkedIn these days).2022-08-2004 min
Experiment Nation: The PodcastS2E29: How Europe leverages AI for optimization with Noémie SauvageWatch this session on Youtube: https://youtu.be/JqT95k7eG_82022-08-1313 min
Experiment Nation: The PodcastS2E28: How Wordle proves that Experimentation works with Rommil SantiagoAbout this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-08-0603 min
Experiment Nation: The PodcastS2E27: Pizza Dough CRO with Simon ClarkBased on a brand new obsession (thanks to the pandemic) for homemade pizza, I would like to talk about how optimisation is just like cooking that perfect pie. You can have all of the tools in the world, but do you have the experienced chef and the right ingredients. Sure, you can cook up a quick Margherita in under an hour, but does it taste good. But, what if you left the dough to rise for a few days? Well, you’d get a much better flavour, and a smooth experience. Optimisation and Pizza Making are the same and I wi...2022-07-3020 min
Experiment Nation: The PodcastS2E26: Can you run tests on sites with little traffic? With Rommil SantiagoAbout this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-07-2304 min
Experiment Nation: The PodcastS2E25: How to verify your data truly reflects user behaviour with Florent BuissonFlorent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It's the book he wished he had when he started in analytics.
In this episode, he shares:
Plus other statistical concepts explained in a way even a five-year-old could understand.Why intuition can actually be a good thing in data analytics
If you need to know R or Python to understand your users
Why and when causal analytics are important
--
Florent Buisson is a behavioral economist with 10 years of...2022-07-1631 min
Experiment Nation: The PodcastS2E24: How do I change people’s attitudes towards Experimentation? With Rommil SantiagoAbout this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-07-0902 min
Experiment Nation: The PodcastS2E23: How to make a better sandwich: An introduction to multivariate testing with Danielle GunrajA/B Testing can be intimidating to the uninitiated, but it doesn’t have to be! I want to introduce testing concepts via a real-world scenario that we can all relate to: Dessert. I’ll cover what an MVT is, hypotheses, independent variables, dependent variables, results (of course), and design flaws. And if you need any more convincing, I have four words for you: Monte Cristo Bread Pudding.2022-07-0211 min
Experiment Nation: The PodcastS2E22: Choosing the right A/B testing tool with Product for ProductMatt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there.
Whether you're in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more.
**This episode, nor those of Product for Product, are endorsements of any of the discussed tools.**
Listen to Product for Product: spreaker.com/show/product-for-product
Find Matt on LinkedIn: /in/mattgreenanalytics
Find Moshe on LinkedIn: /in/mikanovsky2022-06-2527 min
Experiment Nation: The PodcastS2E21: Experiment Cartography - Building the Perfect Roadmap with Kenya Davis and Krissy TrippYou can do better than testing button colors, but how do you decide what to test when, and what type of test to run? Roadmapping. This session teaches you to be the GPS navigator, helping your team optimize experimentation routes. On this journey, you will identify how each path can drive desired impacts by turning a formidable trek into a series of attainable milestones.
Presented by
Kenya Davis, Microsoft Digital Analytics
Planning Program Manager, and Evolytics Decision Science Director Krissy Tripp.
2022-06-1925 min
Experiment Nation: The PodcastExperiment Nation: The Podcast TrailerExperiment Nation: The Podcast is a show on which we share Interviews with Experimenters from around the world, opinion pieces, and recent presentations with you - the experimentation community. We hope you enjoy the show, let’s get to it.
If you enjoy our content, consider signing up for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-06-1700 min
Experiment Nation: The PodcastS2E20: How to rally your team around Voice of Customer research with Tracy LaranjoTracy is a Toronto-based growth marketer with a knack for conversion optimization. In a past life she’s QA tested “adult” eBooks and helped make it easier for Canadians to write their wills online. Tracy is also one of the co-hosts of the Experiment Nation podcast where she chats with optimizers at the top of their game.
Beyond the 9-5, you can catch her knitting, crushing empires in Civ6, or napping with her cats.2022-06-1213 min
Experiment Nation: The PodcastS2E19: How do you respond to someone who says, “Let’s not experiment, it just slows us down. Can’t we just put it on our webpage?” with Rommil SantiagoAbout this series: Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-06-1102 min
Experiment Nation: The PodcastS2E18: Johann Van Tonder on how to conquer 4 common ideation pitfalls with research-backed methodseCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions.
Find Johann on Twitter: @amaclickclick
Learn more about AWA Digital: awa-digital.com2022-06-0437 min
Experiment Nation: The PodcastS2E17: Developing a Culture of Testing/Experimentation with Anil BatraAnil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and an MBA from the University of Washington, Seattle. He is the founder of https://academy.optizent.com – A Digital Analytics training and education company.2022-05-2819 min
Experiment Nation: The PodcastS2E16: When is it OK to run 2 A/B tests simultaneously on a site? Is it ever OK? With Rommil SantiagoAbout this series
Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-05-2104 min
Experiment Nation: The PodcastS2E15: Where are the users? with Moshe MikanovskyWhen experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users.2022-05-1414 min
Experiment Nation: The PodcastHow do I make the most impact in my role when I only own optimization for a small part of the user journey? With Rommil SantiagoAbout this series
Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.2022-05-0703 min
Experiment Nation: The PodcastUsing Chi-Square Analysis for A\B\N Tests with W. Scott SandersAlthough the two sample proportion test is well known within the marketing experimentation community, there are a host of categorical data analysis techniques that are amenable to the analysis of A\B test data. This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation. Specifically, we discuss how to 1) test a\b\n experiments without inflating Type I error after multiple comparisons, 2) analyze tests with more than dichotomous outcome variables and 3) the process for calculating goodness-of-fit and tests-of-independence. Simple guidelines will be provided regarding test assumptions and use case scenarios.2022-05-0224 min
Experiment Nation: The PodcastSina Fak on why CRO is not a person but a multidisciplinary Experimentation teamSina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO.
Learn more about ConversionAdvocates: https://conversionadvocates.com/
Find Sina Fak on LinkedIn: https://www.linkedin.com/in/sinafak/2022-03-3139 min
Experiment Nation: The PodcastHow to make a customer-centric diagnosis with Marion RavelIf you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-02-1812 min
Experiment Nation: The PodcastReducing the cost of running an experimentation program with Tasin RezaWe know that the key skillsets you need for any successful CRO / Experimentation program are: Research, Design, Development and QA. Whilst larger companies who can afford to hire all of those skilled people, for smaller companies, it becomes a big challenge. So much so, many companies exhaust their options of running smaller tests and then stop doing all kind of experimentation work. In this session, I will be covering the areas where the companies can reduce their cost of experimentation, things that they will need to consider and increase their profitability of running a successful experimentation program.
...2022-02-1217 min
Experiment Nation: The PodcastWhat 13 Years of A/B Testing Revealed with Rishi RawatRishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”.
Learn more about Rishi's work at frictionless-commerce.com.2022-02-0548 min
Experiment Nation: The PodcastWhat’s the best time to send an email with Deborah O'MalleyA lot of research and data analysis has gone in to answering this question. But yet, there’s no clear, definitive answer. In attempt to resolve this question once-and-for-all, this session will present and interesting and surprising answer. Applying the results from a real-life A/B test case study, digital marketers will be prompted to think not only about email send time, but also their audience and how both aspects impact conversions.
---
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-02-0518 min
Experiment Nation: The PodcastThe challenges nobody talks about with Taz RismaFinally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-01-2910 min
Experiment Nation: The PodcastWhere I started: Dennis van der HeijdenWelcome to "Where I Started", the interview mini-series in which we get behind the scenes and find out how some of today's experimenters got into CRO. This should be a fun little project that Ontrack Digital started with Experiment Nation to give you a bit of a getaway from all those test results. But also it can be a source of inspiration for those of you that want to get started in CRO and don't really know which path to take.
---
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter...2022-01-2904 min
Experiment Nation: The PodcastWe Need More ART in CRO with Jimmy BarberThis session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. There’s so much data, and we often find ourselves simply staring at metrics looking for “+” or “-” to make decisions. The objective of this session is to draw on thinking strategies from physics, of how to approach CRO differently, without any real “data”, to then gleam positive impacts to CRO.
Finally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-01-2208 min
Experiment Nation: The PodcastMoving Beyond Spaghetti Testing with Haley CarpenterThe success of your testing program depends on the quality of your hypotheses. But too many experimentation programs lack the processes and frameworks to move from spaghetti testing to strategic experimentation. Haley shares two practical frameworks to help you form better hypotheses and objectively rank test ideas.
---
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-01-1511 min
Experiment Nation: The PodcastWhat is product growth? Creating & Navigating the path to product growth with Aditi GuptaAditi Gupta covers the creation of a growth roadmap/ how to build alignment with stakeholders/ creating an org-wide impact.
---
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-01-0707 min
Experiment Nation: The PodcastWhere I started: Shiva ManjunathWelcome to "Where I Started", the interview mini-series in which we get behind the scenes and find out how some of today's experimenters got into CRO. This should be a fun little project that Ontrack Digital started with Experiment Nation to give you a bit of a getaway from all those test results. But also it can be a source of inspiration for those of you that want to get started in CRO and don't really know which path to take.
---
If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter...2022-01-0404 min
Experiment Nation: The PodcastSpeero's Experimentation Maturity Audit with Edgar SpongoltsSpeero's Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency's Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation
---
If you looked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ2022-01-0445 min
Experiment Nation: The PodcastCreating an experimentation program that’s more than A/B testing with Annika Thompson and Paul RandallToo often experiments are squandered. But if you put customer problems first and design the right type of test you can ensure every experiment is valuable to your business. The following talk will give your experimentation programs guardrails to make sure you’re not testing for testing sake. In this session Annika and Paul will share; How to map out business goals and customer problems. How to pick the right type of experiment. e.g when to use tree testing, copy testing, 5 second tests, A/B tests etc. How to gain insights faster and deliver more effective experiments.
...2022-01-0120 min
Experiment Nation: The PodcastBest practices might be killing your experimentation culture – 3 reasons why with Ana Catarina CizilioExperiment Nation: The Conference Reloaded
Everybody is doing it, so you have to do it too, right? As my mom used to say: you’re not everyone! Best practices are not experimentation and you should know that. I want to prove to you this is the easy way, but it’s not the right way for a healthy, profitable and experiment-oriented business. These tactics don’t last long. In this session, we will discuss why, statically, best practices don’t work. It’s fun to know about the competitors, their results and ideas. It may generate new ideas and g...2021-12-2508 min
Experiment Nation: The PodcastRipple Benefits: CRO as the foundation of other digital marketing efforts with Spencer GrayExperiment Nation: The Conference Reloaded
CRO should be the foundation that all of your other digital marketing efforts rests upon. Through what we call our ‘Ripple Benefits’, I’d love to showcase just how CRO not only improves your conversion rates, but your SEO, Content Marketing, Paid Ads, and more. Testing is key and should be the foundation that drives where your efforts are focused. -
-----
If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https...2021-12-1813 min
Experiment Nation: The PodcastAiven’s Petra Lylander on experimentation documentation and processesPetra Lylander is a growth marketer who developed the experimentation process at Helsinki-based SaaS company, Aiven. In this episode she talks about process documentation for experimentation and how to get other teammates to care about it.
------
If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https://lnkd.in/g6rM8w252021-12-1429 min
Experiment Nation: The PodcastHow to "Hack" Experimentation with Anthropology with Eden BidaniExperiment Nation: The Conference Reloaded
AKA Why you should approach research like an Anthropologist How ethnographic research helps you understand *why* people think the way they think (not just *what* they think or how they respond to triggers) to create more meaningful hypotheses and experiments.
------
If you liked this interview, signup for Experiment Nation's bi-weekly newsletter to receive more great interviews like this, memes, editorials, and conference sessions in your inbox: https://lnkd.in/g6rM8w252021-12-1109 min
Experiment Nation: The PodcastExperimentation post-conversion: Switching from buying journey to customer journey with Juliana JacksonExperiment Nation: The Conference Reloaded
Experimentation post-conversion or how to switch from buying journey to customer journey.2021-12-0329 min
Experiment Nation: The PodcastFive things that piss me off about eCommerce and how to fix them with Jon IvancoExperiment Nation: The Conference Reloaded
A quick and dirty guide to pointing out bad practices that create friction to the customer when brands practice the company journey instead of the customer journey.2021-11-2718 min
Experiment Nation: The PodcastCRO não é um profissional e sim um processo (participação especial André Gillich)Nesse episódio nosso convidado André Gillich, Head of CRO, compartilha sua experiência na Jussi crescendo a cultura de experimentação, começando pela nova abordagem em que “CRO não é um profissional e sim um processo.”Exploramos o impacto da cultura “Agil” e o desafio do foco em outputs não outcomes.Fechamos o podcast de forma prática compartilhando iniciativas tomadas em nossas empresas para acelerar a flywheel de experimentação.
Edição: João Pedro AlencarReferências citadas:
Mestre GP https://www.mestregp.com.br/
Product arena https://productarena.io/
It takes a flywheel to fly https://www.micros...2021-11-2538 min
Product for Product ManagementEP 29 - A/B Testing Kickoff with Rommil SantiagoWelcome to the new series on products for Product Managers: A/B Testing! In this episode, Matt and Moshe are joined by Rommil Santiago to discuss the use of A/B testing tools to experiment different product solutions.Rommil is a Product Lead - Experimentation, Personalization, and Analytics Platform at Loblaw Digital, and the Founder and Owner of Experiment Nation.Experiment Nation is a community of conversion rate optimizers, product managers, and data analysts from all over the world who are connected by their passion for experimentation.As product managers, we strive to build...2021-11-2246 min
Experiment Nation: The PodcastSpecsavers’ Steph Le Prevost on growing a top UK CRO programSteph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.2021-11-2043 min
Experiment Nation: The PodcastThe Science of Business with Jonny LongdenExperiment Nation: The Conference Reloaded
CRO, experimentation, A/B testing, research, analytics: these things are all parts of a whole which never really gets discussed. What we’re doing is replicating the scientific method in a business context, and yet we can’t see the wood for the trees. Our industry is focused on the individual elements of what we do and how we do it, but not why we do it and the overall philosophy for it. This is part of the reason that businesses don’t give it the traction it deserves; senior business leaders are not...2021-11-1319 min
Experiment Nation: The PodcastStrategies are not made every day, improvements are with Siddhartha KathpaliaExperiment Nation: The Conference Reloaded
We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q72021-11-0821 min
Experiment Nation: The PodcastGlobal experimentation: Problem-solving at scale with Melanie KyrklundExperiment Nation: The Conference Reloaded
We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q72021-11-0609 min
Experiment Nation: The PodcastChange management for Experimentation Culture – Do’s and Don’ts with Ruben de BoerExperiment Nation: The Conference Reloaded
As conversion specialists and data analysts, we strive for experimentation- and validation-driven culture. To be successful, it is essential to understand that your job is not just to run A/B tests. A large proportion of our work should be dedicated to change management. However, change is hard. In his presentation, Ruben will discuss the importance of change management guided by an understandable model that you can start using today. He will explain the model step-by-step, using the knowledge you already have. You will find many examples of things you should and sh...2021-10-3019 min
Experiment Nation: The PodcastHow to use data to find hidden insights about customers & opportunities for optimization with Sina FakExperiment Nation: The Conference Reloaded
We'd love your feedback. Tell us what you thought of the session and of our conference for a chance to win a free Customer Value Optimization course from Omniconvert.com and a chance to be featured on ExperimentNation.com Send us your feedback here: https://forms.gle/Mzo9h33RZ94d471Q72021-10-2419 min
Experiment Nation: The PodcastMicrosoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programsTim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.2021-10-2346 min
Experiment Nation: The PodcastTips on running a Test-to-Learn Experimentation Program with Shiva ManjunathExperiment Nation: The Conference Reloaded
Shiva will run through WHY you want to be running an experimentation program based on insight generation and not simply ‘winning’. He’ll also show you how to structure tests to support the growth of an insight-driven experimentation program.2021-10-1535 min
Experiment Nation: The PodcastSeven lessons from running 22,000 AB tests with Ayat ShukairyExperiment Nation: The Conference Reloaded
The average success rate of most AB testing programs hovers around 12%. Yep, for every 100 experiments you run, only 12 of them will generate an increase in conversions. That is worse than a coin toss. Too many companies start AB testing hoping that it will deliver a great increase in conversions. A few months later, they are bitterly disappointed. In this session, I will share the lessons we learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing pr...2021-10-0626 min
Experiment Nation: The PodcastMigrando para a área de experimentação vindo do Jornalismo (participação especial Fabricio Migues)Hoje começamos um novo papo em nosso podcast: como migrar para a área de experimentação? Nosso convidado especial é Fabricio Migues, CRO Manager na Small World Financial Services, conta pra gente como foi sair da área de jornalismo e relações públicas e adentrar na experimentação, como aproveitar seus aprendizados e conhecimentos da área de comunicação dentro de CRO e como isso o tem ajudado.
Edição: João Pedro Alencar Referências citadas no episódio:
Referência citada da minha parte
https://www.exp-growth.com/
https://open.spotify.com/episode/4d3Prnlc0VIf...2021-10-0544 min
Experiment Nation: The PodcastWomen in experimentation: What holds us back? With Bithika MehraExperiment Nation: The Conference Reloaded
Why is it that all through school, girls outperform boys but that equation is flipped in the corporate world? Are there factors in our nurture (and possibly nature) that play against us? How do these factors play out in the experimentation space? In this session – recommended for women in experimentation and those working with them – Bithika will help identify blind spots and hopes to help women and teams reach their true potential.2021-10-0319 min
Experiment Nation: The PodcastShopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizersTracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.
Follow Shanelle on Twitter: @shanelle_mullin2021-09-1834 min
Experiment Nation: The PodcastAdventures in Experimentation: Is my company doing CRO right?There's no single answer as Conversion Optimization and Experimentation continue to evolve and find fit in the digital era. What resonates with us is, if you're constantly testing and celebrating performance instead of delivery, you're likely to be on the right path of doing it right. In this episode, Marion Ravel, Eden Bidani, and Positive John shared different angles, from e-commerce, copywriting, and product, to structuring and thinking through CRO.
Books mentioned:
Emotional Design — https://www.amazon.com/Emotional-Design-Love-Everyday-Things/dp/0465051367
Working Backwards: https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595
2021-09-1827 min
Experiment Nation: The PodcastSérie - Estruturando uma área de CRO na sua empresa - episódio 3 (Participação especial André Vieira)Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre:
Qual o ponto de partida para começar a investir em CRO?
Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos
A qual área CRO melhor pertence dentro de uma empresa?
Edição do podcast por João Pedro (https://www.linkedin.com/in/joaopedroalencar/)
Referências citadas ao longo do ep:
Looptimize: https://looptimize.com.br/
Online Dialogue: https://onlinedialogue.com/
How to measure anythi...2021-08-2340 min
Experiment Nation: The PodcastComment mesurer le ROI de mon programme d’expérimentation?Hosted by Marion Ravel and Mathieu Fauveaux2021-08-1335 min
Experiment Nation: The PodcastSérie: Estruturando uma área de CRO na sua empresa - episódio 2Nesse segundo episódio, falamos sobre gatilhos que fazem empresas procurarem o CRO e desafios para se começar a trabalhar com a área. Discutimos sobre entendimento geral de experimentação em uma empresa sobre o produto "estar pronto" para ser otimizado. Fiquem à vontade para contribuir.
Editor: https://www.linkedin.com/in/jo%C3%A3o-pedro-de-queiroz-alencar-1852a518b/
Referências: Agende uma mentoria com John no GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski
Podcast com Ron Kohavi: https://www.abtasty.com/blog/1000-experiments-club-ronny-kohavi/
Auditoria de maturidade de experimentação com base no artigo The Evolution of Continuous Experimentation in Software Pro...2021-07-3126 min
Experiment Nation: The PodcastDexter's Joris Bryon on Common Practices, Starting a CRO agency, and how to spot a CRO imposterTracy Laranjo asks Dexter's Joris Bryon about
How we need to stop saying Best practices and start saying Common Practices
His tips on starting a CRO agency and working with a partner
And how to spot a CRO imposter
2021-07-1043 min
Experiment Nation: The PodcastSérie: Estruturando uma área de CRO na sua empresa - episódio 1Nesse primeiro episódio da série, vamos discutir como caímos no mundo de Otimização de Conversão (CRO), algumas experiências até posições atuais e diferentes perspectivas entre exatas/humanas e seus benefícios.
Editor: João Pedro Alencar https://bit.ly/3jt4BLu
Materiais comentados no episódio:
Learning how to learn from the Awesome Dr. Barbara Oakley: https://bit.ly/3h2AAk1
Making websites win, free audiobook on Spotify >> https://spoti.fi/3qzRYzX
CXL Conversion Optimization minidegree >> https://bit.ly/3Aid9em
Trustworthy Online Controlled Experiments: A Practical Guide to A/B Tes...2021-06-3029 min
Experiment Nation: The PodcastCR-No: Making your CRO program go fasterRommil, Kenya, and Shiva discuss the challenges of speeding up a CRO program, as well as some of the ways they overcome them.2021-06-0530 min
Experiment Nation: The PodcastAdventures in Experimentation: A deep-dive into CRO toolsPositive John and Marion talk about their favorite CRO tools, how they evaluate them, and how to get clients to pay for them.2021-05-0941 min
Experiment Nation: The PodcastProduct Experimentation: Building a competency and fluency with data (Part 2)Jaya and Sid chat with Moshe Mikanovsky, a Product Manager with over 30 years of experience, about the importance of getting closer to the data by getting familiar with data tools and working with business intelligence.
This episode was edited by Jin Yang. She is the co-founder of Mindset Masters. Mindset Masters works with professionals in all industries to encourage high school and university students to develop a growth mindset. If you are interested in speaking in one of their online workshops, please reach out at any time at contact.mindsetmasters@gmail.com.2021-04-1028 min
Experiment Nation: The PodcastProduct Experimentation: Building a competency and fluency with data (Part 1)Jaya and Sid chat about building competency with and a fluency with data to get a better idea of what's happening with systems and how products are helping customers.
Mentioned in this episode: Ravi Mehta's Product Competency Toolkit: https://www.ravi-mehta.com/product-manager-skills/
2021-04-0219 min
Experiment Nation: The PodcastSpecsavers' Melanie Kyrklund on How to run a high-impact optimization programIn this episode, Rommil and Tracy interview Melanie Kyrklund from Specsavers on how to run a high-impact optimization program, how to align the program with a product's vision, and how she likes black licorice. 2021-03-2724 min
Experiment Nation: The PodcastCR-No: Addressing the lack of direction and primary calls to action on pagesThis week, Siobhan Solberg, Kenya Davis, Shiva Manjunath and Eddie Aguilar talk about how to address the lack of direction and primary calls to action on pages.
This episode was edited by Zohaib. Zohaib is an audio engineer, music producer and DJ from Karachi who now lives in Toronto. You can find this profiles here:
https://soundcloud.com/saazbyzoi
https://www.facebook.com/saazbyzoi
https://www.instagram.com/zoi_music/?hl=en
2021-03-2026 min
Experiment Nation: The PodcastCR-No: How to manage stakeholders and HiPPOsIn this episode, our panel discusses how to manage stakeholders and HiPPOs. What do we do with them when they don't agree with our results? How do we get ahead of issues?
On the panel:
Shiva Manjunath
Eddie Aguilar
Kenya Davis
Siobhan Solberg
2021-03-1222 min
Experiment Nation: The PodcastAdventures in Experimentation: The importance of the voice of customer to conversion optimization - as well as to the entire businessEden and Positive John speak about how recording your sessions with clients helps reduce the need for taking notes, how qualitative research is key to not just CRO but for all things business, and how no one likes pop-up surveys except for Positive John.
Useful resources mentioned in the episode: https://www.notion.so/User-Psych-framework-applied-on-LinkedIn-s-conversion-funnel-3bf3cdfc4aa54c2c9191f403157ed3172021-03-0138 min
Experiment Nation: The PodcastAudio version: Widerfunnel’s Chris Goward on how Experimenters need to focus less on the tools and more on strategyThis is the audio version of our recent interview with Widerfunnel’s Chris Goward.2021-02-2307 min
Experiment Nation: The PodcastProduct Experimentation: Aligning the need to deliver and the need to learn with OKRsJaya and Sid explore:
What does a good product experiment look like
Aligning the need to deliver and the need to learn with OKRs
Why aren’t companies adopting the practice
2021-02-1925 min
Experiment Nation: The PodcastExperiment Nation: The PodcastRommil & Tracy interview the very best Experimenters from around the world!2021-02-1800 min
Experiment Nation: The PodcastCR-No: Balancing between optimizing the entire customer journey vs. just the websiteOn today’s panel, we have
Siobhan Solberg from Raze
Shiva Manjunath from Gartner
Kenya Davis from Evolytics
Eddie Aguilar from Circle media labs
In this episode the panel discusses:
Balancing between optimizing the entire funnel vs focusing only on the website
Bringing segmentation into the mix
Their beef with Google optimize
2021-02-0524 min
Experiment Nation: The PodcastWhat you need to know about SEO ExperimentationOn today's episode, we interview Twilio's Justin Coons and talk about:
Not only can you run experiments for SEO, but you also should
Which is better, short-form content or long-form content
What metrics to optimize for when running SEO Experiments
2021-01-3022 min
Experiment Nation: The PodcastPoint/Counterpoint - Exploring different experiment prioritization frameworksOn today's episode of Point/Counterpoint, Trish leads Patrick and Marion through a discussion about: Their CRO New Year's resolutions, and the pros and cons of several experiment prioritization frameworks such as
PIE (https://www.widerfunnel.com/pie-framework/)
PXL (https://cxl.com/blog/better-way-prioritize-ab-tests/)
Hotwire's framework (https://blog.optimizely.com/2015/05/05/how-to-prioritize-ab-testing-ideas/)
2021-01-2423 min
Experiment Nation: The PodcastProduct Experimentation: Start with me, take a chance, be ready for failureJaya and Siddharth explore how Experimentation fits into the Product Development Life Cycle, how to work with challenging stakeholders, share stories about how they've leveraged Experiments to generate results.2021-01-1626 min
Experiment Nation: The PodcastAdventures in Experimentation: How do you answer the question, "How many experiments should I run?"On today’s episode, John Ostrowski and Eden Bidani talk about:
How they respond when someone asks them how many experiments they should run
What they've done when a test breaks in production
Why John keeps a personal list of shame
If you enjoy today’s episode. and you think we’ve earned it - please consider subscribing!2021-01-1136 min
Experiment Nation: The PodcastCR-No: Experiments should be backed by hypotheses - leave your best practices for your processesToday's episode features:
Eddie Aguilar
Kenya Davis
Shiva Manjunath
Siobhan Solberg
The panel talks about:
How best practices in CRO should only apply to approaches and workflows and not necessarily what you should test.
The danger of copying others’ "best practices".
Enjoy!2020-12-2830 min
Experiment Nation: The PodcastThe anniversary episode: A conversation with Rommil that's only a bit about ExperimentationIt's been one year since Experiment Nation started interviewing Experimenters from around the world, can you believe it? For this special episode, the tables are turned! Experiment Nation's new Canadian co-host, Shannon (aka the "Russian Giant"), interviews Rommil for a change of pace. We talk about escape rooms, raising children, and wearing lab coats. We hope you enjoy it! And yes, we promise to go back to talking more about Experimentation soon - pinky swear.
On that note - we're looking for more Interviewers and podcast co-hosts to join us. Shannon and I cannot cover the world...2020-12-0437 min
Experiment Nation: The PodcastConversion Rate Optimization, Best Practices, and Other Terribly Named ThingsIn this episode, we speak with Gartner's Shiva Manjunath about the world of CRO: what it means, what it doesn't mean, and the important role that humour and politics play in it. As a bonus, we learn how his lack of enthusiasm about medicine helped him become the person he is today and what he really thought about last season's NHL playoffs.
We're still working through the audio setup. We'll get it right one day, swear.2020-12-0427 min
Experiment Nation: The PodcastRunning Experiments on Personalization, Machine Learning, and AI with Munir Al-DajaniExperiment Nation finally has a podcast and we couldn't think of a better way to kick it off than having a great in-depth conversation with Munir Al-Dajani about how to run Experiments on Personalization, some of the ethical aspects of Personalization, and the differences between Machine Learning and AI.2020-11-2242 min