We’re thrilled to welcome back Eva Hongyan Gao, Head of Product ESG at AMCS Group, a returning guest (episode 102) and a product leader in B2B SaaS, circular economy, and ESG, for a special episode on using LLMs securely inside the enterprise. Eva joins Matt and Moshe to offer a candid, hands-on look at how AI fits into enterprise toolkits, the challenges of data compliance, and the realities of integrating tools like Microsoft Copilot Studio within strict security frameworks.
Eva brings deep experience building for demanding enterprise customers, where success is measured not just by innovation, but by strict ISO, SOC 2, and GDPR compliance. She shares what happens behind the scenes as product leaders and IT teams try to balance innovation, cost, and data protection, sometimes losing sleep over responsible tool usage and ever-climbing AI integration costs.
Join Matt, Moshe, and Eva as they explore:
- Using AI tools in highly regulated, security-conscious B2B enterprise settings
- The compliance process: from ISO and SOC2 to GDPR and internal AI guidelines
- Why Microsoft Copilot is becoming the default LLM in enterprises, and what you still need to watch out for
- Building internal agents and chat interfaces to answer roadmap questions and handle stakeholder requests
- Lessons learned moving from over-engineered platforms to simpler, compliant AI tools
- Creative AI workflows, including removing branded assets between Copilot and Figma and orchestrating information for various departments
- The ongoing struggle: data redaction, internal transparency, and the limits of controlling generative models
- LLM orchestration: mixing old-school logic with new AI capabilities, and knowing when not to use AI
- Security best practices and the importance of a trust-based compliance mindset across the organization
- What happens when stakeholders use AI tools in ways product never expected
- Opportunities for Copilot and DevOps to streamline maintenance, documentation, and stakeholder requests
- The future of AI in sustainability, product management, and business decision-making
- And much more!
Want to connect with Eva or learn more?You can also connect with us and find more episodes:Note: Any views mentioned in the podcast are the sole views of our hosts and guests, and do not represent the products mentioned in any way.Please leave us a review and feedback ⭐️⭐️⭐️⭐️⭐️
