ABOUT THE KEYNOTE

How to build AI products across B2B and B2C: Stories from Uber, Microsoft & Instacart

In this comprehensive 101 session, Nimisha Sharath Sharma will walk you through the entire process of building and launching AI/ML-powered products.

Using real-world examples from her work at Uber, Microsoft, and Instacart, she will illustrate each key step: from ideation and understanding the industry landscape to setting goals, deep dives into engineering and data science, A/B testing and experimentation, measuring model quality, and navigating legal considerations. She’ll also cover metrics tracking, go-to-market strategies, and the essential post-launch iterations.

This talk is packed with actionable insights and practical examples for anyone looking to bring AI products to market successfully.

Type
Virtual Keynote
Onsite Keynote
Time
October 11, 2024 15:15
To be announced
Year
current

Rewatch the Keynote

Want to join the next just product conference to see keynotes like this live onsite or in the livestream?

Make sure to get your ticket today

Summary & key takeaways

Building AI Products: Key Differences in B2B vs. B2C

When developing AI products, the approach varies significantly between B2B and B2C markets, each presenting unique challenges and opportunities.

1. Building AI Products in B2B vs. B2C

B2B (Business-to-Business):

In B2B environments, the focus centers on direct collaboration with enterprise clients. For example, when building Instacart’s personalized promotions platform, the process began with in-depth discussions with brands like Pepsi and Hershey. These clients offer specific, clear requirements, allowing for tailored AI solutions that meet their unique business needs. The problem definition stage involves direct interviews, continuous engagement, and ongoing alignment to ensure the solution addresses their pain points.

Success in B2B AI products depends heavily on relationship building and trust. Legal and privacy considerations must be carefully managed, as clients need full transparency on how their data is being used. Securing early buy-in is critical, particularly when dealing with sensitive data for training AI models. These clients often become active partners in prototyping and testing, offering real-time feedback that shapes the development process.

B2C (Business-to-Consumer):

In contrast, B2C products are designed for broad, diverse user bases, and the development process is driven by data analysis and user behavior metrics. Direct user feedback is scarce, so dashboards and analytics become essential tools for understanding user patterns. For instance, while working on Bing Ads, the challenge wasn’t understanding individual user feedback but identifying trends across millions of users.

Problem definition in B2C relies on identifying patterns in engagement, retention, and conversion rates. While B2B products are tailored to specific clients, B2C solutions must be scalable, balancing personalization with mass-market appeal. Testing in B2C often occurs through A/B testing, where small segments of users are exposed to new features, and success is measured through statistical significance. Unlike B2B, where clients provide direct feedback, B2C product development requires continuous monitoring of metrics to gauge the effectiveness of AI models.

2. The Five Key Stages of AI Product Development

The development of AI products typically follows five stages, each with distinct differences between B2B and B2C contexts.

Problem Definition:

Everything begins with clearly identifying the problem the product will solve. In B2B, this often comes from direct conversations with clients who express specific needs. For instance, brands using Instacart wanted to know why certain target customers weren’t responding to their promotions. In B2C, problem definition is more data-driven. In the case of Bing Ads, data showed users clicked more on content featuring images and videos, revealing a timing issue with ad placement. B2B relies on qualitative research and direct client feedback, while B2C leans heavily on quantitative data.

Validation & Planning:

In B2B, validation involves checking the feasibility of the proposed AI solution and securing client approval before moving forward. Legal clearances and client buy-in are essential, as products often rely on sensitive data for machine learning models. B2C validation focuses on aligning internal stakeholders. Here, the product team must ensure that the AI solution is scalable and technically feasible, using data-driven insights to validate assumptions. Planning in B2C involves scoping out timelines, setting metrics, and preparing for testing phases like A/B testing.

Designing & Prototyping:

Prototyping differs significantly between B2B and B2C. In B2B, products are often designed with specific clients in mind, with ongoing client feedback shaping the final solution. For example, when building AI-powered promotional tools for Instacart, the team worked closely with clients to ensure the solution met their technical requirements. In B2C, prototyping is a more internal process, where the focus is on building a scalable solution for a broad audience. B2C prototypes are refined through data analysis and testing, with little to no direct user input until the testing phase.

Development & Testing:

Development in B2B is closely tied to client collaboration, with clients providing early feedback and testing the product as it evolves. This ensures the product works within the client’s infrastructure and meets their needs. In B2C, the development process involves rigorous A/B testing, where the product is quietly rolled out to a segment of users. Success is measured through metrics like engagement, conversion, and retention. In B2C, setting guardrail metrics is crucial to ensure the AI model doesn’t negatively impact the user experience or fail at scale.

Launch & Monitoring:

Launch strategies also differ greatly between B2B and B2C. In B2B, launches often occur in phases, starting with early adopters before scaling to a broader client base. This phased approach allows for personalized onboarding and hands-on support, ensuring clients are fully prepared to use the AI product. In B2C, launches are often silent, with a small percentage of users exposed to the new product first. Monitoring AI products post-launch is essential in both contexts, with continuous retraining of models required to maintain performance. In B2C, models face the risk of data drift as user behavior changes, requiring constant updates to stay effective.

3. Challenges in Building AI Products

Building AI products comes with unique challenges, particularly around privacy, ethics, and the continuous need for model updates.

Ethical AI & Privacy Considerations:

Both B2B and B2C products must prioritize ethical AI practices. In B2B, transparency is key, as clients must understand how their data is being used to train machine learning models. Legal clearances and client approval are required before moving forward. In B2C, while users may not be directly involved, teams must ensure that their AI models respect user privacy and are free from bias. Ethical AI guidelines must be built into the development process to avoid any unintended negative consequences.

Model Retraining & Drift:

AI models are dynamic and need to be continuously retrained to remain effective. This is particularly important in fast-changing environments like B2C, where user behavior can shift rapidly. Data drift occurs when the model’s predictions degrade over time due to changes in input data. Retraining AI models on fresh data is crucial to maintaining product performance, especially in high-traffic environments like Bing Ads or Instacart’s promotions platform.

4. Conclusion: A Unique Journey for AI Products

Developing AI products requires careful navigation of both technical and business challenges, whether building for enterprise clients in B2B or mass-market consumers in B2C. Success hinges on clear problem definition, strong collaboration, and a commitment to ethical AI practices. By staying adaptable and continuously refining AI models, product teams can create solutions that not only meet user needs but also evolve with changing behaviors and market conditions.

ABOUT THE SPEAKER

Nimisha Sharath Sharma

Nimisha Sharath Sharma is a seasoned Product Manager with extensive experience in launching and scaling both B2B and B2C products. She has a strong track record of building products from the ground up, managing multimillion-dollar portfolios, and introducing innovative solutions that resonate with customers. Her journey into product management began as a Data Scientist, where she discovered her passion for creating impactful products.

Currently, Nimisha is a Senior Product Manager at Uber, where she leads AI/ML initiatives focused on enhancing road safety. Previously, at Instacart, she spearheaded AI and experimentation-powered promotions, driving savings for consumers and revenue for brands. During her four-year tenure at Microsoft, she led product ad strategy, contributing to revenue growth through personalized ad experiences. Nimisha holds a Master's degree in Data Science from the University of Washington and is highly regarded for her technical expertise, professionalism, and dedication to excellence in product management.