Use Cases
New to MCP? Start with Explore Data with AI for setup instructions and foundational concepts before diving into industry-specific use cases.
User Engagement × Model Quality
The question: Do users who interact with higher-scoring model outputs have better retention?
Thumbs up/down signals tell you something, but they’re noisy and self-selected. Combining them with eval scores gives your ML team a more grounded optimization target — one that’s anchored in what actually keeps users coming back, not just what they rate in the moment.
Feature Usage × Infrastructure Cost
The question: Which AI features have the highest per-user compute cost relative to their retention impact?
Not every high-engagement feature is worth what it costs to serve. This join helps you find the features where cost and retention impact are misaligned — either expensive features that aren’t driving retention, or under-invested features that are.
Pro tip: Run this analysis before roadmap planning, not after. Knowing your cost-to-retain ratio per feature is one of the more defensible inputs into prioritization conversations.
Error Rates × User Drop-off
The question: When error rates spike, how quickly does it show up in session frequency?
Infrastructure teams often work from SLOs that don’t account for user behavior. This join gives you the user-side view of a reliability incident — how fast it ripples into engagement, which segments feel it most, and whether recovery shows up in the data after a fix ships.
Prompt Patterns × Conversion
The question: Which prompt types lead to the highest satisfaction and paid conversion?
Different users come to AI products with different jobs to be done — writing, coding, analysis, research. This join shows you which use cases your product serves best and which ones convert, which is useful both for positioning and for deciding where to invest in fine-tuning.
Sample Prompts by Role
These are starting points. Adjust the time ranges, segments, and metrics to match your product and data.- Product Manager
- ML Engineering Lead
- Data Analyst
- Growth / Marketing Lead
- Executive
- Retention curve for users who used AI feature 5+ times in their first week
- Funnel from free signup to first AI interaction to 10th interaction to upgrade to paid
- Daily trend of AI outputs per user, segmented by plan tier
- User segments with highest thumbs-down ratio on AI outputs
- Engagement pattern for users who hit rate limits vs. those who don’t
- Average time from signup to first “power use” session (10+ prompts)
- Output exported rate difference between free and paid users
- Adoption curve for newest model version — are users switching?
- Conversion rate for users who hit “wow moment” in session 1 vs. later
- Which use case categories (writing, coding, analysis) have highest retention correlation?
Recommended Data Connections
Key Takeaways
- Model quality and user retention are measurable together — connecting eval scores with engagement data gives ML teams a product-centric target to optimize toward.
- Cost-to-serve analysis only means something when it’s paired with retention impact; high compute cost on a high-retention feature is a different problem than high compute cost on a feature users abandon.
- Reliability incidents have a lagged user impact — look at engagement trends in the days after an incident, not just the day of.
- Prompt patterns and use case categories are underused signals for both product positioning and fine-tuning decisions.
- The teams getting the most from this setup are the ones sharing data across ML, product, and growth — not keeping it siloed by function.