Intuit is looking to establish unified measurement frameworks and ensure analytics excellence across global teams, particularly in evaluating and optimizing emerging AI capabilities like Generative AI and agentic workflows.
Requirements
- Proven expertise in statistical analysis, experimentation design, and causal inference techniques.
- Strong programming skills in Python or R, with proficiency in SQL (Hive/Presto/BigQuery experience preferred).
- Hands-on experience designing evaluation and measurement frameworks for Generative AI and agentic workflows, including conversational AI, AI assistants, and autonomous task orchestration.
- Demonstrated success building unified KPI frameworks, measurement pipelines, or analytics governance structures at scale.
- Experience providing technical oversight to global analytics or data science teams.
- Guide experiment design and advanced analytical methods to evaluate platform enhancements, including causal inference techniques, attribution frameworks, and robust A/B testing.
- Track record of embedding analytics into product and platform decisions that drive measurable business impact.
Responsibilities
- Design and implement scalable, durable measurement frameworks to evaluate platform adoption, performance, and long-term business impact.
- Develop and lead measurement and evaluation frameworks for Generative AI systems and agentic workflows, including GenAI-powered digital assistants, retrieval-augmented generation (RAG), and autonomous task execution.
- Define success metrics that capture quality, accuracy, trust, customer experience, and business value of AI-driven interactions.
- Guide experiment design and advanced analytical methods to evaluate platform enhancements, including causal inference techniques, attribution frameworks, and robust A/B testing.
- Lead the definition, consolidation, and governance of key performance indicators (KPIs) across platform workstreams, enabling consistent and transparent measurement of impact.
- Provide technical and strategic oversight of global analytics teams (particularly in India), ensuring high-quality, timely, and aligned delivery of measurement and analytics initiatives.
- Champion sustainable practices in data quality, reporting, and documentation, ensuring long-term maintainability and scalability of analytics infrastructure.
Other
- Serve as a thought leader and strategic partner to product, platform, and engineering leadership.
- Strong business acumen and ability to translate ambiguous questions into clear analytical frameworks, success metrics, and actionable insights.
- Excellent communication skills with the ability to influence and collaborate effectively with senior leadership and cross-functional partners.
- Act as the central analytics partner across Product, Design, Engineering, and Data teams, ensuring analytics and insights are integrated into decision-making at every stage of the product lifecycle.
- Collaborate with product, platform, and engineering leaders to align analytics priorities with platform goals, ensuring data-driven decisions inform roadmaps and investments.