[Remote] Principal, Experience Measurement & Validation
Auto ImportNote: The job is a remote job and is open to candidates in USA. Alteryx is leading the transformation in how work gets done through data, automation, and AI. The Principal, Experience Measurement & Validation will build systems to determine product readiness and value delivery, focusing on both traditional and AI-assisted product experiences.
Responsibilities
- Design and evolve a staged validation system that reduces launch risk by guiding capabilities from internal testing through preview to general availability
- Define experience measurement standards across the product lifecycle, including behavioral and experience health benchmarks used to assess readiness and inform decisions
- Establish scalable approaches to early customer exposure (ex. preview programs, progressive rollouts) that generate reliable signal before broad release
- Define behavioral data and instrumentation requirements in partnership with Engineering and Telemetry, ensuring readiness signals are captured consistently across releases
- Ensure readiness conclusions are grounded in both customer feedback and observed behavior, with clear articulation of risk, confidence, and implications
- Build and own a multi-dimensional experience measurement framework that combines attitudinal and behavioral signals into a cohesive view of product experience health
- Apply this framework through clear baselines and benchmarks to help product teams understand readiness, performance, and areas of risk
- Translate measurement into clear, evidence-based insights that inform release decisions, prioritization, and ongoing product improvements
- Partner with Product to establish shared measurement baselines, with teams layering in feature-specific learning goals
- Translate readiness and experience health signals into clear recommendations and decision guidance for product and engineering leadership
- Contribute to the broader Customer Signals model, integrating telemetry, qualitative research, and experience health into a unified view of product performance
- Partner with Engineering to ensure measurement is designed into capabilities early, enabling reliable signal without slowing delivery
Skills
- 8+ years in quantitative UX research, mixed-methods research, or product insights, with strong quantitative and statistical depth and the judgment to know when behavioral data alone is not enough
- Experience connecting customer feedback to observed behavior and explaining meaningful gaps between the two
- Experience with UX measurement frameworks (ex. HEART, UMUX-Lite, CSAT) and how to connect them to behavioral signals
- Experience working with staged rollouts, preview programs, or feature-flagged releases, and understanding how controlled exposure shapes signal quality
- Strong ability to synthesize across signal types and communicate clearly what the data means, what is at risk, and what should happen next
- Comfortable operating in ambiguity and defining structure where it does not yet exist
- Background in platform or infrastructure product contexts where measurement must operate at scale with limited manual overhead
- Experience in data or analytics platform categories
- Experience measuring or validating AI-assisted or agentic product experiences, where system behavior is probabilistic rather than deterministic
Benefits
- Target annual bonus of 20% of base salary, based on individual and company performance
- A monthly Connectivity Plus stipend of $150 to support remote work-related expenses
- An annual $200 home office reimbursement
- Medical, dental, and vision coverage
- 401(k) with company match
- Paid parental leave, caregiver leave, and flexible time off
- Mental health support and wellness reimbursement
- Career development and education assistance
Company Overview
Company H1B Sponsorship