Sr. Data Scientist, ML Model Evaluation - Apple Media Products at Apple (San Diego, CA)
Lead the product vision and project execution for offline evaluations for Apple Music through Search, Recommendations, and Siri. Partner with Product teams to define ML model evaluation KPIs (NDCG, MRR, Precision@k, etc.) and create dashboards to monitor the performance of our AMP products. Define the instrumentation required for yielding sufficient data in regards to sampling, test set creation. Champion an industry-leading privacy-focused strategy for product measurement, model evaluation, and analytics for Apple Music. Own and evangelize standard methodologies for product analysis, measurement, and instrumentation. Lead model evaluation design and management exercises. Interface with vendors to establish rater pools for your evaluations. Evaluate and improve the quality of critical metrics for key products by analyzing customer pain points. Empower others to understand and leverage data for decision making. Ensure the measurement of new features are designed and instrumented in every release cycle. Productize dashboards that help product teams to improve Search & Recommendations every day. Work with leadership to build a strategy that allows us to leverage our data to create automatic feedback loops that improve the AMP products.
Please let the company know you found this position via
so we can keep providing you with quality jobs.