Session Ready
Exercise

Delta method

Delta method is one of the most practical A/B testing applications. As a Data Scientist you are going to encounter cases where the user assignment per variant is based on user_id to create a consistent experience, while the unit of analysis is something more granular such as a page view or a session.

In this exercise you will analyze the difference in total order_value per page_view ratio metric between variants A and C. The checkout DataFrame is loaded for you along with pandas, numpy, and the pre-defined functions for estimating ratio metrics variance var_delta() and ratio metrics z-test ztest_delta().

Instructions 1/3
undefined XP
  • 1
  • 2
  • 3
  • Define the user-level ratio components for each of the variants A and C with the numerator of total order_value per user_id as the order_value column, and denominator as count of user_id as the page_view column.
Loading