1. Learn
    2. /
  2. Courses
    3. /
  3. A/B Testing in Python

Exercise

Delta method

Delta method is one of the most practical A/B testing applications. As a Data Scientist you are going to encounter cases where the user assignment per variant is based on user_id to create a consistent experience, while the unit of analysis is something more granular such as a page view or a session.

In this exercise you will analyze the difference in total order_value per page_view ratio metric between variants A and C. The checkout DataFrame is loaded for you along with pandas, numpy, and the pre-defined functions for estimating ratio metrics variance var_delta() and ratio metrics z-test ztest_delta().

Instructions 1/3

undefined XP
    1
    2
    3
  • Define the user-level ratio components for each of the variants A and C with the numerator of total order_value per user_id as the order_value column, and denominator as count of user_id as the page_view column.