Implementing a randomized block design

The manufacturing firm you worked with earlier is still interested in conducting some experiments on worker productivity. Previously, the two blocks were set randomly. While this can work, it can be better to group subjects based on similar characteristics.

The same employees are again loaded but this time in a DataFrame called productivity including 1200 other colleagues. It also includes a worker 'productivity_score' column based on units produced per hour. This column was binned into three groups to generate blocks based on similar productivity values. The firm would like to apply a new incentive program with three options ('Bonus', 'Profit Sharing' and 'Work from Home') throughout the firm with treatment applied randomly.

numpy and pandas as np and pd respectively are loaded.

This exercise is part of the course

Experimental Design in Python

Exercise instructions

Shuffle the blocks to create a new DataFrame called prod_df.
Reset the index so that block is not both an index and a column.
Randomly assign the three treatment values in the 'Treatment' column.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Randomly assign workers to blocks
prod_df = productivity.____('____').apply(
  lambda x: x.____(____)
)

# Reset the index
prod_df = prod_df.____(____)

# Assign treatment randomly
prod_df['Treatment'] = np.random.choice(
  ['____', '____', '____'],
  size=len(____)
)

Edit and Run Code

This exercise is part of the course

Experimental Design in Python

IntermediateSkill Level

4.8+

Start Course for Free

Building knowledge in experimental design allows you to test hypotheses with best-practice analytical tools and quantify the risk of your work. You’ll begin your journey by setting the foundations of what experimental design is and different experimental design setups such as blocking and stratification. You’ll then learn and apply visual and analytical tests for normality in experimental data.

Exercise 1: Setting up experiments Exercise 2: Non-random assignment of subjects Exercise 3: Random assignment of subjects Exercise 4: Experimental data setup Exercise 5: Blocking experimental data Exercise 6: Stratifying an experiment Exercise 7: Which was stratified?Exercise 8: Normal data Exercise 9: Visual normality in an agricultural experiment Exercise 10: Analytical normality in an agricultural experiment

You'll delve into sophisticated experimental design techniques, focusing on factorial designs, randomized block designs, and covariate adjustments. These methodologies are instrumental in enhancing the accuracy, efficiency, and interpretability of experimental results. Through a combination of theoretical insights and practical applications, you'll acquire the skills needed to design, implement, and analyze complex experiments in various fields of research.

Exercise 1: Factorial designs: principles and applications Exercise 2: Understanding marketing campaign effectiveness Exercise 3: Heatmap of campaign interactions Exercise 4: Factorial designs and randomized block designs Exercise 5: Randomized block design: controlling variance Exercise 6: Implementing a randomized block design

Current Exercise

Exercise 7: Visualizing productivity within blocks by incentive Exercise 8: ANOVA within blocks of employees Exercise 9: Covariate adjustment in experimental design Exercise 10: Importance of covariates Exercise 11: Covariate adjustment with chick growth

Master statistical tests like t-tests, ANOVA, and Chi-Square, and dive deep into post-hoc analyses and power analysis essentials. Learn to select the right test, interpret p-values and errors, and skillfully conduct power analysis to determine sample and effect sizes, all while leveraging Python's powerful libraries to bring your data insights to life.

Exercise 1: Choosing the right statistical test Exercise 2: Choosing the right test: petrochemicals Exercise 3: Choosing the right test: human resources Exercise 4: Choosing the right test: finance Exercise 5: Post-hoc analysis following ANOVA Exercise 6: Anxiety treatments ANOVA Exercise 7: Applying Tukey's HSD Exercise 8: Applying Bonferoni correction Exercise 9: P-values, alpha, and errors Exercise 10: Analyzing toy durability Exercise 11: Visualizing durability differences Exercise 12: Role of significance levels Exercise 13: Power analysis: sample and effect size Exercise 14: Effect size purpose Exercise 15: Estimating required sample size for energy study

Hop into the complexities of experimental data analysis. Learn to synthesize insights using pandas, address data issues like heteroscedasticity with scipy.stats, and apply nonparametric tests like Mann-Whitney U. Learn additional techniques for transforming, visualizing, and interpreting complex data, enhancing your ability to conduct robust analyses in various experimental settings.

Exercise 1: Synthesizing insights from complex experiments Exercise 2: Visualizing loan approval yield Exercise 3: Exploring customer satisfaction Exercise 4: Effectively communicating experimental data Exercise 5: Addressing complexities in experimental data Exercise 6: Check for heteroscedasticity in shelf life Exercise 7: Exploring and transforming shelf life data Exercise 8: Applying nonparametric tests in experimental analysis Exercise 9: Visualizing and testing preservation methods Exercise 10: Further analyzing food preservation techniques Exercise 11: Congratulations!