Using pandas functions effectively

You are creating a Python application that will calculate summary statistics based on user-selected variables. The complete dataset is quite large. For now, you are setting up your code using part of the dataset, preloaded as adult. As you create a reusable process, make sure you are thinking through the most efficient way to setup the GroupBy object.

This exercise is part of the course

Working with Categorical Data in Python

Exercise instructions

Create a list of the names for two user-selected variables: "Education" and "Above/Below 50k".
Create a GroupBy object, gb, using the user_list as the grouping variables.
Calculate the mean of "Hours/Week" across each group using the most efficient approach covered in the video.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Create a list of user-selected variables
user_list = ____

# Create a GroupBy object using this list
gb = ____

# Find the mean for the variable "Hours/Week" for each group - Be efficient!
print(____)

Edit and Run Code

This exercise is part of the course

Working with Categorical Data in Python

IntermediateSkill Level

4.8+

Start Course for Free

Almost every dataset contains categorical information—and often it’s an unexplored goldmine of information. In this chapter, you’ll learn how pandas handles categorical columns using the data type category. You’ll also discover how to group data by categories to unearth great summary statistics.

Exercise 1: Course introduction Exercise 2: Categorical vs. numerical Exercise 3: Exploring a target variable Exercise 4: Ordinal categorical variables Exercise 5: Categorical data in pandas Exercise 6: Setting dtypes and saving memory Exercise 7: Creating a categorical pandas Series Exercise 8: Setting dtype when reading data Exercise 9: Grouping data by category in pandas Exercise 10: Create lots of groups Exercise 11: Setting up a .groupby() statement Exercise 12: Using pandas functions effectively

Current Exercise

Now it’s time to learn how to set, add, and remove categories from a Series. You’ll also explore how to update, rename, collapse, and reorder categories, before applying your new skills to clean and access other data within your DataFrame.

Exercise 1: Setting category variables Exercise 2: Setting categories Exercise 3: Adding categories Exercise 4: Removing categories Exercise 5: Updating categories Exercise 6: Collapsing categories knowledge check Exercise 7: Renaming categories Exercise 8: Collapsing categories Exercise 9: Reordering categories Exercise 10: Reordering categories in a Series Exercise 11: Using .groupby() after reordering Exercise 12: Cleaning and accessing data Exercise 13: Cleaning variables Exercise 14: Accessing and filtering data

In this chapter, you’ll use the seaborn Python library to create informative visualizations using categorical data—including categorical plots (cat-plot), box plots, bar plots, point plots, and count plots. You’ll then learn how to visualize categorical columns and split data across categorical columns to visualize summary statistics of numerical columns.

Exercise 1: Introduction to categorical plots using Seaborn Exercise 2: Boxplot understanding Exercise 3: Creating a box plot Exercise 4: Seaborn bar plots Exercise 5: Creating a bar plot Exercise 6: Ordering categories Exercise 7: Bar plot using hue Exercise 8: Point and count plots Exercise 9: Creating a point plot Exercise 10: Creating a count plot Exercise 11: Review catplot() types Exercise 12: Additional catplot() options Exercise 13: One visualization per group Exercise 14: Updating categorical plots

Lastly, you’ll learn how to overcome the common pitfalls of using categorical data. You’ll also grow your data encoding skills as you are introduced to label encoding and one-hot encoding—perfect for helping you prepare your data for use in machine learning algorithms.

Exercise 1: Categorical pitfalls Exercise 2: Memory usage knowledge check Exercise 3: Overcoming pitfalls: string issues Exercise 4: Overcoming pitfalls: using NumPy arrays Exercise 5: Label encoding Exercise 6: Create a label encoding and map Exercise 7: Using saved mappings Exercise 8: Creating a Boolean encoding Exercise 9: One-hot encoding Exercise 10: One-hot knowledge check Exercise 11: One-hot encoding specific columns Exercise 12: Wrap-up video