Encontrando os valores ausentes

Ter um resumo de quanto dos seus dados está ausente pode ser útil, mas muitas vezes você vai precisar encontrar as localizações exatas desses valores ausentes. Usando o mesmo subconjunto dos dados do StackOverflow do exercício anterior (sub_df), você vai mostrar como um valor pode ser marcado como ausente.

Este exercicio faz parte do curso

Feature Engineering for Machine Learning in Python

exercicio interativo prático

Tente este exercicio completando este código de exemplo.

# Print the top 10 entries of the DataFrame
print(sub_df.____)

Editar e Executar Código

Este exercicio faz parte do curso

Feature Engineering for Machine Learning in Python

IntermediárioNível de habilidade

4.8+

Comece o curso gratuitamente

In this chapter, you will explore what feature engineering is and how to get started with applying it to real-world data. You will load, explore and visualize a survey response dataset, and in doing so you will learn about its underlying data types and why they have an influence on how you should engineer your features. Using the pandas package you will create new features from both categorical and continuous columns.

Exercise 1: Why generate features?Exercise 2: Getting to know your data Exercise 3: Selecting specific data types Exercise 4: Dealing with categorical features Exercise 5: One-hot encoding and dummy variables Exercise 6: Dealing with uncommon categories Exercise 7: Numeric variables Exercise 8: Binarizing columns Exercise 9: Binning values

This chapter introduces you to the reality of messy and incomplete data. You will learn how to find where your data has missing values and explore multiple approaches on how to deal with them. You will also use string manipulation techniques to deal with unwanted characters in your dataset.

Exercise 1: Por que existem valores ausentes?Exercise 2: Quão esparsos estão meus dados?Exercise 3: Encontrando os valores ausentes

Exercicio Atual

Exercise 4: Lidando com valores ausentes (I)Exercise 5: Exclusão por lista (listwise deletion)Exercise 6: Substituindo valores ausentes por constantes Exercise 7: Lidando com valores ausentes (II)Exercise 8: Preenchendo valores contínuos ausentes Exercise 9: Imputando valores em modelos preditivos Exercise 10: Lidando com outros problemas de dados Exercise 11: Lidando com caracteres soltos (I)Exercise 12: Lidando com caracteres soltos (II)Exercise 13: Encadeamento de métodos

In this chapter, you will focus on analyzing the underlying distribution of your data and whether it will impact your machine learning pipeline. You will learn how to deal with skewed data and situations where outliers may be negatively impacting your analysis.

Exercise 1: Data distributions Exercise 2: What does your data look like? (I)Exercise 3: What does your data look like? (II)Exercise 4: When don't you have to transform your data?Exercise 5: Scaling and transformations Exercise 6: Normalization Exercise 7: Standardization Exercise 8: Log transformation Exercise 9: When can you use normalization?Exercise 10: Removing outliers Exercise 11: Percentage based outlier removal Exercise 12: Statistical outlier removal Exercise 13: Scaling and transforming new data Exercise 14: Train and testing transformations (I)Exercise 15: Train and testing transformations (II)

Finally, in this chapter, you will work with unstructured text data, understanding ways in which you can engineer columnar features out of a text corpus. You will compare how different approaches may impact how much context is being extracted from a text, and how to balance the need for context, without too many features being created.

Exercise 1: Encoding text Exercise 2: Cleaning up your text Exercise 3: High level text features Exercise 4: Word counts Exercise 5: Counting words (I)Exercise 6: Counting words (II)Exercise 7: Limiting your features Exercise 8: Text to DataFrame Exercise 9: Term frequency-inverse document frequency Exercise 10: Tf-idf Exercise 11: Inspecting Tf-idf values Exercise 12: Transforming unseen data Exercise 13: N-grams Exercise 14: Using longer n-grams Exercise 15: Finding the most common words Exercise 16: Wrap-up