1. Learn
    2. /
  2. Courses
    3. /
  3. Streamlined Data Ingestion with pandas

Exercise

Skip bad data

In this exercise you'll use read_csv() parameters to handle files with bad data, like records with more values than columns. By default, trying to import such files triggers a specific error, pandas.errors.ParserError.

Some lines in the Vermont tax data here are corrupted. In order to load the good lines, we need to tell pandas to skip errors. We also want pandas to warn us when it skips a line so we know the scope of data issues.

pandas has been imported as pd. The exercise code will try to read the file. If there is a pandas.errors.ParserError, the code in the except block will run.

Instructions 1/3

undefined XP
  • 1

    Try to import the file vt_tax_data_2016_corrupt.csv without any keyword arguments.

  • 2

    Import vt_tax_data_2016_corrupt.csv with the error_bad_lines parameter set to skip bad records.

  • 3

    Update the import with the warn_bad_lines parameter set to issue a warning whenever a bad record is skipped.