1. Welcome to the course!
Welcome to the first course on Importing Data in Python! My name is Hugo Bowne-Anderson and I am a Data Scientist at DataCamp.
2. Import data
In this course, you'll learn how to import data from a large variety of import data sources, for example, (i) flat files such as dot txts and dot csvs; (ii) files native to other software such as Excel spreadsheets, Stata, SAS and MATLAB files;
3. Import data
(iii) relational databases such as SQLite & PostgreSQL. We’ll cover all of these topics in this course.
4. Plain text files
First off, we're going to learn how to import basic text files, which we can broadly classify into 2 types of files - those containing plain text, such as the opening of Mark Twain's novel The Adventures of Huckleberry Finn, which you can see here,
5. Table data
and those containing records, that is, table data, such as titanic dot csv, in which each
6. Table data
row is a unique passenger onboard and each
7. Table data
column is a characteristic or feature, such as gender, cabin and 'survived or not'.
The latter is known as a flat file and we'll come back to these in a minute.
8. Reading a text file
In this section, we'll figure out how to read lines from a plain text file: So let's do it! To check out any plain text file, you can use Python’s basic open function to open a connection to the file. To do so, you assign the filename to a variable as a string, pass the filename to the function open and also pass it the argument mode equals 'r', which makes sure that we can only read it (we wouldn't want to accidentally write to it!), assign the text from the file to a variable text by applying the method read to the connection to the file. After you do this, make sure that you close the connection to the file using the command file dot close. It’s always best practice to clean while cooking!
9. Printing a text file
You can then print the file to console and check it out using the command print(text).
A brief side note:
10. Writing to a file
if you wanted to open a file in order to write to it, you would pass it the argument mode equals 'w'. We won't use that in this course as this is course on Importing Data but it is good to know.
You can avoid having to close the connection to the file by
11. Context manager with
using a with statement.
This allows you to create a context in which you can execute commands with the file open. Once out of this clause/context, the file is no longer open and, for this reason, with is called a Context Manager.
What you're doing here is called 'binding' a variable in the context manager construct; while still within this construct, the variable file will be bound to open(filename, 'r'). It is best practice to use the with statement as you never have to concern yourself with closing the files again.
12. In the exercises, you’ll:
In the following interactive coding sessions, you’ll figure out how to print files to console. You’ll also learn to print specific lines, which can be very useful for large files. Then we’ll be back to discuss flat files and then I'll show you how to use the Python package NumPy to make our job of importing flat files & numerical data a far easier beast to tame.
13. Let's practice!
Enjoy!