Database and SQL with csvkit
The addition of csvsql
and sql2csv
allows us to go through an entire data workflow inside the terminal without needing to install and set up additional SQL clients and software. In this capstone, we will put together and pull data from a SQLite database, merge this data with a locally saved file, and finally, push a final merged file back to the database, all without ever leaving the command line.
This exercise is part of the course
Data Processing in Shell
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Store SQL for querying from SQLite database
sqlquery_pull="SELECT * FROM SpotifyMostRecentData"
# Apply SQL to save table as local file
sql2csv --db "___:///___.__" --query "$___" > SpotifyMostRecentData.csv