Save yourself time when performing complex repetitive tasks. You’ll begin this course by refreshing your knowledge of common command-line programs and arguments before quickly moving into the world of Bash scripting. You’ll create simple command-line pipelines and then transform these into Bash scripts. You’ll then boost your skills and learn about standard streams and feeding arguments to your Bash scripts.

Introduction and refresher

Extracting scores with shell

Searching a book with shell

Your first Bash script

A simple Bash script

Shell pipelines to Bash scripts

Extract and edit using Bash scripts

Standard streams & arguments

Using arguments in Bash scripts

Using arguments with HR data

From Command-Line to Bash Script

Master the bread and butter of Bash scripts—variables! In this chapter, you’ll learn how to create basic string and numeric variables, and perform calculations on these variables. You’ll also learn about the magic of a shell-within-a-shell (shell-ception), opening up huge opportunities for advanced scripting.

Basic variables in Bash

Using variables in Bash

Shell within a shell

Numeric variables in Bash

Converting Fahrenheit to Celsius

Extracting data from files

Arrays in Bash

Creating an array

Creating associative arrays

Climate calculations in Bash

Variables in Bash Scripting

Life isn't always linear and neither should your Bash scripts. In this chapter, you’ll take your Bash scripts to the next level by learning control statements. You’ll learn the differences between FOR, WHILE, IF, and CASE statements and how to use them in your Bash scripts. Armed with these new tools, you’ll be ready to create more advanced Bash scripts with conditional logic. 

IF-instructies

# Extract Accuracy from first ARGV element
accuracy=$(grep ____ $1 | sed 's/.* //')

# Conditionally move into good_models folder
if [ $accuracy -____ 90 ]; then
    mv $1 ____/
____

# Conditionally move into bad_models folder
if [ $accuracy -lt 90 ]; then
    mv $1 ____/
fi


# Extract Accuracy from first ARGV element
accuracy=$(grep Accuracy $1 | sed 's/.* //')

# Conditionally move into good_models folder
if [ $accuracy -ge 90 ]; then
    mv $1 good_models/
fi

# Conditionally move into bad_models folder
if [ $accuracy -lt 90 ]; then
    mv $1 bad_models/
fi


Modelresultaten sorteren

# Create variable from first ARGV element
sfile=____

# Create an IF statement on sfile's contents
if ____ -q 'SRVM_' $sfile && grep -q '____' $sfile ; ____
	
    # Move file if matched
	mv $sfile ____/
        
fi

# Create variable from first ARGV element
sfile=$1

# Create an IF statement on sfile's contents
if grep -q 'SRVM_' $sfile && grep -q 'vpt' $sfile; then
	
    # Move file if matched
	mv $sfile good_logs/
    
fi

Relevante bestanden verplaatsen

FOR-loops en WHILE-statements

# Use a FOR loop on files in directory
for file in ____/*.____
____  
    # Echo out each file
    echo ____
____


# Use a FOR loop on files in directory
for file in inherited_folder/*.R
do  
    # Echo out each file
    echo $file
done


Een simpele FOR-lus

Een WHILE-statement corrigeren

# Create a FOR statement on files in directory
for file in robs_files/____
____  
    # Create IF statement using grep
    ____ grep -____ '____' $file ; ____
        # Move wanted files to to_keep/ folder
        ____ $file to_keep/
    fi
____


# Create a FOR statement on files in directory
for file in robs_files/*.py
do  
    # Create IF statement using grep
    if grep -q 'RandomForestClassifier' $file ; then
        # Move wanted files to to_keep/ folder
        mv $file to_keep/
    fi
done


Een map opschonen

CASE-instructies

# Create a CASE statement matching the first ARGV element
case ____ in
  # Match on all weekdays
  ____|____|____|____|____)
  echo "It is a Weekday!"____
  # Match on all weekend days
  ____|Sunday)
  echo "It is a Weekend!"____
  # Create a default
  ____) 
  echo "Not a day!"____
____


# Create a CASE statement matching the first ARGV element
case $1 in
  # Match on all weekdays
  Monday|Tuesday|Wednesday|Thursday|Friday)
  echo "It is a Weekday!";;
  # Match on all weekend days
  Saturday|Sunday)
  echo "It is a Weekend!";;
  # Create a default
  *) 
  echo "Not a day!";;
esac


Dagen van de week met CASE

# Use a FOR loop for each file in 'model_out/'
for file in _____/*
do
    # Create a CASE statement for each file's contents
    case $(____ $file) in
      # Match on tree and non-tree models
      *"____"*|*GBM*|*____*)
      mv $____ ____/ ;;
      *____*|*Logistic*)
      ____ $file ;;
      # Create a default
      ____) 
      echo "Unknown model in ____" ;;
    ____
done


# Use a FOR loop for each file in 'model_out'
for file in model_out/*
do
    # Create a CASE statement for each file's contents
    case $(cat $file) in
      # Match on tree and non-tree models
      *"Random Forest"*|*GBM*|*XGBoost*)
      mv $file tree_models/ ;;
      *KNN*|*Logistic*)
      rm $file ;;
      # Create a default
      *) 
      echo "Unknown model in $file" ;;
    esac
done


Modelresultaten verplaatsen met CASE

Een CASE-instructie afsluiten

Control Statements in Bash Scripting

Give your Bash scripts a powerful new addition by building useful functions to process data and variables. In this last chapter, you will learn the structure of functions in Bash, how to use functions to help automate frequent tasks, and program your scripts to run on schedule without needing to even lift a finger.

Basic functions in Bash

Uploading model results to the cloud

Get the current day

Arguments, return values, and scope

A percentage calculator

Sports analytics function

Summing an array

Scheduling your scripts with Cron

Analyzing a crontab schedule

Creating cronjobs

Scheduling cronjobs with crontab

Thanks and wrap up

Functions and Automation

New Hires

Soccer Scores

Hire Data

Model Results

Rob's Files

Model Output

Inherited Folder

Bash is een beknopte, supersnelle en robuuste scripttaal voor data- en bestandsbewerking. Het is een essentiële vaardigheid voor het bouwen van analysepijplijnen in de cloud, geliefd bij Linux-gebruikers om met data te werken die verspreid is over meerdere bestanden.

In deze cursus nemen we je stap voor stap mee door de basis van Bash-scripting. We beginnen met de structuur van Bash-scripts, inclusief het meegeven van argumenten en het tonen van resultaten. Daarna ga je aan de slag met datastructuren, zoals variabelen en arrays, en besturingsconstructies zoals lussen en voorwaarden. Tot slot pas je alles toe in de praktijk door je eigen Bash-functies te schrijven en geautomatiseerde scripts in te plannen die als een klok lopen met cron.

Introduction to Shell

Leer hoe je Bash-scripting gebruikt voor geautomatiseerde scripts en data-analyse in de cloud.

Introductie tot Bash-scripting

Met Bash-scripting kun je analytische pijplijnen in de cloud bouwen en werken met gegevens die in meerdere bestanden zijn opgeslagen.

Een CASE-instructie afsluiten

Introductie tot Bash-scripting

Praktische interactieve oefening