Save yourself time when performing complex repetitive tasks. You’ll begin this course by refreshing your knowledge of common command-line programs and arguments before quickly moving into the world of Bash scripting. You’ll create simple command-line pipelines and then transform these into Bash scripts. You’ll then boost your skills and learn about standard streams and feeding arguments to your Bash scripts.

Introduction and refresher

Extracting scores with shell

Searching a book with shell

Your first Bash script

A simple Bash script

Shell pipelines to Bash scripts

Extract and edit using Bash scripts

Standard streams & arguments

Using arguments in Bash scripts

Using arguments with HR data

From Command-Line to Bash Script

Master the bread and butter of Bash scripts—variables! In this chapter, you’ll learn how to create basic string and numeric variables, and perform calculations on these variables. You’ll also learn about the magic of a shell-within-a-shell (shell-ception), opening up huge opportunities for advanced scripting.

Basic variables in Bash

Using variables in Bash

Shell within a shell

Numeric variables in Bash

Converting Fahrenheit to Celsius

Extracting data from files

Arrays in Bash

Creating an array

Creating associative arrays

Climate calculations in Bash

Variables in Bash Scripting

Life isn't always linear and neither should your Bash scripts. In this chapter, you’ll take your Bash scripts to the next level by learning control statements. You’ll learn the differences between FOR, WHILE, IF, and CASE statements and how to use them in your Bash scripts. Armed with these new tools, you’ll be ready to create more advanced Bash scripts with conditional logic. 

IF-Anweisungen

# Extract Accuracy from first ARGV element
accuracy=$(grep ____ $1 | sed 's/.* //')

# Conditionally move into good_models folder
if [ $accuracy -____ 90 ]; then
    mv $1 ____/
____

# Conditionally move into bad_models folder
if [ $accuracy -lt 90 ]; then
    mv $1 ____/
fi


# Extract Accuracy from first ARGV element
accuracy=$(grep Accuracy $1 | sed 's/.* //')

# Conditionally move into good_models folder
if [ $accuracy -ge 90 ]; then
    mv $1 good_models/
fi

# Conditionally move into bad_models folder
if [ $accuracy -lt 90 ]; then
    mv $1 bad_models/
fi


Modellergebnisse sortieren

# Create variable from first ARGV element
sfile=____

# Create an IF statement on sfile's contents
if ____ -q 'SRVM_' $sfile && grep -q '____' $sfile ; ____
	
    # Move file if matched
	mv $sfile ____/
        
fi

# Create variable from first ARGV element
sfile=$1

# Create an IF statement on sfile's contents
if grep -q 'SRVM_' $sfile && grep -q 'vpt' $sfile; then
	
    # Move file if matched
	mv $sfile good_logs/
    
fi

Relevante Dateien verschieben

FOR-Schleifen & WHILE-Anweisungen

# Use a FOR loop on files in directory
for file in ____/*.____
____  
    # Echo out each file
    echo ____
____


# Use a FOR loop on files in directory
for file in inherited_folder/*.R
do  
    # Echo out each file
    echo $file
done


Eine einfache FOR-Schleife

Einen WHILE-Block korrigieren

# Create a FOR statement on files in directory
for file in robs_files/____
____  
    # Create IF statement using grep
    ____ grep -____ '____' $file ; ____
        # Move wanted files to to_keep/ folder
        ____ $file to_keep/
    fi
____


# Create a FOR statement on files in directory
for file in robs_files/*.py
do  
    # Create IF statement using grep
    if grep -q 'RandomForestClassifier' $file ; then
        # Move wanted files to to_keep/ folder
        mv $file to_keep/
    fi
done


Ein Verzeichnis aufräumen

CASE-Anweisungen

# Create a CASE statement matching the first ARGV element
case ____ in
  # Match on all weekdays
  ____|____|____|____|____)
  echo "It is a Weekday!"____
  # Match on all weekend days
  ____|Sunday)
  echo "It is a Weekend!"____
  # Create a default
  ____) 
  echo "Not a day!"____
____


# Create a CASE statement matching the first ARGV element
case $1 in
  # Match on all weekdays
  Monday|Tuesday|Wednesday|Thursday|Friday)
  echo "It is a Weekday!";;
  # Match on all weekend days
  Saturday|Sunday)
  echo "It is a Weekend!";;
  # Create a default
  *) 
  echo "Not a day!";;
esac


Wochentage mit CASE

# Use a FOR loop for each file in 'model_out/'
for file in _____/*
do
    # Create a CASE statement for each file's contents
    case $(____ $file) in
      # Match on tree and non-tree models
      *"____"*|*GBM*|*____*)
      mv $____ ____/ ;;
      *____*|*Logistic*)
      ____ $file ;;
      # Create a default
      ____) 
      echo "Unknown model in ____" ;;
    ____
done


# Use a FOR loop for each file in 'model_out'
for file in model_out/*
do
    # Create a CASE statement for each file's contents
    case $(cat $file) in
      # Match on tree and non-tree models
      *"Random Forest"*|*GBM*|*XGBoost*)
      mv $file tree_models/ ;;
      *KNN*|*Logistic*)
      rm $file ;;
      # Create a default
      *) 
      echo "Unknown model in $file" ;;
    esac
done


Modellergebnisse mit CASE verschieben

Eine CASE-Anweisung abschließen

Control Statements in Bash Scripting

Give your Bash scripts a powerful new addition by building useful functions to process data and variables. In this last chapter, you will learn the structure of functions in Bash, how to use functions to help automate frequent tasks, and program your scripts to run on schedule without needing to even lift a finger.

Basic functions in Bash

Uploading model results to the cloud

Get the current day

Arguments, return values, and scope

A percentage calculator

Sports analytics function

Summing an array

Scheduling your scripts with Cron

Analyzing a crontab schedule

Creating cronjobs

Scheduling cronjobs with crontab

Thanks and wrap up

Functions and Automation

New Hires

Soccer Scores

Hire Data

Model Results

Rob's Files

Model Output

Inherited Folder

Bash ist eine kompakte, extrem schnelle und robuste Skriptsprache für die Verarbeitung von Daten und Dateien. Sie ist eine Schlüsselkompetenz für den Aufbau von Analyse-Pipelines in der Cloud und wird von Linux-Nutzerinnen und -Nutzern geschätzt, um mit Daten zu arbeiten, die über mehrere Dateien verteilt sind.

In diesem Kurs führen wir dich in die Grundlagen des Bash-Skriptings ein. Wir starten mit dem Aufbau von Bash-Skripten, inklusive dem Übergeben von Argumenten und dem Ausgeben von Ergebnissen. Anschließend arbeitest du mit Datenstrukturen wie Variablen und Arrays und lernst Steueranweisungen wie Schleifen und Bedingungen kennen. Zum Schluss setzt du dein Wissen praktisch um, indem du eigene Bash-Funktionen erstellst und automatisierte Skripte mit cron zuverlässig nach Plan ausführen lässt.

Introduction to Shell

Lernen Sie, Bash-Skripte zu erstellen, Analyse-Pipelines in der Cloud zu bauen und mit Daten zu arbeiten.

Einführung in Bash-Skripting

Mit Bash-Skripten kannst du Analyse-Pipelines in der Cloud erstellen und mit Daten arbeiten, die über mehrere Dateien verteilt sind.

Eine CASE-Anweisung abschließen

Interaktive praktische Übung