In this chapter you will learn the basics of applying logistic regression and support vector machines (SVMs) to classification problems. You'll use the <code>scikit-learn</code> library to fit classification models to real data.

scikit-learn refresher

KNN classification

Comparing models

Overfitting

Applying logistic regression and SVM

Running LogisticRegression and SVC

Sentiment analysis for movie reviews

Linear classifiers

Which decision boundary is linear?

Visualizing decision boundaries

In this chapter you will discover the conceptual framework behind logistic regression and SVMs. This will let you delve deeper into the inner workings of these models.

Linear classifiers: the coefficients

How models make predictions

Changing the model coefficients

What is a loss function?

The 0-1 loss

Minimizing a loss function

Loss function diagrams

Classification loss functions

Comparing the logistic and hinge losses

Implementing logistic regression

Loss functions

In this chapter you will delve into the details of logistic regression. You'll learn all about regularization and how to interpret model output.

Logistic regression and regularization

Regularized logistic regression

Logistic regression and feature selection

Identifying the most positive and negative words

Logistic regression and probabilities

Getting class probabilities

Regularization and probabilities

Visualizing easy and difficult examples

Multi-class logistic regression

Counting the coefficients

Fitting multi-class logistic regression

Visualizing multi-class logistic regression

One-vs-rest SVM

Logistic regression

In this chapter you will learn all about the details of support vector machines. You'll learn about tuning hyperparameters for these models and using kernels to fit non-linear decision boundaries.

Support vectors

Support vector definition

Effect of removing examples

Kernel SVMs

GridSearchCV warm-up

Jointly tuning gamma and C with GridSearchCV

Comparing logistic regression and SVM (and beyond)

An advantage of SVMs

An advantage of logistic regression

Using SGDClassifier

Conclusion

Support Vector Machines

In this course you'll learn all about using linear classifiers, specifically logistic regression and support vector machines, with scikit-learn. Once you've learned how to apply these methods, you'll dive into the ideas behind them and find out what really makes them tick. At the end of this course you'll know how to train, test, and tune these linear classifiers in Python. You'll also have a conceptual foundation for understanding many other machine learning algorithms.

Supervised Learning with scikit-learn

In this course you will learn the details of linear classifiers like logistic regression and SVM.

Linear Classifiers in Python

Machine Learning Scientist in Python

Supervised Machine Learning in Python

The 0-1 loss

Linear Classifiers in Python

Hands-on interactive exercise