This chapter will introduce some basic NLP concepts, such as word tokenization and regular expressions to help parse text. You'll also learn how to handle non-English text and more difficult tokenization you might find.

Introduzione alle espressioni regolari

Quale pattern?

Esercitarsi con le espressioni regolari: re.split() e re.findall()

Introduzione alla tokenizzazione

Tokenizzazione di parole con NLTK

Altre regex con re.search()

Tokenizzazione avanzata con NLTK e regex

Scegliere un tokenizer

Regex con la tokenizzazione NLTK

Tokenizzazione non ASCII

Rappresentare la lunghezza delle parole con NLTK

Esercizio di grafici

Regular expressions & word tokenization

This chapter will introduce you to topic identification, which you can apply to any text you encounter in the wild. Using basic NLP models, you will identify topics from texts based on term frequencies. You'll experiment and compare two simple methods: bag-of-words and Tf-idf using NLTK, and a new library Gensim.

Word counts with bag-of-words

Bag-of-words picker

Building a Counter with bag-of-words

Simple text preprocessing

Text preprocessing steps

Text preprocessing practice

Introduction to gensim

What are word vectors?

Creating and querying a corpus with gensim

Gensim bag-of-words

Tf-idf with gensim

What is tf-idf?

Tf-idf with Wikipedia

Simple topic identification

This chapter will introduce a slightly more advanced topic: named-entity recognition. You'll learn how to identify the who, what, and where of your texts using pre-trained models on English and non-English text. You'll also learn how to use some new libraries, polyglot and spaCy, to add to your NLP toolbox.

Named Entity Recognition

NER with NLTK

Charting practice

Stanford library with NLTK

Introduction to SpaCy

Comparing NLTK with spaCy NER

spaCy NER Categories

Multilingual NER with polyglot

French NER with polyglot I

French NER with polyglot II

Spanish NER with polyglot

Named-entity recognition

You'll apply the basics of what you've learned along with some supervised machine learning to build a "fake news" detector. You'll begin by learning the basics of supervised machine learning, and then move forward by choosing a few important features and testing ideas to identify and classify fake news articles.

Classifying fake news using supervised learning with NLP

Which possible features?

Training and testing

Building word count vectors with scikit-learn

CountVectorizer for text classification

TfidfVectorizer for text classification

Inspecting the vectors

Training and testing a classification model with scikit-learn

Text classification models

Training and testing the "fake news" model with CountVectorizer

Training and testing the "fake news" model with TfidfVectorizer

Simple NLP, complex problems

Improving the model

Improving your model

Inspecting your model

Building a "fake news" classifier

English stopwords

Monty Python and the Holy Grail

News articles

Wikipedia articles

In questo corso imparerai le basi del Natural Language Processing (NLP), ad esempio come identificare e separare le parole, come estrarre gli argomenti da un testo e come costruire un tuo classificatore di fake news. Imparerai anche a usare librerie di base come NLTK, insieme a librerie che sfruttano il deep learning per risolvere problemi NLP comuni. Questo corso ti fornirà le basi per elaborare e analizzare testi mentre prosegui con l’apprendimento di Python.

Python Toolbox

Impara le tecniche fondamentali di NLP con Python per estrarre informazioni dai dati testuali reali.

Introduzione al Natural Language Processing in Python

Impara le tecniche di base per lavorare con il linguaggio naturale usando Python e come usarle per capire meglio i dati testuali del mondo reale.

Founder, kjamistan

Charting word length with nltk

Getting started with matplotlib

Plotting a histogram with matplotlib

Generated histogram

Combining NLP data extraction with plotting

Word length histogram

Let's practice!

Regular expressions & word tokenization - Rappresentare la lunghezza delle parole con NLTK

Rappresentare la lunghezza delle parole con NLTK

Create Your Free Account