This chapter will introduce some basic NLP concepts, such as word tokenization and regular expressions to help parse text. You'll also learn how to handle non-English text and more difficult tokenization you might find.

Introduction to regular expressions

Which pattern?

Practicing regular expressions: re.split() and re.findall()

Introduction to tokenization

Word tokenization with NLTK

More regex with re.search()

Advanced tokenization with NLTK and regex

Choosing a tokenizer

Regex with NLTK tokenization

Non-ascii tokenization

Charting word length with NLTK

Charting practice

Regular expressions & word tokenization

This chapter will introduce you to topic identification, which you can apply to any text you encounter in the wild. Using basic NLP models, you will identify topics from texts based on term frequencies. You'll experiment and compare two simple methods: bag-of-words and Tf-idf using NLTK, and a new library Gensim.

Menghitung kata dengan bag-of-words

Pemilih bag-of-words

Membangun Counter dengan bag-of-words

Prapemrosesan teks sederhana

Langkah praproses teks

Latihan prapemrosesan teks

Pengenalan gensim

Apa itu vektor kata?

Membuat dan melakukan kueri korpus dengan gensim

Bag-of-words dengan Gensim

Tf-idf dengan gensim

Apa itu tf-idf?

Tf-idf dengan Wikipedia

Simple topic identification

This chapter will introduce a slightly more advanced topic: named-entity recognition. You'll learn how to identify the who, what, and where of your texts using pre-trained models on English and non-English text. You'll also learn how to use some new libraries, polyglot and spaCy, to add to your NLP toolbox.

Named Entity Recognition

NER with NLTK

Stanford library with NLTK

Introduction to SpaCy

Comparing NLTK with spaCy NER

spaCy NER Categories

Multilingual NER with polyglot

French NER with polyglot I

French NER with polyglot II

Spanish NER with polyglot

Named-entity recognition

You'll apply the basics of what you've learned along with some supervised machine learning to build a "fake news" detector. You'll begin by learning the basics of supervised machine learning, and then move forward by choosing a few important features and testing ideas to identify and classify fake news articles.

Classifying fake news using supervised learning with NLP

Which possible features?

Training and testing

Building word count vectors with scikit-learn

CountVectorizer for text classification

TfidfVectorizer for text classification

Inspecting the vectors

Training and testing a classification model with scikit-learn

Text classification models

Training and testing the "fake news" model with CountVectorizer

Training and testing the "fake news" model with TfidfVectorizer

Simple NLP, complex problems

Improving the model

Improving your model

Inspecting your model

Building a "fake news" classifier

English stopwords

Monty Python and the Holy Grail

News articles

Wikipedia articles

Dalam kursus ini, Anda akan mempelajari dasar-dasar natural language processing (NLP), seperti cara mengidentifikasi dan memisahkan kata, mengekstrak topik dari teks, serta membangun pengklasifikasi berita palsu Anda sendiri. Anda juga akan belajar menggunakan pustaka dasar seperti NLTK, bersama pustaka yang memanfaatkan deep learning untuk menyelesaikan masalah NLP umum. Kursus ini akan memberi Anda landasan untuk memproses dan mengurai teks saat Anda melanjutkan pembelajaran Python.

Python Toolbox

Pelajari teknik dasar NLP dengan Python dan terapkan untuk mendapatkan wawasan dari data teks nyata.

Pengantar Natural Language Processing di Python

Pelajari teknik dasar pemrosesan bahasa alami menggunakan Python dan cara menerapkannya untuk mengekstrak wawasan dari data teks dunia nyata.

Apa itu vektor kata?

Pengantar Natural Language Processing di Python

Latihan interaktif praktis