This chapter will introduce you to the basics of text processing with spaCy. You'll learn about the data structures, how to work with statistical models, and how to use them to predict linguistic features in your text.

Introduction to spaCy

Getting Started

Documents, spans and tokens

Lexical attributes

Statistical models

Model packages

Loading models

Predicting linguistic annotations

Predicting named entities in context

Rule-based matching

Using the Matcher

Writing match patterns

Finding words, phrases, names and concepts

In this chapter, you'll use your new skills to extract specific information from large volumes of text. You'll learn how to make the most of spaCy's data structures, and how to effectively combine statistical and rule-based approaches for text analysis.

Data Structures (1)

Strings to hashes

Vocab, hashes and lexemes

Data Structures (2)

Creating a Doc

Docs, spans and entities from scratch

Data structures best practices

Word vectors and similarity

Inspecting word vectors

Comparing similarities

Combining models and rules

Debugging patterns (1)

Debugging patterns (2)

Efficient phrase matching

Extracting countries and relationships

Large-scale data analysis with spaCy

This chapter will show you to everything you need to know about spaCy's processing pipeline. You'll learn what goes on under the hood when you process a text, how to write your own components and add them to the pipeline, and how to use custom attributes to add your own meta data to the documents, spans and tokens.

Processing pipelines

What happens when you call nlp?

Inspecting the pipeline

Custom pipeline components

Use cases for custom components

Simple components

Complex components

Extension attributes

Setting extension attributes (1)

Setting extension attributes (2)

Entities and extensions

Components with extensions

Scaling and performance

Processing streams

Processing data with context

Selective processing

Processing Pipelines

In this chapter, you'll learn how to update spaCy's statistical models to customize them for your use case – for example, to predict a new entity type in online comments. You'll write your own training loop from scratch, and understand the basics of how training works, along with tips and tricks that can make your custom NLP projects more successful.

Melatih dan memperbarui model

Tujuan pelatihan

Membuat data pelatihan (1)

Membuat data pelatihan (2)

Siklus pelatihan

Menyiapkan pipeline

Membangun training loop

Mengeksplorasi model

Praktik terbaik dalam pelatihan

Data yang baik vs. data yang buruk

Melatih beberapa label

Penutup

Training a neural network model

Jika Anda bekerja dengan banyak teks, pada akhirnya Anda akan ingin mengetahui lebih banyak tentang teks tersebut. Misalnya, apa topiknya? Apa makna kata-kata dalam konteks? Siapa melakukan apa kepada siapa? Perusahaan dan produk apa yang disebutkan? Teks mana yang mirip satu sama lain? Dalam kursus ini, Anda akan belajar menggunakan spaCy, pustaka standar industri yang berkembang pesat untuk NLP di Python, untuk membangun sistem pemahaman bahasa alami tingkat lanjut, dengan pendekatan berbasis aturan dan Machine Learning.

Introduction to Natural Language Processing in Python

Pelajari cara menggunakan spaCy untuk membangun sistem pemahaman bahasa alami dengan aturan & pembelajaran mesin.

NLP Lanjutan dengan spaCy

Menyiapkan pipeline

NLP Lanjutan dengan spaCy

Latihan interaktif praktis