This chapter will introduce you to the basics of text processing with spaCy. You'll learn about the data structures, how to work with statistical models, and how to use them to predict linguistic features in your text.

Introduction to spaCy

Getting Started

Documents, spans and tokens

Lexical attributes

Statistical models

Model packages

Loading models

Predicting linguistic annotations

Predicting named entities in context

Rule-based matching

Using the Matcher

Writing match patterns

Finding words, phrases, names and concepts

In this chapter, you'll use your new skills to extract specific information from large volumes of text. You'll learn how to make the most of spaCy's data structures, and how to effectively combine statistical and rule-based approaches for text analysis.

Data Structures (1)

Strings to hashes

Vocab, hashes and lexemes

Data Structures (2)

Creating a Doc

Docs, spans and entities from scratch

Data structures best practices

Word vectors and similarity

Inspecting word vectors

Comparing similarities

Combining models and rules

Debugging patterns (1)

Debugging patterns (2)

Efficient phrase matching

Extracting countries and relationships

Large-scale data analysis with spaCy

This chapter will show you to everything you need to know about spaCy's processing pipeline. You'll learn what goes on under the hood when you process a text, how to write your own components and add them to the pipeline, and how to use custom attributes to add your own meta data to the documents, spans and tokens.

Pipeline pemrosesan

Apa yang terjadi saat Anda memanggil nlp?

Memeriksa pipeline

Komponen pipeline kustom

Kasus penggunaan komponen kustom

Komponen sederhana

Komponen kompleks

Atribut ekstensi

Menyetel atribut ekstensi (1)

Menyetel atribut ekstensi (2)

Entitas dan ekstensi

Komponen dengan ekstensi

Skalabilitas dan performa

Pemrosesan streaming

Memproses data dengan konteks

Pemrosesan selektif

Processing Pipelines

In this chapter, you'll learn how to update spaCy's statistical models to customize them for your use case – for example, to predict a new entity type in online comments. You'll write your own training loop from scratch, and understand the basics of how training works, along with tips and tricks that can make your custom NLP projects more successful.

Training and updating models

Purpose of training

Creating training data (1)

Creating training data (2)

The training loop

Setting up the pipeline

Building a training loop

Exploring the model

Training best practices

Good data vs. bad data

Training multiple labels

Wrapping up

Training a neural network model

Jika Anda bekerja dengan banyak teks, pada akhirnya Anda akan ingin mengetahui lebih banyak tentang teks tersebut. Misalnya, apa topiknya? Apa makna kata-kata dalam konteks? Siapa melakukan apa kepada siapa? Perusahaan dan produk apa yang disebutkan? Teks mana yang mirip satu sama lain? Dalam kursus ini, Anda akan belajar menggunakan spaCy, pustaka standar industri yang berkembang pesat untuk NLP di Python, untuk membangun sistem pemahaman bahasa alami tingkat lanjut, dengan pendekatan berbasis aturan dan Machine Learning.

Introduction to Natural Language Processing in Python

Pelajari cara menggunakan spaCy untuk membangun sistem pemahaman bahasa alami dengan aturan & pembelajaran mesin.

NLP Lanjutan dengan spaCy

Apa yang terjadi saat Anda memanggil nlp?

NLP Lanjutan dengan spaCy

Latihan interaktif praktis