This chapter will introduce you to the basics of text processing with spaCy. You'll learn about the data structures, how to work with statistical models, and how to use them to predict linguistic features in your text.

Introduction to spaCy

Getting Started

Documents, spans and tokens

Lexical attributes

Statistical models

Model packages

Loading models

Predicting linguistic annotations

Predicting named entities in context

Rule-based matching

Using the Matcher

Writing match patterns

Finding words, phrases, names and concepts

In this chapter, you'll use your new skills to extract specific information from large volumes of text. You'll learn how to make the most of spaCy's data structures, and how to effectively combine statistical and rule-based approaches for text analysis.

Struktur Data (1)

String menjadi hash

Vocab, hash, dan leksim

Struktur Data (2)

Membuat sebuah Doc

Doc, span, dan entitas dari awal

Praktik terbaik untuk struktur data

Vektor kata dan kemiripan

Menginspeksi vektor kata

Membandingkan kemiripan

Menggabungkan model dan aturan

Melacak galat pada pola (1)

Debugging pola (2)

Pencocokan frasa yang efisien

Mengekstrak negara dan relasi

Large-scale data analysis with spaCy

This chapter will show you to everything you need to know about spaCy's processing pipeline. You'll learn what goes on under the hood when you process a text, how to write your own components and add them to the pipeline, and how to use custom attributes to add your own meta data to the documents, spans and tokens.

Processing pipelines

What happens when you call nlp?

Inspecting the pipeline

Custom pipeline components

Use cases for custom components

Simple components

Complex components

Extension attributes

Setting extension attributes (1)

Setting extension attributes (2)

Entities and extensions

Components with extensions

Scaling and performance

Processing streams

Processing data with context

Selective processing

Processing Pipelines

In this chapter, you'll learn how to update spaCy's statistical models to customize them for your use case – for example, to predict a new entity type in online comments. You'll write your own training loop from scratch, and understand the basics of how training works, along with tips and tricks that can make your custom NLP projects more successful.

Training and updating models

Purpose of training

Creating training data (1)

Creating training data (2)

The training loop

Setting up the pipeline

Building a training loop

Exploring the model

Training best practices

Good data vs. bad data

Training multiple labels

Wrapping up

Training a neural network model

Jika Anda bekerja dengan banyak teks, pada akhirnya Anda akan ingin mengetahui lebih banyak tentang teks tersebut. Misalnya, apa topiknya? Apa makna kata-kata dalam konteks? Siapa melakukan apa kepada siapa? Perusahaan dan produk apa yang disebutkan? Teks mana yang mirip satu sama lain? Dalam kursus ini, Anda akan belajar menggunakan spaCy, pustaka standar industri yang berkembang pesat untuk NLP di Python, untuk membangun sistem pemahaman bahasa alami tingkat lanjut, dengan pendekatan berbasis aturan dan Machine Learning.

Introduction to Natural Language Processing in Python

Pelajari cara menggunakan spaCy untuk membangun sistem pemahaman bahasa alami dengan aturan & pembelajaran mesin.

NLP Lanjutan dengan spaCy

Melacak galat pada pola (1)

NLP Lanjutan dengan spaCy

Latihan interaktif langsung