This chapter will introduce you to the basics of text processing with spaCy. You'll learn about the data structures, how to work with statistical models, and how to use them to predict linguistic features in your text.

Pengantar spaCy

Mulai

Dokumen, span, dan token

Atribut leksikal

Model statistik

Paket model

Memuat model

Memprediksi anotasi linguistik

Memprediksi entitas bernama dalam konteks

Pencocokan berbasis aturan

Menggunakan Matcher

Menulis pola pencocokan

Finding words, phrases, names and concepts

In this chapter, you'll use your new skills to extract specific information from large volumes of text. You'll learn how to make the most of spaCy's data structures, and how to effectively combine statistical and rule-based approaches for text analysis.

Data Structures (1)

Strings to hashes

Vocab, hashes and lexemes

Data Structures (2)

Creating a Doc

Docs, spans and entities from scratch

Data structures best practices

Word vectors and similarity

Inspecting word vectors

Comparing similarities

Combining models and rules

Debugging patterns (1)

Debugging patterns (2)

Efficient phrase matching

Extracting countries and relationships

Large-scale data analysis with spaCy

This chapter will show you to everything you need to know about spaCy's processing pipeline. You'll learn what goes on under the hood when you process a text, how to write your own components and add them to the pipeline, and how to use custom attributes to add your own meta data to the documents, spans and tokens.

Processing pipelines

What happens when you call nlp?

Inspecting the pipeline

Custom pipeline components

Use cases for custom components

Simple components

Complex components

Extension attributes

Setting extension attributes (1)

Setting extension attributes (2)

Entities and extensions

Components with extensions

Scaling and performance

Processing streams

Processing data with context

Selective processing

Processing Pipelines

In this chapter, you'll learn how to update spaCy's statistical models to customize them for your use case – for example, to predict a new entity type in online comments. You'll write your own training loop from scratch, and understand the basics of how training works, along with tips and tricks that can make your custom NLP projects more successful.

Training and updating models

Purpose of training

Creating training data (1)

Creating training data (2)

The training loop

Setting up the pipeline

Building a training loop

Exploring the model

Training best practices

Good data vs. bad data

Training multiple labels

Wrapping up

Training a neural network model

Jika Anda bekerja dengan banyak teks, pada akhirnya Anda akan ingin mengetahui lebih banyak tentang teks tersebut. Misalnya, apa topiknya? Apa makna kata-kata dalam konteks? Siapa melakukan apa kepada siapa? Perusahaan dan produk apa yang disebutkan? Teks mana yang mirip satu sama lain? Dalam kursus ini, Anda akan belajar menggunakan spaCy, pustaka standar industri yang berkembang pesat untuk NLP di Python, untuk membangun sistem pemahaman bahasa alami tingkat lanjut, dengan pendekatan berbasis aturan dan Machine Learning.

Introduction to Natural Language Processing in Python

Pelajari cara menggunakan spaCy untuk membangun sistem pemahaman bahasa alami dengan aturan & pembelajaran mesin.

NLP Lanjutan dengan spaCy

Paket model

NLP Lanjutan dengan spaCy

Latihan interaktif praktis