Learn the structure of HTML. We begin by explaining why web scraping can be a valuable addition to your data science toolbox and then delving into some basics of HTML. We end the chapter by giving a brief introduction on XPath notation, which is used to navigate the elements within HTML code.

Web Scraping Overview

Web-scraping is not nonsense!

HyperText Markup Language

HTML tree wordy navigation

From Tree to HTML

Attributes

Keep it Classy

Finding href

Crash Course in XPath

Where am I?

It's Time to P

A classy span

Introduction to HTML

Leverage XPath syntax to explore scrapy selectors. Both of these concepts will move you towards being able to scrape an HTML document.

XPathologi

Menghitung Elemen di Alam Bebas

Atribut pada Body

Pilih DataCamp!

Menjelajah XPath di Luar Jalur Umum

Di mana @ berada

Periksa Class Anda

Tautan (Hyper) Aktif

Tautan Rahasia

Objek Selector

Perangkai XPath

Bagi-bagi Div di Latihan Ini

Sumber dari Sumbernya

Kelas Kursus lewat Inspeksi

Meminta sebuah Selector

XPaths and Selectors

Learn CSS Locator syntax and begin playing with the idea of chaining together CSS Locators with XPath. We also introduce Response objects, which behave like Selectors but give us extra tools to mobilize our scraping efforts across multiple websites. 

From XPath to CSS

The (X)Path to CSS Locators

Get an "a" in this Course

The CSS Wildcard

CSS Attributes and Text Selection

You've been `href`ed

Top Level Text

All Level Text

Respond Please!

Reveal By Response

Responding with Selectors

Selecting from a Selection

Survey

Titular

Scraping with Children

CSS Locators, Chaining, and Responses

Learn to create web crawlers with scrapy. These scrapy spiders will crawl the web through multiple pages, following links to scrape each of those pages automatically according to the procedures we've learned in the previous chapters.

Your First Spider

Inheriting the Spider

Hurl the URLs

Start Requests

Self Referencing is Classy

Starting with Start Requests

Parse and Crawl

Pen Names

Crawler Time

Capstone

Time to Run

DataCamp Descriptions

Capstone Crawler

The Finale

Spiders

DataCamp webpage HTML

Kemampuan untuk membangun alat yang dapat mengambil dan mengurai informasi yang tersimpan di seluruh internet telah dan akan terus bernilai dalam berbagai aspek data science. Dalam kursus ini, Anda akan mempelajari cara menavigasi dan mengurai kode HTML, serta membangun alat untuk merayapi situs web secara otomatis. Meskipun proses scraping kita dilakukan menggunakan pustaka Python yang serbaguna, yaitu scrapy, banyak teknik yang Anda pelajari di kursus ini juga dapat diterapkan pada pustaka Python populer lainnya, termasuk BeautifulSoup dan Selenium. Setelah menyelesaikan kursus ini, Anda akan memiliki pemahaman yang kuat tentang struktur HTML, mampu membangun alat untuk mengurai kode HTML dan mengakses informasi yang diinginkan, serta membuat spider scrapy sederhana untuk merayapi web dalam skala besar.

Intermediate Python

Pelajari cara mengambil dan mengurai informasi dari internet menggunakan pustaka Python scrapy.

Menjelajah XPath di Luar Jalur Umum

Create Your Free Account