Membagi HTML

Dalam latihan ini, Anda akan membagi sebuah HTML yang berisi perintah eksekutif tentang AI yang dikeluarkan oleh Gedung Putih AS pada Oktober 2023. Untuk mempertahankan konteks sebanyak mungkin di dalam potongan, Anda akan membagi dengan nilai chunk_size dan chunk_overlap yang lebih besar.

Semua kelas LangChain yang diperlukan untuk menyelesaikan latihan ini telah dimuat sebelumnya untuk Anda.

Latihan ini adalah bagian dari kursus

Mengembangkan Aplikasi LLM dengan LangChain

Petunjuk latihan

Buat UnstructuredHTMLLoader untuk white_house_executive_order_nov_2023.html, lalu muat ke memori.
Tetapkan chunk_size sebesar 300 dan chunk_overlap sebesar 100.
Buat RecursiveCharacterTextSplitter yang melakukan pemisahan pada karakter '.', lalu gunakan metode .split_documents() untuk membagi data dan cetak potongannya.

Latihan interaktif praktis

Cobalah latihan ini dengan menyelesaikan kode contoh berikut.

# Load the HTML document into memory
loader = UnstructuredHTMLLoader(____)
data = loader.____()

# Define variables
chunk_size = ____
chunk_overlap = ____

# Split the HTML
splitter = RecursiveCharacterTextSplitter(
    chunk_size=chunk_size,
    chunk_overlap=chunk_overlap,
    separators=____)

docs = splitter.____(data)
print(docs)

Edit dan Jalankan Kode

Latihan ini adalah bagian dari kursus

Mengembangkan Aplikasi LLM dengan LangChain

SkillTag.level.intermediateSkillTag.label

4.8+

Mulai Kursus Gratis

Welcome to the LangChain framework for building applications on LLMs! You'll learn about the main components of LangChain, including models, chains, agents, prompts, and parsers. You'll create chatbots using both open-source models from Hugging Face and proprietary models from OpenAI, create prompt templates, and integrate different chatbot memory strategies to manage context and resources during conversations.

Exercise 1: The LangChain ecosystem Exercise 2: OpenAI models in LangChain!Exercise 3: Hugging Face models in LangChain!Exercise 4: Prompt templates Exercise 5: Prompt templates and chaining Exercise 6: Chat prompt templates Exercise 7: Few-shot prompting Exercise 8: Creating the few-shot example set Exercise 9: Building the few-shot prompt template Exercise 10: Implementing few-shot prompting

Time to level up your LangChain chains! You'll learn to use the LangChain Expression Language (LCEL) for defining chains with greater flexibility. You'll create sequential chains, where inputs are passed between components to create more advanced applications. You'll also begin to integrate agents, which use LLMs for decision-making.

Exercise 1: Sequential chains Exercise 2: Building prompts for sequential chains Exercise 3: Sequential chains with LCEL Exercise 4: Introduction to LangChain agents Exercise 5: What's an agent?Exercise 6: ReAct agents Exercise 7: Custom tools for agents Exercise 8: Defining a function for tool use Exercise 9: Creating custom tools Exercise 10: Integrating custom tools with agents

One limitation of LLMs is that they have a knowledge cut-off due to being trained on data up to a certain point. In this chapter, you'll learn to create applications that use Retrieval Augmented Generation (RAG) to integrate external data with LLMs. The RAG workflow contains a few different processes, including splitting data, creating and storing the embeddings using a vector database, and retrieving the most relevant information for use in the application. You'll learn to master the entire workflow!

Exercise 1: Mengintegrasikan pemuat dokumen Exercise 2: Pemuatan dokumen PDF Exercise 3: Pemuat dokumen CSV Exercise 4: Pemuat dokumen HTML Exercise 5: Memecah data eksternal untuk pengambilan kembali Exercise 6: Memisah berdasarkan karakter Exercise 7: Memecah secara rekursif berdasarkan karakter Exercise 8: Membagi HTML

Latihan Saat Ini

Exercise 9: Penyimpanan dan pengambilan RAG menggunakan basis data vektor Exercise 10: Menyiapkan dokumen dan basis data vektor Exercise 11: Membangun templat prompt retrieval Exercise 12: Membuat rantai RAG Exercise 13: Penutup!