Film özetlerinin TF-IDF'i

Belir randomly seçilen filmlerin özetlerini belge kümeleme için kullanalım. Belgelerde kümeleme yapmadan önce, istenmeyen gürültüden (özel karakterler ve durak sözcükler gibi) arındırılmaları ve TF-IDF ile seyrek bir matrise dönüştürülmeleri gerekir.

Listede yer alan plots değişkenindeki film özetlerinin TF-IDF'ini oluşturmak için TfidfVectorizer sınıfını kullan. remove_noise() fonksiyonu, TfidfVectorizer sınıfında tokenizer olarak kullanılmak üzere hazır. .fit_transform() metodu veriyi TfidfVectorizer nesnesine uydurur ve ardından TF-IDF seyrek matrisini üretir.

Not: .fit_transform() metodunun çalışması birkaç saniye sürebilir.

Bu egzersiz

Python ile Kümeleme Analizi

kursunun bir parçasıdır

Kursu Görüntüle

Egzersiz talimatları

sklearn içinden TfidfVectorizer sınıfını içe aktar.
TfidfVectorizer sınıfını minimum ve maksimum frekansları sırasıyla 0.1 ve 0.75, maksimum özellik sayısını 50 olacak şekilde başlat.
Başlatılan TfidfVectorizer sınıfında fit_transform() metodunu plots listesiyle kullan.

Uygulamalı interaktif egzersiz

Bu örnek kodu tamamlayarak bu egzersizi bitirin.

# Import TfidfVectorizer class from sklearn
from sklearn.feature_extraction.text import ____

# Initialize TfidfVectorizer
tfidf_vectorizer = TfidfVectorizer(____)

# Use the .fit_transform() method on the list plots
tfidf_matrix = ____

Kodu Düzenle ve Çalıştır

Bu egzersiz

Python ile Kümeleme Analizi

kursunun bir parçasıdır

IntermediárioNível de habilidade

4.8+

Kursa Ücretsiz Başlayın

Before you are ready to classify news articles, you need to be introduced to the basics of clustering. This chapter familiarizes you with a class of machine learning algorithms called unsupervised learning and then introduces you to clustering, one of the popular unsupervised learning algorithms. You will know about two popular clustering techniques - hierarchical clustering and k-means clustering. The chapter concludes with basic pre-processing steps before you start clustering data.

Exercise 1: Unsupervised learning: basics Exercise 2: Unsupervised learning in real world Exercise 3: Pokémon sightings Exercise 4: Basics of cluster analysis Exercise 5: Pokémon sightings: hierarchical clustering Exercise 6: Pokémon sightings: k-means clustering Exercise 7: Data preparation for cluster analysis Exercise 8: Normalize basic list data Exercise 9: Visualize normalized data Exercise 10: Normalization of small numbers Exercise 11: FIFA 18: Normalize data

This chapter focuses on a popular clustering algorithm - hierarchical clustering - and its implementation in SciPy. In addition to the procedure to perform hierarchical clustering, it attempts to help you answer an important question - how many clusters are present in your data? The chapter concludes with a discussion on the limitations of hierarchical clustering and discusses considerations while using hierarchical clustering.

Exercise 1: Basics of hierarchical clustering Exercise 2: Hierarchical clustering: ward method Exercise 3: Hierarchical clustering: single method Exercise 4: Hierarchical clustering: complete method Exercise 5: Visualize clusters Exercise 6: Visualize clusters with matplotlib Exercise 7: Visualize clusters with seaborn Exercise 8: How many clusters?Exercise 9: Create a dendrogram Exercise 10: How many clusters in comic con data?Exercise 11: Limitations of hierarchical clustering Exercise 12: Timing run of hierarchical clustering Exercise 13: FIFA 18: exploring defenders

This chapter introduces a different clustering algorithm - k-means clustering - and its implementation in SciPy. K-means clustering overcomes the biggest drawback of hierarchical clustering that was discussed in the last chapter. As dendrograms are specific to hierarchical clustering, this chapter discusses one method to find the number of clusters before running k-means clustering. The chapter concludes with a discussion on the limitations of k-means clustering and discusses considerations while using this algorithm.

Exercise 1: Basics of k-means clustering Exercise 2: K-means clustering: first exercise Exercise 3: Runtime of k-means clustering Exercise 4: How many clusters?Exercise 5: Elbow method on distinct clusters Exercise 6: Elbow method on uniform data Exercise 7: Limitations of k-means clustering Exercise 8: Impact of seeds on distinct clusters Exercise 9: Uniform clustering patterns Exercise 10: FIFA 18: defenders revisited

Now that you are familiar with two of the most popular clustering techniques, this chapter helps you apply this knowledge to real-world problems. The chapter first discusses the process of finding dominant colors in an image, before moving on to the problem discussed in the introduction - clustering of news articles. The chapter concludes with a discussion on clustering with multiple variables, which makes it difficult to visualize all the data.

Exercise 1: Görüntülerde baskın renkler Exercise 2: Görüntüden RGB değerlerini çıkar Exercise 3: Kaç baskın renk var?Exercise 4: Baskın renkleri görüntüle Exercise 5: Belge kümeleme Exercise 6: Film özetlerinin TF-IDF'i

Geçerli Egzersiz

Exercise 7: Film kümelerindeki en iyi terimler Exercise 8: Birden çok özellik ile kümeleme Exercise 9: Çok sayıda özellikle kümeleme Exercise 10: Kümelerde temel kontroller Exercise 11: FIFA 18: eksiksiz bir oyuncuyu ne yapar?Exercise 12: Hoşça kal!