Exercise

Text tokenizing

In this exercise, you will use the flickr dataset, which has 30,000 images and associated captions, to perform preprocessing operations on text. This is necessary to be used by models for tasks such as text classification. This is especially useful for multi-modal applications where Hugging Face models can be used to check caption suitability for an associated image.

The dataset (dataset) has been loaded and the AutoTokenizer has been imported.

Instructions 1/2

undefined XP

1

2

Load the first "caption" from the image at index 5 of the dataset.

.css-6su6fj{-webkit-flex-shrink:0;-ms-flex-negative:0;flex-shrink:0;}Exercise

Instructions 1/2

Exercise