Defining a function for chunking
To be able to batch upserts in a reproducible way, you'll need to define a function to split your list of vectors into chunks.
The built-in itertools module has already been imported for you.
Este ejercicio forma parte del curso
Vector Databases for Embeddings with Pinecone
Instrucciones del ejercicio
- Convert the
iterableinput into an iterator. - Slice
itinto chunks of sizebatch_sizeusing theitertoolsmodule. - Yield the current chunk.
Ejercicio interactivo práctico
Prueba este ejercicio y completa el código de muestra.
def chunks(iterable, batch_size=100):
"""A helper function to break an iterable into chunks of size batch_size."""
# Convert the iterable into an iterator
it = ____
# Slice the iterator into chunks of size batch_size
chunk = tuple(itertools.____(it, ____))
while chunk:
# Yield the chunk
____
chunk = tuple(itertools.islice(it, batch_size))