1. Learn
    2. /
  2. Courses
    3. /
  3. Scalable Data Processing in R

Exercise

Parallelizing calls to chunk.apply

The chunk.apply() function can also make use of parallel processes to process data more quickly. When the parallel parameter is set to a value greater than one on Linux and Unix machine (including the Mac) multiple processes read and process data at the same time thereby reducing the execution time. On Windows the parallel parameter is ignored.

Instructions

100 XP
  • Benchmark the function iotools_read_fun(), first with 1 process and then with 3 parallel processes.