Actions you must take in order to run your ML Data fast
Jun 18, 2021
- Use the
prefetch
transformation to overlap the work of a producer and consumer - Parallelize the data reading transformation using the
interleave
transformation - Parallelize the
map
transformation by setting thenum_parallel_calls
argument - Use the
cache
transformation to cache data in memory during the first epoch - Vectorize user-defined functions passed in to the
map
transformation - Reduce memory usage when applying the
interleave
,prefetch
, andshuffle
transformations