URL details: teddykoker.com/2020/12/dataloader/
URL title:
DataLoaders Explained: Building a Multi-Process Data Loader from Scratch | Teddy Koker
URL description:
When training a Deep Learning model, one must often read and pre-process data before it can be passed through the model. Depending on the data source and transformations needed, this step can amount to a non-negligable amount of time, which leads to unecessarily longer training times. This bottleneck is often remedied using a torch.utils.data.DataLoader for PyTorch, or a tf.data.Dataset for Tensorflow. These structures leverage parallel processing and pre-fetching in order reduce data loading time as much a
URL last crawled:
2022-06-12
URL speed:
0.662 MB/s,
downloaded in 0.070 seconds
1 external links to this url
Only links from external domains are shown on this page.