Trying to load images from /datasets/celebA and it fails, always on different image, with this error:
PIL.UnidentifiedImageError: cannot identify image file '/datasets/celebA/027395.jpg'
Here is a full notebook with repro:
It’s standard fastai/PyTorch setup, the point where it fails is
fastai.learner.Learner.lr_find(), which triggers the underlying DataLoader to actually load images from the disk. It’s worth pointing out that this image loading is parallelized.
Since it always fails on different image, I think it’s some disk-access/fs problem on Paperspace/Gradient.
Any ideas would be appreciated. Thank you.