It seems more straightforward to fix your data-in-files layout than to implement a novel in-GPU filesystem, though.

You can improve file-open overhead in conventional filesystems, too. Including the FUSE one I was working on.