Hi all, We are trying to read csv/json files that have been snappy/lz4 compressed with spark. Files were compressed with the lz4 command line tool and the python snappy library.
Both did not succeed, while other formats (bzip2 & gzip) worked fine. I've read in some places that the codec is not fully compatible between different implementations. Has anyone else had success with this? Would be happy to hear how you went about it. Thanks, Yeachan