Hi Priyanka, We are getting compressed file from source, which we need to read and decompress it. So that we can process the actual data.
Can you please provide any reader/Operator which is readily available to decompress the data while reading data in DataTorrent? On Mon, Oct 3, 2016 at 1:07 PM, Priyanka Gugale <[email protected]> wrote: > Hi, > > Do you want to read files in compressed form only or you want to your > program to decompress and read it? > If you want to read it in compressed format you can use FSInputModule > (which uses FileSplitter and block reader) directly to read your files. > If you want to uncompress while reading, there are other options you can > choose. I will explain in detail once you confirm this is what you are > trying to achieve. > > -Priyanka > > On Mon, Oct 3, 2016 at 12:38 PM, chiranjeevi vasupilli < > [email protected]> wrote: > >> Hi Team, >> >> Can you please provide any reader/Operator which is capable of reading >> the compressed data in DataTorrent. >> >> I have a requirement to read .snappy files having cntl+A separaor using >> filesplitter ,can u please let me know how to do it? >> >> >> -- >> thanks >> chiru >> > > -- ur's chiru
