[ https://issues.apache.org/jira/browse/IMPALA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong resolved IMPALA-3073. ----------------------------------- Resolution: Cannot Reproduce I don't think we have an example of this happening so will close for now. > Verify if compressed data in avro, sequence file format could be multistream > ---------------------------------------------------------------------------- > > Key: IMPALA-3073 > URL: https://issues.apache.org/jira/browse/IMPALA-3073 > Project: IMPALA > Issue Type: New Feature > Components: Backend > Affects Versions: Impala 2.0 > Reporter: Juan Yu > Priority: Minor > > When generating compressed text file, certain tools (like pbzip2) could > parallel compression and create multistream compressed data. We need to > verify if this applies to other file formats like parquet, avro, sequence > that use those codec. If yes, Codec::ProcessBlock() should support > multistream compressd block data. decompression should not stop when reach > the end of compressed stream, e.g. Z_STREAM_END, BZ_STREAM_END. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org