Hello

UnpackContent is for archive formats.  gzip/snappy/lz4 aren't archive
formats but are compression types.  You want CompressContent in
decompress mode.  I think the first question is why they didn't
decompress.  Did you verify the were indeed still compressed?  You can
use IdentifyMimeType to do a quick check of what it thinks they are.
Or grab the content from nifi's provenance capability and look at it
using linux tools.

Thanks
Joe

On Wed, Apr 19, 2017 at 5:43 PM, Banias H <banias4sp...@gmail.com> wrote:
> Hi,
>
> I have NiFi 1.1.1 and would like to compress messages before sending to a
> Kafka topic.
>  I can do this in the PublishKafka_0_10 processor. There is a "Compression
> Type" property where I can choose:
>
> - none
> - gzip
> - snappy
> - lz4
>
> But in the ConsumeKafka_0_10 processor, there is no option to decompress
> messages. Is there a way to decompress messages from Kafka topics in the
> consumer flow?
>
> I tried the following setup:
>
> Producer Flow
> - In PublishKafka_0_10 processor, set "Compression Type" to either gzip or
> snappy
>
> Consumer Flow
> - In Compress processor, set "Mode" set to "decompress" and set "Compression
> Format" to either gzip or snappy. However both failed to decompress.
>
> - Tried UnpackContent processor, but there is no "gzip", "snappy", or even
> "lz4" I can select.
>
> If anyone has a suggestion on how to decompress Kafka messages that are
> compressed by PublishKafka_0_10 processor, I would really appreciate it.
>
> Thanks,
> BH
>
>

Reply via email to