[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-07 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032831#comment-17032831 ] John Zhuge commented on HADOOP-12990: - Yes indeed. Actually 3 apps (lz4 tool, Hadoo

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-07 Thread Redriver (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032814#comment-17032814 ] Redriver commented on HADOOP-12990: --- [~jzhuge] Thanks for your information. It is con

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-07 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032202#comment-17032202 ] John Zhuge commented on HADOOP-12990: - [~redriver] since Hadoop is not involved, yo

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-07 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032199#comment-17032199 ] John Zhuge commented on HADOOP-12990: - OOM usually indicates format mismatch, e.g.,

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-06 Thread Redriver (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032112#comment-17032112 ] Redriver commented on HADOOP-12990: --- I think Spark writes event log with hadoop lz4 f

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-06 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031853#comment-17031853 ] John Zhuge commented on HADOOP-12990: - [~redriver] Thanks for the info. {quote}But

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-06 Thread Redriver (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031726#comment-17031726 ] Redriver commented on HADOOP-12990: --- As [~jzhuge] said, Hadoop lz4 compression used b

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2020-02-05 Thread Redriver (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031283#comment-17031283 ] Redriver commented on HADOOP-12990: --- Is there a quick way to decompress the hadoop '.

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-04-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973452#comment-15973452 ] Jason Lowe commented on HADOOP-12990: - My apologies for the delay, somehow I missed

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834745#comment-15834745 ] Jason Lowe commented on HADOOP-12990: - bq. Is there a streaming version of the decod

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-20 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832709#comment-15832709 ] Ilya Ganelin commented on HADOOP-12990: --- Is there a streaming version of the decod

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830596#comment-15830596 ] Jason Lowe commented on HADOOP-12990: - bq. My proposed approach is to create a new f

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-19 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830582#comment-15830582 ] Ilya Ganelin commented on HADOOP-12990: --- [~jzhuge] My proposed approach is to crea

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830570#comment-15830570 ] Jason Lowe commented on HADOOP-12990: - After having worked on the ZStandard codec in

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830555#comment-15830555 ] John Zhuge commented on HADOOP-12990: - Not that I am aware of. Go for it! Past com

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2017-01-19 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830536#comment-15830536 ] Ilya Ganelin commented on HADOOP-12990: --- Hi, all - we've just run into this. Is th

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-05-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289809#comment-15289809 ] Jason Lowe commented on HADOOP-12990: - I agree with [~qwertymaniac] that the right w

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-05-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268366#comment-15268366 ] John Zhuge commented on HADOOP-12990: - [~cavanaug], lz4 command line and hadoop-lz4

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-05-02 Thread John Cavanaugh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268231#comment-15268231 ] John Cavanaugh commented on HADOOP-12990: - We have a lot of large json files we

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223149#comment-15223149 ] John Zhuge commented on HADOOP-12990: - Able to hack my way to make OS lz4 tool (r114

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223148#comment-15223148 ] John Zhuge commented on HADOOP-12990: - Summary of the difference between Hadoop lz4

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222434#comment-15222434 ] Harsh J commented on HADOOP-12990: -- There does not also seem to be any benefit of using

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222405#comment-15222405 ] John Zhuge commented on HADOOP-12990: - Should we support this use case? > lz4 incom

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221968#comment-15221968 ] Chris Nauroth commented on HADOOP-12990: Thanks [~qwertymaniac]. Our comments c

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221965#comment-15221965 ] Chris Nauroth commented on HADOOP-12990: Is this actually expected to work? Had

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221946#comment-15221946 ] Harsh J commented on HADOOP-12990: -- I don't think our Lz4Codec implementation actually

[jira] [Commented] (HADOOP-12990) lz4 incompatibility between OS and Hadoop

2016-04-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221862#comment-15221862 ] John Zhuge commented on HADOOP-12990: - >From the backtrace, {{getCompressedData}} go