[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434269#comment-17434269 ] Dongjoon Hyun commented on SPARK-35181: --- If you want to get some help, please use

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434263#comment-17434263 ] Dongjoon Hyun commented on SPARK-35181: --- I have no clue for those issues, but sinc

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434258#comment-17434258 ] angerszhu commented on SPARK-35181: --- [~dongjoon] Yea, only when use ``spark.io.compres

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434257#comment-17434257 ] Dongjoon Hyun commented on SPARK-35181: --- BTW, according to the log, if you are try

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434252#comment-17434252 ] Dongjoon Hyun commented on SPARK-35181: --- I'm not sure how you build and configure

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-10-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434241#comment-17434241 ] angerszhu commented on SPARK-35181: --- [~dongjoon] This issue resolve when we upgrade th

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410842#comment-17410842 ] Dongjoon Hyun commented on SPARK-35181: --- According to your log, it seems that you

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410841#comment-17410841 ] Dongjoon Hyun commented on SPARK-35181: --- No. We are using it by default for `spark

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-09-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410492#comment-17410492 ] angerszhu commented on SPARK-35181: --- {code} 2021-08-28 22:38:19 INFO CodecPool:184 -

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-08-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407090#comment-17407090 ] angerszhu commented on SPARK-35181: --- [~dongjoon]Thanks for your information, I will tr

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407065#comment-17407065 ] Dongjoon Hyun commented on SPARK-35181: --- [~angerszhuuu], there is no problem if yo

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-08-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407027#comment-17407027 ] angerszhu commented on SPARK-35181: --- Hi [~dongjoon] Can I know if I use it as default

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-04-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327109#comment-17327109 ] Apache Spark commented on SPARK-35181: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-35181) Use zstd for spark.io.compression.codec by default

2021-04-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327108#comment-17327108 ] Apache Spark commented on SPARK-35181: -- User 'dongjoon-hyun' has created a pull req