[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Description:
We use TPCx-BB(BigBench) to evaluate the performance of Spark shuffle RPC
encryption in
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Description:
We use TPCx-BB(BigBench) to evaluate the performance of Spark shuffle RPC
encryption in
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-16358:
Assignee: Xiao Li
> Remove InsertIntoHiveTable From Logical Plan
>
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16358.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 14037
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Description:
We use TPCx-BB(BigBench) to evaluate the performance of Spark shuffle RPC
encryption.
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Environment:
Apache Spark 1.6.1
TPCx-BB 1.0.1
jdk 1.7
was:
Apache Spark 1.6.1
TPCx-BB 1.0.1
jdk
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Environment:
Apache Spark 1.6.1
TPCx-BB 1.0.1
jdk 1.8.0_73
was:
Apache Spark 1.6.1
BigBench 1.0.1
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Description:
We use TPCx-BB
During our performance test of Spark shuffle RPC encryption using 3DES on
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Environment:
Apache Spark 1.6.1
BigBench 1.0.1
jdk 1.8.0_73
was:
Apache Spark 1.6.1
BigBench
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Summary: After enabling Spark shuffle RPC encryption using 3DES, Sparksql
query has poor performance
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Fix Version/s: (was: 2.1.0)
> After enabling Spark shuffle RPC encryption using 3DES, Sparksql
[
https://issues.apache.org/jira/browse/SPARK-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360841#comment-15360841
]
Apache Spark commented on SPARK-15598:
--
User 'techaddict' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360837#comment-15360837
]
Apache Spark commented on SPARK-16329:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16359:
Assignee: Apache Spark
> unidoc workaround for multiple kafka versions
>
[
https://issues.apache.org/jira/browse/SPARK-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360824#comment-15360824
]
Apache Spark commented on SPARK-16359:
--
User 'koeninger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16359:
Assignee: (was: Apache Spark)
> unidoc workaround for multiple kafka versions
>
Cody Koeninger created SPARK-16359:
--
Summary: unidoc workaround for multiple kafka versions
Key: SPARK-16359
URL: https://issues.apache.org/jira/browse/SPARK-16359
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-15204:
Fix Version/s: 2.1.0
> Improve nullability inference for Aggregator
>
[
https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-15204.
-
Resolution: Fixed
Target Version/s: 2.1.0
> Improve nullability inference for
[
https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-15204:
Assignee: Koert Kuipers
> Improve nullability inference for Aggregator
>
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Environment:
Apache Spark 1.6.1
BigBench 1.0.1
was:
Apache Spark 1.6.1 with local patch for
[
https://issues.apache.org/jira/browse/SPARK-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360801#comment-15360801
]
Apache Spark commented on SPARK-16329:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
marymwu updated SPARK-16089:
Component/s: SQL
> Spark2.0 doesn't support the certain static partition SQL statment as "insert
>
[
https://issues.apache.org/jira/browse/SPARK-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
marymwu updated SPARK-16092:
Component/s: SQL
> Spark2.0 take no effect after set hive.exec.dynamic.partition.mode=nonstrict
> as a
[
https://issues.apache.org/jira/browse/SPARK-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
marymwu updated SPARK-16093:
Component/s: SQL
> Spark2.0 take no effect after set spark.sql.autoBroadcastJoinThreshold = 1
>
[
https://issues.apache.org/jira/browse/SPARK-15009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360782#comment-15360782
]
Bryan Cutler commented on SPARK-15009:
--
At the time I reported this, it was blocked by SPARK-14087
[
https://issues.apache.org/jira/browse/SPARK-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15896:
Assignee: Apache Spark
> Clean shuffle files after finish the SQL query
>
[
https://issues.apache.org/jira/browse/SPARK-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15896:
Assignee: (was: Apache Spark)
> Clean shuffle files after finish the SQL query
>
[
https://issues.apache.org/jira/browse/SPARK-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360781#comment-15360781
]
Apache Spark commented on SPARK-15896:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16317:
Assignee: (was: Apache Spark)
> Add file filtering interface for FileFormat
>
[
https://issues.apache.org/jira/browse/SPARK-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360779#comment-15360779
]
Apache Spark commented on SPARK-16317:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16317:
Assignee: Apache Spark
> Add file filtering interface for FileFormat
>
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-16358:
Summary: Remove InsertIntoHiveTable From Logical Plan (was: Remove
LogicalPlan Node InsertIntoHiveTable )
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16358:
Assignee: Apache Spark
> Remove LogicalPlan Node InsertIntoHiveTable
>
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16358:
Assignee: (was: Apache Spark)
> Remove LogicalPlan Node InsertIntoHiveTable
>
[
https://issues.apache.org/jira/browse/SPARK-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360775#comment-15360775
]
Apache Spark commented on SPARK-16358:
--
User 'gatorsmile' has created a pull request for this issue:
Xiao Li created SPARK-16358:
---
Summary: Remove LogicalPlan Node InsertIntoHiveTable
Key: SPARK-16358
URL: https://issues.apache.org/jira/browse/SPARK-16358
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeweichen updated SPARK-16357:
--
Description: During our performance test of Spark shuffle RPC encryption
using 3DES on Sparksql, we
zeweichen created SPARK-16357:
-
Summary: For Spark shuffle RPC encryption using 3DES on Sparksql,
throughput test of 2 stream lasts 2.68X time than power test.
Key: SPARK-16357
URL:
[
https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360752#comment-15360752
]
Kazuaki Ishizaki commented on SPARK-15467:
--
My
[
https://issues.apache.org/jira/browse/SPARK-15009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360714#comment-15360714
]
Shuai Lin commented on SPARK-15009:
---
Hi [~bryanc] , what's the status of this ticket? I can work on it
[
https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16288.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 13976
[
https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-16288:
Assignee: Dongjoon Hyun
> Implement inline table generating function
>
[
https://issues.apache.org/jira/browse/SPARK-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360572#comment-15360572
]
Wenchen Fan commented on SPARK-16333:
-
looks like the `TaskInfo.accumulables` is always Nil in 1.6,
[
https://issues.apache.org/jira/browse/SPARK-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360564#comment-15360564
]
Arnaud Bailly commented on SPARK-16350:
---
I tested provided PR and I can confirm it fixes the issue
[
https://issues.apache.org/jira/browse/SPARK-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360500#comment-15360500
]
Sean Owen commented on SPARK-16333:
---
[~cloud_fan] [~andrewor14] I wonder if you would know anything
[
https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16323:
Assignee: Apache Spark
> Avoid unnecessary cast when doing integral divide
>
[
https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360477#comment-15360477
]
Apache Spark commented on SPARK-16323:
--
User 'techaddict' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16323:
Assignee: (was: Apache Spark)
> Avoid unnecessary cast when doing integral divide
>
[
https://issues.apache.org/jira/browse/SPARK-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-16279:
Assignee: Dongjoon Hyun
> Implement map_values SQL function
> -
>
[
https://issues.apache.org/jira/browse/SPARK-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-16278:
Assignee: Dongjoon Hyun
> Implement map_keys SQL function
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16278.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 13967
[
https://issues.apache.org/jira/browse/SPARK-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16279.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 13967
[
https://issues.apache.org/jira/browse/SPARK-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16329.
-
Resolution: Fixed
Fix Version/s: 2.1.0
> select * from temp_table_no_cols fails
>
[
https://issues.apache.org/jira/browse/SPARK-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-16329:
Assignee: Xiao Li
> select * from temp_table_no_cols fails
>
[
https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-16323:
--
Comment: was deleted
(was: Hi, [~clockfly].
If you don't mind, I'll make a PR for this.)
>
[
https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360443#comment-15360443
]
Dongjoon Hyun commented on SPARK-16323:
---
Hi, [~clockfly].
If you don't mind, I'll make a PR for
[
https://issues.apache.org/jira/browse/SPARK-16354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360442#comment-15360442
]
Sandeep Singh commented on SPARK-16354:
---
[~smilegator] What should be the expected behaviour, a
[
https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360425#comment-15360425
]
Apache Spark commented on SPARK-16356:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16356:
Assignee: Apache Spark
> Add testImplicits for ML unit tests and promote toDF()
>
[
https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16356:
Assignee: (was: Apache Spark)
> Add testImplicits for ML unit tests and promote
Hyukjin Kwon created SPARK-16356:
Summary: Add testImplicits for ML unit tests and promote toDF()
Key: SPARK-16356
URL: https://issues.apache.org/jira/browse/SPARK-16356
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-16355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-16355:
Description:
When a query containing LIMIT/TABLESAMPLE 0, the statistics could be zero.
Results are
[
https://issues.apache.org/jira/browse/SPARK-16355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-16355:
Description:
When a query containing LIMIT/TABLESAMPLE 0, the statistics could be zero.
Results are
64 matches
Mail list logo