[jira] [Created] (SPARK-30400) Test failure in SQL module on ppc64le

2019-12-31 Thread AK97 (Jira)
AK97 created SPARK-30400: Summary: Test failure in SQL module on ppc64le Key: SPARK-30400 URL: https://issues.apache.org/jira/browse/SPARK-30400 Project: Spark Issue Type: Test Components:

[jira] [Resolved] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-23626. -- Resolution: Won't Fix > DAGScheduler blocked due to JobSubmitted event >

[jira] [Updated] (SPARK-30399) Bucketing does not compatible with partitioning in practice

2019-12-31 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shay Elbaz updated SPARK-30399: --- Description: When using Spark Bucketed table, Spark would use as many partitions as the number of b

[jira] [Created] (SPARK-30399) Bucketing does not compatible with partitioning in practice

2019-12-31 Thread Shay Elbaz (Jira)
Shay Elbaz created SPARK-30399: -- Summary: Bucketing does not compatible with partitioning in practice Key: SPARK-30399 URL: https://issues.apache.org/jira/browse/SPARK-30399 Project: Spark Issu

[jira] [Commented] (SPARK-24202) Separate SQLContext dependency from SparkSession.implicits

2019-12-31 Thread Sam hendley (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006214#comment-17006214 ] Sam hendley commented on SPARK-24202: - I agree that this would be a very valuable ch

[jira] [Commented] (SPARK-26734) StackOverflowError on WAL serialization caused by large receivedBlockQueue

2019-12-31 Thread Stephen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006211#comment-17006211 ] Stephen commented on SPARK-26734: - Is this bug fixed? I still see the same error at Spar

[jira] [Updated] (SPARK-30339) Avoid to fail twice in function lookup

2019-12-31 Thread Zhenhua Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-30339: - Fix Version/s: 2.4.5 > Avoid to fail twice in function lookup >

[jira] [Resolved] (SPARK-30363) Add Documentation for Refresh Resources

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30363. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27023 [https://gi

[jira] [Assigned] (SPARK-30363) Add Documentation for Refresh Resources

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30363: Assignee: Rakesh Raushan > Add Documentation for Refresh Resources >

[jira] [Resolved] (SPARK-30389) Add jar should not allow to add other format except jar file

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30389. -- Resolution: Not A Problem > Add jar should not allow to add other format except jar file > ---

[jira] [Resolved] (SPARK-30392) Documentation for the date_trunc function is incorrect

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30392. -- Resolution: Not A Problem Yes, this is being reported against 2.3.0 apparently > Documentatio

[jira] [Resolved] (SPARK-30336) Move Kafka consumer related classes to its own package

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30336. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26991 [https://gi

[jira] [Assigned] (SPARK-30336) Move Kafka consumer related classes to its own package

2019-12-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30336: Assignee: Jungtaek Lim > Move Kafka consumer related classes to its own package > ---

[jira] [Updated] (SPARK-30339) Avoid to fail twice in function lookup

2019-12-31 Thread Zhenhua Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-30339: - Description: Currently if function lookup fails, spark will give it a second chance by casting d

[jira] [Commented] (SPARK-27692) Optimize evaluation of udf that is deterministic and has literal inputs

2019-12-31 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006127#comment-17006127 ] Maciej Szymkiewicz commented on SPARK-27692: Could you explain what is the v

[jira] [Updated] (SPARK-30393) Too much ProvisionedThroughputExceededException while recover from checkpoint

2019-12-31 Thread Stephen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen updated SPARK-30393: Environment: I am using EMR 5.25.0, Spark 2.4.3, spark-streaming-kinesis-asl 2.4.3 I have 6 r5.4xLarge in

[jira] [Created] (SPARK-30398) PCA/RegressionMetrics/RowMatrix avoid unnecessary computation

2019-12-31 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30398: Summary: PCA/RegressionMetrics/RowMatrix avoid unnecessary computation Key: SPARK-30398 URL: https://issues.apache.org/jira/browse/SPARK-30398 Project: Spark

[jira] [Created] (SPARK-30397) [pyspark] Writer applied to custom model changes type of keys' dict from int to str

2019-12-31 Thread Jean-Marc Montanier (Jira)
Jean-Marc Montanier created SPARK-30397: --- Summary: [pyspark] Writer applied to custom model changes type of keys' dict from int to str Key: SPARK-30397 URL: https://issues.apache.org/jira/browse/SPARK-30397

[jira] [Updated] (SPARK-30396) When there are multiple DISTINCT aggregate expressions acting on different fields, any DISTINCT aggregate expression allows the use of the FILTER clause

2019-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30396: --- Description: This ticket is related to https://issues.apache.org/jira/browse/SPARK-27986 This ticke

[jira] [Updated] (SPARK-30395) When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause

2019-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30395: --- Description: This ticket is related to https://issues.apache.org/jira/browse/SPARK-27986 This ticke

[jira] [Updated] (SPARK-30395) When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause

2019-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30395: --- Description: This ticket is related to https://issues.apache.org/jira/browse/SPARK-27986 This ticke

[jira] [Created] (SPARK-30396) When there are multiple DISTINCT aggregate expressions acting on different fields, any DISTINCT aggregate expression allows the use of the FILTER clause

2019-12-31 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-30396: -- Summary: When there are multiple DISTINCT aggregate expressions acting on different fields, any DISTINCT aggregate expression allows the use of the FILTER clause Key: SPARK-30396 URL

[jira] [Created] (SPARK-30395) When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause

2019-12-31 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-30395: -- Summary: When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause Key: SPARK-30395 URL: https: