[jira] [Resolved] (SPARK-22895) Push down the deterministic predicates that are after the first non-deterministic

2017-12-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22895. - Resolution: Fixed Fix Version/s: 2.3.0 > Push down the deterministic predicates that are after

[jira] [Resolved] (SPARK-22363) Add unit test for Window spilling

2017-12-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22363. - Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 2.3.0 > Add unit test for

[jira] [Assigned] (SPARK-22931) Add deterministic parameter to registerFunction

2017-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22931: Assignee: Apache Spark (was: Xiao Li) > Add deterministic parameter to registerFunction

[jira] [Assigned] (SPARK-22931) Add deterministic parameter to registerFunction

2017-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22931: Assignee: Xiao Li (was: Apache Spark) > Add deterministic parameter to registerFunction

[jira] [Commented] (SPARK-22931) Add deterministic parameter to registerFunction

2017-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307050#comment-16307050 ] Apache Spark commented on SPARK-22931: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-22931) Add deterministic parameter to registerFunction

2017-12-30 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22931: --- Summary: Add deterministic parameter to registerFunction Key: SPARK-22931 URL: https://issues.apache.org/jira/browse/SPARK-22931 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22930) Improve the description of Vectorized UDFs for non-deterministic cases

2017-12-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307020#comment-16307020 ] Xiao Li commented on SPARK-22930: - cc [~bryanc] [~icexelloss] > Improve the description of Vectorized

[jira] [Created] (SPARK-22930) Improve the description of Vectorized UDFs for non-deterministic cases

2017-12-30 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22930: --- Summary: Improve the description of Vectorized UDFs for non-deterministic cases Key: SPARK-22930 URL: https://issues.apache.org/jira/browse/SPARK-22930 Project: Spark

[jira] [Commented] (SPARK-22929) Short name for "kafka" doesn't work in pyspark with packages

2017-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306943#comment-16306943 ] Sean Owen commented on SPARK-22929: --- There's a typo in 'kakfa'; is that the issue or just a typo in the

[jira] [Created] (SPARK-22929) Short name for "kafka" doesn't work in pyspark with packages

2017-12-30 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-22929: Summary: Short name for "kafka" doesn't work in pyspark with packages Key: SPARK-22929 URL: https://issues.apache.org/jira/browse/SPARK-22929 Project: Spark

[jira] [Resolved] (SPARK-22924) R DataFrame API for sortWithinPartitions

2017-12-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22924. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20118

[jira] [Assigned] (SPARK-22924) R DataFrame API for sortWithinPartitions

2017-12-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22924: Assignee: Felix Cheung > R DataFrame API for sortWithinPartitions >

[jira] [Resolved] (SPARK-22919) Bump Apache httpclient versions

2017-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22919. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by https://github.com/apache/spark/pull/20103

[jira] [Assigned] (SPARK-22919) Bump Apache httpclient versions

2017-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22919: - Assignee: Fokko Driesprong Priority: Minor (was: Major) Issue Type: Improvement

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

2017-12-30 Thread Ganesh Chand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Description: 1) {{Trigger.java}} link is broken in the documentation -

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

2017-12-30 Thread Ganesh Chand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Description: 1) {{Trigger.java}} link is broken in the documentation -

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

2017-12-30 Thread Ganesh Chand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Description: 1) {{Trigger.java}} link is broken in the documentation -

[jira] [Created] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

2017-12-30 Thread Ganesh Chand (JIRA)
Ganesh Chand created SPARK-22928: Summary: API Documentation issue for org.apache.spark.sql.streaming.Trigger Key: SPARK-22928 URL: https://issues.apache.org/jira/browse/SPARK-22928 Project: Spark