[jira] [Assigned] (SPARK-20719) Support LIMIT ALL

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20719: Assignee: Apache Spark (was: Xiao Li) > Support LIMIT ALL > - > >

[jira] [Assigned] (SPARK-20719) Support LIMIT ALL

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20719: Assignee: Xiao Li (was: Apache Spark) > Support LIMIT ALL > - > >

[jira] [Commented] (SPARK-20719) Support LIMIT ALL

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007631#comment-16007631 ] Apache Spark commented on SPARK-20719: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-20719) Support LIMIT ALL

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20719: Description: `LIMIT ALL` is the same as omitting the `LIMIT` clause. It is supported by both PrestgreSQL

[jira] [Created] (SPARK-20719) Support LIMIT ALL

2017-05-11 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20719: --- Summary: Support LIMIT ALL Key: SPARK-20719 URL: https://issues.apache.org/jira/browse/SPARK-20719 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-20608) Standby namenodes should be allowed to included in yarn.spark.access.namenodes to support HDFS HA

2017-05-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007599#comment-16007599 ] Marcelo Vanzin commented on SPARK-20608: That looks like the configuration you're using for the

[jira] [Assigned] (SPARK-20665) Spark-sql, "Bround" and "Round" function return NULL

2017-05-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20665: --- Assignee: liuxian > Spark-sql, "Bround" and "Round" function return NULL >

[jira] [Resolved] (SPARK-20665) Spark-sql, "Bround" and "Round" function return NULL

2017-05-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20665. - Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 2.0.3

[jira] [Assigned] (SPARK-20718) FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20718: Assignee: Apache Spark > FileSourceScanExec with different filter orders should be the

[jira] [Assigned] (SPARK-20718) FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20718: Assignee: (was: Apache Spark) > FileSourceScanExec with different filter orders

[jira] [Updated] (SPARK-20718) FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-20718: - Summary: FileSourceScanExec with different filter orders should be the same after

[jira] [Commented] (SPARK-20718) FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007582#comment-16007582 ] Apache Spark commented on SPARK-20718: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20716: Assignee: Apache Spark (was: Tathagata Das) > StateStore.abort() should not throw

[jira] [Assigned] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20716: Assignee: Tathagata Das (was: Apache Spark) > StateStore.abort() should not throw

[jira] [Commented] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007581#comment-16007581 ] Apache Spark commented on SPARK-20716: -- User 'tdas' has created a pull request for this issue:

[jira] [Created] (SPARK-20718) FileSourceScanExec with different filter orders should have the same result

2017-05-11 Thread Zhenhua Wang (JIRA)
Zhenhua Wang created SPARK-20718: Summary: FileSourceScanExec with different filter orders should have the same result Key: SPARK-20718 URL: https://issues.apache.org/jira/browse/SPARK-20718 Project:

[jira] [Assigned] (SPARK-20399) Can't use same regex pattern between 1.6 and 2.x due to unescaped sql string in parser

2017-05-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20399: --- Assignee: Liang-Chi Hsieh > Can't use same regex pattern between 1.6 and 2.x due to

[jira] [Resolved] (SPARK-20399) Can't use same regex pattern between 1.6 and 2.x due to unescaped sql string in parser

2017-05-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20399. - Resolution: Fixed > Can't use same regex pattern between 1.6 and 2.x due to unescaped sql string

[jira] [Updated] (SPARK-20399) Can't use same regex pattern between 1.6 and 2.x due to unescaped sql string in parser

2017-05-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20399: Fix Version/s: 2.2.0 > Can't use same regex pattern between 1.6 and 2.x due to unescaped sql

[jira] [Assigned] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20717: Assignee: Apache Spark (was: Tathagata Das) > Tweak MapGroupsWithState update function

[jira] [Assigned] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20717: Assignee: Tathagata Das (was: Apache Spark) > Tweak MapGroupsWithState update function

[jira] [Commented] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007573#comment-16007573 ] Apache Spark commented on SPARK-20717: -- User 'tdas' has created a pull request for this issue:

[jira] [Updated] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-20717: -- Description: Timeout and state data are two independent entities and should be settable

[jira] [Commented] (SPARK-20608) Standby namenodes should be allowed to included in yarn.spark.access.namenodes to support HDFS HA

2017-05-11 Thread Yuechen Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007561#comment-16007561 ] Yuechen Chen commented on SPARK-20608: -- I try this solution, but meet with some problems. I

[jira] [Commented] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007556#comment-16007556 ] Apache Spark commented on SPARK-18772: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-20717: - Summary: Tweak MapGroupsWithState update function behavior Key: SPARK-20717 URL: https://issues.apache.org/jira/browse/SPARK-20717 Project: Spark Issue

[jira] [Updated] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-20716: -- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-19067) > StateStore.abort()

[jira] [Commented] (SPARK-10408) Autoencoder

2017-05-11 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007535#comment-16007535 ] Jeremy commented on SPARK-10408: I mentioned this in the PR, but I also want to mention here that I'll do

[jira] [Created] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-20716: - Summary: StateStore.abort() should not throw further exception Key: SPARK-20716 URL: https://issues.apache.org/jira/browse/SPARK-20716 Project: Spark

[jira] [Updated] (SPARK-20665) Spark-sql, "Bround" and "Round" function return NULL

2017-05-11 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20665: Affects Version/s: 2.0.0 2.1.0 > Spark-sql, "Bround" and "Round" function return

[jira] [Commented] (SPARK-13486) Move SQLConf into an internal package

2017-05-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007428#comment-16007428 ] Reynold Xin commented on SPARK-13486: - Why is this troubling? SQLConf was previously package visible

[jira] [Assigned] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20715: Assignee: Josh Rosen (was: Apache Spark) > MapStatuses shouldn't be redundantly stored

[jira] [Assigned] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20715: Assignee: Apache Spark (was: Josh Rosen) > MapStatuses shouldn't be redundantly stored

[jira] [Commented] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007351#comment-16007351 ] Apache Spark commented on SPARK-20715: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Created] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker

2017-05-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-20715: -- Summary: MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker Key: SPARK-20715 URL: https://issues.apache.org/jira/browse/SPARK-20715

[jira] [Assigned] (SPARK-20714) Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20714: Assignee: Apache Spark (was: Tathagata Das) > Fix match error when watermark is set with

[jira] [Assigned] (SPARK-20714) Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20714: Assignee: Tathagata Das (was: Apache Spark) > Fix match error when watermark is set with

[jira] [Commented] (SPARK-20714) Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007306#comment-16007306 ] Apache Spark commented on SPARK-20714: -- User 'tdas' has created a pull request for this issue:

[jira] [Commented] (SPARK-13210) NPE in Sort

2017-05-11 Thread David McWhorter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007303#comment-16007303 ] David McWhorter commented on SPARK-13210: - is it worth reopening this issue, or creating a new

[jira] [Created] (SPARK-20714) Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-20714: - Summary: Fix match error when watermark is set with timeout = no timeout / processing timeout Key: SPARK-20714 URL: https://issues.apache.org/jira/browse/SPARK-20714

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-20666: - Target Version/s: 2.2.0 > Flaky test - SparkListenerBus randomly failing

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20483: Fix Version/s: (was: 2.2.1) 2.2.0 > Mesos Coarse mode may starve other Mesos

[jira] [Updated] (SPARK-14471) The alias created in SELECT could be used in GROUP BY and followed expressions

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14471: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > The alias

[jira] [Updated] (SPARK-20426) OneForOneStreamManager occupies too much memory.

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20426: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-20482) Resolving Casts is too strict on having time zone set

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20482: Fix Version/s: (was: 2.2.1) 2.2.0 > Resolving Casts is too strict on having time

[jira] [Updated] (SPARK-20471) Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled.

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20471: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Remove

[jira] [Updated] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20476: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Exception

[jira] [Updated] (SPARK-20047) Constrained Logistic Regression

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20047: Fix Version/s: (was: 2.2.1) 2.2.0 > Constrained Logistic Regression >

[jira] [Updated] (SPARK-20517) Download link in history server UI is not correct

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20517: Fix Version/s: (was: 2.2.1) 2.2.0 > Download link in history server UI is not

[jira] [Updated] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20549: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20459: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > JdbcUtils

[jira] [Updated] (SPARK-20534) Outer generators skip missing records if used alone

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20534: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Outer

[jira] [Updated] (SPARK-20537) OffHeapColumnVector reallocation may not copy existing data

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20537: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-11968) ALS recommend all methods spend most of time in GC

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11968: Fix Version/s: (was: 2.2.1) 2.2.0 > ALS recommend all methods spend most of time in

[jira] [Updated] (SPARK-20621) Delete deprecated config parameter in 'spark-env.sh'

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20621: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Delete

[jira] [Updated] (SPARK-20546) spark-class gets syntax error in posix mode

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20546: Fix Version/s: (was: 2.2.1) 2.2.0 > spark-class gets syntax error in posix mode >

[jira] [Updated] (SPARK-20421) Mark JobProgressListener (and related classes) as deprecated

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20421: Fix Version/s: (was: 2.2.1) 2.2.0 > Mark JobProgressListener (and related classes)

[jira] [Updated] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20558: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > clear

[jira] [Updated] (SPARK-20596) Improve ALS recommend all test cases

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20596: Fix Version/s: (was: 2.2.1) 2.2.0 > Improve ALS recommend all test cases >

[jira] [Updated] (SPARK-20587) Improve performance of ML ALS recommendForAll

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20587: Fix Version/s: (was: 2.2.1) 2.2.0 > Improve performance of ML ALS recommendForAll >

[jira] [Updated] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20667: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Cleanup the

[jira] [Updated] (SPARK-20627) Remove pip local version string (PEP440)

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20627: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Remove pip

[jira] [Updated] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20548: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Flaky Test:

[jira] [Updated] (SPARK-20615) SparseVector.argmax throws IndexOutOfBoundsException when the sparse vector has a size greater than zero but no elements defined.

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20615: Fix Version/s: (was: 2.2.1) 2.2.0 > SparseVector.argmax throws

[jira] [Updated] (SPARK-20373) Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20373: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Batch

[jira] [Resolved] (SPARK-20373) Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20373. - Resolution: Fixed > Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute >

[jira] [Updated] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20686: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17685: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12837: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Spark

[jira] [Updated] (SPARK-20678) Ndv for columns not in filter condition should also be updated

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20678: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > Ndv for

[jira] [Updated] (SPARK-20590) Map default input data source formats to inlined classes

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20590: Fix Version/s: (was: 2.3.0) > Map default input data source formats to inlined classes >

[jira] [Updated] (SPARK-20630) Thread Dump link available in Executors tab irrespective of spark.ui.threadDumpsEnabled

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20630: Fix Version/s: (was: 2.2.1) 2.2.0 > Thread Dump link available in Executors tab

[jira] [Updated] (SPARK-20600) KafkaRelation should be pretty printed in web UI (Details for Query)

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20600: Fix Version/s: (was: 2.3.0) > KafkaRelation should be pretty printed in web UI (Details for Query) >

[jira] [Updated] (SPARK-20688) correctly check analysis for scalar sub-queries

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20688: Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 > correctly

[jira] [Updated] (SPARK-20637) MappedRDD, FilteredRDD, etc. are still referenced in code comments

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20637: Fix Version/s: (was: 2.2.1) 2.2.0 > MappedRDD, FilteredRDD, etc. are still

[jira] [Updated] (SPARK-20569) RuntimeReplaceable functions accept invalid third parameter

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20569: Fix Version/s: (was: 2.2.1) > RuntimeReplaceable functions accept invalid third parameter >

[jira] [Updated] (SPARK-20569) RuntimeReplaceable functions accept invalid third parameter

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20569: Fix Version/s: 2.2.1 > RuntimeReplaceable functions accept invalid third parameter >

[jira] [Updated] (SPARK-20600) KafkaRelation should be pretty printed in web UI (Details for Query)

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20600: Fix Version/s: (was: 2.2.1) 2.2.0 > KafkaRelation should be pretty printed in web

[jira] [Updated] (SPARK-20685) BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20685: Fix Version/s: (was: 2.3.0) > BatchPythonEvaluation UDF evaluator fails for case of single UDF with >

[jira] [Updated] (SPARK-20685) BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20685: Fix Version/s: (was: 2.2.1) 2.2.0 > BatchPythonEvaluation UDF evaluator fails for

[jira] [Updated] (SPARK-20590) Map default input data source formats to inlined classes

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20590: Fix Version/s: (was: 2.2.1) 2.2.0 > Map default input data source formats to

[jira] [Updated] (SPARK-20569) RuntimeReplaceable functions accept invalid third parameter

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20569: Fix Version/s: (was: 2.2.1) 2.2.0 > RuntimeReplaceable functions accept invalid

[jira] [Updated] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting from Breeze sparse matrix

2017-05-11 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Bermudez Corrales updated SPARK-20687: -- Summary: mllib.Matrices.fromBreeze may crash when converting from

[jira] [Commented] (SPARK-20512) SparkR 2.2 QA: Programming guide, migration guide, vignettes updates

2017-05-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006951#comment-16006951 ] Felix Cheung commented on SPARK-20512: -- I did a QA pass on the R vignettes > SparkR 2.2 QA:

[jira] [Resolved] (SPARK-20431) Support a DDL-formatted string in DataFrameReader.schema

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20431. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Support a

[jira] [Resolved] (SPARK-20600) KafkaRelation should be pretty printed in web UI (Details for Query)

2017-05-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20600. -- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20033) spark sql can not use hive permanent function

2017-05-11 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover resolved SPARK-20033. - Resolution: Not A Problem Marking this JIRA as resolved, accordingly. > spark sql can not use

[jira] [Commented] (SPARK-20033) spark sql can not use hive permanent function

2017-05-11 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006870#comment-16006870 ] Mark Grover commented on SPARK-20033: - Reading the PR, it seems like this is not an issue. The

[jira] [Assigned] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20687: Assignee: (was: Apache Spark) > mllib.Matrices.fromBreeze may crash when converting

[jira] [Assigned] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20687: Assignee: Apache Spark > mllib.Matrices.fromBreeze may crash when converting breeze

[jira] [Commented] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006804#comment-16006804 ] Apache Spark commented on SPARK-20687: -- User 'ghoto' has created a pull request for this issue:

[jira] [Closed] (SPARK-20416) Column names inconsistent for UDFs in SQL vs Dataset

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-20416. --- Resolution: Fixed Fix Version/s: 2.3.0 > Column names inconsistent for UDFs in SQL vs Dataset >

[jira] [Assigned] (SPARK-20416) Column names inconsistent for UDFs in SQL vs Dataset

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20416: --- Assignee: Xiao Li > Column names inconsistent for UDFs in SQL vs Dataset >

[jira] [Assigned] (SPARK-20416) Column names inconsistent for UDFs in SQL vs Dataset

2017-05-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20416: --- Assignee: Takeshi Yamamuro (was: Xiao Li) > Column names inconsistent for UDFs in SQL vs Dataset >

[jira] [Resolved] (SPARK-20709) spark-shell use proxy-user failed

2017-05-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20709. Resolution: Duplicate > spark-shell use proxy-user failed >

[jira] [Resolved] (SPARK-19323) Upgrade breeze to 0.13

2017-05-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-19323. - Resolution: Duplicate > Upgrade breeze to 0.13 > -- > > Key:

[jira] [Commented] (SPARK-19354) Killed tasks are getting marked as FAILED

2017-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006549#comment-16006549 ] Thomas Graves commented on SPARK-19354: --- just an fyi, filed

[jira] [Created] (SPARK-20713) Speculative task that got CommitDenied exception shows up as failed

2017-05-11 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-20713: - Summary: Speculative task that got CommitDenied exception shows up as failed Key: SPARK-20713 URL: https://issues.apache.org/jira/browse/SPARK-20713 Project: Spark

[jira] [Closed] (SPARK-19354) Killed tasks are getting marked as FAILED

2017-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-19354. - Resolution: Duplicate > Killed tasks are getting marked as FAILED >

[jira] [Commented] (SPARK-19354) Killed tasks are getting marked as FAILED

2017-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006464#comment-16006464 ] Thomas Graves commented on SPARK-19354: --- thanks for pointing those out, that does fix this issue, I

  1   2   >