[jira] [Resolved] (SPARK-20175) Exists should not be evaluated in Join operator and can be converted to ScalarSubquery if no correlated reference

2017-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20175. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17491 [https://githu

[jira] [Resolved] (SPARK-20274) support compatible array element type in encoder

2017-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20274. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17587 [https://githu

[jira] [Commented] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

2017-04-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964263#comment-15964263 ] Sean Owen commented on SPARK-20284: --- It's a developer API, so dont' think callers will

[jira] [Comment Edited] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

2017-04-11 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964257#comment-15964257 ] Sergei Lebedev edited comment on SPARK-20284 at 4/11/17 11:57 AM: -

[jira] [Commented] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

2017-04-11 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964257#comment-15964257 ] Sergei Lebedev commented on SPARK-20284: It makes the stream well-behaved for any

[jira] [Assigned] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20293: Assignee: (was: Apache Spark) > In the page of 'jobs' or 'stages' of history server we

[jira] [Commented] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964184#comment-15964184 ] Apache Spark commented on SPARK-20293: -- User 'guoxiaolongzte' has created a pull req

[jira] [Assigned] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20293: Assignee: Apache Spark > In the page of 'jobs' or 'stages' of history server web ui,,click

[jira] [Updated] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

2017-04-11 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20293: --- Attachment: stages.png jobs.png error2.png err

[jira] [Updated] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

2017-04-11 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20293: --- Description: In the page of 'jobs' or 'stages' of history server web ui, Click on the 'Go' bu

[jira] [Created] (SPARK-20293) In history web ui,click the 'Go' button, paging query, the page error

2017-04-11 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20293: -- Summary: In history web ui,click the 'Go' button, paging query, the page error Key: SPARK-20293 URL: https://issues.apache.org/jira/browse/SPARK-20293 Project: Sp

[jira] [Commented] (SPARK-20292) string representation of TreeNode is messy

2017-04-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964154#comment-15964154 ] Liang-Chi Hsieh commented on SPARK-20292: - I will look into this. > string repre

[jira] [Commented] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

2017-04-11 Thread Jerry.X.He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964151#comment-15964151 ] Jerry.X.He commented on SPARK-20266: it seems fixed, but did not found the original r

[jira] [Commented] (SPARK-10057) Faill to load class org.slf4j.impl.StaticLoggerBinder

2017-04-11 Thread Jifeng Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964087#comment-15964087 ] Jifeng Yin commented on SPARK-10057: It seems to be due to https://issues-test.apache

[jira] [Commented] (SPARK-20292) string representation of TreeNode is messy

2017-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964073#comment-15964073 ] Wenchen Fan commented on SPARK-20292: - cc [~viirya] [~smilegator] > string represent

[jira] [Created] (SPARK-20292) string representation of TreeNode is messy

2017-04-11 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-20292: --- Summary: string representation of TreeNode is messy Key: SPARK-20292 URL: https://issues.apache.org/jira/browse/SPARK-20292 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-20291) NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964047#comment-15964047 ] Apache Spark commented on SPARK-20291: -- User 'dbtsai' has created a pull request for

[jira] [Assigned] (SPARK-20291) NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20291: Assignee: Apache Spark (was: DB Tsai) > NaNvl(FloatType, NullType) should not be cast to

[jira] [Assigned] (SPARK-20291) NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20291: Assignee: DB Tsai (was: Apache Spark) > NaNvl(FloatType, NullType) should not be cast to

[jira] [Updated] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2017-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20236: Summary: Overwrite a partitioned data source table should only overwrite related partitions (was:

[jira] [Created] (SPARK-20291) NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread DB Tsai (JIRA)
DB Tsai created SPARK-20291: --- Summary: NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType) Key: SPARK-20291 URL: https://issues.apache.org/jira/browse/SPARK-20291 Project: Spark

[jira] [Updated] (SPARK-20236) Overwrite a partitioned table should only overwrite related partitions

2017-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20236: Description: When we overwrite a partitioned data source table, currently Spark will truncate the

[jira] [Assigned] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20290: Assignee: Apache Spark > PySpark Column should provide eqNullSafe > --

[jira] [Assigned] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20290: Assignee: (was: Apache Spark) > PySpark Column should provide eqNullSafe > ---

[jira] [Assigned] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20290: Assignee: Apache Spark > PySpark Column should provide eqNullSafe > --

[jira] [Commented] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964032#comment-15964032 ] Apache Spark commented on SPARK-20290: -- User 'zero323' has created a pull request fo

[jira] [Assigned] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20290: Assignee: (was: Apache Spark) > PySpark Column should provide eqNullSafe > ---

[jira] [Created] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-04-11 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-20290: -- Summary: PySpark Column should provide eqNullSafe Key: SPARK-20290 URL: https://issues.apache.org/jira/browse/SPARK-20290 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-20289) Use StaticInvoke rather than NewInstance for boxing primitive types

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20289: Assignee: Reynold Xin (was: Apache Spark) > Use StaticInvoke rather than NewInstance for

[jira] [Assigned] (SPARK-20289) Use StaticInvoke rather than NewInstance for boxing primitive types

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20289: Assignee: Apache Spark (was: Reynold Xin) > Use StaticInvoke rather than NewInstance for

[jira] [Commented] (SPARK-20289) Use StaticInvoke rather than NewInstance for boxing primitive types

2017-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964005#comment-15964005 ] Apache Spark commented on SPARK-20289: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-20289) Use StaticInvoke rather than NewInstance for boxing primitive types

2017-04-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-20289: --- Summary: Use StaticInvoke rather than NewInstance for boxing primitive types Key: SPARK-20289 URL: https://issues.apache.org/jira/browse/SPARK-20289 Project: Spark

[jira] [Resolved] (SPARK-20097) Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-04-11 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20097. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17431 [https:/

[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-11 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963939#comment-15963939 ] Stephane Maarek commented on SPARK-20287: - The other issue I can see is the coord

[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-11 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963938#comment-15963938 ] Stephane Maarek commented on SPARK-20287: - [~srowen] those are good points. In th

<    1   2