[jira] [Updated] (SPARK-19040) I just want to report a dug

2016-12-30 Thread xiaowei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaowei updated SPARK-19040: Labels: patch (was: ) > I just want to report a dug > --- > >

[jira] [Created] (SPARK-19040) I just want to report a dug

2016-12-30 Thread xiaowei (JIRA)
xiaowei created SPARK-19040: --- Summary: I just want to report a dug Key: SPARK-19040 URL: https://issues.apache.org/jira/browse/SPARK-19040 Project: Spark Issue Type: Bug Components:

[jira] [Comment Edited] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788833#comment-15788833 ] J.P Feng edited comment on SPARK-19037 at 12/31/16 3:31 AM: yes, my spark

[jira] [Commented] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788833#comment-15788833 ] J.P Feng commented on SPARK-19037: -- yes, my spark version is version 2.1 downloaded from official site.

[jira] [Created] (SPARK-19039) UDF ClosureCleaner bug when UDF, col applied in paste mode in REPL

2016-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-19039: - Summary: UDF ClosureCleaner bug when UDF, col applied in paste mode in REPL Key: SPARK-19039 URL: https://issues.apache.org/jira/browse/SPARK-19039

[jira] [Commented] (SPARK-18404) RPC call from executor to driver blocks when getting map output locations (Netty Only)

2016-12-30 Thread Jeffrey Shmain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788734#comment-15788734 ] Jeffrey Shmain commented on SPARK-18404: Yes, but with Akka response is in milliseconds (few

[jira] [Updated] (SPARK-19038) Can't find keytab file when using Hive catalog

2016-12-30 Thread Peter Parente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Parente updated SPARK-19038: -- Description: h2. Stack Trace {noformat} Py4JJavaErrorTraceback (most recent call last) in ()

[jira] [Updated] (SPARK-19038) Can't find keytab file when using Hive catalog

2016-12-30 Thread Peter Parente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Parente updated SPARK-19038: -- Environment: Hadoop / YARN 2.6, pyspark, yarn-client mode (was: Hadoop / YARN 2.6, pyspark)

[jira] [Created] (SPARK-19038) Can't find keytab file when using Hive catalog

2016-12-30 Thread Peter Parente (JIRA)
Peter Parente created SPARK-19038: - Summary: Can't find keytab file when using Hive catalog Key: SPARK-19038 URL: https://issues.apache.org/jira/browse/SPARK-19038 Project: Spark Issue Type:

[jira] [Updated] (SPARK-19038) Can't find keytab file when using Hive catalog

2016-12-30 Thread Peter Parente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Parente updated SPARK-19038: -- Description: h2. Stack Trace {noformat} Py4JJavaErrorTraceback (most recent call last) in ()

[jira] [Resolved] (SPARK-19016) Document scalable partition handling feature in the programming guide

2016-12-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-19016. Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue resolved by pull

[jira] [Assigned] (SPARK-14975) Predicted Probability per training instance for Gradient Boosted Trees in mllib.

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14975: Assignee: Apache Spark > Predicted Probability per training instance for Gradient Boosted

[jira] [Commented] (SPARK-14975) Predicted Probability per training instance for Gradient Boosted Trees in mllib.

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788293#comment-15788293 ] Apache Spark commented on SPARK-14975: -- User 'imatiach-msft' has created a pull request for this

[jira] [Assigned] (SPARK-14975) Predicted Probability per training instance for Gradient Boosted Trees in mllib.

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14975: Assignee: (was: Apache Spark) > Predicted Probability per training instance for

[jira] [Commented] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

2016-12-30 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788152#comment-15788152 ] Shixiong Zhu commented on SPARK-17463: -- [~sunil.rangwani] Could you provide the codes that use

[jira] [Resolved] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-12-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18123. - Resolution: Resolved Fix Version/s: 2.2.0 >

[jira] [Updated] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-12-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18123: Assignee: Dongjoon Hyun > org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case >

[jira] [Resolved] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19037. --- Resolution: Duplicate > Run count(distinct x) from sub query found some errors >

[jira] [Commented] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788001#comment-15788001 ] Herman van Hovell commented on SPARK-19037: --- NVM - this fix will be in the 2.1.1 release. >

[jira] [Commented] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787995#comment-15787995 ] Herman van Hovell commented on SPARK-19037: --- This should be fixed in 2.1. See:

[jira] [Commented] (SPARK-14975) Predicted Probability per training instance for Gradient Boosted Trees in mllib.

2016-12-30 Thread Ilya Matiach (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787910#comment-15787910 ] Ilya Matiach commented on SPARK-14975: -- I can take a look into this issue. It looks like GBT needs

[jira] [Commented] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

2016-12-30 Thread Sunil Rangwani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787809#comment-15787809 ] Sunil Rangwani commented on SPARK-17463: Hi I get the same error with Spark 2.0.2 on EMR 5.2.0 I

[jira] [Commented] (SPARK-18781) Allow MatrixFactorizationModel.predict to skip user/product approximation count

2016-12-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787786#comment-15787786 ] Liang-Chi Hsieh commented on SPARK-18781: - [~eyal] Do you have estimated time cost of the

[jira] [Commented] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787733#comment-15787733 ] J.P Feng commented on SPARK-19037: -- errors logs when doing dropDuplicates with sub-query in spark-shell:

[jira] [Comment Edited] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713 ] J.P Feng edited comment on SPARK-19037 at 12/30/16 2:02 PM: errors logs when

[jira] [Updated] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.P Feng updated SPARK-19037: - Description: when i use spark-shell or spark-sql to execute count(distinct name) from subquery, some

[jira] [Updated] (SPARK-19037) Run count(distinct x) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.P Feng updated SPARK-19037: - Summary: Run count(distinct x) from sub query found some errors (was: Run count(distinct name) from sub

[jira] [Updated] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.P Feng updated SPARK-19037: - Description: when i use spark-shell or spark-sql to execute count(distinct name) from subquery, some

[jira] [Comment Edited] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713 ] J.P Feng edited comment on SPARK-19037 at 12/30/16 1:54 PM: errors logs:

[jira] [Created] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
J.P Feng created SPARK-19037: Summary: Run count(distinct name) from sub query found some errors Key: SPARK-19037 URL: https://issues.apache.org/jira/browse/SPARK-19037 Project: Spark Issue

[jira] [Commented] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787714#comment-15787714 ] J.P Feng commented on SPARK-19037: -- errors logs: > Run count(distinct name) from sub query found some

[jira] [Commented] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713 ] J.P Feng commented on SPARK-19037: -- errors logs: > Run count(distinct name) from sub query found some

[jira] [Issue Comment Deleted] (SPARK-19037) Run count(distinct name) from sub query found some errors

2016-12-30 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.P Feng updated SPARK-19037: - Comment: was deleted (was: errors logs:) > Run count(distinct name) from sub query found some errors >

[jira] [Commented] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

2016-12-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787622#comment-15787622 ] Dongjoon Hyun commented on SPARK-18857: --- Hi, [~vishalagrwal]. I agree with you. This is an

[jira] [Assigned] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18857: Assignee: (was: Apache Spark) > SparkSQL ThriftServer hangs while extracting huge

[jira] [Commented] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787618#comment-15787618 ] Apache Spark commented on SPARK-18857: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

2016-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18857: Assignee: Apache Spark > SparkSQL ThriftServer hangs while extracting huge data volumes

[jira] [Assigned] (SPARK-18808) ml.KMeansModel.transform is very inefficient

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18808: - Assignee: Sean Owen > ml.KMeansModel.transform is very inefficient >

[jira] [Resolved] (SPARK-18808) ml.KMeansModel.transform is very inefficient

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18808. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16328

[jira] [Updated] (SPARK-18808) ml.KMeansModel.transform is very inefficient

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18808: -- Priority: Minor (was: Major) > ml.KMeansModel.transform is very inefficient >

[jira] [Commented] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

2016-12-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787428#comment-15787428 ] Dongjoon Hyun commented on SPARK-18857: --- Thank you for testing and sharing that information! >

[jira] [Commented] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Sanjay Dasgupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787426#comment-15787426 ] Sanjay Dasgupta commented on SPARK-19034: - Yes, the SPARK_HOME was the issue. Apologies for the

[jira] [Resolved] (SPARK-19032) Non-deterministic results using aggregation first across multiple workers

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19032. --- Resolution: Not A Problem Agree, I don't see a reason to expect that sort order is preserved by

[jira] [Commented] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787416#comment-15787416 ] Sean Owen commented on SPARK-19035: --- The difference in behavior does sound like at least a cosmetic

[jira] [Issue Comment Deleted] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19035: -- Comment: was deleted (was: The core issue is why : select case when a=1 then 1 else *1* end b,count(1)

[jira] [Commented] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787410#comment-15787410 ] Dongjoon Hyun commented on SPARK-19034: --- Hi, [~sanjay.dasgu...@gmail.com]. I tried the binary you

[jira] [Commented] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787411#comment-15787411 ] Dongjoon Hyun commented on SPARK-19034: --- +1 > Download packages on

[jira] [Issue Comment Deleted] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated SPARK-19035: -- Comment: was deleted (was: The core issue is why : select case when a=1 then 1 else *1* end b,count(1)

[jira] [Commented] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787406#comment-15787406 ] Sean Owen commented on SPARK-19034: --- I don't see that: {code}

[jira] [Commented] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787403#comment-15787403 ] Feng Yuan commented on SPARK-19035: --- The core issue is why : select case when a=1 then 1 else *1* end

[jira] [Commented] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787402#comment-15787402 ] Feng Yuan commented on SPARK-19035: --- The core issue is why : select case when a=1 then 1 else *1* end

[jira] [Commented] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787404#comment-15787404 ] Feng Yuan commented on SPARK-19035: --- The core issue is why : select case when a=1 then 1 else *1* end

[jira] [Resolved] (SPARK-18737) Serialization setting "spark.serializer" ignored in Spark 2.x

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18737. --- Resolution: Duplicate Good find, that looks like the same issue. It looks like the resolution was

[jira] [Reopened] (SPARK-18737) Serialization setting "spark.serializer" ignored in Spark 2.x

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-18737: --- > Serialization setting "spark.serializer" ignored in Spark 2.x >

[jira] [Commented] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Sanjay Dasgupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787390#comment-15787390 ] Sanjay Dasgupta commented on SPARK-19034: - The "Direct download" link to the "Pre-built for

[jira] [Commented] (SPARK-18933) Different log output between Terminal screen and stderr file

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787331#comment-15787331 ] Sean Owen commented on SPARK-18933: --- stdout and stderr exist for all processes. You can redirect them

[jira] [Commented] (SPARK-18986) ExternalAppendOnlyMap shouldn't fail when forced to spill before calling its iterator

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787325#comment-15787325 ] Sean Owen commented on SPARK-18986: --- (Priority really doesn't mean anything. Feel free to help review

[jira] [Resolved] (SPARK-19034) Download packages on 'spark.apache.org/downloads.html' contain release 2.0.2

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19034. --- Resolution: Invalid I checked several of the 2.1.0 artifacts and they appear to contain the correct

[jira] [Resolved] (SPARK-18738) Some Spark SQL queries has poor performance on HDFS Erasure Coding feature when enabling dynamic allocation.

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18738. --- Resolution: Not A Problem I am going to close this as not a problem unless there's more info here

[jira] [Commented] (SPARK-18781) Allow MatrixFactorizationModel.predict to skip user/product approximation count

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787309#comment-15787309 ] Sean Owen commented on SPARK-18781: --- I take it back, I see why remembering the result probably doesn't

[jira] [Commented] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787298#comment-15787298 ] Sean Owen commented on SPARK-19035: --- I'm not sure that's supposed to work. You are using a in the group

[jira] [Commented] (SPARK-19036) Merging dealyed micro batches

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787290#comment-15787290 ] Sean Owen commented on SPARK-19036: --- This completely overlooks that merging batches means delaying any

[jira] [Commented] (SPARK-18930) Inserting in partitioned table - partitioned field should be last in select statement.

2016-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787284#comment-15787284 ] Sean Owen commented on SPARK-18930: --- You say the result of the select is correct. If you want a

[jira] [Updated] (SPARK-19036) Merging dealyed micro batches

2016-12-30 Thread Sungho Ham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungho Ham updated SPARK-19036: --- Summary: Merging dealyed micro batches (was: Merging dealyed micro batches for parallelism ) >

[jira] [Updated] (SPARK-19036) Merging dealyed micro batches for parallelism

2016-12-30 Thread Sungho Ham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungho Ham updated SPARK-19036: --- Component/s: Structured Streaming > Merging dealyed micro batches for parallelism >

[jira] [Updated] (SPARK-19036) Merging dealyed micro batches for parallelism

2016-12-30 Thread Sungho Ham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungho Ham updated SPARK-19036: --- Description: Efficiency of parallel execution get worsen when data is not evenly distributed by

[jira] [Updated] (SPARK-19036) Merging dealyed micro batches for parallelism

2016-12-30 Thread Sungho Ham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungho Ham updated SPARK-19036: --- Description: Efficiency of parallel execution get worsen when data is not evenly distributed by

[jira] [Updated] (SPARK-19036) Merging dealyed micro batches for parallelism

2016-12-30 Thread Sungho Ham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungho Ham updated SPARK-19036: --- Description: Efficiency of parallel execution get worsen when data is not evenly distributed by

[jira] [Created] (SPARK-19036) Merging dealyed micro batches for parallelism

2016-12-30 Thread Sungho Ham (JIRA)
Sungho Ham created SPARK-19036: -- Summary: Merging dealyed micro batches for parallelism Key: SPARK-19036 URL: https://issues.apache.org/jira/browse/SPARK-19036 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-19012) CreateOrReplaceTempView throws org.apache.spark.sql.catalyst.parser.ParseException when viewName first char is numerical

2016-12-30 Thread Jork Zijlstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787194#comment-15787194 ] Jork Zijlstra commented on SPARK-19012: --- [~hvanhovell] Its already working for me, I was already

[jira] [Updated] (SPARK-19035) rand() function in case when cause failed

2016-12-30 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated SPARK-19035: -- Summary: rand() function in case when cause failed (was: rand() function in case when cause will