[jira] [Created] (SPARK-22139) Remove the variable which is never used in SparkConf.scala

2017-09-26 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-22139: -- Summary: Remove the variable which is never used in SparkConf.scala Key: SPARK-22139 URL: https://issues.apache.org/jira/browse/SPARK-22139 Project: Spark

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182095#comment-16182095 ] Li Yuanjian commented on SPARK-22074: - Yes, that's right. > Task killed by other att

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182062#comment-16182062 ] Saisai Shao commented on SPARK-22074: - So if I understand correctly, this happens whe

[jira] [Comment Edited] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181943#comment-16181943 ] Li Yuanjian edited comment on SPARK-22074 at 9/27/17 4:46 AM: -

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181943#comment-16181943 ] Li Yuanjian commented on SPARK-22074: - Hi [~jerryshao] saisai, the 66.0 resubmitted b

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181924#comment-16181924 ] Saisai Shao commented on SPARK-22074: - Hey [~XuanYuan], I'm a little confused why the

[jira] [Commented] (SPARK-3165) DecisionTree does not use sparsity in data

2017-09-26 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-3165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181925#comment-16181925 ] Yan Facai (颜发才) commented on SPARK-3165: The PR proposed by me has been closed bec

[jira] [Commented] (SPARK-22138) Allow retry during release-build

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181917#comment-16181917 ] Apache Spark commented on SPARK-22138: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-22138) Allow retry during release-build

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22138: Assignee: holdenk (was: Apache Spark) > Allow retry during release-build > --

[jira] [Assigned] (SPARK-22138) Allow retry during release-build

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22138: Assignee: Apache Spark (was: holdenk) > Allow retry during release-build > --

[jira] [Commented] (SPARK-22129) Spark release scripts ignore the GPG_KEY and always sign with your default key

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181916#comment-16181916 ] Apache Spark commented on SPARK-22129: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-22129) Spark release scripts ignore the GPG_KEY and always sign with your default key

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22129: Assignee: Apache Spark (was: holdenk) > Spark release scripts ignore the GPG_KEY and alwa

[jira] [Assigned] (SPARK-22129) Spark release scripts ignore the GPG_KEY and always sign with your default key

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22129: Assignee: holdenk (was: Apache Spark) > Spark release scripts ignore the GPG_KEY and alwa

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2017-09-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181905#comment-16181905 ] Saisai Shao commented on SPARK-9103: Hi [~irashid], thanks a lot for your response. I

[jira] [Created] (SPARK-22138) Allow retry during release-build

2017-09-26 Thread holdenk (JIRA)
holdenk created SPARK-22138: --- Summary: Allow retry during release-build Key: SPARK-22138 URL: https://issues.apache.org/jira/browse/SPARK-22138 Project: Spark Issue Type: Improvement Comp

[jira] [Assigned] (SPARK-22112) Add missing method to pyspark api: spark.read.csv(Dataset)

2017-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22112: Assignee: Jia-Xuan Liu > Add missing method to pyspark api: spark.read.csv(Dataset) >

[jira] [Resolved] (SPARK-22112) Add missing method to pyspark api: spark.read.csv(Dataset)

2017-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22112. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19339 [https://git

[jira] [Updated] (SPARK-22123) Add latest failure reason for task set blacklist

2017-09-26 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-22123: - Description: Till now , every job which aborted by completed blacklist just show log like below which ha

[jira] [Created] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-26 Thread yzheng616 (JIRA)
yzheng616 created SPARK-22137: - Summary: Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String) Key: SPARK-22137 URL: https://issues.apache.org/jira/browse/SPARK-22137

[jira] [Commented] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

2017-09-26 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181874#comment-16181874 ] guoxiaolongzte commented on SPARK-22134: Increase the parameters spark.driver.e

[jira] [Assigned] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22135: Assignee: Apache Spark > metrics in spark-dispatcher not being registered properly > -

[jira] [Commented] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181809#comment-16181809 ] Apache Spark commented on SPARK-22135: -- User 'pmackles' has created a pull request f

[jira] [Assigned] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22135: Assignee: (was: Apache Spark) > metrics in spark-dispatcher not being registered prope

[jira] [Commented] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181804#comment-16181804 ] paul mackles commented on SPARK-22135: -- here is the PR: https://github.com/apache/sp

[jira] [Updated] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

2017-09-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22134: - Priority: Major (was: Critical) > StackOverflowError issue when applying large nested UDF calls

[jira] [Commented] (SPARK-17075) Cardinality Estimation of Predicate Expressions

2017-09-26 Thread Ron Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181793#comment-16181793 ] Ron Hu commented on SPARK-17075: This jira has been resolved. Pull request 19357 was add

[jira] [Assigned] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22136: Assignee: (was: Apache Spark) > Implement stream-stream outer joins in append mode > -

[jira] [Commented] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181789#comment-16181789 ] Apache Spark commented on SPARK-22136: -- User 'joseph-torres' has created a pull requ

[jira] [Assigned] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22136: Assignee: Apache Spark > Implement stream-stream outer joins in append mode >

[jira] [Created] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-09-26 Thread Jose Torres (JIRA)
Jose Torres created SPARK-22136: --- Summary: Implement stream-stream outer joins in append mode Key: SPARK-22136 URL: https://issues.apache.org/jira/browse/SPARK-22136 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-21322) support histogram in filter cardinality estimation

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21322: Assignee: Apache Spark > support histogram in filter cardinality estimation >

[jira] [Commented] (SPARK-21322) support histogram in filter cardinality estimation

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181787#comment-16181787 ] Apache Spark commented on SPARK-21322: -- User 'ron8hu' has created a pull request for

[jira] [Assigned] (SPARK-21322) support histogram in filter cardinality estimation

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21322: Assignee: (was: Apache Spark) > support histogram in filter cardinality estimation > -

[jira] [Commented] (SPARK-17075) Cardinality Estimation of Predicate Expressions

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181784#comment-16181784 ] Apache Spark commented on SPARK-17075: -- User 'ron8hu' has created a pull request for

[jira] [Commented] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

2017-09-26 Thread Andrew Hu Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181782#comment-16181782 ] Andrew Hu Zheng commented on SPARK-22134: - Sean, I understand what you are trying

[jira] [Comment Edited] (SPARK-19141) VectorAssembler metadata causing memory issues

2017-09-26 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174685#comment-16174685 ] Weichen Xu edited comment on SPARK-19141 at 9/27/17 12:12 AM: -

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2017-09-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181724#comment-16181724 ] Joseph K. Bradley commented on SPARK-3181: -- Re: [~sethah]'s comment about separat

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-09-26 Thread Drew Robb (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181716#comment-16181716 ] Drew Robb commented on SPARK-8288: -- I do not yet have a fully working fix. I think that t

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-09-26 Thread Jithin Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181679#comment-16181679 ] Jithin Thomas commented on SPARK-8288: -- Hi, is there a temporary fix for this issue?

[jira] [Updated] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22135: - Description: There is a bug in the way that the metrics in org.apache.spark.scheduler.cluster.mes

[jira] [Created] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
paul mackles created SPARK-22135: Summary: metrics in spark-dispatcher not being registered properly Key: SPARK-22135 URL: https://issues.apache.org/jira/browse/SPARK-22135 Project: Spark Iss

[jira] [Commented] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181650#comment-16181650 ] Sean Owen commented on SPARK-22134: --- I mean, if you chain enough method calls, of cours

[jira] [Created] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

2017-09-26 Thread Andrew Hu Zheng (JIRA)
Andrew Hu Zheng created SPARK-22134: --- Summary: StackOverflowError issue when applying large nested UDF calls Key: SPARK-22134 URL: https://issues.apache.org/jira/browse/SPARK-22134 Project: Spark

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2017-09-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181543#comment-16181543 ] Imran Rashid commented on SPARK-9103: - Hi [~jerryshao], sorry it took me a little whil

[jira] [Resolved] (SPARK-22121) Spark should fix hive table location for hdfs HA

2017-09-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22121. -- Resolution: Won't Fix Discussed with [~smilegator] on the PR, we've decided for now to mark thi

[jira] [Created] (SPARK-22133) Document Mesos reject offer duration configutations

2017-09-26 Thread Arthur Rand (JIRA)
Arthur Rand created SPARK-22133: --- Summary: Document Mesos reject offer duration configutations Key: SPARK-22133 URL: https://issues.apache.org/jira/browse/SPARK-22133 Project: Spark Issue Type:

[jira] [Created] (SPARK-22132) Document the Dispatcher REST API

2017-09-26 Thread Arthur Rand (JIRA)
Arthur Rand created SPARK-22132: --- Summary: Document the Dispatcher REST API Key: SPARK-22132 URL: https://issues.apache.org/jira/browse/SPARK-22132 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-22131) Add Mesos Secrets Support to the Mesos Driver

2017-09-26 Thread Arthur Rand (JIRA)
Arthur Rand created SPARK-22131: --- Summary: Add Mesos Secrets Support to the Mesos Driver Key: SPARK-22131 URL: https://issues.apache.org/jira/browse/SPARK-22131 Project: Spark Issue Type: New F

[jira] [Commented] (SPARK-22104) Add new option to dataframe -> parquet ==> custom extension to file name

2017-09-26 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181285#comment-16181285 ] Anbu Cheeralan commented on SPARK-22104: Here is a similar ticket for csv ==> ht

[jira] [Updated] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22130: - Issue Type: Improvement (was: Bug) > UTF8String.trim() inefficiently scans all white-spa

[jira] [Commented] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

2017-09-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181190#comment-16181190 ] Kazuaki Ishizaki commented on SPARK-16845: -- [~mvelusce] Thank you for reporting

[jira] [Assigned] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22130: Assignee: (was: Apache Spark) > UTF8String.trim() inefficiently scans all white-space

[jira] [Assigned] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22130: Assignee: Apache Spark > UTF8String.trim() inefficiently scans all white-space string twic

[jira] [Commented] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181129#comment-16181129 ] Apache Spark commented on SPARK-22130: -- User 'kiszk' has created a pull request for

[jira] [Updated] (SPARK-22121) Spark should fix hive table location for hdfs HA

2017-09-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-22121: - Description: When converting an existing hdfs setup to have multiple namenodes, users *should* r

[jira] [Commented] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181070#comment-16181070 ] Kazuaki Ishizaki commented on SPARK-22130: -- I will submit a PR soon. > UTF8Stri

[jira] [Created] (SPARK-22130) UTF8String.trim() inefficiently scans all white-space string twice.

2017-09-26 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22130: Summary: UTF8String.trim() inefficiently scans all white-space string twice. Key: SPARK-22130 URL: https://issues.apache.org/jira/browse/SPARK-22130 Project:

[jira] [Commented] (SPARK-20992) Support for Nomad as scheduler backend

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181040#comment-16181040 ] Apache Spark commented on SPARK-20992: -- User 'barnardb' has created a pull request f

[jira] [Commented] (SPARK-22104) Add new option to dataframe -> parquet ==> custom extension to file name

2017-09-26 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180988#comment-16180988 ] Anbu Cheeralan commented on SPARK-22104: [~hyukjin.kwon] Yes. I am writing files

[jira] [Updated] (SPARK-22123) Add latest failure reason for task set blacklist

2017-09-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-22123: - Component/s: Scheduler > Add latest failure reason for task set blacklist > -

[jira] [Updated] (SPARK-22123) Add latest failure reason for task set blacklist

2017-09-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-22123: - Summary: Add latest failure reason for task set blacklist (was: Add latest failure reason for ta

[jira] [Created] (SPARK-22129) Spark release scripts ignore the GPG_KEY and always sign with your default key

2017-09-26 Thread holdenk (JIRA)
holdenk created SPARK-22129: --- Summary: Spark release scripts ignore the GPG_KEY and always sign with your default key Key: SPARK-22129 URL: https://issues.apache.org/jira/browse/SPARK-22129 Project: Spark

[jira] [Commented] (SPARK-22103) Move HashAggregateExec parent consume to a separate function in codegen

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180801#comment-16180801 ] Apache Spark commented on SPARK-22103: -- User 'juliuszsompolski' has created a pull r

[jira] [Commented] (SPARK-22128) Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180745#comment-16180745 ] Apache Spark commented on SPARK-22128: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-22128) Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22128: Assignee: Sean Owen (was: Apache Spark) > Update paranamer to 2.8 to avoid BytecodeReadin

[jira] [Assigned] (SPARK-22128) Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22128: Assignee: Apache Spark (was: Sean Owen) > Update paranamer to 2.8 to avoid BytecodeReadin

[jira] [Created] (SPARK-22128) Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda

2017-09-26 Thread Sean Owen (JIRA)
Sean Owen created SPARK-22128: - Summary: Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda Key: SPARK-22128 URL: https://issues.apache.org/jira/br

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2017-09-26 Thread Lukas Rytz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180689#comment-16180689 ] Lukas Rytz commented on SPARK-14540: Ah, you just found a new bug in Scala 2.12! I cr

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180658#comment-16180658 ] Sean Owen commented on SPARK-14540: --- I might have spoken too soon. After solving some o

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180652#comment-16180652 ] Li Yuanjian commented on SPARK-22074: - Hi [~jerryshao], thanks for you comment. In m

[jira] [Assigned] (SPARK-22127) The Master Register Application Function requires an warn log to increase the waiting status

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22127: Assignee: (was: Apache Spark) > The Master Register Application Function requires an w

[jira] [Assigned] (SPARK-22127) The Master Register Application Function requires an warn log to increase the waiting status

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22127: Assignee: Apache Spark > The Master Register Application Function requires an warn log to

[jira] [Commented] (SPARK-22127) The Master Register Application Function requires an warn log to increase the waiting status

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180635#comment-16180635 ] Apache Spark commented on SPARK-22127: -- User 'guoxiaolongzte' has created a pull req

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-26 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 9/26/17 11:37 AM: --

[jira] [Created] (SPARK-22127) The Master Register Application Function requires an warn log to increase the waiting status

2017-09-26 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-22127: -- Summary: The Master Register Application Function requires an warn log to increase the waiting status Key: SPARK-22127 URL: https://issues.apache.org/jira/browse/SPARK-22127

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-26 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 9/26/17 10:27 AM: --

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-26 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 9/26/17 10:27 AM: --

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-26 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 9/26/17 10:19 AM: --

[jira] [Assigned] (SPARK-22126) Fix model-specific optimization support for ML tuning

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22126: Assignee: (was: Apache Spark) > Fix model-specific optimization support for ML tuning

[jira] [Assigned] (SPARK-22126) Fix model-specific optimization support for ML tuning

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22126: Assignee: Apache Spark > Fix model-specific optimization support for ML tuning > -

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

2017-09-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180583#comment-16180583 ] Apache Spark commented on SPARK-22126: -- User 'WeichenXu123' has created a pull reque

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-26 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 9/26/17 10:17 AM: --

[jira] [Created] (SPARK-22126) Fix model-specific optimization support for ML tuning

2017-09-26 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-22126: -- Summary: Fix model-specific optimization support for ML tuning Key: SPARK-22126 URL: https://issues.apache.org/jira/browse/SPARK-22126 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

2017-09-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16180506#comment-16180506 ] Saisai Shao commented on SPARK-22074: - Hi [~XuanYuan], can you please help me to unde

[jira] [Resolved] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22080. --- Resolution: Won't Fix > Allow developers to add pre-optimisation rules >

[jira] [Resolved] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22016. --- Resolution: Won't Fix > Add HiveDialect for JDBC connection to Hive > ---

[jira] [Resolved] (SPARK-21655) Kill CLI for Yarn mode

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21655. --- Resolution: Won't Fix > Kill CLI for Yarn mode > -- > > Key: SPAR

[jira] [Resolved] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21737. --- Resolution: Won't Fix > Create communication channel between arbitrary clients and the Spark AM in >

[jira] [Resolved] (SPARK-21235) UTest should clear temp results when run case

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21235. --- Resolution: Won't Fix > UTest should clear temp results when run case >

[jira] [Resolved] (SPARK-15574) Python meta-algorithms in Scala

2017-09-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15574. --- Resolution: Won't Fix > Python meta-algorithms in Scala > --- > >

[jira] [Assigned] (SPARK-22124) Sample and Limit should also defer input evaluation under codegen

2017-09-26 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22124: --- Assignee: Liang-Chi Hsieh > Sample and Limit should also defer input evaluation under codege

[jira] [Resolved] (SPARK-22124) Sample and Limit should also defer input evaluation under codegen

2017-09-26 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22124. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19345 [https://githu