[jira] [Commented] (SPARK-15072) Remove SparkSession.withHiveSupport

2016-05-03 Thread Sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270155#comment-15270155 ] Sagar commented on SPARK-15072: --- [~techaddict] Yes it fails as assembly/assembly removed, test is ignored

[jira] [Resolved] (SPARK-15107) Allow running test cases with different iterations in micro-benchmark util

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15107. - Resolution: Fixed Fix Version/s: 2.0.0 > Allow running test cases with different

[jira] [Commented] (SPARK-13946) PySpark DataFrames allows you to silently use aggregate expressions derived from different table expressions

2016-05-03 Thread Niranjan Molkeri` (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270151#comment-15270151 ] Niranjan Molkeri` commented on SPARK-13946: --- Hi, I ran the following code. {noformat} import

[jira] [Commented] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270123#comment-15270123 ] Felix Cheung commented on SPARK-14817: -- perhaps this SPARK-12071 should be included? > ML, Graph, R

[jira] [Commented] (SPARK-14385) Use FunctionIdentifier in FunctionRegistry/SessionCatalog

2016-05-03 Thread Niranjan Molkeri` (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270121#comment-15270121 ] Niranjan Molkeri` commented on SPARK-14385: --- Hi, I would like to take a look at the problem.

[jira] [Commented] (SPARK-15072) Remove SparkSession.withHiveSupport

2016-05-03 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270122#comment-15270122 ] Sandeep Singh commented on SPARK-15072: --- [~snanda] the first build/sbt will fail coz

[jira] [Commented] (SPARK-14539) Fetching delegation tokens in Hive-Thriftserver fails when hive.server2.enable.doAs = True

2016-05-03 Thread Niranjan Molkeri` (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270113#comment-15270113 ] Niranjan Molkeri` commented on SPARK-14539: --- Hi, Can i know which hive version are using? >

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-03 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270107#comment-15270107 ] holdenk commented on SPARK-14813: - While starting to do this audit, a number of params are missing but

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

2016-05-03 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270105#comment-15270105 ] holdenk commented on SPARK-10931: - So, just to be certain, for

[jira] [Commented] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270104#comment-15270104 ] Apache Spark commented on SPARK-15110: -- User 'NarineK' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15110: Assignee: Apache Spark > SparkR - Implement repartitionByColumn on DataFrame >

[jira] [Assigned] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15110: Assignee: (was: Apache Spark) > SparkR - Implement repartitionByColumn on DataFrame >

[jira] [Updated] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-03 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-15110: -- Description: Implement repartitionByColumn on DataFrame. This will allow us to run R

[jira] [Created] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-03 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-15110: - Summary: SparkR - Implement repartitionByColumn on DataFrame Key: SPARK-15110 URL: https://issues.apache.org/jira/browse/SPARK-15110 Project: Spark

[jira] [Commented] (SPARK-11148) Unable to create views

2016-05-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270069#comment-15270069 ] Yin Huai commented on SPARK-11148: -- Hi [~lunendl], we have cut the 2.0 branch and we are in QA period

[jira] [Assigned] (SPARK-15109) Accept Dataset[_] in joins

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15109: Assignee: Apache Spark (was: Reynold Xin) > Accept Dataset[_] in joins >

[jira] [Commented] (SPARK-15109) Accept Dataset[_] in joins

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270068#comment-15270068 ] Apache Spark commented on SPARK-15109: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15109) Accept Dataset[_] in joins

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15109: Assignee: Reynold Xin (was: Apache Spark) > Accept Dataset[_] in joins >

[jira] [Commented] (SPARK-13269) Expose more executor stats in stable status API

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270067#comment-15270067 ] Andrew Or commented on SPARK-13269: --- Oops actually this was already done in SPARK-14069. Closing this

[jira] [Resolved] (SPARK-13269) Expose more executor stats in stable status API

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13269. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.0.0 > Expose more executor

[jira] [Created] (SPARK-15109) Accept Dataset[_] in joins

2016-05-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15109: --- Summary: Accept Dataset[_] in joins Key: SPARK-15109 URL: https://issues.apache.org/jira/browse/SPARK-15109 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-15108) Function is Not Found when Describe Permanent UDTF

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270039#comment-15270039 ] Apache Spark commented on SPARK-15108: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15108) Function is Not Found when Describe Permanent UDTF

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15108: Assignee: Apache Spark > Function is Not Found when Describe Permanent UDTF >

[jira] [Assigned] (SPARK-15108) Function is Not Found when Describe Permanent UDTF

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15108: Assignee: (was: Apache Spark) > Function is Not Found when Describe Permanent UDTF >

[jira] [Updated] (SPARK-15108) Function is Not Found when Describe Permanent UDTF

2016-05-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15108: Summary: Function is Not Found when Describe Permanent UDTF (was: Function is Not Found when Describe

[jira] [Updated] (SPARK-15108) Function is Not Found when Describe Permanent UDTF

2016-05-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15108: Description: When Describe UDTF, it returns a wrong result. The command is unable to find the function,

[jira] [Created] (SPARK-15108) Function is Not Found when Describe Permanent UDF

2016-05-03 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15108: --- Summary: Function is Not Found when Describe Permanent UDF Key: SPARK-15108 URL: https://issues.apache.org/jira/browse/SPARK-15108 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15089) kafka-spark consumer with SSL problem

2016-05-03 Thread JasonChang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270030#comment-15270030 ] JasonChang commented on SPARK-15089: Hi Sean yes, broker works with SSL I run on kafka comsumer, it

[jira] [Commented] (SPARK-15072) Remove SparkSession.withHiveSupport

2016-05-03 Thread Sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270032#comment-15270032 ] Sagar commented on SPARK-15072: --- This helps to build test.jar $ ./build/sbt -Pyarn -Phadoop-2.3

[jira] [Commented] (SPARK-15032) When we create a new JDBC session, we may need to create a new session of executionHive

2016-05-03 Thread Sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270018#comment-15270018 ] Sagar commented on SPARK-15032: --- You are right! It is safer to create new session of executionHive while

[jira] [Commented] (SPARK-15063) filtering and joining back doesn't work

2016-05-03 Thread Sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270012#comment-15270012 ] Sagar commented on SPARK-15063: --- What else is required to do it in new df for each filter can you

[jira] [Commented] (SPARK-15086) Update Java API once the Scala one is finalized

2016-05-03 Thread Sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270007#comment-15270007 ] Sagar commented on SPARK-15086: --- In order to update Java API once Scala terminates. Please provide more

[jira] [Commented] (SPARK-15107) Allow running test cases with different iterations in micro-benchmark util

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270003#comment-15270003 ] Apache Spark commented on SPARK-15107: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15107) Allow running test cases with different iterations in micro-benchmark util

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15107: Assignee: Reynold Xin (was: Apache Spark) > Allow running test cases with different

[jira] [Assigned] (SPARK-15107) Allow running test cases with different iterations in micro-benchmark util

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15107: Assignee: Apache Spark (was: Reynold Xin) > Allow running test cases with different

[jira] [Created] (SPARK-15107) Allow running test cases with different iterations in micro-benchmark util

2016-05-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15107: --- Summary: Allow running test cases with different iterations in micro-benchmark util Key: SPARK-15107 URL: https://issues.apache.org/jira/browse/SPARK-15107 Project:

[jira] [Updated] (SPARK-14645) non local Python resource doesn't work with Mesos cluster mode

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14645: -- Assignee: Timothy Chen > non local Python resource doesn't work with Mesos cluster mode >

[jira] [Resolved] (SPARK-14414) Make error messages consistent across DDLs

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14414. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make error messages consistent across DDLs >

[jira] [Resolved] (SPARK-15097) Import fails for someDataset.sqlContext.implicits._

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15097. --- Resolution: Fixed Assignee: Koert Kuipers Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15084) Use builder pattern to create SparkSession in PySpark

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15084. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use builder

[jira] [Resolved] (SPARK-14645) non local Python resource doesn't work with Mesos cluster mode

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14645. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > non local Python

[jira] [Updated] (SPARK-14422) Improve handling of optional configs in SQLConf

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14422: -- Assignee: Sandeep Singh > Improve handling of optional configs in SQLConf >

[jira] [Resolved] (SPARK-14422) Improve handling of optional configs in SQLConf

2016-05-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14422. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Improve handling

[jira] [Assigned] (SPARK-15106) Add package documentation for ML and remove BETA from Scala & Java for ML pipeline API.

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15106: Assignee: (was: Apache Spark) > Add package documentation for ML and remove BETA from

[jira] [Commented] (SPARK-15106) Add package documentation for ML and remove BETA from Scala & Java for ML pipeline API.

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269901#comment-15269901 ] Apache Spark commented on SPARK-15106: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15106) Add package documentation for ML and remove BETA from Scala & Java for ML pipeline API.

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15106: Assignee: Apache Spark > Add package documentation for ML and remove BETA from Scala &

[jira] [Created] (SPARK-15106) Add package documentation for ML and remove BETA from Scala & Java for ML pipeline API.

2016-05-03 Thread holdenk (JIRA)
holdenk created SPARK-15106: --- Summary: Add package documentation for ML and remove BETA from Scala & Java for ML pipeline API. Key: SPARK-15106 URL: https://issues.apache.org/jira/browse/SPARK-15106

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-03 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269827#comment-15269827 ] holdenk commented on SPARK-14813: - I'm happy to start doing a first pass on this later on this week if no

[jira] [Commented] (SPARK-14772) Python ML Params.copy treats uid, paramMaps differently than Scala

2016-05-03 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269824#comment-15269824 ] holdenk commented on SPARK-14772: - I can take a look at this if no one else is working on it and it

[jira] [Commented] (SPARK-15096) LogisticRegression MultiClassSummarizer numClasses can fail if no valid labels are found

2016-05-03 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269776#comment-15269776 ] Miao Wang commented on SPARK-15096: --- If nobody is working on this one, I will work on this one now.

[jira] [Commented] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-05-03 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269775#comment-15269775 ] Xin Ren commented on SPARK-14817: - ok, I'll start looking for new APIs. So just create new tickets

[jira] [Commented] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-03 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269768#comment-15269768 ] Miao Wang commented on SPARK-15101: --- [~josephkb] I want to know how to work on these kind of JIRAs. For

[jira] [Assigned] (SPARK-14900) spark.ml classification metrics should include accuracy

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14900: Assignee: (was: Apache Spark) > spark.ml classification metrics should include

[jira] [Assigned] (SPARK-14900) spark.ml classification metrics should include accuracy

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14900: Assignee: Apache Spark > spark.ml classification metrics should include accuracy >

[jira] [Commented] (SPARK-14900) spark.ml classification metrics should include accuracy

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269754#comment-15269754 ] Apache Spark commented on SPARK-14900: -- User 'wangmiao1981' has created a pull request for this

[jira] [Commented] (SPARK-13269) Expose more executor stats in stable status API

2016-05-03 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269738#comment-15269738 ] Alex Bozarth commented on SPARK-13269: -- Hey [~andrewor14], I was interested in this and took a look

[jira] [Commented] (SPARK-15095) Drop binary mode in ThriftServer

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269719#comment-15269719 ] Apache Spark commented on SPARK-15095: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-15105) Remove HiveSessionHook from ThriftServer

2016-05-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15105: -- Summary: Remove HiveSessionHook from ThriftServer Key: SPARK-15105 URL: https://issues.apache.org/jira/browse/SPARK-15105 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15102) remove delegation token from ThriftServer

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269700#comment-15269700 ] Apache Spark commented on SPARK-15102: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15104) Bad spacing in log line

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15104. - Resolution: Fixed Assignee: Andrew Ash Fix Version/s: 2.0.0 > Bad spacing in log

[jira] [Resolved] (SPARK-15102) remove delegation token from ThriftServer

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15102. - Resolution: Fixed Fix Version/s: 2.0.0 > remove delegation token from ThriftServer >

[jira] [Assigned] (SPARK-15104) Bad spacing in log line

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15104: Assignee: Apache Spark > Bad spacing in log line > --- > >

[jira] [Commented] (SPARK-15104) Bad spacing in log line

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269648#comment-15269648 ] Apache Spark commented on SPARK-15104: -- User 'ash211' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15104) Bad spacing in log line

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15104: Assignee: (was: Apache Spark) > Bad spacing in log line > --- > >

[jira] [Created] (SPARK-15104) Bad spacing in log line

2016-05-03 Thread Andrew Ash (JIRA)
Andrew Ash created SPARK-15104: -- Summary: Bad spacing in log line Key: SPARK-15104 URL: https://issues.apache.org/jira/browse/SPARK-15104 Project: Spark Issue Type: Bug Affects Versions:

[jira] [Closed] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9466. -- Resolution: Auto Closed > Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite >

[jira] [Closed] (SPARK-12008) Spark hive security authorization doesn't work as Apache hive's

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12008. --- Resolution: Invalid Marking this as invalid since these are unsupported for now. We might add

[jira] [Commented] (SPARK-15103) Add support for batch jobs correctly inferring partitions from data written with file stream sink

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269632#comment-15269632 ] Apache Spark commented on SPARK-15103: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15103) Add support for batch jobs correctly inferring partitions from data written with file stream sink

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15103: Assignee: Tathagata Das (was: Apache Spark) > Add support for batch jobs correctly

[jira] [Assigned] (SPARK-15103) Add support for batch jobs correctly inferring partitions from data written with file stream sink

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15103: Assignee: Apache Spark (was: Tathagata Das) > Add support for batch jobs correctly

[jira] [Closed] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12066. --- Resolution: Cannot Reproduce Closing as cannot reproduce for now. > spark sql throw

[jira] [Commented] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

2016-05-03 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269620#comment-15269620 ] Dongjoon Hyun commented on SPARK-15037: --- Sure. Go ahead if you want. This is still blocked by

[jira] [Resolved] (SPARK-15056) Parse Unsupported Sampling Syntax and Issue Better Exceptions

2016-05-03 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-15056. --- Resolution: Fixed Assignee: Xiao Li > Parse Unsupported Sampling Syntax and

[jira] [Created] (SPARK-15103) Add support for batch jobs correctly inferring partitions from data written with file stream sink

2016-05-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-15103: - Summary: Add support for batch jobs correctly inferring partitions from data written with file stream sink Key: SPARK-15103 URL:

[jira] [Resolved] (SPARK-13971) Implicit group by with distinct modifier on having raises an unexpected error

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13971. - Resolution: Fixed Fix Version/s: 2.0.0 > Implicit group by with distinct modifier on

[jira] [Resolved] (SPARK-14973) The CrossValidator and TrainValidationSplit miss the seed when saving and loading

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14973. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12825

[jira] [Updated] (SPARK-15102) remove delegation token from ThriftServer

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15102: Issue Type: Sub-task (was: Bug) Parent: SPARK-14987 > remove delegation token from

[jira] [Updated] (SPARK-14973) The CrossValidator and TrainValidationSplit miss the seed when saving and loading

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14973: -- Shepherd: Joseph K. Bradley > The CrossValidator and TrainValidationSplit miss the

[jira] [Updated] (SPARK-15095) Drop binary mode in ThriftServer

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15095: Issue Type: Sub-task (was: Bug) Parent: SPARK-14987 > Drop binary mode in ThriftServer >

[jira] [Updated] (SPARK-14973) The CrossValidator and TrainValidationSplit miss the seed when saving and loading

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14973: -- Assignee: Xusen Yin > The CrossValidator and TrainValidationSplit miss the seed when

[jira] [Closed] (SPARK-10152) Support Init script for hive-thriftserver

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-10152. --- Resolution: Won't Fix > Support Init script for hive-thriftserver >

[jira] [Created] (SPARK-15102) remove delegation token from ThriftServer

2016-05-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15102: -- Summary: remove delegation token from ThriftServer Key: SPARK-15102 URL: https://issues.apache.org/jira/browse/SPARK-15102 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-15095) Drop binary mode in ThriftServer

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15095. - Resolution: Fixed Fix Version/s: 2.0.0 > Drop binary mode in ThriftServer >

[jira] [Created] (SPARK-15100) Audit: ml.feature

2016-05-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15100: - Summary: Audit: ml.feature Key: SPARK-15100 URL: https://issues.apache.org/jira/browse/SPARK-15100 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269588#comment-15269588 ] Joseph K. Bradley commented on SPARK-14817: --- [~BenFradet] [~iamshrek] [~podongfeng] [~wm624] If

[jira] [Created] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15101: - Summary: Audit: ml.clustering and ml.recommendation Key: SPARK-15101 URL: https://issues.apache.org/jira/browse/SPARK-15101 Project: Spark Issue

[jira] [Created] (SPARK-15098) Audit: ml.classification

2016-05-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15098: - Summary: Audit: ml.classification Key: SPARK-15098 URL: https://issues.apache.org/jira/browse/SPARK-15098 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-15099) Audit: ml.regression

2016-05-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15099: - Summary: Audit: ml.regression Key: SPARK-15099 URL: https://issues.apache.org/jira/browse/SPARK-15099 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new features & APIs

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269581#comment-15269581 ] Joseph K. Bradley commented on SPARK-14815: --- I'll go ahead and create subtasks for auditing

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14808: -- Description: This JIRA lists tasks for the next Spark release's QA period for MLlib,

[jira] [Closed] (SPARK-14809) Examples: Check for new APIs requiring example code in 2.0

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14809. - Resolution: Duplicate This used to be relevant when examples & the user guide were

[jira] [Updated] (SPARK-14809) Examples: Check for new APIs requiring example code in 2.0

2016-05-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14809: -- Issue Type: Documentation (was: Sub-task) Parent: (was: SPARK-14808) >

[jira] [Resolved] (SPARK-15073) Make SparkSession constructors private

2016-05-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15073. - Resolution: Fixed > Make SparkSession constructors private >

[jira] [Assigned] (SPARK-15097) Import fails for someDataset.sqlContext.implicits._

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15097: Assignee: (was: Apache Spark) > Import fails for someDataset.sqlContext.implicits._ >

[jira] [Commented] (SPARK-15097) Import fails for someDataset.sqlContext.implicits._

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269548#comment-15269548 ] Apache Spark commented on SPARK-15097: -- User 'koertkuipers' has created a pull request for this

[jira] [Assigned] (SPARK-15097) Import fails for someDataset.sqlContext.implicits._

2016-05-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15097: Assignee: Apache Spark > Import fails for someDataset.sqlContext.implicits._ >

[jira] [Resolved] (SPARK-11316) coalesce doesn't handle UnionRDD with partial locality properly

2016-05-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11316. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11327

[jira] [Resolved] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS

2016-05-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14521. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12598

[jira] [Resolved] (SPARK-14234) Executor crashes for TaskRunner thread interruption

2016-05-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14234. -- Resolution: Fixed Assignee: Devaraj K Fix Version/s: 2.0.0 > Executor crashes

[jira] [Comment Edited] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

2016-05-03 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269475#comment-15269475 ] Sandeep Singh edited comment on SPARK-15037 at 5/3/16 8:22 PM: --- [~dongjoon]

  1   2   3   >