[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-26 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213363#comment-15213363 ] koert kuipers commented on SPARK-13531: --- oh its because statistics for UnaryNode is

[jira] [Commented] (SPARK-14181) TrainValidationSplit should have HasSeed

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213362#comment-15213362 ] Apache Spark commented on SPARK-14181: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-14181) TrainValidationSplit should have HasSeed

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14181: Assignee: (was: Apache Spark) > TrainValidationSplit should have HasSeed > ---

[jira] [Assigned] (SPARK-14181) TrainValidationSplit should have HasSeed

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14181: Assignee: Apache Spark > TrainValidationSplit should have HasSeed > --

[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-26 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213361#comment-15213361 ] koert kuipers commented on SPARK-13531: --- before the optimization both MapPartitions

[jira] [Created] (SPARK-14181) TrainValidationSplit should have HasSeed

2016-03-26 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-14181: - Summary: TrainValidationSplit should have HasSeed Key: SPARK-14181 URL: https://issues.apache.org/jira/browse/SPARK-14181 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213359#comment-15213359 ] Yanbo Liang commented on SPARK-13783: - [~GayathriMurali] Please go first, I will help

[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-26 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213358#comment-15213358 ] koert kuipers commented on SPARK-13531: --- i did a little more digging and i think th

[jira] [Commented] (SPARK-13786) Pyspark ml.tuning support export/import

2016-03-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213357#comment-15213357 ] Xusen Yin commented on SPARK-13786: --- I have finished the CrossValidator, but need to wa

[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213327#comment-15213327 ] Apache Spark commented on SPARK-14138: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14138: Assignee: (was: Apache Spark) > Generated SpecificColumnarIterator code can exceed JVM

[jira] [Assigned] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14138: Assignee: Apache Spark > Generated SpecificColumnarIterator code can exceed JVM size limit

[jira] [Updated] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14177: - Assignee: Xiao Li > Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES" > --

[jira] [Resolved] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14177. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11977 [https://github.com/

[jira] [Updated] (SPARK-14157) Parse Drop Function DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14157: - Assignee: Liang-Chi Hsieh > Parse Drop Function DDL command > --- > >

[jira] [Resolved] (SPARK-14157) Parse Drop Function DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14157. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11959 [https://github.com/

[jira] [Commented] (SPARK-14033) Merging Estimator & Model

2016-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213274#comment-15213274 ] Joseph K. Bradley commented on SPARK-14033: --- We've been using "MLlib" to refer

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-14100: - Assignee: Joseph K. Bradley > Merge StringIndexer and StringIndexerModel > -

[jira] [Commented] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213272#comment-15213272 ] Apache Spark commented on SPARK-14100: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14100: Assignee: (was: Apache Spark) > Merge StringIndexer and StringIndexerModel > -

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14100: Assignee: Apache Spark > Merge StringIndexer and StringIndexerModel >

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Marcin Tustin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213249#comment-15213249 ] Marcin Tustin commented on SPARK-14163: --- PR for this here: https://github.com/apach

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213248#comment-15213248 ] Apache Spark commented on SPARK-14163: -- User 'mtustin-handy' has created a pull requ

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-03-26 Thread Derrick Burns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213247#comment-15213247 ] Derrick Burns commented on SPARK-3220: -- Thank you! Spark by Readdle(https:/

[jira] [Assigned] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14163: Assignee: (was: Apache Spark) > SumEvaluator and countApprox cannot reliably handle RD

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213246#comment-15213246 ] Apache Spark commented on SPARK-14163: -- User 'yongtang' has created a pull request f

[jira] [Assigned] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14163: Assignee: Apache Spark > SumEvaluator and countApprox cannot reliably handle RDDs of size

[jira] [Resolved] (SPARK-14116) buildReader implementation for ORC

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14116. -- Resolution: Fixed Issue resolved by pull request 11936 [https://github.com/apache/spark/pull/11936] >

[jira] [Commented] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

2016-03-26 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213206#comment-15213206 ] holdenk commented on SPARK-14141: - Its doable, but I'm not sure it belongs in Spark its s

[jira] [Updated] (SPARK-14161) Parse Drop Database DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14161: - Assignee: Xiao Li > Parse Drop Database DDL command > --- > >

[jira] [Resolved] (SPARK-14161) Parse Drop Database DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14161. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11962 [https://github.com/

[jira] [Commented] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

2016-03-26 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213199#comment-15213199 ] Luke Miner commented on SPARK-14141: If that's the case, it sounds like it is doable.

[jira] [Assigned] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14139: Assignee: (was: Apache Spark) > Dataset loses nullability in operations with RowEncode

[jira] [Commented] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213196#comment-15213196 ] Apache Spark commented on SPARK-14139: -- User 'koertkuipers' has created a pull reque

[jira] [Assigned] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14139: Assignee: Apache Spark > Dataset loses nullability in operations with RowEncoder > ---

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-14180: Description: I'm fairly certain that https://github.com/apache/spark/pull/11031 introduced

[jira] [Commented] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213184#comment-15213184 ] Michael Gummelt commented on SPARK-14180: - cc [~zsxwing] > Deadlock in CoarseGra

[jira] [Created] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-14180: --- Summary: Deadlock in CoarseGrainedExecutorBackend Shutdown Key: SPARK-14180 URL: https://issues.apache.org/jira/browse/SPARK-14180 Project: Spark Issue

[jira] [Updated] (SPARK-14179) Improve Dataset performance

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14179: Description: This is a ticket for a few things that can improve dataset performance. was: This

[jira] [Created] (SPARK-14179) Improve Dataset performance

2016-03-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14179: --- Summary: Improve Dataset performance Key: SPARK-14179 URL: https://issues.apache.org/jira/browse/SPARK-14179 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-14175) Simplify whole stage codegen interface

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14175. - Resolution: Fixed Fix Version/s: 2.0.0 > Simplify whole stage codegen interface >

[jira] [Resolved] (SPARK-14135) Add off-heap storage memory bookkeeping support to MemoryManager

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14135. - Resolution: Fixed Fix Version/s: 2.0.0 > Add off-heap storage memory bookkeeping support t

[jira] [Commented] (SPARK-14123) Function related commands

2016-03-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213130#comment-15213130 ] Bo Meng commented on SPARK-14123: - For throwing exception, I think [~andrewor14](SPARK-14

[jira] [Commented] (SPARK-14125) View related commands

2016-03-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213078#comment-15213078 ] Xiao Li commented on SPARK-14125: - This needs to parse Alter View at first. Will do it so

[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213071#comment-15213071 ] Kazuaki Ishizaki commented on SPARK-14138: -- I will make a PR that includes two s

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-03-26 Thread burness duan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213059#comment-15213059 ] burness duan commented on SPARK-3220: - I have use this Derrick's kmeans, It is efficie

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-26 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213012#comment-15213012 ] Sun Rui commented on SPARK-14147: - this makes sense to me. [~Narine], does this solve you

[jira] [Resolved] (SPARK-2208) local metrics tests can fail on fast machines

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2208. -- Resolution: Won't Fix Fix Version/s: (was: 2.0.0) > local metrics tests can fail on fast mach

[jira] [Reopened] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14173: --- OK that might be legitimate. The code that would generate this message is: {code} private def ignoreNo

[jira] [Assigned] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12494: Assignee: (was: Apache Spark) > Array out of bound Exception in KMeans Yarn Mode > ---

[jira] [Assigned] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12494: Assignee: Apache Spark > Array out of bound Exception in KMeans Yarn Mode > --

[jira] [Commented] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212999#comment-15212999 ] Apache Spark commented on SPARK-12494: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread liyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212993#comment-15212993 ] liyan commented on SPARK-14173: --- hi Owen: What I used is java *SparkLauncher* interface, t

[jira] [Resolved] (SPARK-13973) `ipython notebook` is going away...

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13973. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11829 [https://github.co

[jira] [Updated] (SPARK-13973) `ipython notebook` is going away...

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13973: -- Assignee: Rekha Joshi > `ipython notebook` is going away... > --- > >

[jira] [Reopened] (SPARK-14102) Block `reset` command in SparkShell

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14102: --- > Block `reset` command in SparkShell > --- > > Key: SPAR

[jira] [Updated] (SPARK-14089) Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14089: -- Assignee: Liwei Lin > Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x > --

[jira] [Resolved] (SPARK-14089) Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14089. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11910 [https://github.co

[jira] [Resolved] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14173. --- Resolution: Not A Problem It's not clear what you're reporting here. How did you set the property? It

[jira] [Commented] (SPARK-14178) DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSerializedMapOutputStatuses.

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212973#comment-15212973 ] Sean Owen commented on SPARK-14178: --- It's not clear what change you are proposing -- ho

[jira] [Assigned] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14113: Assignee: Apache Spark > Consider marking JobConf closure-cleaning in HadoopRDD as optiona

[jira] [Assigned] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14113: Assignee: (was: Apache Spark) > Consider marking JobConf closure-cleaning in HadoopRDD

[jira] [Commented] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212895#comment-15212895 ] Apache Spark commented on SPARK-14113: -- User 'rajeshbalamohan' has created a pull re

[jira] [Resolved] (SPARK-13874) Move docs of streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13874. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Move docs of stre

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf hive.exec.max.dynamic.partitions=

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf hive.exec.max.dynamic.partitions=

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf hive.exec.max.dynamic.partitions=

[jira] [Updated] (SPARK-14178) DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSerializedMapOutputStatuses.

2016-03-26 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-14178: Summary: DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSer

[jira] [Created] (SPARK-14178) Compare Option[String] and String directly

2016-03-26 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-14178: --- Summary: Compare Option[String] and String directly Key: SPARK-14178 URL: https://issues.apache.org/jira/browse/SPARK-14178 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212852#comment-15212852 ] Apache Spark commented on SPARK-14177: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14177: Assignee: Apache Spark > Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DB

[jira] [Assigned] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14177: Assignee: (was: Apache Spark) > Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATA