[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213327#comment-15213327 ] Apache Spark commented on SPARK-14138: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14138: Assignee: (was: Apache Spark) > Generated SpecificColumnarIterator code can exceed

[jira] [Assigned] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14138: Assignee: Apache Spark > Generated SpecificColumnarIterator code can exceed JVM size

[jira] [Updated] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14177: - Assignee: Xiao Li > Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES" >

[jira] [Resolved] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14177. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11977

[jira] [Updated] (SPARK-14157) Parse Drop Function DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14157: - Assignee: Liang-Chi Hsieh > Parse Drop Function DDL command > --- > >

[jira] [Resolved] (SPARK-14157) Parse Drop Function DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14157. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11959

[jira] [Commented] (SPARK-14033) Merging Estimator & Model

2016-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213274#comment-15213274 ] Joseph K. Bradley commented on SPARK-14033: --- We've been using "MLlib" to refer to both

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-14100: - Assignee: Joseph K. Bradley > Merge StringIndexer and StringIndexerModel >

[jira] [Commented] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213272#comment-15213272 ] Apache Spark commented on SPARK-14100: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14100: Assignee: (was: Apache Spark) > Merge StringIndexer and StringIndexerModel >

[jira] [Assigned] (SPARK-14100) Merge StringIndexer and StringIndexerModel

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14100: Assignee: Apache Spark > Merge StringIndexer and StringIndexerModel >

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Marcin Tustin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213249#comment-15213249 ] Marcin Tustin commented on SPARK-14163: --- PR for this here:

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213248#comment-15213248 ] Apache Spark commented on SPARK-14163: -- User 'mtustin-handy' has created a pull request for this

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-03-26 Thread Derrick Burns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213247#comment-15213247 ] Derrick Burns commented on SPARK-3220: -- Thank you! Spark by

[jira] [Assigned] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14163: Assignee: (was: Apache Spark) > SumEvaluator and countApprox cannot reliably handle

[jira] [Commented] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213246#comment-15213246 ] Apache Spark commented on SPARK-14163: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14163) SumEvaluator and countApprox cannot reliably handle RDDs of size 1

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14163: Assignee: Apache Spark > SumEvaluator and countApprox cannot reliably handle RDDs of size

[jira] [Resolved] (SPARK-14116) buildReader implementation for ORC

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14116. -- Resolution: Fixed Issue resolved by pull request 11936 [https://github.com/apache/spark/pull/11936] >

[jira] [Commented] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

2016-03-26 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213206#comment-15213206 ] holdenk commented on SPARK-14141: - Its doable, but I'm not sure it belongs in Spark its self. Maybe

[jira] [Updated] (SPARK-14161) Parse Drop Database DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14161: - Assignee: Xiao Li > Parse Drop Database DDL command > --- > >

[jira] [Resolved] (SPARK-14161) Parse Drop Database DDL command

2016-03-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14161. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11962

[jira] [Commented] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

2016-03-26 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213199#comment-15213199 ] Luke Miner commented on SPARK-14141: If that's the case, it sounds like it is doable. One way would

[jira] [Commented] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213196#comment-15213196 ] Apache Spark commented on SPARK-14139: -- User 'koertkuipers' has created a pull request for this

[jira] [Assigned] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14139: Assignee: (was: Apache Spark) > Dataset loses nullability in operations with

[jira] [Assigned] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14139: Assignee: Apache Spark > Dataset loses nullability in operations with RowEncoder >

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-14180: Description: I'm fairly certain that https://github.com/apache/spark/pull/11031 introduced

[jira] [Commented] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213184#comment-15213184 ] Michael Gummelt commented on SPARK-14180: - cc [~zsxwing] > Deadlock in

[jira] [Created] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-14180: --- Summary: Deadlock in CoarseGrainedExecutorBackend Shutdown Key: SPARK-14180 URL: https://issues.apache.org/jira/browse/SPARK-14180 Project: Spark

[jira] [Updated] (SPARK-14179) Improve Dataset performance

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14179: Description: This is a ticket for a few things that can improve dataset performance. was: This

[jira] [Created] (SPARK-14179) Improve Dataset performance

2016-03-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14179: --- Summary: Improve Dataset performance Key: SPARK-14179 URL: https://issues.apache.org/jira/browse/SPARK-14179 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-14175) Simplify whole stage codegen interface

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14175. - Resolution: Fixed Fix Version/s: 2.0.0 > Simplify whole stage codegen interface >

[jira] [Resolved] (SPARK-14135) Add off-heap storage memory bookkeeping support to MemoryManager

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14135. - Resolution: Fixed Fix Version/s: 2.0.0 > Add off-heap storage memory bookkeeping support

[jira] [Commented] (SPARK-14123) Function related commands

2016-03-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213130#comment-15213130 ] Bo Meng commented on SPARK-14123: - For throwing exception, I think [~andrewor14](SPARK-14119) has already

[jira] [Commented] (SPARK-14125) View related commands

2016-03-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213078#comment-15213078 ] Xiao Li commented on SPARK-14125: - This needs to parse Alter View at first. Will do it soon. > View

[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-03-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213071#comment-15213071 ] Kazuaki Ishizaki commented on SPARK-14138: -- I will make a PR that includes two solutions: 1.

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-03-26 Thread burness duan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213059#comment-15213059 ] burness duan commented on SPARK-3220: - I have use this Derrick's kmeans, It is efficient in our

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

2016-03-26 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213012#comment-15213012 ] Sun Rui commented on SPARK-14147: - this makes sense to me. [~Narine], does this solve your problem? >

[jira] [Resolved] (SPARK-2208) local metrics tests can fail on fast machines

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2208. -- Resolution: Won't Fix Fix Version/s: (was: 2.0.0) > local metrics tests can fail on fast

[jira] [Reopened] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14173: --- OK that might be legitimate. The code that would generate this message is: {code} private def

[jira] [Assigned] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12494: Assignee: (was: Apache Spark) > Array out of bound Exception in KMeans Yarn Mode >

[jira] [Assigned] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12494: Assignee: Apache Spark > Array out of bound Exception in KMeans Yarn Mode >

[jira] [Commented] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212999#comment-15212999 ] Apache Spark commented on SPARK-12494: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread liyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212993#comment-15212993 ] liyan commented on SPARK-14173: --- hi Owen: What I used is java *SparkLauncher* interface, the code is as

[jira] [Resolved] (SPARK-13973) `ipython notebook` is going away...

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13973. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11829

[jira] [Updated] (SPARK-13973) `ipython notebook` is going away...

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13973: -- Assignee: Rekha Joshi > `ipython notebook` is going away... > --- > >

[jira] [Reopened] (SPARK-14102) Block `reset` command in SparkShell

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14102: --- > Block `reset` command in SparkShell > --- > > Key:

[jira] [Updated] (SPARK-14089) Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14089: -- Assignee: Liwei Lin > Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x >

[jira] [Resolved] (SPARK-14089) Remove methods that has been deprecated since 1.1.x, 1.2.x and 1.3.x

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14089. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11910

[jira] [Resolved] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14173. --- Resolution: Not A Problem It's not clear what you're reporting here. How did you set the property?

[jira] [Commented] (SPARK-14178) DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSerializedMapOutputStatuses.

2016-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212973#comment-15212973 ] Sean Owen commented on SPARK-14178: --- It's not clear what change you are proposing -- how should it get

[jira] [Assigned] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14113: Assignee: Apache Spark > Consider marking JobConf closure-cleaning in HadoopRDD as

[jira] [Assigned] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14113: Assignee: (was: Apache Spark) > Consider marking JobConf closure-cleaning in

[jira] [Commented] (SPARK-14113) Consider marking JobConf closure-cleaning in HadoopRDD as optional

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212895#comment-15212895 ] Apache Spark commented on SPARK-14113: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Resolved] (SPARK-13874) Move docs of streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13874. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Move docs of

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-03-26 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf

[jira] [Updated] (SPARK-14178) DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSerializedMapOutputStatuses.

2016-03-26 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-14178: Summary: DAGScheduler should get map output statuses directly, not by

[jira] [Created] (SPARK-14178) Compare Option[String] and String directly

2016-03-26 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-14178: --- Summary: Compare Option[String] and String directly Key: SPARK-14178 URL: https://issues.apache.org/jira/browse/SPARK-14178 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212852#comment-15212852 ] Apache Spark commented on SPARK-14177: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14177: Assignee: Apache Spark > Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET

[jira] [Assigned] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14177: Assignee: (was: Apache Spark) > Parse DDL command: "DESCRIBE DATABASE" and "ALTER

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212848#comment-15212848 ] Jeff Zhang commented on SPARK-13587: bq. Have you considered using NFS or Amazon EFS to allow users

[jira] [Updated] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14177: Description: Based on the Hive DDL document

[jira] [Created] (SPARK-14177) Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES"

2016-03-26 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14177: --- Summary: Parse DDL command: "DESCRIBE DATABASE" and "ALTER DATABASE SET DBPROPERTIES" Key: SPARK-14177 URL: https://issues.apache.org/jira/browse/SPARK-14177 Project: Spark