[jira] [Assigned] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-15959: Assignee: Yin Huai > Add the support of hive.metastore.warehouse.dir back >

[jira] [Closed] (SPARK-15961) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-15961. - Resolution: Duplicate > Audit new SQL confs > > >

[jira] [Updated] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15959: - Labels: release_notes releasenotes (was: ) > Add the support of hive.metastore.warehouse.dir back >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331168#comment-15331168 ] Jinxia Liu commented on SPARK-12177: Thanks Cody! > Update KafkaDStreams to new Kafka 0.10 Consumer

[jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-06-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331132#comment-15331132 ] Imran Rashid commented on SPARK-15815: -- [~SuYan] is this the same as

[jira] [Updated] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-06-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-15815: - Component/s: Scheduler > Hang while enable blacklistExecutor and DynamicExecutorAllocator >

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331119#comment-15331119 ] Reynold Xin commented on SPARK-13928: - It was never meant to be public (the comment had a note saying

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331114#comment-15331114 ] Cody Koeninger commented on SPARK-12177: [~jinx...@ebay.com] looks like that test had some flaky

[jira] [Created] (SPARK-15961) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15961: - Summary: Audit new SQL confs Key: SPARK-15961 URL: https://issues.apache.org/jira/browse/SPARK-15961 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15960) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15960: - Summary: Audit new SQL confs Key: SPARK-15960 URL: https://issues.apache.org/jira/browse/SPARK-15960 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15824) Run 'with ... insert ... select' failed when use spark thriftserver

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331027#comment-15331027 ] Apache Spark commented on SPARK-15824: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331026#comment-15331026 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for the quick reply. 1. glad to

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331021#comment-15331021 ] Cody Koeninger commented on SPARK-12177: [~jinx...@ebay.com] 1. I'm already looking at that test

[jira] [Created] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-15959: Summary: Add the support of hive.metastore.warehouse.dir back Key: SPARK-15959 URL: https://issues.apache.org/jira/browse/SPARK-15959 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331007#comment-15331007 ] Jinxia Liu edited comment on SPARK-12177 at 6/15/16 2:29 AM: -

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331007#comment-15331007 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for contributing the connector for

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331005#comment-15331005 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for contributing the connector for

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331003#comment-15331003 ] Cody Koeninger commented on SPARK-12177: I had verified basic functionality with a broker set up

[jira] [Resolved] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15952. - Resolution: Fixed Assignee: Bo Meng Fix Version/s: 2.0.0 > "show databases" does

[jira] [Resolved] (SPARK-15945) Implement conversion utils in Scala/Java

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15945. - Resolution: Fixed > Implement conversion utils in Scala/Java >

[jira] [Resolved] (SPARK-15065) HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is flaky

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15065. -- Resolution: Fixed Fix Version/s: 2.0.0 > HiveSparkSubmitSuite's "set spark.sql.warehouse.dir"

[jira] [Commented] (SPARK-15065) HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is flaky

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330999#comment-15330999 ] Yin Huai commented on SPARK-15065: -- Thanks. I took a look at jenkins' history. Looks like it is good

[jira] [Resolved] (SPARK-15631) Dataset and encoder bug fixes

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15631. -- Resolution: Fixed Fix Version/s: 2.0.0 > Dataset and encoder bug fixes >

[jira] [Resolved] (SPARK-12323) Don't assign default value for non-nullable columns of a Dataset

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12323. -- Resolution: Fixed Fix Version/s: 2.0.0 > Don't assign default value for non-nullable columns of

[jira] [Resolved] (SPARK-15011) org.apache.spark.sql.hive.StatisticsSuite.analyze MetastoreRelations fails when hadoop 2.3 or hadoop 2.4 is used

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15011. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-15933) Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-15933. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13653

[jira] [Created] (SPARK-15958) Make initial buffer size for the Sorter configurable

2016-06-14 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-15958: --- Summary: Make initial buffer size for the Sorter configurable Key: SPARK-15958 URL: https://issues.apache.org/jira/browse/SPARK-15958 Project: Spark Issue

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Assignee: (was: Yanbo Liang) > RFormula supports forcing to index label >

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type currently. If the label is

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: Apache Spark > When unwrapping ORC avoid pattern matching at runtime >

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: Apache Spark > When unwrapping ORC avoid pattern matching at runtime >

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: (was: Apache Spark) > When unwrapping ORC avoid pattern matching at runtime

[jira] [Commented] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330946#comment-15330946 ] Apache Spark commented on SPARK-15956: -- User 'dafrista' has created a pull request for this issue:

[jira] [Commented] (SPARK-3451) spark-submit should support specifying glob wildcards in the --jars CLI option

2016-06-14 Thread Kun Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330945#comment-15330945 ] Kun Liu commented on SPARK-3451: Vote for this feature. If no one will, I may try as my first time to

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type

[jira] [Resolved] (SPARK-15927) Eliminate redundant code in DAGScheduler's getParentStages and getAncestorShuffleDependencies methods.

2016-06-14 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-15927. Resolution: Fixed Fix Version/s: 2.1.0 Fixed by

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-15957: --- Assignee: Yanbo Liang (was: Apache Spark) > RFormula supports forcing to index label >

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label >

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: (was: Apache Spark) > RFormula supports forcing to index label >

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label >

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label >

[jira] [Commented] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330896#comment-15330896 ] Apache Spark commented on SPARK-15957: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: (was: Apache Spark) > RFormula supports forcing to index label >

[jira] [Created] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15957: --- Summary: RFormula supports forcing to index label Key: SPARK-15957 URL: https://issues.apache.org/jira/browse/SPARK-15957 Project: Spark Issue Type:

[jira] [Created] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Brian Cho (JIRA)
Brian Cho created SPARK-15956: - Summary: When unwrapping ORC avoid pattern matching at runtime Key: SPARK-15956 URL: https://issues.apache.org/jira/browse/SPARK-15956 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15954: Assignee: Apache Spark > TestHive has issues being used in PySpark >

[jira] [Commented] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330822#comment-15330822 ] Apache Spark commented on SPARK-15954: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15954: Assignee: (was: Apache Spark) > TestHive has issues being used in PySpark >

[jira] [Updated] (SPARK-15955) Failed Spark application returns with exitcode equals to zero

2016-06-14 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-15955: --- Summary: Failed Spark application returns with exitcode equals to zero (was: Failed Spark

[jira] [Commented] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330821#comment-15330821 ] holdenk commented on SPARK-15954: - See related PR https://github.com/apache/spark/pull/12938 > TestHive

[jira] [Created] (SPARK-15955) Failed Spark application returns with client console equals zero

2016-06-14 Thread Yesha Vora (JIRA)
Yesha Vora created SPARK-15955: -- Summary: Failed Spark application returns with client console equals zero Key: SPARK-15955 URL: https://issues.apache.org/jira/browse/SPARK-15955 Project: Spark

[jira] [Created] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread holdenk (JIRA)
holdenk created SPARK-15954: --- Summary: TestHive has issues being used in PySpark Key: SPARK-15954 URL: https://issues.apache.org/jira/browse/SPARK-15954 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Apache Spark (was: Tathagata Das) > Renamed ContinuousQuery to StreamingQuery

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Tathagata Das (was: Apache Spark) > Renamed ContinuousQuery to StreamingQuery

[jira] [Commented] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330805#comment-15330805 ] Apache Spark commented on SPARK-15953: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Apache Spark (was: Tathagata Das) > Renamed ContinuousQuery to StreamingQuery

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Tathagata Das (was: Apache Spark) > Renamed ContinuousQuery to StreamingQuery

[jira] [Updated] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15953: -- Target Version/s: 2.0.0 > Renamed ContinuousQuery to StreamingQuery for simplicity >

[jira] [Created] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-15953: - Summary: Renamed ContinuousQuery to StreamingQuery for simplicity Key: SPARK-15953 URL: https://issues.apache.org/jira/browse/SPARK-15953 Project: Spark

[jira] [Updated] (SPARK-15933) Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15933: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-8360 > Refactor reader-writer interface

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330723#comment-15330723 ] Apache Spark commented on SPARK-15046: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15741: Assignee: (was: Apache Spark) > PySpark Cleanup of _setDefault with seed=None >

[jira] [Assigned] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15741: Assignee: Apache Spark > PySpark Cleanup of _setDefault with seed=None >

[jira] [Commented] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330696#comment-15330696 ] Apache Spark commented on SPARK-15741: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330675#comment-15330675 ] Mark Grover commented on SPARK-12177: - bq. I can rename it to spark-streaming-kafka-0-10 to match the

[jira] [Assigned] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15952: Assignee: (was: Apache Spark) > "show databases" does not get sorted result >

[jira] [Commented] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330663#comment-15330663 ] Apache Spark commented on SPARK-15952: -- User 'bomeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15952: Assignee: Apache Spark > "show databases" does not get sorted result >

[jira] [Updated] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-15741: - Description: Several places in PySpark ML have Params._setDefault with a seed param equal to

[jira] [Reopened] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reopened SPARK-15741: -- Reopened as I feel this still should be cleaned up. > PySpark Cleanup of _setDefault with

[jira] [Created] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Bo Meng (JIRA)
Bo Meng created SPARK-15952: --- Summary: "show databases" does not get sorted result Key: SPARK-15952 URL: https://issues.apache.org/jira/browse/SPARK-15952 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-15892: --- > Incorrectly merged AFTAggregator with zero total count >

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Fix Version/s: (was: 1.6.2) > Incorrectly merged AFTAggregator with zero total

[jira] [Assigned] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15951: Assignee: Apache Spark > Change Executors Page to use datatables to support sorting

[jira] [Commented] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330629#comment-15330629 ] Apache Spark commented on SPARK-15951: -- User 'kishorvpatil' has created a pull request for this

[jira] [Assigned] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15951: Assignee: (was: Apache Spark) > Change Executors Page to use datatables to support

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330552#comment-15330552 ] Cody Koeninger commented on SPARK-12177: I can rename it to spark-streaming-kafka-0-10 to match

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-06-14 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330550#comment-15330550 ] Russell Alexander Spitzer commented on SPARK-13928: --- So users(like me ;) ) need to

[jira] [Commented] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330529#comment-15330529 ] Shixiong Zhu commented on SPARK-15905: -- Did you happen to block the stdout or stderr? Such as the

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-14 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330526#comment-15330526 ] Yan Chen commented on SPARK-15716: -- The checkpoint path is on HDFS. The application is already shutdown,

[jira] [Created] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Kishor Patil (JIRA)
Kishor Patil created SPARK-15951: Summary: Change Executors Page to use datatables to support sorting columns and searching Key: SPARK-15951 URL: https://issues.apache.org/jira/browse/SPARK-15951

[jira] [Updated] (SPARK-15888) Python UDF over aggregate fails

2016-06-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15888: --- Priority: Blocker (was: Major) > Python UDF over aggregate fails > ---

[jira] [Assigned] (SPARK-15888) Python UDF over aggregate fails

2016-06-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-15888: -- Assignee: Davies Liu > Python UDF over aggregate fails > --- > >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330500#comment-15330500 ] Mark Grover commented on SPARK-12177: - bq. It's worth mentioning that authentication is also

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330497#comment-15330497 ] Shixiong Zhu commented on SPARK-15716: -- I saw there were a lot of

[jira] [Resolved] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15247. -- Resolution: Fixed Fix Version/s: 2.0.0 This issue has been resolved by

[jira] [Updated] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15247: - Assignee: Takeshi Yamamuro > sqlCtx.read.parquet yields at least n_executors * n_cores tasks >

[jira] [Comment Edited] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330482#comment-15330482 ] Tejas Patil edited comment on SPARK-15905 at 6/14/16 8:12 PM: -- [~zsxwing]

[jira] [Commented] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330482#comment-15330482 ] Tejas Patil commented on SPARK-15905: - @zsxwing >> Do you have the whole jstack output? I will not

[jira] [Commented] (SPARK-15904) High Memory Pressure using MLlib K-means

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330480#comment-15330480 ] Sean Owen commented on SPARK-15904: --- I don't think the problem is your code. You're allocating on the

[jira] [Commented] (SPARK-15849) FileNotFoundException on _temporary while doing saveAsTable to S3

2016-06-14 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330240#comment-15330240 ] Thomas Demoor commented on SPARK-15849: --- Forgot to mention, it also speeds up your writes 2x >

[jira] [Commented] (SPARK-15849) FileNotFoundException on _temporary while doing saveAsTable to S3

2016-06-14 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330238#comment-15330238 ] Thomas Demoor commented on SPARK-15849: --- Seems like typical list-after-write inconsistency.

[jira] [Resolved] (SPARK-15895) _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15895. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13623

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-14 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Affects Version/s: (was: 1.6.1) (was: 1.6.0)

[jira] [Commented] (SPARK-15915) CacheManager should use canonicalized plan for planToCache.

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330175#comment-15330175 ] Apache Spark commented on SPARK-15915: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-15934) Return binary mode in ThriftServer

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330168#comment-15330168 ] Apache Spark commented on SPARK-15934: -- User 'epahomov' has created a pull request for this issue:

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-06-14 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330166#comment-15330166 ] Kai Jiang commented on SPARK-15767: --- Thanks [~shivaram]! Yes, as you said, we should shorter name of

[jira] [Updated] (SPARK-15864) Inconsistent Behaviors when Uncaching Non-cached Tables

2016-06-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15864: Assignee: Xiao Li > Inconsistent Behaviors when Uncaching Non-cached Tables >

  1   2   3   >