[jira] [Commented] (SPARK-11072) simplify self join handling

2016-04-26 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259653#comment-15259653 ] Saurabh Santhosh commented on SPARK-11072: -- Will this resolve https://issues.apa

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2016-04-26 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259650#comment-15259650 ] Saurabh Santhosh commented on SPARK-10925: -- [~smilegator] Hi, I have created an

[jira] [Updated] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2016-04-26 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Santhosh updated SPARK-14948: - Description: h2. Spark Analyser is throwing the following exception in a specific scenari

[jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2016-04-26 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259646#comment-15259646 ] Saurabh Santhosh commented on SPARK-14948: -- This issue is related to https://iss

[jira] [Created] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2016-04-26 Thread Saurabh Santhosh (JIRA)
Saurabh Santhosh created SPARK-14948: Summary: Exception when joining DataFrames derived form the same DataFrame Key: SPARK-14948 URL: https://issues.apache.org/jira/browse/SPARK-14948 Project: Sp

[jira] [Resolved] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14944. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12727 [https://github.com/

[jira] [Resolved] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14943. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12727 [https://github.com/

[jira] [Commented] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259638#comment-15259638 ] Apache Spark commented on SPARK-14943: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: Query Plan 1.6.1.png > Spark 2.0 vs 1.6.1 Query Time(out) > -

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: (was: screenshot-Spark_1.6.1.png) > Spark 2.0 vs 1.6.1 Query Time(out

[jira] [Updated] (SPARK-14947) Showtable Command - Can't List Tables Using JDBC Connector

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14947: --- Priority: Minor (was: Major) > Showtable Command - Can't List Tables Using JDBC Conn

[jira] [Created] (SPARK-14947) Showtable Command - Can't List Tables Using JDBC Connector

2016-04-26 Thread Raymond Honderdors (JIRA)
Raymond Honderdors created SPARK-14947: -- Summary: Showtable Command - Can't List Tables Using JDBC Connector Key: SPARK-14947 URL: https://issues.apache.org/jira/browse/SPARK-14947 Project: Spark

[jira] [Resolved] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14911. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12681 [https://github.

[jira] [Updated] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14911: --- Assignee: Liwei Lin > Fix a potential data race in TaskMemoryManager > --

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: spark-env.sh spark-defaults.conf config files used by bot

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: screenshot-Spark_1.6.1.png > Spark 2.0 vs 1.6.1 Query Time(out) > ---

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: screenshot-spark_2.0.png > Spark 2.0 vs 1.6.1 Query Time(out) > -

[jira] [Created] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
Raymond Honderdors created SPARK-14946: -- Summary: Spark 2.0 vs 1.6.1 Query Time(out) Key: SPARK-14946 URL: https://issues.apache.org/jira/browse/SPARK-14946 Project: Spark Issue Type: Bu

[jira] [Assigned] (SPARK-14945) Python SparkSession API

2016-04-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14945: - Assignee: Andrew Or > Python SparkSession API > --- > > Key:

[jira] [Created] (SPARK-14945) Python SparkSession API

2016-04-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14945: - Summary: Python SparkSession API Key: SPARK-14945 URL: https://issues.apache.org/jira/browse/SPARK-14945 Project: Spark Issue Type: Sub-task Components:

[jira] [Assigned] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14944: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf from HiveTableScanExec and Hi

[jira] [Commented] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259565#comment-15259565 ] Apache Spark commented on SPARK-14944: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14944: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf from HiveTableScanExec and Hi

[jira] [Created] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14944: --- Summary: Remove HiveConf from HiveTableScanExec and HiveTableReader Key: SPARK-14944 URL: https://issues.apache.org/jira/browse/SPARK-14944 Project: Spark Issu

[jira] [Assigned] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14943: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf dependency from ScriptTransfo

[jira] [Assigned] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14943: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf dependency from ScriptTransfo

[jira] [Commented] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259560#comment-15259560 ] Apache Spark commented on SPARK-14943: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14943: --- Summary: Remove HiveConf dependency from ScriptTransformation Key: SPARK-14943 URL: https://issues.apache.org/jira/browse/SPARK-14943 Project: Spark Issue Type

[jira] [Resolved] (SPARK-14913) Simplify configuration API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14913. - Resolution: Fixed Fix Version/s: 2.0.0 > Simplify configuration API >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-04-26 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259536#comment-15259536 ] Cody Koeninger commented on SPARK-12177: Well, given that we have working impleme

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-04-26 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259530#comment-15259530 ] Mario Briggs commented on SPARK-12177: -- what's the thinking on this one with respect

[jira] [Updated] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13477: Assignee: Andrew Or (was: Reynold Xin) > User-facing catalog API > --- > >

[jira] [Resolved] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13477. - Resolution: Fixed Fix Version/s: 2.0.0 > User-facing catalog API > ---

[jira] [Assigned] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14942: Assignee: (was: Apache Spark) > First construct a batch then run the batch for continu

[jira] [Commented] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259498#comment-15259498 ] Apache Spark commented on SPARK-14942: -- User 'lw-lin' has created a pull request for

[jira] [Created] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14942: - Summary: First construct a batch then run the batch for continuous queries Key: SPARK-14942 URL: https://issues.apache.org/jira/browse/SPARK-14942 Project: Spark

[jira] [Assigned] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14942: Assignee: Apache Spark > First construct a batch then run the batch for continuous queries

[jira] [Commented] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259466#comment-15259466 ] Apache Spark commented on SPARK-14786: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259464#comment-15259464 ] Apache Spark commented on SPARK-14783: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259434#comment-15259434 ] Apache Spark commented on SPARK-11940: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14941: Assignee: Reynold Xin (was: Apache Spark) > Remove runtime HiveConf > ---

[jira] [Assigned] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14941: Assignee: Apache Spark (was: Reynold Xin) > Remove runtime HiveConf > ---

[jira] [Commented] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259380#comment-15259380 ] Apache Spark commented on SPARK-14941: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14941: --- Summary: Remove runtime HiveConf Key: SPARK-14941 URL: https://issues.apache.org/jira/browse/SPARK-14941 Project: Spark Issue Type: Sub-task Componen

[jira] [Resolved] (SPARK-14445) Show columns/partitions

2016-04-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14445. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 1 [https://github.

[jira] [Commented] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-04-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259266#comment-15259266 ] Nicholas Chammas commented on SPARK-14932: -- [~marmbrus] - Not sure if you're a g

[jira] [Commented] (SPARK-14919) Spark Cannot be used with software that requires jackson-databind 2.6+: RDDOperationScope

2016-04-26 Thread John Ferguson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259247#comment-15259247 ] John Ferguson commented on SPARK-14919: --- So basically no matter what we - Spark, us

[jira] [Resolved] (SPARK-14732) spark.ml GaussianMixture should not use spark.mllib MultivariateGaussian

2016-04-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-14732. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12593 [https://github.com/ap

[jira] [Assigned] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14940: Assignee: Andrew Or (was: Apache Spark) > Move ExternalCatalog to own file >

[jira] [Commented] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259193#comment-15259193 ] Apache Spark commented on SPARK-14940: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14940: Assignee: Apache Spark (was: Andrew Or) > Move ExternalCatalog to own file >

[jira] [Created] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14940: - Summary: Move ExternalCatalog to own file Key: SPARK-14940 URL: https://issues.apache.org/jira/browse/SPARK-14940 Project: Spark Issue Type: Bug Componen

[jira] [Assigned] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14858: Assignee: (was: Apache Spark) > Push predicates with subquery > -

[jira] [Commented] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259184#comment-15259184 ] Apache Spark commented on SPARK-14858: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14858: Assignee: Apache Spark > Push predicates with subquery > -- >

[jira] [Updated] (SPARK-14834) Force adding doc for new api in pyspark with @since annotation

2016-04-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-14834: --- Description: This is for enforcing user to add python doc when adding new python api with @since anno

[jira] [Assigned] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14939: Assignee: Apache Spark > Eliminate No-op Alias SortOrder in Sort > ---

[jira] [Commented] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259165#comment-15259165 ] Apache Spark commented on SPARK-14939: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14939: Assignee: (was: Apache Spark) > Eliminate No-op Alias SortOrder in Sort >

[jira] [Assigned] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14938: Assignee: Apache Spark > Use Datasets to improve internal implementation > ---

[jira] [Commented] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259160#comment-15259160 ] Apache Spark commented on SPARK-14938: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14938: Assignee: (was: Apache Spark) > Use Datasets to improve internal implementation >

[jira] [Created] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14939: - Summary: Eliminate No-op Alias SortOrder in Sort Key: SPARK-14939 URL: https://issues.apache.org/jira/browse/SPARK-14939 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14938: - Description: As discussed in [https://github.com/apache/spark/pull/11915], we can use {{Dataset.a

[jira] [Updated] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14938: - Description: As discussed in (GITHUB)[https://github.com/apache/spark/pull/11915], we can use {{D

[jira] [Created] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-14938: Summary: Use Datasets to improve internal implementation Key: SPARK-14938 URL: https://issues.apache.org/jira/browse/SPARK-14938 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14937: Assignee: (was: Apache Spark) > spark.ml LogisticRegression sqlCtx in scala is inconsi

[jira] [Commented] (SPARK-14926) OneVsRest labelMetadata uses incorrect name

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259146#comment-15259146 ] zhengruifeng commented on SPARK-14926: -- [~josephkb] I can work on this. > OneVsRest

[jira] [Commented] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259149#comment-15259149 ] Apache Spark commented on SPARK-14937: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14937: Assignee: Apache Spark > spark.ml LogisticRegression sqlCtx in scala is inconsistent with

[jira] [Commented] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259142#comment-15259142 ] Miao Wang commented on SPARK-14937: --- submitting PR now. > spark.ml LogisticRegression

[jira] [Created] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Miao Wang (JIRA)
Miao Wang created SPARK-14937: - Summary: spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python Key: SPARK-14937 URL: https://issues.apache.org/jira/browse/SPARK-14937 Project: S

[jira] [Comment Edited] (SPARK-5997) Increase partition count without performing a shuffle

2016-04-26 Thread Robert Ormandi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259101#comment-15259101 ] Robert Ormandi edited comment on SPARK-5997 at 4/26/16 10:58 PM: ---

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2016-04-26 Thread Robert Ormandi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259101#comment-15259101 ] Robert Ormandi commented on SPARK-5997: --- Does it simply solve the problem if the met

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-26 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259100#comment-15259100 ] Jakob Odersky commented on SPARK-14519: --- That sounds reasonable, however should the

[jira] [Created] (SPARK-14936) FlumePollingStreamSuite is slow

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14936: -- Summary: FlumePollingStreamSuite is slow Key: SPARK-14936 URL: https://issues.apache.org/jira/browse/SPARK-14936 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259095#comment-15259095 ] Apache Spark commented on SPARK-14933: -- User 'xwu0226' has created a pull request fo

[jira] [Assigned] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14933: Assignee: (was: Apache Spark) > Failed to create view out of a parquet or orc table >

[jira] [Assigned] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14933: Assignee: Apache Spark > Failed to create view out of a parquet or orc table > --

[jira] [Created] (SPARK-14935) DistributedSuite "local-cluster format" shouldn't actually launch clusters

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14935: -- Summary: DistributedSuite "local-cluster format" shouldn't actually launch clusters Key: SPARK-14935 URL: https://issues.apache.org/jira/browse/SPARK-14935 Project: Spark

[jira] [Updated] (SPARK-13734) SparkR histogram

2016-04-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-13734: -- Assignee: Oscar D. Lara Yejas > SparkR histogram > > >

[jira] [Created] (SPARK-14934) Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files"

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14934: -- Summary: Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files" Key: SPARK-14934 URL: https://issues.apache.org/jira/browse/SPARK-14934

[jira] [Resolved] (SPARK-13734) SparkR histogram

2016-04-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13734. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259084#comment-15259084 ] Xin Wu commented on SPARK-14933: I have a fix for this and will submit a PR soon. > Fail

[jira] [Commented] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

2016-04-26 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259079#comment-15259079 ] Jakob Odersky commented on SPARK-14146: --- the reason this fails is because spark-she

[jira] [Closed] (SPARK-14928) Support variable substitution in SET command

2016-04-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng closed SPARK-14928. --- Resolution: Won't Fix > Support variable substitution in SET command > --

[jira] [Commented] (SPARK-14928) Support variable substitution in SET command

2016-04-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259069#comment-15259069 ] Bo Meng commented on SPARK-14928: - Parser already handles it. Closing it. > Support vari

[jira] [Created] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Xin Wu (JIRA)
Xin Wu created SPARK-14933: -- Summary: Failed to create view out of a parquet or orc table Key: SPARK-14933 URL: https://issues.apache.org/jira/browse/SPARK-14933 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14925) Published POMs should be flattened

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14925. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12706 [https://github.

[jira] [Comment Edited] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2016-04-26 Thread Ben McCann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255122#comment-15255122 ] Ben McCann edited comment on SPARK-7008 at 4/26/16 10:09 PM: -

[jira] [Created] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-04-26 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-14932: Summary: Allow DataFrame.replace() to replace values with None Key: SPARK-14932 URL: https://issues.apache.org/jira/browse/SPARK-14932 Project: Spark

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258998#comment-15258998 ] Apache Spark commented on SPARK-12154: -- User 'mccheah' has created a pull request fo

[jira] [Commented] (SPARK-14927) DataFrame. saveAsTable creates RDD partitions but not Hive partitions

2016-04-26 Thread Sasha Ovsankin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259014#comment-15259014 ] Sasha Ovsankin commented on SPARK-14927: Seems that the workaround is not to let

[jira] [Resolved] (SPARK-14929) Disable vectorized hashmap for wide schemas and high-precision decimals

2016-04-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14929. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12710 [https://github.

[jira] [Created] (SPARK-14931) Mismatched default values between pipelines in Spark and PySpark

2016-04-26 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-14931: - Summary: Mismatched default values between pipelines in Spark and PySpark Key: SPARK-14931 URL: https://issues.apache.org/jira/browse/SPARK-14931 Project: Spark I

[jira] [Assigned] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14130: Assignee: Yin Huai (was: Apache Spark) > [Table related commands] Alter column >

[jira] [Assigned] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14130: Assignee: Apache Spark (was: Yin Huai) > [Table related commands] Alter column >

[jira] [Commented] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258996#comment-15258996 ] Apache Spark commented on SPARK-14130: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-14834) Force adding doc for new api in pyspark with @since annotation

2016-04-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258994#comment-15258994 ] Joseph K. Bradley commented on SPARK-14834: --- Please describe this in the JIRA d

[jira] [Commented] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258991#comment-15258991 ] Yin Huai commented on SPARK-14130: -- We will ban those commands. > [Table related comman

  1   2   3   >