[jira] [Resolved] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11009. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11030) SQLTab should be shared by across sessions

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11030. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9048

[jira] [Resolved] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10888. --- Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s:

[jira] [Resolved] (SPARK-10913) Add attach() function for DataFrame

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10913. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955336#comment-14955336 ] Shivaram Venkataraman commented on SPARK-11086: --- This is a great suggestion. Could you open

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955335#comment-14955335 ] Reynold Xin commented on SPARK-: The big ones are: 1. encoders (which breaks almost every function

[jira] [Created] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-13 Thread patcharee (JIRA)
patcharee created SPARK-11087: - Summary: spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate Key: SPARK-11087 URL: https://issues.apache.org/jira/browse/SPARK-11087 Project: Spark

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2750: --- Description: Now I try to add https support for web ui using Jetty ssl integration.Below is the

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955269#comment-14955269 ] Shivaram Venkataraman commented on SPARK-2563: -- This bug was for the old NIO code. For 1.4.0

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-13 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955337#comment-14955337 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Added some indentation to those comments

[jira] [Resolved] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11036. Resolution: Duplicate > AttributeReference should not be created outside driver >

[jira] [Resolved] (SPARK-10051) Support collecting data of StructType in DataFrame

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10051. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955286#comment-14955286 ] Sandy Ryza commented on SPARK-: --- To ask the obvious question: what are the reasons that the RDD API

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955320#comment-14955320 ] Sandy Ryza commented on SPARK-: --- [~rxin] where are the places where the API would need to break? >

[jira] [Commented] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

2015-10-13 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel commented on SPARK-2365: Can it also have a capability to do a "scan" over ordered rdd?

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955486#comment-14955486 ] Davies Liu commented on SPARK-10617: [~shao.lo] I still do not get it, if the add_months is right,

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

2015-10-13 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 7:12 PM: -- Can it also

[jira] [Commented] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955577#comment-14955577 ] Apache Spark commented on SPARK-10619: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10619: Assignee: Apache Spark (was: Thomas Graves) > Can't sort columns on Executor Page >

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10619: Assignee: Thomas Graves (was: Apache Spark) > Can't sort columns on Executor Page >

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955593#comment-14955593 ] Herman van Hovell commented on SPARK-11008: --- A fix for a bug concerning the use of Window

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-10619: - Assignee: Thomas Graves > Can't sort columns on Executor Page >

[jira] [Commented] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955548#comment-14955548 ] Thomas Graves commented on SPARK-10619: --- looks like this was broken by commit:

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-13 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1499#comment-1499 ] Zhan Zhang commented on SPARK-11087: no matter whether the table is sorted or not, the predicate

[jira] [Commented] (SPARK-10388) Public dataset loader interface

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955567#comment-14955567 ] Xiangrui Meng commented on SPARK-10388: --- Discussed with [~rams] offline and he is interested in

[jira] [Resolved] (SPARK-7402) JSON serialization of params

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7402. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9090

[jira] [Updated] (SPARK-7402) JSON serialization of standard params

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7402: - Summary: JSON serialization of standard params (was: JSON serialization of params) > JSON

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955368#comment-14955368 ] Michael Armbrust commented on SPARK-: - Other compatibility breaking things include: getting

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

2015-10-13 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955376#comment-14955376 ] Narine Kokhlikyan commented on SPARK-11057: --- I have one short question about the limitations on

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955409#comment-14955409 ] Davies Liu commented on SPARK-11083: What's the version you are using? Does this still happen on

[jira] [Updated] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-13 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-10181: --- Summary: HiveContext is not used with keytab principal but with user principal/unix username

[jira] [Created] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-11090: Summary: Initial code generated construction of Product classes from InternalRow Key: SPARK-11090 URL: https://issues.apache.org/jira/browse/SPARK-11090

[jira] [Commented] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955427#comment-14955427 ] Davies Liu commented on SPARK-5391: --- I tried this, it worked in master, will close this as resolved. >

[jira] [Assigned] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11090: Assignee: Michael Armbrust (was: Apache Spark) > Initial code generated construction of

[jira] [Assigned] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11090: Assignee: Apache Spark (was: Michael Armbrust) > Initial code generated construction of

[jira] [Commented] (SPARK-10504) aggregate where NULL is defined as the value expression aborts when SUM used

2015-10-13 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955214#comment-14955214 ] Charmee Patel commented on SPARK-10504: --- This fix only works when tungsten is enabled in 1.5 and

[jira] [Updated] (SPARK-11079) Post-hoc review Netty based RPC implementation - round 1

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11079: Summary: Post-hoc review Netty based RPC implementation - round 1 (was: Review Netty based RPC

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

2015-10-13 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955264#comment-14955264 ] Romi Kuntsman commented on SPARK-2563: -- i got a socket timeout in spark 1.4.0 is this still relevant

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955358#comment-14955358 ] Apache Spark commented on SPARK-11086: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11086: Assignee: (was: Apache Spark) > createDataFrame should dropFactor column-wise not

[jira] [Created] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-10-13 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11089: -- Summary: Add a option for thrift-server to share a single session across all connections Key: SPARK-11089 URL: https://issues.apache.org/jira/browse/SPARK-11089 Project:

[jira] [Resolved] (SPARK-6561) Add partition support in saveAsParquet

2015-10-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6561. --- Resolution: Duplicate Assignee: Cheng Lian Fix Version/s: 1.4.0 > Add partition

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955379#comment-14955379 ] Reynold Xin commented on SPARK-11057: - Not sure if there is an explicit max, but the query optimizer

[jira] [Commented] (SPARK-10791) Optimize MLlib LDA topic distribution query performance

2015-10-13 Thread Mohamed Baddar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955408#comment-14955408 ] Mohamed Baddar commented on SPARK-10791: [~aspa] would you please clarify the specific thread in

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955416#comment-14955416 ] Davies Liu commented on SPARK-11067: [~navis] Could you send out a PR for this patch? > Spark SQL

[jira] [Resolved] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-5391. --- Resolution: Fixed Fix Version/s: 1.6.0 > SparkSQL fails to create tables with custom JSON

[jira] [Commented] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955425#comment-14955425 ] Apache Spark commented on SPARK-11090: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11086: Assignee: Apache Spark > createDataFrame should dropFactor column-wise not cell-wise >

[jira] [Created] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-11088: -- Summary: Optimize DataSourceStrategy.mergeWithPartitionValues Key: SPARK-11088 URL: https://issues.apache.org/jira/browse/SPARK-11088 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread shao lo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shao lo reopened SPARK-10617: - The bug is not that add_months is wrong. The bug is that order of evaluation is wrong. The two queries

[jira] [Commented] (SPARK-10791) Optimize MLlib LDA topic distribution query performance

2015-10-13 Thread Marko Asplund (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955444#comment-14955444 ] Marko Asplund commented on SPARK-10791: --- Please see: Sep 2015 / Thread view / page 8 thread title:

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Prasad Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955622#comment-14955622 ] Prasad Chalasani commented on SPARK-11008: -- great, so it wasn't a "minor" bug after all :) >

[jira] [Commented] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955634#comment-14955634 ] Apache Spark commented on SPARK-10389: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11052: -- Assignee: Trystan Leftwich > Spaces in the build dir causes failures in the build/mvn script >

[jira] [Comment Edited] (SPARK-10337) Views are broken

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949251#comment-14949251 ] Yin Huai edited comment on SPARK-10337 at 10/13/15 9:30 PM: *Update: The flag

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

2015-10-13 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 9:46 PM: -- Is it possible

[jira] [Commented] (SPARK-7099) Floating point literals cannot be specified using exponent

2015-10-13 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955790#comment-14955790 ] kevin yu commented on SPARK-7099: - Hello Ryan: Can you close this JIRA? Thanks. Kevin > Floating point

[jira] [Commented] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955796#comment-14955796 ] Apache Spark commented on SPARK-11032: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-11080) Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11080: --- Description: In the current implementation of named expressions' ExprIds, we rely on a per-JVM

[jira] [Updated] (SPARK-11080) Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11080: --- Summary: Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions (was:

[jira] [Resolved] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11052. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9065

[jira] [Comment Edited] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955691#comment-14955691 ] Davies Liu edited comment on SPARK-10617 at 10/13/15 9:15 PM: -- If you really

[jira] [Resolved] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10617. Resolution: Not A Problem Assignee: Davies Liu > Leap year miscalculated in sql query >

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955691#comment-14955691 ] Davies Liu commented on SPARK-10617: If you really want to get 2016-02-28 back, you could do

[jira] [Commented] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955737#comment-14955737 ] Apache Spark commented on SPARK-11091: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11091: Assignee: Apache Spark (was: Yin Huai) > Change the flag of spark.sql.canonicalizeView

[jira] [Assigned] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11032: Assignee: (was: Apache Spark) > Failure to resolve having correctly >

[jira] [Assigned] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11032: Assignee: Apache Spark > Failure to resolve having correctly >

[jira] [Resolved] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11080. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9093

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955646#comment-14955646 ] Davies Liu commented on SPARK-9182: --- For JDBC, I think we could push more stuff (for example, a + b > 3)

[jira] [Resolved] (SPARK-10983) Implement unified memory manager

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10983. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9084

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread shao lo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955668#comment-14955668 ] shao lo commented on SPARK-10617: - Yik!! I was assuming add_months(cast('2015-02-28' as date), 12)

[jira] [Updated] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11091: - Description: The meaning of this flag is exactly the opposite. Let's change it. was:This flag's name

[jira] [Created] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11091: Summary: Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView Key: SPARK-11091 URL: https://issues.apache.org/jira/browse/SPARK-11091 Project: Spark

[jira] [Commented] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955765#comment-14955765 ] Apache Spark commented on SPARK-11088: -- User 'liancheng' has created a pull request for this issue:

[jira] [Commented] (SPARK-11070) Remove older releases on dist.apache.org

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955675#comment-14955675 ] Sean Owen commented on SPARK-11070: --- [~pwendell] I updated the site download javascript, but I don't

[jira] [Updated] (SPARK-11060) Fix some potential NPEs in DStream transformation

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11060: -- Priority: Minor (was: Major) > Fix some potential NPEs in DStream transformation >

[jira] [Commented] (SPARK-10217) Spark SQL cannot handle ordering directive in ORDER BY clauses with expressions

2015-10-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955723#comment-14955723 ] Xiao Li commented on SPARK-10217: - Hi, Simeon, I am trying to reproduce your problem on Spark 1.5.1. I

[jira] [Assigned] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11091: Assignee: Yin Huai (was: Apache Spark) > Change the flag of spark.sql.canonicalizeView

[jira] [Assigned] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11088: Assignee: Apache Spark (was: Cheng Lian) > Optimize

[jira] [Assigned] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11088: Assignee: Cheng Lian (was: Apache Spark) > Optimize

[jira] [Created] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-11092: - Summary: Add source URLs to API documentation. Key: SPARK-11092 URL: https://issues.apache.org/jira/browse/SPARK-11092 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-11092: -- Description: It would be nice to have source URLs in the Spark scaladoc, similar to the

[jira] [Commented] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955996#comment-14955996 ] Jakob Odersky commented on SPARK-11092: --- I can't set the assignee field, though I'd like to resolve

[jira] [Updated] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-11092: -- Description: It would be nice to have source URLs in the Spark scaladoc, similar to the

[jira] [Resolved] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10932. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8986

[jira] [Resolved] (SPARK-11059) ML: change range of quantile probabilities in AFTSurvivalRegression

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11059. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9083

[jira] [Updated] (SPARK-11059) ML: change range of quantile probabilities in AFTSurvivalRegression

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11059: -- Assignee: Kai Jiang > ML: change range of quantile probabilities in AFTSurvivalRegression >

[jira] [Comment Edited] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955868#comment-14955868 ] Reynold Xin edited comment on SPARK- at 10/13/15 11:00 PM: --- [~sandyr]

[jira] [Commented] (SPARK-7099) Floating point literals cannot be specified using exponent

2015-10-13 Thread Ryan Pham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955962#comment-14955962 ] Ryan Pham commented on SPARK-7099: -- Hi Kevin. It seems like I can't close this JIRA since I'm not its

[jira] [Resolved] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11090. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9100

[jira] [Updated] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10932: --- Fix Version/s: 1.5.2 > Port two minor changes to release packaging scripts back into Spark repo >

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955840#comment-14955840 ] Sandy Ryza commented on SPARK-: --- If I understand correctly, it seems like there are ways to work

[jira] [Updated] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10389: - Fix Version/s: 1.5.2 > support order by non-attribute grouping expression on Aggregate >

[jira] [Commented] (SPARK-5328) Update PySpark MLlib NaiveBayes API to take model type parameter for Bernoulli fit

2015-10-13 Thread Bhargav Mangipudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955855#comment-14955855 ] Bhargav Mangipudi commented on SPARK-5328: -- I can take up this work item. > Update PySpark MLlib

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955868#comment-14955868 ] Reynold Xin commented on SPARK-: [~sandyr] Your concern is absolutely valid, but I don't think

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Fix Version/s: 1.6.0 > PySpark StreamingLogisticRegressionWithSGD does not train with given

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955878#comment-14955878 ] Michael Armbrust commented on SPARK-: - I think improving Java compatibility and getting rid of

[jira] [Resolved] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10959. --- Resolution: Fixed Fix Version/s: (was: 1.6.0) 1.5.2 Issue

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955877#comment-14955877 ] Reynold Xin commented on SPARK-: BTW another possible approach that we haven't discussed is that

<    1   2   3   >