[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956367#comment-14956367 ] Xiao Li commented on SPARK-10925: - Also hit the same problem. Trying to narrow down the r

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956341#comment-14956341 ] Sandy Ryza commented on SPARK-: --- Thanks for the explanation [~rxin] and [~marmbrus].

[jira] [Created] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

2015-10-13 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11095: --- Summary: Simplify Netty RPC implementation by using a separate thread pool for each endpoint Key: SPARK-11095 URL: https://issues.apache.org/jira/browse/SPARK-11095 Pro

[jira] [Resolved] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10996. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0 Reso

[jira] [Updated] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10981: -- Assignee: Monica Liu > R semijoin leads to Java errors, R leftsemi leads to Spa

[jira] [Resolved] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10981. --- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 Resolv

[jira] [Assigned] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11094: Assignee: Apache Spark > Test runner script fails to parse Java version. > ---

[jira] [Assigned] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11094: Assignee: (was: Apache Spark) > Test runner script fails to parse Java version. >

[jira] [Commented] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956288#comment-14956288 ] Apache Spark commented on SPARK-11094: -- User 'jodersky' has created a pull request f

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

2015-10-13 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956279#comment-14956279 ] Xusen Yin commented on SPARK-10935: --- [~mengxr] [~kpl...@gmail.com] Are you still love t

[jira] [Created] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-11094: - Summary: Test runner script fails to parse Java version. Key: SPARK-11094 URL: https://issues.apache.org/jira/browse/SPARK-11094 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10055) San Francisco Crime Classification

2015-10-13 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956276#comment-14956276 ] Xusen Yin commented on SPARK-10055: --- Yes, I will find a new dataset soon and ping you o

[jira] [Assigned] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11092: Assignee: (was: Apache Spark) > Add source URLs to API documentation. > --

[jira] [Commented] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956270#comment-14956270 ] Apache Spark commented on SPARK-11092: -- User 'jodersky' has created a pull request f

[jira] [Assigned] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11092: Assignee: Apache Spark > Add source URLs to API documentation. > -

[jira] [Assigned] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10382: Assignee: Apache Spark (was: Xusen Yin) > Make example code in user guide testable >

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956250#comment-14956250 ] Apache Spark commented on SPARK-10382: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10382: Assignee: Xusen Yin (was: Apache Spark) > Make example code in user guide testable >

[jira] [Closed] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-9302. -- Resolution: Fixed > Handle complex JSON types in collect()/head() >

[jira] [Commented] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956237#comment-14956237 ] Sun Rui commented on SPARK-9302: This is fixed after supporting complex types in DataFrame

[jira] [Assigned] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9694: --- Assignee: Apache Spark > Add random seed Param to Scala CrossValidator >

[jira] [Commented] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956234#comment-14956234 ] Apache Spark commented on SPARK-9694: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9694: --- Assignee: (was: Apache Spark) > Add random seed Param to Scala CrossValidator > -

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-10-13 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956196#comment-14956196 ] fang fang chen commented on SPARK-9338: --- Also encounter this issue, the sql is very

[jira] [Closed] (SPARK-9443) Expose sampleByKey in SparkR

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-9443. -- Resolution: Duplicate > Expose sampleByKey in SparkR > > > Key: SPA

[jira] [Commented] (SPARK-9443) Expose sampleByKey in SparkR

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956179#comment-14956179 ] Sun Rui commented on SPARK-9443: close it as it duplicates SPARK-10996 > Expose sampleByK

[jira] [Assigned] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11067: Assignee: (was: Apache Spark) > Spark SQL thrift server fails to handle decimal value

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956129#comment-14956129 ] Apache Spark commented on SPARK-11067: -- User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11067: Assignee: Apache Spark > Spark SQL thrift server fails to handle decimal value > -

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956121#comment-14956121 ] Navis commented on SPARK-11067: --- [~alexliu68] Seeing that "RowBasedSet" is in stack trace,

[jira] [Updated] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

2015-10-13 Thread Adam Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Lewandowski updated SPARK-11093: - Description: Currently when using a child-first classloader (spark.driver|executor.userC

[jira] [Assigned] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11093: Assignee: (was: Apache Spark) > ChildFirstURLClassLoader#getResources should return al

[jira] [Commented] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956099#comment-14956099 ] Apache Spark commented on SPARK-11093: -- User 'alewando' has created a pull request f

[jira] [Assigned] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11093: Assignee: Apache Spark > ChildFirstURLClassLoader#getResources should return all found res

[jira] [Commented] (SPARK-10747) add support for window specification to include how NULLS are ordered

2015-10-13 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956094#comment-14956094 ] Xin Wu commented on SPARK-10747: I ran this query on the released Hive 1.2.1 version, and

[jira] [Closed] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

2015-10-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-11082. --- Resolution: Invalid > Cores per executor is wrong when response vcore number is less than requested

[jira] [Created] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

2015-10-13 Thread Adam Lewandowski (JIRA)
Adam Lewandowski created SPARK-11093: Summary: ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader Key: SPARK-11093 URL: https://issues.apache.org/j

[jira] [Resolved] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11091. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9103 [https://github.com/a

[jira] [Resolved] (SPARK-11068) Add callback to query execution

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11068. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9078 [https://github.c

[jira] [Updated] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-11092: -- Description: It would be nice to have source URLs in the Spark scaladoc, similar to the standa

[jira] [Commented] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955996#comment-14955996 ] Jakob Odersky commented on SPARK-11092: --- I can't set the assignee field, though I'd

[jira] [Updated] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-11092: -- Description: It would be nice to have source URLs in the Spark scaladoc, similar to the standa

[jira] [Created] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-11092: - Summary: Add source URLs to API documentation. Key: SPARK-11092 URL: https://issues.apache.org/jira/browse/SPARK-11092 Project: Spark Issue Type: Documenta

[jira] [Resolved] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11032. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9105 [http

[jira] [Resolved] (SPARK-11090) Initial code generated construction of Product classes from InternalRow

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11090. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9100 [http

[jira] [Commented] (SPARK-7099) Floating point literals cannot be specified using exponent

2015-10-13 Thread Ryan Pham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955962#comment-14955962 ] Ryan Pham commented on SPARK-7099: -- Hi Kevin. It seems like I can't close this JIRA since

[jira] [Updated] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10389: - Fix Version/s: 1.5.2 > support order by non-attribute grouping expression on Aggregate >

[jira] [Resolved] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10959. --- Resolution: Fixed Fix Version/s: (was: 1.6.0) 1.5.2 Issue resol

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955878#comment-14955878 ] Michael Armbrust commented on SPARK-: - I think improving Java compatibility an

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Fix Version/s: 1.6.0 > PySpark StreamingLogisticRegressionWithSGD does not train with given reg

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955877#comment-14955877 ] Reynold Xin commented on SPARK-: BTW another possible approach that we haven't dis

[jira] [Comment Edited] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955868#comment-14955868 ] Reynold Xin edited comment on SPARK- at 10/13/15 11:00 PM: -

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955868#comment-14955868 ] Reynold Xin commented on SPARK-: [~sandyr] Your concern is absolutely valid, but I

[jira] [Resolved] (SPARK-11059) ML: change range of quantile probabilities in AFTSurvivalRegression

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11059. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9083 [https://gi

[jira] [Updated] (SPARK-11059) ML: change range of quantile probabilities in AFTSurvivalRegression

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11059: -- Assignee: Kai Jiang > ML: change range of quantile probabilities in AFTSurvivalRegression > ---

[jira] [Commented] (SPARK-5328) Update PySpark MLlib NaiveBayes API to take model type parameter for Bernoulli fit

2015-10-13 Thread Bhargav Mangipudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955855#comment-14955855 ] Bhargav Mangipudi commented on SPARK-5328: -- I can take up this work item. > Upda

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955840#comment-14955840 ] Sandy Ryza commented on SPARK-: --- If I understand correctly, it seems like there are

[jira] [Updated] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10932: --- Fix Version/s: 1.5.2 > Port two minor changes to release packaging scripts back into Spark repo > ---

[jira] [Resolved] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10932. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8986 [https://github.c

[jira] [Updated] (SPARK-11080) Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11080: --- Summary: Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions (was: NamedExpr

[jira] [Updated] (SPARK-11080) Incorporate per-JVM id into ExprId to prevent unsafe cross-JVM comparisions

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11080: --- Description: In the current implementation of named expressions' ExprIds, we rely on a per-JVM Atomi

[jira] [Resolved] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11080. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9093 [http

[jira] [Assigned] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11032: Assignee: (was: Apache Spark) > Failure to resolve having correctly >

[jira] [Assigned] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11032: Assignee: Apache Spark > Failure to resolve having correctly > ---

[jira] [Commented] (SPARK-11032) Failure to resolve having correctly

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955796#comment-14955796 ] Apache Spark commented on SPARK-11032: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-7099) Floating point literals cannot be specified using exponent

2015-10-13 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955790#comment-14955790 ] kevin yu commented on SPARK-7099: - Hello Ryan: Can you close this JIRA? Thanks. Kevin > F

[jira] [Assigned] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11088: Assignee: Cheng Lian (was: Apache Spark) > Optimize DataSourceStrategy.mergeWithPartition

[jira] [Assigned] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11088: Assignee: Apache Spark (was: Cheng Lian) > Optimize DataSourceStrategy.mergeWithPartition

[jira] [Commented] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955765#comment-14955765 ] Apache Spark commented on SPARK-11088: -- User 'liancheng' has created a pull request

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

2015-10-13 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 9:46 PM: --

[jira] [Assigned] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11091: Assignee: Yin Huai (was: Apache Spark) > Change the flag of spark.sql.canonicalizeView to

[jira] [Commented] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955737#comment-14955737 ] Apache Spark commented on SPARK-11091: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11091: Assignee: Apache Spark (was: Yin Huai) > Change the flag of spark.sql.canonicalizeView to

[jira] [Updated] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11091: - Description: The meaning of this flag is exactly the opposite. Let's change it. was:This flag's name

[jira] [Created] (SPARK-11091) Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView

2015-10-13 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11091: Summary: Change the flag of spark.sql.canonicalizeView to spark.sql.nativeView Key: SPARK-11091 URL: https://issues.apache.org/jira/browse/SPARK-11091 Project: Spark

[jira] [Commented] (SPARK-10217) Spark SQL cannot handle ordering directive in ORDER BY clauses with expressions

2015-10-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955723#comment-14955723 ] Xiao Li commented on SPARK-10217: - Hi, Simeon, I am trying to reproduce your problem on

[jira] [Comment Edited] (SPARK-10337) Views are broken

2015-10-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949251#comment-14949251 ] Yin Huai edited comment on SPARK-10337 at 10/13/15 9:30 PM: *

[jira] [Comment Edited] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955691#comment-14955691 ] Davies Liu edited comment on SPARK-10617 at 10/13/15 9:15 PM: -

[jira] [Resolved] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10617. Resolution: Not A Problem Assignee: Davies Liu > Leap year miscalculated in sql query > -

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955691#comment-14955691 ] Davies Liu commented on SPARK-10617: If you really want to get 2016-02-28 back, you c

[jira] [Resolved] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11052. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9065 [https://github.com

[jira] [Updated] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11052: -- Assignee: Trystan Leftwich > Spaces in the build dir causes failures in the build/mvn script >

[jira] [Updated] (SPARK-11060) Fix some potential NPEs in DStream transformation

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11060: -- Priority: Minor (was: Major) > Fix some potential NPEs in DStream transformation > ---

[jira] [Commented] (SPARK-11070) Remove older releases on dist.apache.org

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955675#comment-14955675 ] Sean Owen commented on SPARK-11070: --- [~pwendell] I updated the site download javascript

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-13 Thread shao lo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955668#comment-14955668 ] shao lo commented on SPARK-10617: - Yik!! I was assuming add_months(cast('2015-02-28'

[jira] [Resolved] (SPARK-10983) Implement unified memory manager

2015-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10983. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9084 [https://github.c

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-10-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955646#comment-14955646 ] Davies Liu commented on SPARK-9182: --- For JDBC, I think we could push more stuff (for exa

[jira] [Commented] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955634#comment-14955634 ] Apache Spark commented on SPARK-10389: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Prasad Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955622#comment-14955622 ] Prasad Chalasani commented on SPARK-11008: -- great, so it wasn't a "minor" bug af

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955593#comment-14955593 ] Herman van Hovell commented on SPARK-11008: --- A fix for a bug concerning the use

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10619: Assignee: Apache Spark (was: Thomas Graves) > Can't sort columns on Executor Page > -

[jira] [Commented] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955577#comment-14955577 ] Apache Spark commented on SPARK-10619: -- User 'tgravescs' has created a pull request

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10619: Assignee: Thomas Graves (was: Apache Spark) > Can't sort columns on Executor Page > -

[jira] [Updated] (SPARK-7402) JSON serialization of standard params

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7402: - Summary: JSON serialization of standard params (was: JSON serialization of params) > JSON serial

[jira] [Resolved] (SPARK-7402) JSON serialization of params

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7402. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9090 [https://githu

[jira] [Commented] (SPARK-10388) Public dataset loader interface

2015-10-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955567#comment-14955567 ] Xiangrui Meng commented on SPARK-10388: --- Discussed with [~rams] offline and he is i

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-13 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1499#comment-1499 ] Zhan Zhang commented on SPARK-11087: no matter whether the table is sorted or not, th

[jira] [Commented] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955548#comment-14955548 ] Thomas Graves commented on SPARK-10619: --- looks like this was broken by commit: ht

[jira] [Assigned] (SPARK-10619) Can't sort columns on Executor Page

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-10619: - Assignee: Thomas Graves > Can't sort columns on Executor Page >

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

2015-10-13 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 7:12 PM: --

  1   2   3   >