[jira] [Comment Edited] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

2016-09-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524581#comment-15524581 ] Herman van Hovell edited comment on SPARK-17673 at 9/27/16 12:15 AM: --

[jira] [Commented] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

2016-09-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524581#comment-15524581 ] Herman van Hovell commented on SPARK-17673: --- [~russell spitzer] Are you using S

[jira] [Comment Edited] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

2016-09-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524581#comment-15524581 ] Herman van Hovell edited comment on SPARK-17673 at 9/27/16 12:16 AM: --

[jira] [Resolved] (SPARK-17590) Analyze CTE definitions at once and allow CTE subquery to define CTE

2016-09-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17590. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.1.0 > An

[jira] [Updated] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17458: -- Assignee: (was: Herman van Hovell) > Alias specified for aggregates in a pivot are

[jira] [Updated] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17458: -- Assignee: Herman van Hovell > Alias specified for aggregates in a pivot are not honored

[jira] [Resolved] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17458. --- Resolution: Fixed Fix Version/s: 2.1.0 I cannot find the JIRA username of the

[jira] [Resolved] (SPARK-17364) Can not query hive table starting with number

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17364. --- Resolution: Fixed Assignee: Sean Zhong Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17429) spark sql length(1) return error

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17429. --- Resolution: Fixed Assignee: cen yuhai Fix Version/s: 2.1.0 > spark sq

[jira] [Resolved] (SPARK-17114) Adding a 'GROUP BY 1' where first column is literal results in wrong answer

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17114. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-17544) Timeout waiting for connection from pool, DataFrame Reader's not closing S3 connections?

2016-09-15 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17544: -- Description: I have an application that loops through a text file to find files in S3 a

[jira] [Resolved] (SPARK-10747) add support for NULLS FIRST|LAST in ORDER BY clause

2016-09-14 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-10747. --- Resolution: Fixed Assignee: Xin Wu Fix Version/s: 2.1.0 > add support

[jira] [Resolved] (SPARK-17530) Add Statistics into DESCRIBE FORMATTED

2016-09-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17530. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Add Statis

[jira] [Commented] (SPARK-17450) spark sql rownumber OOM

2016-09-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488005#comment-15488005 ] Herman van Hovell commented on SPARK-17450: --- https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-17142) Complex query triggers binding error in HashAggregateExec

2016-09-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17142. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Compl

[jira] [Resolved] (SPARK-17515) CollectLimit.execute() should perform per-partition limits

2016-09-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17515. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > CollectLimit

[jira] [Resolved] (SPARK-17415) Better error message for driver-side broadcast join OOMs

2016-09-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17415. --- Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.1.0 > Bet

[jira] [Commented] (SPARK-17450) spark sql rownumber OOM

2016-09-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474517#comment-15474517 ] Herman van Hovell commented on SPARK-17450: --- You could try. You would also have

[jira] [Commented] (SPARK-17450) spark sql rownumber OOM

2016-09-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474518#comment-15474518 ] Herman van Hovell commented on SPARK-17450: --- You could try. You would also have

[jira] [Issue Comment Deleted] (SPARK-17450) spark sql rownumber OOM

2016-09-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17450: -- Comment: was deleted (was: You could try. You would also have to add the follow-up by d

[jira] [Commented] (SPARK-17450) spark sql rownumber OOM

2016-09-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474363#comment-15474363 ] Herman van Hovell commented on SPARK-17450: --- This generally a bad idea. All you

[jira] [Closed] (SPARK-17431) How to get 2 years prior date from currentdate using Spark Sql

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17431. - Resolution: Not A Problem > How to get 2 years prior date from currentdate using Spark Sq

[jira] [Commented] (SPARK-17429) spark sql length(1) return error

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15470329#comment-15470329 ] Herman van Hovell commented on SPARK-17429: --- TBH this seems like something whic

[jira] [Commented] (SPARK-17430) Spark task Hangs after OOM while DAG scheduler tries to serialize a task

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15470321#comment-15470321 ] Herman van Hovell commented on SPARK-17430: --- [~Mikhail] We use github pull requ

[jira] [Commented] (SPARK-17403) Fatal Error: Scan cached strings

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15470311#comment-15470311 ] Herman van Hovell commented on SPARK-17403: --- [~rhernando] My current hypothesis

[jira] [Resolved] (SPARK-17427) function SIZE should return -1 when parameter is null

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17427. --- Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 2.1.0 > functi

[jira] [Updated] (SPARK-17427) function SIZE should return -1 when parameter is null

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17427: -- Labels: releasenotes (was: ) > function SIZE should return -1 when parameter is null >

[jira] [Updated] (SPARK-17296) Spark SQL: cross join + two joins = BUG

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17296: -- Fix Version/s: 2.0.1 > Spark SQL: cross join + two joins = BUG > --

[jira] [Updated] (SPARK-17253) Left join where ON clause does not reference the right table produces analysis error

2016-09-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17253: -- Fix Version/s: 2.0.1 > Left join where ON clause does not reference the right table pro

[jira] [Commented] (SPARK-17423) Support IGNORE NULLS option in Window functions

2016-09-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468973#comment-15468973 ] Herman van Hovell commented on SPARK-17423: --- IMO LEAD and LAG with ignore nulls

[jira] [Resolved] (SPARK-17253) Left join where ON clause does not reference the right table produces analysis error

2016-09-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17253. --- Resolution: Duplicate Assignee: Herman van Hovell Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17296) Spark SQL: cross join + two joins = BUG

2016-09-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17296. --- Resolution: Fixed Fix Version/s: 2.1.0 > Spark SQL: cross join + two joins = B

[jira] [Assigned] (SPARK-17296) Spark SQL: cross join + two joins = BUG

2016-09-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-17296: - Assignee: Herman van Hovell > Spark SQL: cross join + two joins = BUG >

[jira] [Comment Edited] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465808#comment-15465808 ] Herman van Hovell edited comment on SPARK-17403 at 9/5/16 9:24 PM:

[jira] [Commented] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465808#comment-15465808 ] Herman van Hovell commented on SPARK-17403: --- Well then we sorta know where to l

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465799#comment-15465799 ] Herman van Hovell commented on SPARK-17364: --- This should work. For instance thi

[jira] [Commented] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465383#comment-15465383 ] Herman van Hovell commented on SPARK-17403: --- [~rhernando] Could you try this wi

[jira] [Updated] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17403: -- Description: The process creates views from JDBC (SQL server) source and combines them

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465338#comment-15465338 ] Herman van Hovell commented on SPARK-15822: --- Could you open a new ticket for th

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465335#comment-15465335 ] Herman van Hovell commented on SPARK-15822: --- Thanks! Do you also have this prob

[jira] [Comment Edited] (SPARK-17072) generate table level stats:stats generation/storing/loading

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15465257#comment-15465257 ] Herman van Hovell edited comment on SPARK-17072 at 9/5/16 3:36 PM:

[jira] [Resolved] (SPARK-17072) generate table level stats:stats generation/storing/loading

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17072. --- Resolution: Fixed Fix Version/s: 2.1.0 This is resolve by PR https://github.co

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464962#comment-15464962 ] Herman van Hovell commented on SPARK-15822: --- Could you share the query plan?

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464808#comment-15464808 ] Herman van Hovell commented on SPARK-15822: --- [~rhernando] It should not be rela

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464809#comment-15464809 ] Herman van Hovell commented on SPARK-15822: --- [~rhernando] It should not be rela

[jira] [Issue Comment Deleted] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-09-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15822: -- Comment: was deleted (was: [~rhernando] It should not be related to this one. Are you d

[jira] [Resolved] (SPARK-17335) Creating Hive table from Spark data

2016-09-03 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17335. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17298) Require explicit CROSS join for cartesian products by default

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17298. --- Resolution: Fixed Assignee: Srinath Fix Version/s: 2.1.0 > Require ex

[jira] [Comment Edited] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459539#comment-15459539 ] Herman van Hovell edited comment on SPARK-13721 at 9/2/16 8:40 PM:

[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459539#comment-15459539 ] Herman van Hovell commented on SPARK-13721: --- Could you explain what this would

[jira] [Resolved] (SPARK-17351) Refactor JDBCRDD to expose JDBC -> SparkSQL conversion functionality

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17351. --- Resolution: Fixed Fix Version/s: 2.1.0 > Refactor JDBCRDD to expose JDBC -> Sp

[jira] [Resolved] (SPARK-16984) executeTake tries all partitions if first parition is empty

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16984. --- Resolution: Fixed Assignee: Robert Kruszewski Fix Version/s: 2.1.0 >

[jira] [Commented] (SPARK-17253) Left join where ON clause does not reference the right table produces analysis error

2016-09-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458033#comment-15458033 ] Herman van Hovell commented on SPARK-17253: --- [~jiangxb] We do support cross joi

[jira] [Commented] (SPARK-17366) Temp tables cached in spark - Joins performance

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456694#comment-15456694 ] Herman van Hovell commented on SPARK-17366: --- [~chris_sanjiv] Is this a question

[jira] [Comment Edited] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455709#comment-15455709 ] Herman van Hovell edited comment on SPARK-17335 at 9/1/16 3:07 PM:

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455709#comment-15455709 ] Herman van Hovell commented on SPARK-17335: --- {ArrayType} and {MapType} do not h

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455672#comment-15455672 ] Herman van Hovell commented on SPARK-17335: --- Turns out this is not correct, Str

[jira] [Issue Comment Deleted] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17335: -- Comment: was deleted (was: Turns out this is not correct, StructType handles this corre

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455671#comment-15455671 ] Herman van Hovell commented on SPARK-17335: --- Turns out this is not correct, Str

[jira] [Updated] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17335: -- Component/s: (was: Spark Core) SQL > Creating Hive table from Spar

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

2016-09-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455529#comment-15455529 ] Herman van Hovell commented on SPARK-17335: --- [~jupblb] Are you using a nested s

[jira] [Commented] (SPARK-17348) Incorrect results from subquery transformation

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453516#comment-15453516 ] Herman van Hovell commented on SPARK-17348: --- This is an interesting one. TBH I

[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15452926#comment-15452926 ] Herman van Hovell commented on SPARK-13721: --- You can follow the suggestion in t

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15452175#comment-15452175 ] Herman van Hovell commented on SPARK-17335: --- [~jupblb] Could you open a PR for

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15452148#comment-15452148 ] Herman van Hovell commented on SPARK-17195: --- There is no easy way to get around

[jira] [Commented] (SPARK-17322) 'ANY n' clause for SQL queries to increase the ease of use of WHERE clause predicates

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451825#comment-15451825 ] Herman van Hovell commented on SPARK-17322: --- Is this use of {{ANY}} part of the

[jira] [Updated] (SPARK-17322) 'ANY n' clause for SQL queries to increase the ease of use of WHERE clause predicates

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17322: -- Shepherd: (was: Reynold Xin) > 'ANY n' clause for SQL queries to increase the ease of

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

2016-08-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451794#comment-15451794 ] Herman van Hovell commented on SPARK-17328: --- [~jlaskowski] go for it. Ping me i

[jira] [Resolved] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-08-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16456. --- Resolution: Duplicate > Reuse the uncorrelated scalar subqueries with the same logica

[jira] [Resolved] (SPARK-16419) EnsureRequirements adds extra Sort to already sorted cached table

2016-08-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16419. --- Resolution: Duplicate > EnsureRequirements adds extra Sort to already sorted cached t

[jira] [Commented] (SPARK-17296) Spark SQL: cross join + two joins = BUG

2016-08-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446371#comment-15446371 ] Herman van Hovell commented on SPARK-17296: --- I think you have found a bug in th

[jira] [Commented] (SPARK-17289) Sort based partial aggregation breaks due to SPARK-12978

2016-08-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446341#comment-15446341 ] Herman van Hovell commented on SPARK-17289: --- Looks good. Can you open a PR? >

[jira] [Commented] (SPARK-17289) Sort based partial aggregation breaks due to SPARK-12978

2016-08-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446013#comment-15446013 ] Herman van Hovell commented on SPARK-17289: --- cc [~maropu] > Sort based partial

[jira] [Commented] (SPARK-17289) Sort based partial aggregation breaks due to SPARK-12978

2016-08-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446015#comment-15446015 ] Herman van Hovell commented on SPARK-17289: --- [~clockfly] Are you working on thi

[jira] [Updated] (SPARK-17289) Sort based partial aggregation breaks due to SPARK-12978

2016-08-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17289: -- Priority: Blocker (was: Major) > Sort based partial aggregation breaks due to SPARK-12

[jira] [Resolved] (SPARK-17271) Planner adds un-necessary Sort even if child ordering is semantically same as required ordering

2016-08-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17271. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 > Planne

[jira] [Commented] (SPARK-17251) "ClassCastException: OuterReference cannot be cast to NamedExpression" for correlated subquery on the RHS of an IN operator

2016-08-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439360#comment-15439360 ] Herman van Hovell commented on SPARK-17251: --- Ok, I have taken a look at this on

[jira] [Commented] (SPARK-16998) select($"column1", explode($"column2")) is extremely slow

2016-08-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439276#comment-15439276 ] Herman van Hovell commented on SPARK-16998: --- [~maropu] Do you mind if I do it m

[jira] [Commented] (SPARK-17252) Performing arithmetic in VALUES can lead to ClassCastException / MatchErrors during query parsing

2016-08-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439269#comment-15439269 ] Herman van Hovell commented on SPARK-17252: --- I cannot reproduce this. I tried b

[jira] [Created] (SPARK-17263) Support binary literals in SQL

2016-08-26 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-17263: - Summary: Support binary literals in SQL Key: SPARK-17263 URL: https://issues.apache.org/jira/browse/SPARK-17263 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-17258) Scientific decimals should be parsed as Decimals

2016-08-26 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-17258: - Summary: Scientific decimals should be parsed as Decimals Key: SPARK-17258 URL: https://issues.apache.org/jira/browse/SPARK-17258 Project: Spark Is

[jira] [Resolved] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17205. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Literal.sql

[jira] [Created] (SPARK-17246) Support BigDecimal literal parsing

2016-08-25 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-17246: - Summary: Support BigDecimal literal parsing Key: SPARK-17246 URL: https://issues.apache.org/jira/browse/SPARK-17246 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-17229) Postgres JDBC dialect should not widen float and short types during reads

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17229. --- Resolution: Fixed Fix Version/s: 2.1.0 > Postgres JDBC dialect should not wide

[jira] [Comment Edited] (SPARK-16998) select($"column1", explode($"column2")) is extremely slow

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437598#comment-15437598 ] Herman van Hovell edited comment on SPARK-16998 at 8/25/16 8:27 PM: ---

[jira] [Commented] (SPARK-16998) select($"column1", explode($"column2")) is extremely slow

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437598#comment-15437598 ] Herman van Hovell commented on SPARK-16998: --- I still have a code generation PR

[jira] [Resolved] (SPARK-17167) Issue Exceptions when Analyze Table on In-Memory Cataloged Tables

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17167. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.1 > Issue Exce

[jira] [Resolved] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17099. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17120. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-16991) Full outer join followed by inner join produces wrong results

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16991. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17061) Incorrect results returned following a join of two datasets and a map step where total number of columns >100

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17061. --- Resolution: Fixed Assignee: Liwei Lin (was: Apache Spark) Fix Version

[jira] [Resolved] (SPARK-17093) Roundtrip encoding of array> fields is wrong when whole-stage codegen is disabled

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17093. --- Resolution: Fixed Assignee: Liwei Lin Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys

2016-08-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-12978. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.1.0 > S

[jira] [Updated] (SPARK-16216) CSV data source does not write date and timestamp correctly

2016-08-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-16216: -- Assignee: Hyukjin Kwon > CSV data source does not write date and timestamp correctly >

[jira] [Commented] (SPARK-16216) CSV data source does not write date and timestamp correctly

2016-08-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435602#comment-15435602 ] Herman van Hovell commented on SPARK-16216: --- I have merged https://github.com/a

[jira] [Resolved] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

2016-08-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16983. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Add

[jira] [Commented] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433849#comment-15433849 ] Herman van Hovell commented on SPARK-17099: --- A small update. Disregard my previ

[jira] [Commented] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433833#comment-15433833 ] Herman van Hovell commented on SPARK-17120: --- PR https://github.com/apache/spark

[jira] [Comment Edited] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433780#comment-15433780 ] Herman van Hovell edited comment on SPARK-17120 at 8/23/16 11:02 PM: --

[jira] [Comment Edited] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433780#comment-15433780 ] Herman van Hovell edited comment on SPARK-17120 at 8/23/16 11:01 PM: --

<    4   5   6   7   8   9   10   11   12   13   >