[jira] [Commented] (SPARK-18254) UDFs don't see aliased column names

[ https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633379#comment-15633379 ] Herman van Hovell commented on SPARK-18254: --- How can you take the length of a r

[jira] [Commented] (SPARK-18254) UDFs don't see aliased column names

[ https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633395#comment-15633395 ] Herman van Hovell commented on SPARK-18254: --- H... I am not python expert. I

[jira] [Issue Comment Deleted] (SPARK-18254) UDFs don't see aliased column names

[ https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18254: -- Comment: was deleted (was: How can you take the length of a row? Do you expect these to

[jira] [Resolved] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

[ https://issues.apache.org/jira/browse/SPARK-17957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17957. --- Resolution: Fixed Fix Version/s: 2.1.0 > Calling outer join and na.fill(0) and

[jira] [Resolved] (SPARK-17981) Incorrectly Set Nullability to False in FilterExec

[ https://issues.apache.org/jira/browse/SPARK-17981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17981. --- Resolution: Fixed Fix Version/s: 2.1.0 > Incorrectly Set Nullability to False

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629296#comment-15629296 ] Herman van Hovell commented on SPARK-18209: --- It might be even easier to store t

[jira] [Resolved] (SPARK-16839) CleanupAliases may leave redundant aliases at end of analysis state

[ https://issues.apache.org/jira/browse/SPARK-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16839. --- Resolution: Fixed Assignee: Eyal Farago Fix Version/s: 2.1.0 > Cleanu

[jira] [Resolved] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

[ https://issues.apache.org/jira/browse/SPARK-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17996. --- Resolution: Fixed Fix Version/s: 2.1.0 > catalog.getFunction(name) returns wro

[jira] [Commented] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620685#comment-15620685 ] Herman van Hovell commented on SPARK-18174: --- [~smilegator] Won't this create a

[jira] [Resolved] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18106. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Anal

[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613580#comment-15613580 ] Herman van Hovell commented on SPARK-18125: --- I tried something like this on mas

[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613497#comment-15613497 ] Herman van Hovell commented on SPARK-18125: --- Could one of you provide a reprodu

[jira] [Updated] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18125: -- Description: Code logic looks like this: {noformat} .groupByKey

[jira] [Updated] (SPARK-18137) RewriteDistinctAggregates UnresolvedException when a UDAF has a foldable TypeCheck

[ https://issues.apache.org/jira/browse/SPARK-18137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18137: -- Description: when run a sql with distinct(on spark github master branch), it throw Unr

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611712#comment-15611712 ] Herman van Hovell commented on SPARK-18134: --- Maps are not comparable. This make

[jira] [Updated] (SPARK-18127) Add hooks and extension points to Spark

[ https://issues.apache.org/jira/browse/SPARK-18127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18127: -- Target Version/s: 2.2.0 (was: 2.1.0) > Add hooks and extension points to Spark > -

[jira] [Updated] (SPARK-18127) Add hooks and extension points to Spark

[ https://issues.apache.org/jira/browse/SPARK-18127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18127: -- Description: As a Spark user I want to be able to customize my spark session. I current

[jira] [Updated] (SPARK-18127) Add hooks and extension points to Spark

[ https://issues.apache.org/jira/browse/SPARK-18127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18127: -- Target Version/s: 2.1.0 Description: As a Spark user I want to be able to cust

[jira] [Resolved] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17733. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-18067) SortMergeJoin adds shuffle if join predicates have non partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601455#comment-15601455 ] Herman van Hovell commented on SPARK-18067: --- [~tejasp] This makes sense to me.

[jira] [Updated] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18058: -- Fix Version/s: 2.0.2 > AnalysisException may be thrown when union two DFs whose struct

[jira] [Resolved] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18058. --- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 2.1.0 > AnalysisEx

[jira] [Commented] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

[ https://issues.apache.org/jira/browse/SPARK-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599951#comment-15599951 ] Herman van Hovell commented on SPARK-18065: --- This is - unfortunately - not real

[jira] [Updated] (SPARK-17123) Performing set operations that combine string and date / timestamp columns may result in generated projection code which doesn't compile

[ https://issues.apache.org/jira/browse/SPARK-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17123: -- Fix Version/s: 2.0.2 > Performing set operations that combine string and date / timesta

[jira] [Resolved] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

[ https://issues.apache.org/jira/browse/SPARK-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18045. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Move

[jira] [Resolved] (SPARK-18038) Move output partitioning definition from UnaryNodeExec to its children

[ https://issues.apache.org/jira/browse/SPARK-18038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18038. --- Resolution: Fixed Fix Version/s: 2.1.0 > Move output partitioning definition f

[jira] [Commented] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599523#comment-15599523 ] Herman van Hovell commented on SPARK-17495: --- O? Which data types are we missing

[jira] [Resolved] (SPARK-17123) Performing set operations that combine string and date / timestamp columns may result in generated projection code which doesn't compile

[ https://issues.apache.org/jira/browse/SPARK-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17123. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.1.0 > Perfo

[jira] [Commented] (SPARK-17074) generate histogram information for column

[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15597858#comment-15597858 ] Herman van Hovell commented on SPARK-17074: --- [~ZenWzh] I think your current app

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595377#comment-15595377 ] Herman van Hovell commented on SPARK-18016: --- Yeah there are limitations. Splitt

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595315#comment-15595315 ] Herman van Hovell commented on SPARK-18016: --- The java constant pool cannot hold

[jira] [Updated] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17982: -- Description: The following statement fails in the spark shell . {noformat} scala> spar

[jira] [Created] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

Herman van Hovell created SPARK-17996: - Summary: catalog.getFunction(name) returns wrong result for a permanent function Key: SPARK-17996 URL: https://issues.apache.org/jira/browse/SPARK-17996 Pro

[jira] [Resolved] (SPARK-17751) Remove spark.sql.eagerAnalysis

[ https://issues.apache.org/jira/browse/SPARK-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17751. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Remove spa

[jira] [Resolved] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17827. --- Resolution: Fixed Fix Version/s: 2.1.0 > StatisticsColumnSuite failures on big

[jira] [Updated] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17827: -- Assignee: Pete Robbins > StatisticsColumnSuite failures on big endian platforms > -

[jira] [Commented] (SPARK-17868) Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564586#comment-15564586 ] Herman van Hovell commented on SPARK-17868: --- [~jiangxb] can you work on this on

[jira] [Updated] (SPARK-17868) Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17868: -- Assignee: (was: Herman van Hovell) > Do not use bitmasks during parsing and analysi

[jira] [Created] (SPARK-17868) Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS

Herman van Hovell created SPARK-17868: - Summary: Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS Key: SPARK-17868 URL: https://issues.apache.org/jira/browse/SPARK-17868

[jira] [Resolved] (SPARK-17844) DataFrame API should simplify defining frame boundaries without partitioning/ordering

[ https://issues.apache.org/jira/browse/SPARK-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17844. --- Resolution: Fixed Fix Version/s: 2.1.0 Resolved per Reynold's PR. > DataFrame

[jira] [Closed] (SPARK-8816) Improve Performance of Unbounded Following Window Frame Processing

[ https://issues.apache.org/jira/browse/SPARK-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-8816. Resolution: Won't Fix Closing as won't fix since this has not come up as a performance probl

[jira] [Resolved] (SPARK-17741) Grammar to parse top level and nested data fields separately

[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17741. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Gramm

[jira] [Resolved] (SPARK-17832) TableIdentifier.quotedString creates un-parseable names when name contains a backtick

[ https://issues.apache.org/jira/browse/SPARK-17832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17832. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15557458#comment-15557458 ] Herman van Hovell commented on SPARK-17820: --- Yeah, sure we should take a look a

[jira] [Updated] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17820: -- Description: I am executing a HiveQL in spark-shell, I intend to insert a record into 2

[jira] [Resolved] (SPARK-17761) Simplify InternalRow hierarchy

[ https://issues.apache.org/jira/browse/SPARK-17761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17761. --- Resolution: Fixed Fix Version/s: 2.1.0 > Simplify InternalRow hierarchy >

[jira] [Updated] (SPARK-17832) TableIdentifier.quotedString creates un-parseable names when name contains a backtick

[ https://issues.apache.org/jira/browse/SPARK-17832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17832: -- Summary: TableIdentifier.quotedString creates un-parseable names when name contains a b

[jira] [Created] (SPARK-17832) TableIdentifier.quotedString creates un-parseable names when name contains a backpack

Herman van Hovell created SPARK-17832: - Summary: TableIdentifier.quotedString creates un-parseable names when name contains a backpack Key: SPARK-17832 URL: https://issues.apache.org/jira/browse/SPARK-17832

[jira] [Updated] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17612: -- Fix Version/s: 2.0.2 > Support `DESCRIBE table PARTITION` SQL syntax >

[jira] [Closed] (SPARK-17757) Remove CreateNamedStruct expressions

[ https://issues.apache.org/jira/browse/SPARK-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17757. - Resolution: Not A Problem > Remove CreateNamedStruct expressions > --

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549514#comment-15549514 ] Herman van Hovell commented on SPARK-17728: --- I think we eventually should add i

[jira] [Resolved] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17328. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > NPE

[jira] [Created] (SPARK-17782) Kafka 010 test is flaky

Herman van Hovell created SPARK-17782: - Summary: Kafka 010 test is flaky Key: SPARK-17782 URL: https://issues.apache.org/jira/browse/SPARK-17782 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17495: -- Issue Type: Improvement (was: Bug) > Hive hash implementation > --

[jira] [Resolved] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17495. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 > Hive h

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547358#comment-15547358 ] Herman van Hovell commented on SPARK-17728: --- The second one does not trigger th

[jira] [Comment Edited] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547358#comment-15547358 ] Herman van Hovell edited comment on SPARK-17728 at 10/5/16 1:56 AM: ---

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547352#comment-15547352 ] Herman van Hovell commented on SPARK-17728: --- There are different evaluation pat

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547300#comment-15547300 ] Herman van Hovell commented on SPARK-17758: --- That is correct. First keeps track

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547107#comment-15547107 ] Herman van Hovell commented on SPARK-17328: --- Go ahead. The actual fix is a one

[jira] [Commented] (SPARK-17074) generate histogram information for column

[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546911#comment-15546911 ] Herman van Hovell commented on SPARK-17074: --- I would prefer modifying (extendin

[jira] [Updated] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17758: -- Labels: correctness (was: ) > Spark Aggregate function LAST returns null on an empty

[jira] [Resolved] (SPARK-17753) Simple case in spark sql throws ParseException

[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17753. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15544011#comment-15544011 ] Herman van Hovell commented on SPARK-17758: --- We do, you have to implement a {{m

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543969#comment-15543969 ] Herman van Hovell commented on SPARK-17728: --- First of all, we implement subexpr

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543947#comment-15543947 ] Herman van Hovell commented on SPARK-17758: --- You could write your own UDAF. Pa

[jira] [Updated] (SPARK-17773) HiveInspector wrapper for JavaVoidObjectInspector is missing

[ https://issues.apache.org/jira/browse/SPARK-17773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17773: -- Description: Executing following query fails. {noformat} select SOME_UDAF*(a.arr) from

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543738#comment-15543738 ] Herman van Hovell commented on SPARK-17758: --- Yeah, you have a point there. It s

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543175#comment-15543175 ] Herman van Hovell commented on SPARK-17758: --- Why should last return a non null

[jira] [Updated] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17758: -- Description: My Environment Spark 2.0.0 I have included the physical plan of my app

[jira] [Created] (SPARK-17761) Simplify InternalRow hierarchy

Herman van Hovell created SPARK-17761: - Summary: Simplify InternalRow hierarchy Key: SPARK-17761 URL: https://issues.apache.org/jira/browse/SPARK-17761 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-17757) Remove CreateNamedStruct expressions

Herman van Hovell created SPARK-17757: - Summary: Remove CreateNamedStruct expressions Key: SPARK-17757 URL: https://issues.apache.org/jira/browse/SPARK-17757 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15539368#comment-15539368 ] Herman van Hovell commented on SPARK-17753: --- Yeah, the current grammar doesn't

[jira] [Commented] (SPARK-17753) Simple case in spark sql throws ParseException

[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15539354#comment-15539354 ] Herman van Hovell commented on SPARK-17753: --- We do not support the GTE/LTE/GT/L

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17753: -- Description: Simple case in sql throws parser exception in spark 2.0. The following que

[jira] [Updated] (SPARK-17739) Collapse adjacent similar Window operators

[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17739: -- Issue Type: Improvement (was: Bug) > Collapse adjacent similar Window operators >

[jira] [Resolved] (SPARK-17739) Collapse adjacent similar Window operators

[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17739. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 Resolv

[jira] [Commented] (SPARK-17739) Collapse adjacent similar Window operators

[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536957#comment-15536957 ] Herman van Hovell commented on SPARK-17739: --- Go ahead! > Collapse adjacent sim

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535023#comment-15535023 ] Herman van Hovell commented on SPARK-17728: --- I think calling {{explain(true)}}

[jira] [Closed] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17728. - Resolution: Not A Problem > UDFs are run too many times > --- > >

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534792#comment-15534792 ] Herman van Hovell commented on SPARK-17728: --- I am going to close this as not a

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534790#comment-15534790 ] Herman van Hovell commented on SPARK-17728: --- Spark assumes UDF's are pure funct

[jira] [Updated] (SPARK-17739) Collapse adjacent similar Window operators

[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17739: -- Summary: Collapse adjacent similar Window operators (was: Collapse adjacent similar Wi

[jira] [Created] (SPARK-17739) Collapse adjacent similar Window operations.

Herman van Hovell created SPARK-17739: - Summary: Collapse adjacent similar Window operations. Key: SPARK-17739 URL: https://issues.apache.org/jira/browse/SPARK-17739 Project: Spark Issue

[jira] [Resolved] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17612. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 Resolv

[jira] [Resolved] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17653. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.1.0 Reso

[jira] [Commented] (SPARK-17735) Cannot call sqlContext inside udf

[ https://issues.apache.org/jira/browse/SPARK-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534069#comment-15534069 ] Herman van Hovell commented on SPARK-17735: --- It it better to completely do this

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534059#comment-15534059 ] Herman van Hovell commented on SPARK-17728: --- You really should not try to use a

[jira] [Closed] (SPARK-17735) Cannot call sqlContext inside udf

[ https://issues.apache.org/jira/browse/SPARK-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17735. - Resolution: Not A Problem > Cannot call sqlContext inside udf > -

[jira] [Updated] (SPARK-17735) Cannot call sqlContext inside udf

[ https://issues.apache.org/jira/browse/SPARK-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17735: -- Description: Hello, I know it is a strange use case but I just wanted to append is cach

[jira] [Commented] (SPARK-17735) Cannot call sqlContext inside udf

[ https://issues.apache.org/jira/browse/SPARK-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534040#comment-15534040 ] Herman van Hovell commented on SPARK-17735: --- You really should not use {{sqlCon

[jira] [Created] (SPARK-17717) Add existence checks to user facing catalog

Herman van Hovell created SPARK-17717: - Summary: Add existence checks to user facing catalog Key: SPARK-17717 URL: https://issues.apache.org/jira/browse/SPARK-17717 Project: Spark Issue T

[jira] [Resolved] (SPARK-17712) Incorrect result due to invalid pushdown of data-independent filter beneath aggregate

[ https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17712. --- Resolution: Fixed Fix Version/s: 2.1.0 Resolved per Josh's PR. > Incorrect re

[jira] [Resolved] (SPARK-17677) Break WindowExec.scala into multiple files

[ https://issues.apache.org/jira/browse/SPARK-17677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17677. --- Resolution: Fixed Fix Version/s: 2.1.0 Resolved per Reynold's PR. > Break Win

[jira] [Resolved] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17618. --- Resolution: Fixed Fix Version/s: 1.6.3 Resolved per Josh's PR. Follow-up for

[jira] [Resolved] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17660. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > DESC FORMA

[jira] [Resolved] (SPARK-17682) nit: Mark children as final for Unary, Binary, Leaf expression and plan nodes

[ https://issues.apache.org/jira/browse/SPARK-17682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17682. --- Resolution: Fixed Fix Version/s: 2.1.0 Resolved per Reynold's PR. > nit: Mark

[jira] [Commented] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525036#comment-15525036 ] Herman van Hovell commented on SPARK-17673: --- Could you also share the optimized

[jira] [Comment Edited] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525036#comment-15525036 ] Herman van Hovell edited comment on SPARK-17673 at 9/27/16 4:31 AM: ---

[jira] [Commented] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524993#comment-15524993 ] Herman van Hovell commented on SPARK-17673: --- [~rspitzer] we only reuse an excha

<    3   4   5   6   7   8   9   10   11   12   >