[jira] [Commented] (SPARK-17788) RangePartitioner results in few very large tasks and many small to empty tasks

2016-11-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699276#comment-15699276 ] Wenchen Fan commented on SPARK-17788: - After looking at the code, it seems the only w

[jira] [Commented] (SPARK-18539) Cannot filter by nonexisting column in parquet file

2016-11-27 Thread Vitaly Gerasimov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699367#comment-15699367 ] Vitaly Gerasimov commented on SPARK-18539: -- [~dongjoon] I don't know. However, i

[jira] [Updated] (SPARK-18593) JDBCRDD fails to filter CHAR type column for PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18593: -- Summary: JDBCRDD fails to filter CHAR type column for PostgreSQL (was: Unable to use filter fu

[jira] [Resolved] (SPARK-18315) Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18315. --- Resolution: Cannot Reproduce > Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1 > ---

[jira] [Updated] (SPARK-18593) JDBCRDD fails to filter CHAR type column for PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18593: -- Description: In Apache Spark 1.6.x, JDBCRDD returns incorrect results for a query with filters

[jira] [Resolved] (SPARK-18484) case class datasets - ability to specify decimal precision and scale

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18484. --- Resolution: Won't Fix > case class datasets - ability to specify decimal precision and scale > --

[jira] [Resolved] (SPARK-18503) Pre 2.0 spark driver/executor memory default unit is bytes, post 2.0 default unit is MB

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18503. --- Resolution: Not A Problem > Pre 2.0 spark driver/executor memory default unit is bytes, post 2.0 defa

[jira] [Resolved] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18475. --- Resolution: Not A Problem > Be able to provide higher parallelization for StructuredStreaming Kafka S

[jira] [Resolved] (SPARK-18122) Fallback to Kryo for unknown classes in ExpressionEncoder

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18122. --- Resolution: Won't Fix > Fallback to Kryo for unknown classes in ExpressionEncoder > -

[jira] [Updated] (SPARK-18593) JDBCRDD returns incorrect results for a query with filters on CHAR type column of PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18593: -- Labels: correctness (was: ) > JDBCRDD returns incorrect results for a query with filters on CH

[jira] [Updated] (SPARK-18593) JDBCRDD returns incorrect results for a query with filters on CHAR type column of PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18593: -- Summary: JDBCRDD returns incorrect results for a query with filters on CHAR type column of Post

[jira] [Resolved] (SPARK-6346) Use faster converging optimization method in MLlib

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6346. -- Resolution: Not A Problem > Use faster converging optimization method in MLlib > ---

[jira] [Resolved] (SPARK-18561) when checkpoint restore ,Streaming Dstream join RDD from hbase exception

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18561. --- Resolution: Invalid > when checkpoint restore ,Streaming Dstream join RDD from hbase exception > ---

[jira] [Commented] (SPARK-18593) JDBCRDD returns incorrect results for a query with filters on CHAR type column of PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699431#comment-15699431 ] Dongjoon Hyun commented on SPARK-18593: --- Although this is correctness issue, there

[jira] [Resolved] (SPARK-17436) dataframe.write sometimes does not keep sorting

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17436. --- Resolution: Not A Problem Target Version/s: 2.1.0 OK, if this seems to you resolved as of 2

[jira] [Updated] (SPARK-18593) JDBCRDD returns incorrect results for filters on CHAR of PostgreSQL

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18593: -- Summary: JDBCRDD returns incorrect results for filters on CHAR of PostgreSQL (was: JDBCRDD ret

[jira] [Commented] (SPARK-18120) QueryExecutionListener method doesnt' get executed for DataFrameWriter methods

2016-11-27 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699523#comment-15699523 ] Thomas Sebastian commented on SPARK-18120: -- [~salilsurendran] [~rxin] [~jayadeva

[jira] [Commented] (SPARK-18593) JDBCRDD returns incorrect results for filters on CHAR of PostgreSQL

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699536#comment-15699536 ] Apache Spark commented on SPARK-18593: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-18593) JDBCRDD returns incorrect results for filters on CHAR of PostgreSQL

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18593: Assignee: Apache Spark > JDBCRDD returns incorrect results for filters on CHAR of PostgreS

[jira] [Assigned] (SPARK-18593) JDBCRDD returns incorrect results for filters on CHAR of PostgreSQL

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18593: Assignee: (was: Apache Spark) > JDBCRDD returns incorrect results for filters on CHAR

[jira] [Commented] (SPARK-17212) TypeCoercion support widening conversion between DateType and TimestampType

2016-11-27 Thread Furcy Pin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699575#comment-15699575 ] Furcy Pin commented on SPARK-17212: --- Hi, I have the same issue between DateType and St

[jira] [Commented] (SPARK-18122) Fallback to Kryo for unknown classes in ExpressionEncoder

2016-11-27 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699681#comment-15699681 ] koert kuipers commented on SPARK-18122: --- [~sowen] why won'f fix? what changed [~mar

[jira] [Commented] (SPARK-18122) Fallback to Kryo for unknown classes in ExpressionEncoder

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699688#comment-15699688 ] Sean Owen commented on SPARK-18122: --- See discussion on the PR. Reopen if there is an al

[jira] [Commented] (SPARK-17212) TypeCoercion support widening conversion between DateType and TimestampType

2016-11-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699699#comment-15699699 ] Herman van Hovell commented on SPARK-17212: --- This fixes union, but not greatest

[jira] [Created] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-18597: - Summary: Do not push down filters for LEFT ANTI JOIN Key: SPARK-18597 URL: https://issues.apache.org/jira/browse/SPARK-18597 Project: Spark Issue T

[jira] [Commented] (SPARK-17212) TypeCoercion support widening conversion between DateType and TimestampType

2016-11-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699731#comment-15699731 ] Hyukjin Kwon commented on SPARK-17212: -- Oh, [~hvanhovell], I might be wrong but I gu

[jira] [Commented] (SPARK-17212) TypeCoercion support widening conversion between DateType and TimestampType

2016-11-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699751#comment-15699751 ] Hyukjin Kwon commented on SPARK-17212: -- Oh wait, I am sorry. I rushed the comments.

[jira] [Created] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Hamish Morgan (JIRA)
Hamish Morgan created SPARK-18598: - Summary: Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError Key: SPARK-18598 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Assigned] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18598: Assignee: (was: Apache Spark) > Encoding a Java Bean with extra accessors, produces in

[jira] [Assigned] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18598: Assignee: Apache Spark > Encoding a Java Bean with extra accessors, produces inconsistent

[jira] [Commented] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699842#comment-15699842 ] Apache Spark commented on SPARK-18598: -- User 'hamishmorgan' has created a pull reque

[jira] [Updated] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Hamish Morgan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hamish Morgan updated SPARK-18598: -- Description: Most operations of {{org.apache.spark.sql.Dataset}} throw {{java.lang.AssertionEr

[jira] [Created] (SPARK-18599) Add the Spectral LDA algorithm which applies Tensor Decomposition to the LDA modelling. The Spectral LDA is a new breed of algorithm purely linear with guaranteed conver

2016-11-27 Thread Jencir Lee (JIRA)
Jencir Lee created SPARK-18599: -- Summary: Add the Spectral LDA algorithm which applies Tensor Decomposition to the LDA modelling. The Spectral LDA is a new breed of algorithm purely linear with guaranteed convergence by theory. Key:

[jira] [Updated] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Jencir Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jencir Lee updated SPARK-18599: --- Summary: Add the Spectral LDA algorithm (was: Add the Spectral LDA algorithm which applies Tensor De

[jira] [Assigned] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18599: Assignee: (was: Apache Spark) > Add the Spectral LDA algorithm > -

[jira] [Commented] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699952#comment-15699952 ] Apache Spark commented on SPARK-18599: -- User 'jli05' has created a pull request for

[jira] [Assigned] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18599: Assignee: Apache Spark > Add the Spectral LDA algorithm > -- >

[jira] [Commented] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699975#comment-15699975 ] Sean Owen commented on SPARK-18599: --- If this is already a usable stand-alone package, d

[jira] [Commented] (SPARK-18599) Add the Spectral LDA algorithm

2016-11-27 Thread Jencir Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1569#comment-1569 ] Jencir Lee commented on SPARK-18599: We consider it a competitive alternative to the

[jira] [Commented] (SPARK-17788) RangePartitioner results in few very large tasks and many small to empty tasks

2016-11-27 Thread Babak Alipour (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700013#comment-15700013 ] Babak Alipour commented on SPARK-17788: --- No, I didn't change that conf. I did try t

[jira] [Created] (SPARK-18600) BZ2 CRC read error needs better reporting

2016-11-27 Thread Charles Allen (JIRA)
Charles Allen created SPARK-18600: - Summary: BZ2 CRC read error needs better reporting Key: SPARK-18600 URL: https://issues.apache.org/jira/browse/SPARK-18600 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18600) BZ2 CRC read error needs better reporting

2016-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18600: -- Priority: Minor (was: Major) Description: {code} 16/11/25 20:05:03 ERROR InsertIntoHadoopFsRel

[jira] [Commented] (SPARK-18120) QueryExecutionListener method doesnt' get executed for DataFrameWriter methods

2016-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700108#comment-15700108 ] Reynold Xin commented on SPARK-18120: - They should get triggered. Are you sure they d

[jira] [Commented] (SPARK-18598) Encoding a Java Bean with extra accessors, produces inconsistent Dataset, resulting in AssertionError

2016-11-27 Thread Hamish Morgan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700192#comment-15700192 ] Hamish Morgan commented on SPARK-18598: --- PR closed, unmerged. Couldn't fix it witho

[jira] [Updated] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18597: -- Labels: correctness (was: ) > Do not push down filters for LEFT ANTI JOIN > --

[jira] [Created] (SPARK-18601) Simplify Create/Get complex expression pairs in optimizer

2016-11-27 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-18601: - Summary: Simplify Create/Get complex expression pairs in optimizer Key: SPARK-18601 URL: https://issues.apache.org/jira/browse/SPARK-18601 Project: Spark

[jira] [Commented] (SPARK-17788) RangePartitioner results in few very large tasks and many small to empty tasks

2016-11-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700440#comment-15700440 ] Herman van Hovell commented on SPARK-17788: --- [~babak.alip...@gmail.com] A few q

[jira] [Created] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-27 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18602: Summary: Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6 Key: SPARK-18602 URL: https://issues.apache.org/jira/browse/SPARK-18602

[jira] [Updated] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18603: -- Description: This issue aims to allow OuterReference columns in projection lists of IN correla

[jira] [Created] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-18603: - Summary: Support `OuterReference` in projection list of IN correlated subqueries Key: SPARK-18603 URL: https://issues.apache.org/jira/browse/SPARK-18603 Project: Sp

[jira] [Commented] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700515#comment-15700515 ] Apache Spark commented on SPARK-18602: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18602: Assignee: Apache Spark > Dependency list still shows that the version of > org.codehaus.j

[jira] [Assigned] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18602: Assignee: (was: Apache Spark) > Dependency list still shows that the version of > org

[jira] [Updated] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18603: -- Description: This issue aims to allow OuterReference columns in projection lists of IN correla

[jira] [Assigned] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18597: Assignee: Apache Spark > Do not push down filters for LEFT ANTI JOIN > ---

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700571#comment-15700571 ] Apache Spark commented on SPARK-18597: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18597: Assignee: (was: Apache Spark) > Do not push down filters for LEFT ANTI JOIN >

[jira] [Created] (SPARK-18604) Collapse Window optimizer rule changes column order

2016-11-27 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-18604: - Summary: Collapse Window optimizer rule changes column order Key: SPARK-18604 URL: https://issues.apache.org/jira/browse/SPARK-18604 Project: Spark

[jira] [Commented] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700626#comment-15700626 ] Nattavut Sutyanyong commented on SPARK-18603: - [~dongjoon] Shall we coordinat

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-27 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700636#comment-15700636 ] Nattavut Sutyanyong commented on SPARK-18597: - It's nice to learn through thi

[jira] [Created] (SPARK-18605) Spark Streaming ERROR TransportResponseHandler: Still have 1 requests outstanding when connection

2016-11-27 Thread jiafeng.zhang (JIRA)
jiafeng.zhang created SPARK-18605: - Summary: Spark Streaming ERROR TransportResponseHandler: Still have 1 requests outstanding when connection Key: SPARK-18605 URL: https://issues.apache.org/jira/browse/SPARK-186

[jira] [Resolved] (SPARK-18594) Name Validation of Databases/Tables

2016-11-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18594. - Resolution: Fixed Assignee: Xiao Li > Name Validation of Databases/Tables > ---

[jira] [Commented] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700838#comment-15700838 ] Dongjoon Hyun commented on SPARK-18603: --- Sure! > Support `OuterReference` in proje

[jira] [Updated] (SPARK-18603) Support `OuterReference` in projection list of IN correlated subqueries

2016-11-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18603: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-18455 > Support `OuterReference`

[jira] [Resolved] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

2016-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18482. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.1.0 > make sure Spark ca

[jira] [Commented] (SPARK-18518) HasSolver should support allowed values

2016-11-27 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701099#comment-15701099 ] zhengruifeng commented on SPARK-18518: -- I think three places need to modify: 1, make

[jira] [Commented] (SPARK-18220) ClassCastException occurs when using select query on ORC file

2016-11-27 Thread Jerryjung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701117#comment-15701117 ] Jerryjung commented on SPARK-18220: --- [~cloud_fan] For further information, tables were

[jira] [Assigned] (SPARK-18518) HasSolver should support allowed values

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18518: Assignee: zhengruifeng (was: Apache Spark) > HasSolver should support allowed values > --

[jira] [Assigned] (SPARK-18518) HasSolver should support allowed values

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18518: Assignee: Apache Spark (was: zhengruifeng) > HasSolver should support allowed values > --

[jira] [Commented] (SPARK-18518) HasSolver should support allowed values

2016-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701120#comment-15701120 ] Apache Spark commented on SPARK-18518: -- User 'zhengruifeng' has created a pull reque

[jira] [Resolved] (SPARK-18585) Use `ev.isNull = "false"` if possible for Janino to have a chance to optimize.

2016-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18585. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.1.0 > Use `ev.isNull =

[jira] [Resolved] (SPARK-15950) Eliminate unreachable code at projection for complex types

2016-11-27 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki resolved SPARK-15950. -- Resolution: Duplicate > Eliminate unreachable code at projection for complex types > --