[jira] [Commented] (SPARK-18053) ARRAY equality is broken in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598986#comment-15598986 ] Wenchen Fan commented on SPARK-18053: - [~lian cheng] are you sure this issue exists in 2.0? The new

[jira] [Updated] (SPARK-18035) Introduce performant and memory efficient APIs to create ArrayBasedMapData

[ https://issues.apache.org/jira/browse/SPARK-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18035: Assignee: Tejas Patil > Introduce performant and memory efficient APIs to create ArrayBasedMapData >

[jira] [Resolved] (SPARK-18035) Introduce performant and memory efficient APIs to create ArrayBasedMapData

[ https://issues.apache.org/jira/browse/SPARK-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18035. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15573

[jira] [Updated] (SPARK-18035) Introduce performant and memory efficient APIs to create ArrayBasedMapData

[ https://issues.apache.org/jira/browse/SPARK-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-18035: Summary: Introduce performant and memory efficient APIs to create ArrayBasedMapData (was:

[jira] [Updated] (SPARK-17698) Join predicates should not contain filter clauses

[ https://issues.apache.org/jira/browse/SPARK-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17698: Fix Version/s: 2.0.2 > Join predicates should not contain filter clauses >

[jira] [Commented] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598448#comment-15598448 ] Aral Can Kaymaz commented on SPARK-16845: - I am currently out of office, and will be back on

[jira] [Commented] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598442#comment-15598442 ] Don Drake commented on SPARK-16845: --- Update: It turns out that I am still getting this exception.

[jira] [Commented] (SPARK-17698) Join predicates should not contain filter clauses

[ https://issues.apache.org/jira/browse/SPARK-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598437#comment-15598437 ] Apache Spark commented on SPARK-17698: -- User 'tejasapatil' has created a pull request for this

[jira] [Updated] (SPARK-18038) Move output partitioning definition from UnaryNodeExec to its children

[ https://issues.apache.org/jira/browse/SPARK-18038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18038: Target Version/s: 2.1.0 > Move output partitioning definition from UnaryNodeExec to its children >

[jira] [Updated] (SPARK-18038) Move output partitioning definition from UnaryNodeExec to its children

[ https://issues.apache.org/jira/browse/SPARK-18038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18038: Assignee: Tejas Patil > Move output partitioning definition from UnaryNodeExec to its children >

[jira] [Commented] (SPARK-18017) Changing Hadoop parameter through sparkSession.sparkContext.hadoopConfiguration doesn't work

[ https://issues.apache.org/jira/browse/SPARK-18017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598339#comment-15598339 ] Yuehua Zhang commented on SPARK-18017: -- Thanks for your input! I only want to change the parameter

[jira] [Resolved] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-928. --- Resolution: Fixed Assignee: Sandeep Singh Fix Version/s: 2.1.0 > Add support for

[jira] [Resolved] (SPARK-18051) Custom PartitionCoalescer cause serialization exception

[ https://issues.apache.org/jira/browse/SPARK-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18051. - Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.1.0 > Custom

[jira] [Comment Edited] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598281#comment-15598281 ] David Shar edited comment on SPARK-18027 at 10/22/16 6:36 PM: -- I believe it

[jira] [Commented] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598281#comment-15598281 ] David Shar commented on SPARK-18027: I believe it there is a major difference between the 2

[jira] [Resolved] (SPARK-17123) Performing set operations that combine string and date / timestamp columns may result in generated projection code which doesn't compile

[ https://issues.apache.org/jira/browse/SPARK-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17123. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.1.0 >

[jira] [Updated] (SPARK-17994) Add back a file status cache for catalog tables

[ https://issues.apache.org/jira/browse/SPARK-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17994: Assignee: Eric Liang > Add back a file status cache for catalog tables >

[jira] [Resolved] (SPARK-17994) Add back a file status cache for catalog tables

[ https://issues.apache.org/jira/browse/SPARK-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17994. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15539

[jira] [Commented] (SPARK-17074) generate histogram information for column

[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597858#comment-15597858 ] Herman van Hovell commented on SPARK-17074: --- [~ZenWzh] I think your current approach is valid.

[jira] [Commented] (SPARK-18054) Unexpected error from UDF that gets an element of a vector: argument 1 requires vector type, however, '`_column_`' is of vector type

[ https://issues.apache.org/jira/browse/SPARK-18054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597816#comment-15597816 ] Barry Becker commented on SPARK-18054: -- Ah. That is quite likely the problem. I will verify next

[jira] [Comment Edited] (SPARK-17074) generate histogram information for column

[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570366#comment-15570366 ] Zhenhua Wang edited comment on SPARK-17074 at 10/22/16 12:52 PM: - Well,

[jira] [Updated] (SPARK-17986) SQLTransformer leaks temporary tables

[ https://issues.apache.org/jira/browse/SPARK-17986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17986: Affects Version/s: (was: 2.0.1) > SQLTransformer leaks temporary tables >

[jira] [Resolved] (SPARK-17986) SQLTransformer leaks temporary tables

[ https://issues.apache.org/jira/browse/SPARK-17986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-17986. - Resolution: Fixed Assignee: Drew Robb Fix Version/s: 2.1.0

[jira] [Assigned] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18022: Assignee: Apache Spark > java.lang.NullPointerException instead of real exception when

[jira] [Commented] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597477#comment-15597477 ] Apache Spark commented on SPARK-18022: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18022: Assignee: (was: Apache Spark) > java.lang.NullPointerException instead of real

[jira] [Assigned] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18027: Assignee: Apache Spark > .sparkStaging not clean on RM ApplicationNotFoundException >

[jira] [Resolved] (SPARK-15042) ConnectedComponents fails to compute graph with 200 vertices (but long paths)

[ https://issues.apache.org/jira/browse/SPARK-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15042. --- Resolution: Cannot Reproduce Provisionally closing as it may have been fixed in between these

[jira] [Assigned] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18027: Assignee: (was: Apache Spark) > .sparkStaging not clean on RM

[jira] [Commented] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597470#comment-15597470 ] Apache Spark commented on SPARK-18027: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-18062) ProbabilisticClassificationModel.normalizeToProbabilitiesInPlace should return probabilities when given all-0 vector

[ https://issues.apache.org/jira/browse/SPARK-18062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597464#comment-15597464 ] Sean Owen commented on SPARK-18062: --- In the spirit of throwing errors on invalid input, shouldn't this

[jira] [Commented] (SPARK-18052) Spark Job failing with org.apache.spark.rpc.RpcTimeoutException

[ https://issues.apache.org/jira/browse/SPARK-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597456#comment-15597456 ] Sean Owen commented on SPARK-18052: --- This sounds like you have some env or network problem. I'm not

[jira] [Commented] (SPARK-18054) Unexpected error from UDF that gets an element of a vector: argument 1 requires vector type, however, '`_column_`' is of vector type

[ https://issues.apache.org/jira/browse/SPARK-18054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597454#comment-15597454 ] Sean Owen commented on SPARK-18054: --- Are you creating .ml vectors, or .mllib vectors? there are two

[jira] [Updated] (SPARK-17898) --repositories needs username and password

[ https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17898: -- Fix Version/s: 2.1.0 > --repositories needs username and password >

[jira] [Reopened] (SPARK-17898) --repositories needs username and password

[ https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-17898: --- > --repositories needs username and password > --- > >

[jira] [Resolved] (SPARK-17898) --repositories needs username and password

[ https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17898. --- Resolution: Fixed Documented. > --repositories needs username and password >

[jira] [Resolved] (SPARK-17944) sbin/start-* scripts use of `hostname -f` fail with Solaris

[ https://issues.apache.org/jira/browse/SPARK-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17944. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15557

[jira] [Updated] (SPARK-17944) sbin/start-* scripts use of `hostname -f` fail with Solaris

[ https://issues.apache.org/jira/browse/SPARK-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17944: -- Assignee: Erik O'Shaughnessy > sbin/start-* scripts use of `hostname -f` fail with Solaris >

[jira] [Resolved] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18047. --- Resolution: Not A Problem > Spark worker port should be greater than 1023 >

[jira] [Assigned] (SPARK-18063) Failed to infer constraints over multiple aliases

[ https://issues.apache.org/jira/browse/SPARK-18063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18063: Assignee: (was: Apache Spark) > Failed to infer constraints over multiple aliases >

[jira] [Commented] (SPARK-18063) Failed to infer constraints over multiple aliases

[ https://issues.apache.org/jira/browse/SPARK-18063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597304#comment-15597304 ] Apache Spark commented on SPARK-18063: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-18063) Failed to infer constraints over multiple aliases

[ https://issues.apache.org/jira/browse/SPARK-18063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18063: Assignee: Apache Spark > Failed to infer constraints over multiple aliases >

[jira] [Created] (SPARK-18063) Failed to infer constraints over multiple aliases

Jiang Xingbo created SPARK-18063: Summary: Failed to infer constraints over multiple aliases Key: SPARK-18063 URL: https://issues.apache.org/jira/browse/SPARK-18063 Project: Spark Issue