[jira] [Updated] (SPARK-10960) SQL with windowing function cannot reference column in inner select block

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10960: Description: There seems to be a bug in the Spark SQL parser when I use windowing functions. Speci

[jira] [Issue Comment Deleted] (SPARK-11000) Derby have booted the database twice in yarn security mode.

2015-10-07 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-11000: - Comment: was deleted (was: Very similar with it but this is in yarn security mode.) > Derby have

[jira] [Commented] (SPARK-11000) Derby have booted the database twice in yarn security mode.

2015-10-07 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948138#comment-14948138 ] SaintBacchus commented on SPARK-11000: -- Very similar with it but this is in yarn sec

[jira] [Created] (SPARK-11000) Derby have booted the database twice in yarn security mode.

2015-10-07 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-11000: Summary: Derby have booted the database twice in yarn security mode. Key: SPARK-11000 URL: https://issues.apache.org/jira/browse/SPARK-11000 Project: Spark

[jira] [Resolved] (SPARK-7869) Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Columns

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7869. Resolution: Fixed Fix Version/s: 1.6.0 > Spark Data Frame Fails to Load Postgres Tables with

[jira] [Updated] (SPARK-10974) Add progress bar for output operation column and use red dots for failed batches

2015-10-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-10974: - Summary: Add progress bar for output operation column and use red dots for failed batches (was:

[jira] [Assigned] (SPARK-10999) Physical plan node Coalesce should be able to handle UnsafeRow

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10999: Assignee: Apache Spark (was: Cheng Lian) > Physical plan node Coalesce should be able to

[jira] [Commented] (SPARK-10999) Physical plan node Coalesce should be able to handle UnsafeRow

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948133#comment-14948133 ] Apache Spark commented on SPARK-10999: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-10999) Physical plan node Coalesce should be able to handle UnsafeRow

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10999: Assignee: Cheng Lian (was: Apache Spark) > Physical plan node Coalesce should be able to

[jira] [Created] (SPARK-10999) Physical plan node Coalesce should be able to handle UnsafeRow

2015-10-07 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10999: -- Summary: Physical plan node Coalesce should be able to handle UnsafeRow Key: SPARK-10999 URL: https://issues.apache.org/jira/browse/SPARK-10999 Project: Spark I

[jira] [Assigned] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10996: Assignee: Apache Spark > Implement sampleBy() in DataFrameStatFunctions >

[jira] [Commented] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948099#comment-14948099 ] Apache Spark commented on SPARK-10996: -- User 'sun-rui' has created a pull request fo

[jira] [Assigned] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10996: Assignee: (was: Apache Spark) > Implement sampleBy() in DataFrameStatFunctions > -

[jira] [Assigned] (SPARK-10998) Show non-children in default Expression.toString

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10998: Assignee: Michael Armbrust (was: Apache Spark) > Show non-children in default Expression.

[jira] [Commented] (SPARK-10998) Show non-children in default Expression.toString

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948007#comment-14948007 ] Apache Spark commented on SPARK-10998: -- User 'marmbrus' has created a pull request f

[jira] [Assigned] (SPARK-10998) Show non-children in default Expression.toString

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10998: Assignee: Apache Spark (was: Michael Armbrust) > Show non-children in default Expression.

[jira] [Created] (SPARK-10998) Show non-children in default Expression.toString

2015-10-07 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-10998: Summary: Show non-children in default Expression.toString Key: SPARK-10998 URL: https://issues.apache.org/jira/browse/SPARK-10998 Project: Spark Issu

[jira] [Created] (SPARK-10997) Netty-based RPC env should support a "client-only" mode.

2015-10-07 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10997: -- Summary: Netty-based RPC env should support a "client-only" mode. Key: SPARK-10997 URL: https://issues.apache.org/jira/browse/SPARK-10997 Project: Spark

[jira] [Closed] (SPARK-10753) Implement freqItems() and sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-10753. --- Resolution: Duplicate > Implement freqItems() and sampleBy() in DataFrameStatFunctions >

[jira] [Commented] (SPARK-10753) Implement freqItems() and sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947995#comment-14947995 ] Sun Rui commented on SPARK-10753: - break down this issue into two subtasks. and close thi

[jira] [Assigned] (SPARK-10987) yarn-client mode misbehaving with netty-based RPC backend

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10987: Assignee: Apache Spark > yarn-client mode misbehaving with netty-based RPC backend > -

[jira] [Created] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-07 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10996: --- Summary: Implement sampleBy() in DataFrameStatFunctions Key: SPARK-10996 URL: https://issues.apache.org/jira/browse/SPARK-10996 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-10987) yarn-client mode misbehaving with netty-based RPC backend

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947994#comment-14947994 ] Apache Spark commented on SPARK-10987: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-10987) yarn-client mode misbehaving with netty-based RPC backend

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10987: Assignee: (was: Apache Spark) > yarn-client mode misbehaving with netty-based RPC back

[jira] [Updated] (SPARK-10995) Graceful shutdown drops processing in Spark Streaming

2015-10-07 Thread Michal Cizmazia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Cizmazia updated SPARK-10995: Description: After triggering the graceful shutdown on the following application, the appl

[jira] [Created] (SPARK-10995) Graceful shutdown drops processing in Spark Streaming

2015-10-07 Thread Michal Cizmazia (JIRA)
Michal Cizmazia created SPARK-10995: --- Summary: Graceful shutdown drops processing in Spark Streaming Key: SPARK-10995 URL: https://issues.apache.org/jira/browse/SPARK-10995 Project: Spark I

[jira] [Created] (SPARK-10994) Local clustering coefficient computation in GraphX

2015-10-07 Thread Yang Yang (JIRA)
Yang Yang created SPARK-10994: - Summary: Local clustering coefficient computation in GraphX Key: SPARK-10994 URL: https://issues.apache.org/jira/browse/SPARK-10994 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-10989) Add the dot and hadamard products to the Vectors object

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10989: Assignee: (was: Apache Spark) > Add the dot and hadamard products to the Vectors objec

[jira] [Commented] (SPARK-10989) Add the dot and hadamard products to the Vectors object

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947964#comment-14947964 ] Apache Spark commented on SPARK-10989: -- User 'da-steve101' has created a pull reques

[jira] [Assigned] (SPARK-10989) Add the dot and hadamard products to the Vectors object

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10989: Assignee: Apache Spark > Add the dot and hadamard products to the Vectors object > ---

[jira] [Assigned] (SPARK-10993) Inital code generated encoder for product types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10993: Assignee: Apache Spark (was: Michael Armbrust) > Inital code generated encoder for produc

[jira] [Assigned] (SPARK-10993) Inital code generated encoder for product types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10993: Assignee: Michael Armbrust (was: Apache Spark) > Inital code generated encoder for produc

[jira] [Commented] (SPARK-10993) Inital code generated encoder for product types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947962#comment-14947962 ] Apache Spark commented on SPARK-10993: -- User 'marmbrus' has created a pull request f

[jira] [Created] (SPARK-10993) Inital code generated encoder for product types

2015-10-07 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-10993: Summary: Inital code generated encoder for product types Key: SPARK-10993 URL: https://issues.apache.org/jira/browse/SPARK-10993 Project: Spark Issue

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-07 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947928#comment-14947928 ] Rick Hillegas commented on SPARK-10977: --- Hi Sean, That approach may work for some

[jira] [Commented] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947912#comment-14947912 ] Apache Spark commented on SPARK-10992: -- User 'chenghao-intel' has created a pull req

[jira] [Assigned] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10992: Assignee: (was: Apache Spark) > Partial Aggregation Support for Hive UDAF > --

[jira] [Assigned] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10992: Assignee: Apache Spark > Partial Aggregation Support for Hive UDAF > -

[jira] [Created] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-10992: - Summary: Partial Aggregation Support for Hive UDAF Key: SPARK-10992 URL: https://issues.apache.org/jira/browse/SPARK-10992 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-10992: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Partial Aggregation Support for H

[jira] [Assigned] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10767: Assignee: Apache Spark > Make pyspark shared params codegen more consistent > ---

[jira] [Assigned] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10767: Assignee: (was: Apache Spark) > Make pyspark shared params codegen more consistent >

[jira] [Commented] (SPARK-10767) Make pyspark shared params codegen more consistent

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947899#comment-14947899 ] Apache Spark commented on SPARK-10767: -- User 'holdenk' has created a pull request fo

[jira] [Commented] (SPARK-10987) yarn-client mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947893#comment-14947893 ] Marcelo Vanzin commented on SPARK-10987: Anyway, here's what I found so far. Dri

[jira] [Created] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

2015-10-07 Thread holdenk (JIRA)
holdenk created SPARK-10991: --- Summary: LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set Key: SPARK-10991 URL: https://issues.apache.org/jira/browse/SPARK-10991

[jira] [Resolved] (SPARK-9774) Add Python API for ml.regression.IsotonicRegression

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9774. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8214 [https

[jira] [Resolved] (SPARK-10064) Decision tree continuous feature binning is slow in large feature spaces

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10064. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8246 [ht

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

2015-10-07 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947871#comment-14947871 ] Huaxin Gao commented on SPARK-8386: --- The TableExists bug is already resolved in Jira 907

[jira] [Closed] (SPARK-10940) Too many open files Spark Shuffle

2015-10-07 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal closed SPARK-10940. --- Resolution: Fixed Could not able to reproduce after restarting all the machines. > Too many open fil

[jira] [Assigned] (SPARK-10990) Avoid the serialization multiple times during unrolling of complex types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10990: Assignee: Apache Spark (was: Davies Liu) > Avoid the serialization multiple times during

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

2015-10-07 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947836#comment-14947836 ] Sandeep Pal commented on SPARK-10940: - I rebooted all the machines and issue is not r

[jira] [Commented] (SPARK-10990) Avoid the serialization multiple times during unrolling of complex types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947838#comment-14947838 ] Apache Spark commented on SPARK-10990: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10990) Avoid the serialization multiple times during unrolling of complex types

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10990: Assignee: Davies Liu (was: Apache Spark) > Avoid the serialization multiple times during

[jira] [Created] (SPARK-10990) Avoid the serialization multiple times during unrolling of complex types

2015-10-07 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10990: -- Summary: Avoid the serialization multiple times during unrolling of complex types Key: SPARK-10990 URL: https://issues.apache.org/jira/browse/SPARK-10990 Project: Spark

[jira] [Created] (SPARK-10989) Add the dot and hadamard products to the Vectors object

2015-10-07 Thread Stephen Tridgell (JIRA)
Stephen Tridgell created SPARK-10989: Summary: Add the dot and hadamard products to the Vectors object Key: SPARK-10989 URL: https://issues.apache.org/jira/browse/SPARK-10989 Project: Spark

[jira] [Assigned] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10988: Assignee: Apache Spark (was: Josh Rosen) > Reduce duplication in Aggregate2's expression

[jira] [Assigned] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10988: Assignee: Josh Rosen (was: Apache Spark) > Reduce duplication in Aggregate2's expression

[jira] [Commented] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947817#comment-14947817 ] Apache Spark commented on SPARK-10988: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

2015-10-07 Thread Peter Haumer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947815#comment-14947815 ] Peter Haumer commented on SPARK-8386: - Huaxin Gao, sorry for not replying earlier. It

[jira] [Created] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-07 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10988: -- Summary: Reduce duplication in Aggregate2's expression rewriting logic Key: SPARK-10988 URL: https://issues.apache.org/jira/browse/SPARK-10988 Project: Spark Is

[jira] [Updated] (SPARK-10987) yarn-client mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-10987: --- Summary: yarn-client mode misbehaving with netty-based RPC backend (was: yarn-cluster mode m

[jira] [Commented] (SPARK-10987) yarn-cluster mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947788#comment-14947788 ] Marcelo Vanzin commented on SPARK-10987: Hmm. I think I know what's going on, jus

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

2015-10-07 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947775#comment-14947775 ] Huaxin Gao commented on SPARK-8386: --- Actually I can also recreate the problem in the oth

[jira] [Updated] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10875: -- Shepherd: Xiangrui Meng Target Version/s: 1.6.0 > RowMatrix.computeCovariance() res

[jira] [Updated] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10875: -- Assignee: Nick Pritchard > RowMatrix.computeCovariance() result is not exactly symmetric >

[jira] [Resolved] (SPARK-10917) Improve performance of complex types in columnar cache

2015-10-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10917. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8971 [https://github.c

[jira] [Resolved] (SPARK-10738) Refactoring `Instance` out from LOR and LIR, and also cleaning up some code

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10738. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8853 [https://gi

[jira] [Resolved] (SPARK-10980) Create wrong decimal if unscaled > 1e18 and scale > 0

2015-10-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10980. Resolution: Fixed Fix Version/s: 1.2.3 1.5.2 1.3.2

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Assignee: Bryan Cutler > PySpark StreamingLogisticRegressionWithSGD does not train with given r

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Target Version/s: 1.5.2, 1.6.0 > PySpark StreamingLogisticRegressionWithSGD does not train with

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Shepherd: Xiangrui Meng > PySpark StreamingLogisticRegressionWithSGD does not train with given

[jira] [Resolved] (SPARK-9702) Repartition operator should use Exchange to perform its shuffle

2015-10-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9702. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8083 [https://github.com/apac

[jira] [Updated] (SPARK-9702) Repartition operator should use Exchange to perform its shuffle

2015-10-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9702: Assignee: Josh Rosen > Repartition operator should use Exchange to perform its shuffle > ---

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

2015-10-07 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947749#comment-14947749 ] Huaxin Gao commented on SPARK-8386: --- If the above fix is correct, can I have a pull requ

[jira] [Resolved] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10490. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8936 [https://gi

[jira] [Updated] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-10-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10490: -- Assignee: Yanbo Liang > Consolidate the Cholesky solvers in WeightedLeastSquares and ALS >

[jira] [Commented] (SPARK-10987) yarn-cluster mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947743#comment-14947743 ] Marcelo Vanzin commented on SPARK-10987: The {{ExecutorRunnable}} process (client

[jira] [Updated] (SPARK-10000) Consolidate storage and execution memory management

2015-10-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Summary: Consolidate storage and execution memory management (was: Consolidate cache memory management

[jira] [Commented] (SPARK-10987) yarn-cluster mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947738#comment-14947738 ] Marcelo Vanzin commented on SPARK-10987: It may not be cluster mode per se; I ran

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

2015-10-07 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947736#comment-14947736 ] Huaxin Gao commented on SPARK-8386: --- I looked the code, it has this @deprecated("Use w

[jira] [Resolved] (SPARK-10982) Rename ExpressionAggregate -> DeclarativeAggregate

2015-10-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10982. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9013 [https://github.c

[jira] [Updated] (SPARK-10919) Association rules class should return the support of each rule

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10919: -- Summary: Association rules class should return the support of each rule (was: Assosiat

[jira] [Created] (SPARK-10987) yarn-cluster mode misbehaving with netty-based RPC backend

2015-10-07 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10987: -- Summary: yarn-cluster mode misbehaving with netty-based RPC backend Key: SPARK-10987 URL: https://issues.apache.org/jira/browse/SPARK-10987 Project: Spark

[jira] [Commented] (SPARK-10919) Assosiation rules class should return the support of each rule

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947720#comment-14947720 ] Joseph K. Bradley commented on SPARK-10919: --- Would you be interested in sending

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947711#comment-14947711 ] Reynold Xin commented on SPARK-10914: - I don't think size estimator would impact the

[jira] [Comment Edited] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945358#comment-14945358 ] Reynold Xin edited comment on SPARK-10914 at 10/7/15 10:22 PM:

[jira] [Created] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-07 Thread Joseph Wu (JIRA)
Joseph Wu created SPARK-10986: - Summary: ClassNotFoundException when running on Client mode, with a Mesos master. Key: SPARK-10986 URL: https://issues.apache.org/jira/browse/SPARK-10986 Project: Spark

[jira] [Updated] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-07 Thread Joseph Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Wu updated SPARK-10986: -- Description: When running an example task on a Mesos cluster (local master, local agent), any Spark ta

[jira] [Updated] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10914: Description: Using an inner join, to match together two integer columns, I generally get no result

[jira] [Comment Edited] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945441#comment-14945441 ] Reynold Xin edited comment on SPARK-10914 at 10/7/15 10:12 PM:

[jira] [Updated] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10914: Description: Using an inner join, to match together two integer columns, I generally get no result

[jira] [Updated] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10779: -- Assignee: Evan Chen > Set initialModel for KMeans model in PySpark (spark.mllib) >

[jira] [Resolved] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-10-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10779. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8967 [ht

[jira] [Commented] (SPARK-10342) Cooperative memory management

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947687#comment-14947687 ] Reynold Xin commented on SPARK-10342: - [~fxing] thanks a lot for the interest. Since

[jira] [Updated] (SPARK-7869) Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Columns

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7869: --- Target Version/s: 1.6.0 > Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Columns >

[jira] [Updated] (SPARK-7869) Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Columns

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7869: --- Assignee: Alexey Grishchenko > Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Colu

[jira] [Updated] (SPARK-7869) Spark Data Frame Fails to Load Postgres Tables with JSONB DataType Columns

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7869: --- Description: Most of our tables load into dataframes just fine with postgres. However we have a numbe

[jira] [Updated] (SPARK-10186) Add support for more postgres column types

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10186: Labels: (was: array json postgres sql struct) > Add support for more postgres column types >

[jira] [Resolved] (SPARK-10679) javax.jdo.JDOFatalUserException in executor

2015-10-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10679. - Resolution: Fixed Fix Version/s: 1.6.0 > javax.jdo.JDOFatalUserException in executor > ---

[jira] [Created] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-10985: - Summary: Avoid passing evicted blocks throughout BlockManager / CacheManager Key: SPARK-10985 URL: https://issues.apache.org/jira/browse/SPARK-10985 Project: Spark

  1   2   >