[jira] [Assigned] (SPARK-9319) Add support for setting column names, types

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9319: --- Assignee: Apache Spark > Add support for setting column names, types > --

[jira] [Assigned] (SPARK-9319) Add support for setting column names, types

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9319: --- Assignee: (was: Apache Spark) > Add support for setting column names, types > ---

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968657#comment-14968657 ] Apache Spark commented on SPARK-9319: - User 'felixcheung' has created a pull request f

[jira] [Commented] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

2015-10-21 Thread prakhar jauhari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968655#comment-14968655 ] prakhar jauhari commented on SPARK-11181: - Ya. i'll do it for branch 1.3 :) > Sp

[jira] [Commented] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

2015-10-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968649#comment-14968649 ] Saisai Shao commented on SPARK-11181: - I think you'd better backport to branch 1.3, n

[jira] [Commented] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

2015-10-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968648#comment-14968648 ] Saisai Shao commented on SPARK-11181: - OK, get it. > Spark Yarn : Spark reducing tot

[jira] [Commented] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

2015-10-21 Thread prakhar jauhari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968645#comment-14968645 ] prakhar jauhari commented on SPARK-11181: - Hey [~saisai_shao], this jira is for t

[jira] [Created] (SPARK-11254) Thriftserver on kerberos secured cluster in YARN mode

2015-10-21 Thread wpxidian (JIRA)
wpxidian created SPARK-11254: Summary: Thriftserver on kerberos secured cluster in YARN mode Key: SPARK-11254 URL: https://issues.apache.org/jira/browse/SPARK-11254 Project: Spark Issue Type: Bu

[jira] [Closed] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-11190. --- Resolution: Won't Fix Close it as the feature is already in the master branch, and will be available in next

[jira] [Commented] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-10-21 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968628#comment-14968628 ] Yuhang Chen commented on SPARK-9523: So you mean closures also support kryo? But I nev

[jira] [Reopened] (SPARK-11214) Join with Unicode-String results wrong empty

2015-10-21 Thread Hans Fischer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hans Fischer reopened SPARK-11214: -- I have updated to Spark 1.5.1 and still get an empty result set. How could this be? > Join with U

[jira] [Commented] (SPARK-9595) Adding API to SparkConf for kryo serializers registration

2015-10-21 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968615#comment-14968615 ] Yuhang Chen commented on SPARK-9595: Sorry, I replied to the wrong person, the questio

[jira] [Comment Edited] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968608#comment-14968608 ] Sun Rui edited comment on SPARK-11231 at 10/22/15 6:03 AM: --- [~s

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968608#comment-14968608 ] Sun Rui commented on SPARK-11231: - [~shivaram] This feature can be done on R side even th

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968605#comment-14968605 ] Sun Rui commented on SPARK-11231: - [~mpollock], we are implement R-like merge in sparkR

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968596#comment-14968596 ] Bilind Hajer commented on SPARK-11190: -- > df.recipes <- read.df(sqlContext, source =

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968594#comment-14968594 ] Sun Rui commented on SPARK-11190: - ls.str() is not automaic for print. But overriding pri

[jira] [Commented] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968576#comment-14968576 ] Apache Spark commented on SPARK-11243: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-7428) DataFrame.join() could create a new df with duplicate column name

2015-10-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968575#comment-14968575 ] Xiao Li commented on SPARK-7428: IMO, it is impossible to fix the problem if we use dataFr

[jira] [Commented] (SPARK-10754) table and column name are case sensitive when json Dataframe was registered as tempTable using JavaSparkContext.

2015-10-21 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968570#comment-14968570 ] Huaxin Gao commented on SPARK-10754: Hi Scott, I tried a temp table with a struct col

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968569#comment-14968569 ] Shivaram Venkataraman commented on SPARK-11190: --- We could - but there are a

[jira] [Assigned] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8658: --- Assignee: (was: Apache Spark) > AttributeReference equals method only compare name, exprI

[jira] [Assigned] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8658: --- Assignee: Apache Spark > AttributeReference equals method only compare name, exprId and dataT

[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968553#comment-14968553 ] Apache Spark commented on SPARK-8658: - User 'gatorsmile' has created a pull request fo

[jira] [Comment Edited] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968543#comment-14968543 ] Sun Rui edited comment on SPARK-11190 at 10/22/15 4:42 AM: --- For

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968543#comment-14968543 ] Sun Rui commented on SPARK-11190: - For better user experience, I am thinking if we can de

[jira] [Commented] (SPARK-11247) Back to master always try to use fqdn node name

2015-10-21 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968517#comment-14968517 ] Carson Wang commented on SPARK-11247: - You can set SPARK_MASTER_IP to your master's I

[jira] [Commented] (SPARK-11253) reset all accumulators in physical operators before execute an action

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968484#comment-14968484 ] Apache Spark commented on SPARK-11253: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11253) reset all accumulators in physical operators before execute an action

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11253: Assignee: (was: Apache Spark) > reset all accumulators in physical operators before ex

[jira] [Assigned] (SPARK-11253) reset all accumulators in physical operators before execute an action

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11253: Assignee: Apache Spark > reset all accumulators in physical operators before execute an ac

[jira] [Created] (SPARK-11253) reset all accumulators in physical operators before execute an action

2015-10-21 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11253: --- Summary: reset all accumulators in physical operators before execute an action Key: SPARK-11253 URL: https://issues.apache.org/jira/browse/SPARK-11253 Project: Spark

[jira] [Commented] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

2015-10-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968453#comment-14968453 ] Saisai Shao commented on SPARK-11181: - Hi [~prakhar088], As discussed in the mailist

[jira] [Commented] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968437#comment-14968437 ] Apache Spark commented on SPARK-8029: - User 'squito' has created a pull request for th

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968427#comment-14968427 ] Xiao Li commented on SPARK-10925: - There is another ongoing JIRA that has a big impact on

[jira] [Comment Edited] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-21 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966119#comment-14966119 ] hujiayin edited comment on SPARK-11200 at 10/22/15 2:37 AM: H

[jira] [Updated] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-21 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-11200: - Affects Version/s: (was: 1.5.1) 1.6.0 > NettyRpcEnv endless message "cannot se

[jira] [Assigned] (SPARK-11226) Empty line in json file should be skipped

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11226: Assignee: Apache Spark > Empty line in json file should be skipped > -

[jira] [Commented] (SPARK-11216) add encoder/decoder for external row

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968391#comment-14968391 ] Apache Spark commented on SPARK-11216: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11226) Empty line in json file should be skipped

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11226: Assignee: (was: Apache Spark) > Empty line in json file should be skipped > --

[jira] [Commented] (SPARK-11226) Empty line in json file should be skipped

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968387#comment-14968387 ] Apache Spark commented on SPARK-11226: -- User 'zjffdu' has created a pull request for

[jira] [Resolved] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11243. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 > Output UnsafeRow in

[jira] [Reopened] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

2015-10-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reopened SPARK-11102: Reopen it > Uninformative exception when specifing non-exist input for JSON data source >

[jira] [Created] (SPARK-11252) ExternalShuffleClient should release connection after it had completed to fetch blocks from yarn's NameManager

2015-10-21 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-11252: Summary: ExternalShuffleClient should release connection after it had completed to fetch blocks from yarn's NameManager Key: SPARK-11252 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-21 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968293#comment-14968293 ] Xin Wu commented on SPARK-11246: I am able to recreate this issue on 1.6.0 with hive 1.2.

[jira] [Resolved] (SPARK-9392) Dataframe drop should work on unresolved columns

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9392. Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0 > Dataframe drop should

[jira] [Assigned] (SPARK-10997) Netty-based RPC env should support a "client-only" mode.

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10997: Assignee: (was: Apache Spark) > Netty-based RPC env should support a "client-only" mod

[jira] [Commented] (SPARK-10997) Netty-based RPC env should support a "client-only" mode.

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968272#comment-14968272 ] Apache Spark commented on SPARK-10997: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-10997) Netty-based RPC env should support a "client-only" mode.

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10997: Assignee: Apache Spark > Netty-based RPC env should support a "client-only" mode. > --

[jira] [Commented] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968259#comment-14968259 ] Marcelo Vanzin commented on SPARK-11251: Is this the same as SPARK-11130? > Page

[jira] [Assigned] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11251: Assignee: Apache Spark (was: Andrew Or) > Page size calculation is wrong in local mode >

[jira] [Assigned] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11251: Assignee: Andrew Or (was: Apache Spark) > Page size calculation is wrong in local mode >

[jira] [Commented] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968257#comment-14968257 ] Apache Spark commented on SPARK-11251: -- User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-21 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11251: - Summary: Page size calculation is wrong in local mode Key: SPARK-11251 URL: https://issues.apache.org/jira/browse/SPARK-11251 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11250) Generate different alias for columns with same name during join

2015-10-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11250: --- Assignee: Narine Kokhlikyan > Generate different alias for columns with same name during join > -

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Yu Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968238#comment-14968238 ] Yu Gao commented on SPARK-10181: The exception was from the driver process on local machi

[jira] [Assigned] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10181: Assignee: Apache Spark > HiveContext is not used with keytab principal but with user princ

[jira] [Assigned] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10181: Assignee: (was: Apache Spark) > HiveContext is not used with keytab principal but with

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968239#comment-14968239 ] Apache Spark commented on SPARK-10181: -- User 'yolandagao' has created a pull request

[jira] [Assigned] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11171: Assignee: (was: Apache Spark) > PMML for Pipelines API > -- > >

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968214#comment-14968214 ] Apache Spark commented on SPARK-11171: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-11241) Add a common trait for PMML exportable ML pipeline models

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11241: Assignee: Apache Spark > Add a common trait for PMML exportable ML pipeline models > -

[jira] [Assigned] (SPARK-11237) PMML export for ML KMeans

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11237: Assignee: (was: Apache Spark) > PMML export for ML KMeans > -

[jira] [Commented] (SPARK-11241) Add a common trait for PMML exportable ML pipeline models

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968216#comment-14968216 ] Apache Spark commented on SPARK-11241: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-11241) Add a common trait for PMML exportable ML pipeline models

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11241: Assignee: (was: Apache Spark) > Add a common trait for PMML exportable ML pipeline mod

[jira] [Commented] (SPARK-11237) PMML export for ML KMeans

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968215#comment-14968215 ] Apache Spark commented on SPARK-11237: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11171: Assignee: Apache Spark > PMML for Pipelines API > -- > >

[jira] [Assigned] (SPARK-11237) PMML export for ML KMeans

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11237: Assignee: Apache Spark > PMML export for ML KMeans > - > >

[jira] [Assigned] (SPARK-11235) Support streaming data using network library

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11235: Assignee: (was: Apache Spark) > Support streaming data using network library > ---

[jira] [Commented] (SPARK-11235) Support streaming data using network library

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968192#comment-14968192 ] Apache Spark commented on SPARK-11235: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11235) Support streaming data using network library

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11235: Assignee: Apache Spark > Support streaming data using network library > --

[jira] [Commented] (SPARK-11250) Generate different alias for columns with same name during join

2015-10-21 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968186#comment-14968186 ] Narine Kokhlikyan commented on SPARK-11250: --- Can you assign this to me [~davies

[jira] [Created] (SPARK-11250) Generate different alias for columns with same name during join

2015-10-21 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11250: -- Summary: Generate different alias for columns with same name during join Key: SPARK-11250 URL: https://issues.apache.org/jira/browse/SPARK-11250 Project: Spark

[jira] [Closed] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-11229. Resolution: Cannot Reproduce Closing, please reopen if you have addition info about reprodu

[jira] [Updated] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2015-10-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-11249: - Affects Version/s: 1.5.1 > [Launcher] Launcher library fails is app resource is not added

[jira] [Updated] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2015-10-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-11249: - Component/s: Spark Submit > [Launcher] Launcher library fails is app resource is not adde

[jira] [Created] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2015-10-21 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-11249: Summary: [Launcher] Launcher library fails is app resource is not added Key: SPARK-11249 URL: https://issues.apache.org/jira/browse/SPARK-11249 Project: Spark

[jira] [Created] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

2015-10-21 Thread Trystan Leftwich (JIRA)
Trystan Leftwich created SPARK-11248: Summary: Spark hivethriftserver is using the wrong user to while getting HDFS permissions Key: SPARK-11248 URL: https://issues.apache.org/jira/browse/SPARK-11248

[jira] [Commented] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-21 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968089#comment-14968089 ] Xin Wu commented on SPARK-11229: [~marmbrus] Please take a look if this is safe to close

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968085#comment-14968085 ] Shivaram Venkataraman commented on SPARK-11190: --- Environments can be used l

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968079#comment-14968079 ] Bilind Hajer commented on SPARK-11190: -- Well this would be a map datatype from Cassa

[jira] [Updated] (SPARK-10151) Support invocation of hive macro

2015-10-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10151: --- Assignee: Navis > Support invocation of hive macro > > >

[jira] [Resolved] (SPARK-10151) Support invocation of hive macro

2015-10-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10151. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8354 [https://github.c

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968031#comment-14968031 ] Shivaram Venkataraman commented on SPARK-11190: --- We do convert maps in Scal

[jira] [Created] (SPARK-11247) Back to master always try to use fqdn node name

2015-10-21 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-11247: --- Summary: Back to master always try to use fqdn node name Key: SPARK-11247 URL: https://issues.apache.org/jira/browse/SPARK-11247 Project: Spark Issue T

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967979#comment-14967979 ] Bilind Hajer commented on SPARK-11190: -- Ok, got master spark version built, I am no

[jira] [Resolved] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8654. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9036 [https:/

[jira] [Created] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-21 Thread David Ross (JIRA)
David Ross created SPARK-11246: -- Summary: [1.5] Table cache for Parquet broken in 1.5 Key: SPARK-11246 URL: https://issues.apache.org/jira/browse/SPARK-11246 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967956#comment-14967956 ] holdenk commented on SPARK-11171: - So from the implementation point of view, we could kee

[jira] [Resolved] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11233. - Resolution: Fixed Assignee: Shagun Sodhani Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967930#comment-14967930 ] Rick Hillegas commented on SPARK-10857: --- Hi Reynold, Yes, this would fail if the t

[jira] [Resolved] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11208. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9178 [http

[jira] [Created] (SPARK-11245) Upgrade twitter4j to version 4.x

2015-10-21 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-11245: --- Summary: Upgrade twitter4j to version 4.x Key: SPARK-11245 URL: https://issues.apache.org/jira/browse/SPARK-11245 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967907#comment-14967907 ] Shivaram Venkataraman commented on SPARK-11190: --- You'll need to add the -P

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-21 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967903#comment-14967903 ] Bilind Hajer commented on SPARK-11190: -- I built spark using mvn, on the master versi

[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

2015-10-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967898#comment-14967898 ] Xiao Li commented on SPARK-8658: Hi, Michael, Thank you! It sounds a trivial work. Let m

[jira] [Resolved] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9210. - Resolution: Fixed Assignee: Yin Huai Fix Version/s: 1.6.0 > checkValidAggr

[jira] [Resolved] (SPARK-9740) first/last aggregate NULL behavior

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9740. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8113 [https:/

[jira] [Resolved] (SPARK-11197) Run SQL query on files directly without create a table

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11197. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9173 [http

[jira] [Updated] (SPARK-10743) keep the name of expression if possible when do cast

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10743: - Assignee: Wenchen Fan > keep the name of expression if possible when do cast > --

[jira] [Comment Edited] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967827#comment-14967827 ] Reynold Xin edited comment on SPARK-10857 at 10/21/15 8:31 PM:

  1   2   3   >