[jira] [Resolved] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11205. - Resolution: Fixed Assignee: Jeff Zhang Fix Version/s: 1.6.0 > Delegate to scala D

[jira] [Updated] (SPARK-11205) Match the output of DataFrame#explain() in both scala api and python

2015-10-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11205: --- Summary: Match the output of DataFrame#explain() in both scala api and python (was: Delegate to scal

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2015-10-21 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966346#comment-14966346 ] Konstantin Shaposhnikov commented on SPARK-10066: - I have the same proble

[jira] [Comment Edited] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2015-10-21 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966346#comment-14966346 ] Konstantin Shaposhnikov edited comment on SPARK-10066 at 10/21/15 7:19 AM:

[jira] [Created] (SPARK-11226) Empty line in json file should be skipped

2015-10-21 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11226: -- Summary: Empty line in json file should be skipped Key: SPARK-11226 URL: https://issues.apache.org/jira/browse/SPARK-11226 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11188: Assignee: Apache Spark > Elide stacktraces in bin/spark-sql for AnalysisExceptions > -

[jira] [Assigned] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11188: Assignee: (was: Apache Spark) > Elide stacktraces in bin/spark-sql for AnalysisExcepti

[jira] [Commented] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966357#comment-14966357 ] Apache Spark commented on SPARK-11188: -- User 'dilipbiswal' has created a pull reques

[jira] [Commented] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-21 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966391#comment-14966391 ] hujiayin commented on SPARK-11200: -- Hi Sean, I didn't close/reopen it. The issue is ther

[jira] [Created] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2015-10-21 Thread Yuri Saito (JIRA)
Yuri Saito created SPARK-11227: -- Summary: Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1 Key: SPARK-11227 URL: https://issues.apache.org/jira/browse/SPARK-11227 Project: Spark

[jira] [Updated] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2015-10-21 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Saito updated SPARK-11227: --- Description: When running jar including Spark Job at HDFS HA Cluster, Mesos and Spark1.5.1, the job

[jira] [Reopened] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-21 Thread Ankit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit reopened SPARK-11213: --- HI All , Firstly i would like to thanks for such an amazing effort you guys take . I am trying to use SparkR fu

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-21 Thread Henning Petersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966405#comment-14966405 ] Henning Petersen commented on SPARK-11193: -- We are also greeted with this except

[jira] [Assigned] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11037: Assignee: Apache Spark > Cleanup Option usage in JdbcUtils > -

[jira] [Commented] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966460#comment-14966460 ] Apache Spark commented on SPARK-11037: -- User 'pravingadakh' has created a pull reque

[jira] [Assigned] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11037: Assignee: (was: Apache Spark) > Cleanup Option usage in JdbcUtils > --

[jira] [Created] (SPARK-11228) Job stuck in Executor failure loop when NettyTransport failed to bind

2015-10-21 Thread Romi Kuntsman (JIRA)
Romi Kuntsman created SPARK-11228: - Summary: Job stuck in Executor failure loop when NettyTransport failed to bind Key: SPARK-11228 URL: https://issues.apache.org/jira/browse/SPARK-11228 Project: Spar

[jira] [Assigned] (SPARK-11210) Add window functions into SparkR [step 2]

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11210: Assignee: Apache Spark > Add window functions into SparkR [step 2] > -

[jira] [Commented] (SPARK-11210) Add window functions into SparkR [step 2]

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966491#comment-14966491 ] Apache Spark commented on SPARK-11210: -- User 'sun-rui' has created a pull request fo

[jira] [Assigned] (SPARK-11210) Add window functions into SparkR [step 2]

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11210: Assignee: (was: Apache Spark) > Add window functions into SparkR [step 2] > --

[jira] [Commented] (SPARK-7335) Submitting a query to Thrift Server occurs error: java.lang.IllegalStateException: unread block data

2015-10-21 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966490#comment-14966490 ] Romi Kuntsman commented on SPARK-7335: -- [~meiyoula] can you please reopen the issue?

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966525#comment-14966525 ] Sean Owen commented on SPARK-11144: --- Write an email to u...@spark.apache.org first plea

[jira] [Resolved] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11144. --- Resolution: Not A Problem > Add SparkLauncher for Spark Streaming, Spark SQL, etc > -

[jira] [Resolved] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9523. -- Resolution: Not A Problem I think you're just talking about the difference between implementing Kryo and

[jira] [Commented] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2015-10-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966601#comment-14966601 ] Steve Loughran commented on SPARK-11227: sounds like an HA config problem: HDFS i

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-10-21 Thread LINTE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966624#comment-14966624 ] LINTE commented on SPARK-10500: --- Any update on this JIRA ? > sparkr.zip cannot be created

[jira] [Created] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-21 Thread Romi Kuntsman (JIRA)
Romi Kuntsman created SPARK-11229: - Summary: NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0 Key: SPARK-11229 URL: https://issues.apache.org/jira/browse/SPARK-11229 Project: Spark

[jira] [Comment Edited] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-10-21 Thread LINTE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966624#comment-14966624 ] LINTE edited comment on SPARK-10500 at 10/21/15 10:44 AM: -- Any u

[jira] [Created] (SPARK-11230) Add Outbox to cache the sending messages to resolve the message disorder issue

2015-10-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11230: Summary: Add Outbox to cache the sending messages to resolve the message disorder issue Key: SPARK-11230 URL: https://issues.apache.org/jira/browse/SPARK-11230 Projec

[jira] [Closed] (SPARK-11230) Add Outbox to cache the sending messages to resolve the message disorder issue

2015-10-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-11230. Resolution: Duplicate Didn't see SPARK-11098 before creating this one > Add Outbox to cache the se

[jira] [Assigned] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11098: Assignee: Apache Spark > RPC message ordering is not guaranteed >

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966651#comment-14966651 ] Apache Spark commented on SPARK-11098: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11098: Assignee: (was: Apache Spark) > RPC message ordering is not guaranteed > -

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966657#comment-14966657 ] Shixiong Zhu commented on SPARK-11098: -- [~vanzin] Vanzin Sorry I didn't realize you

[jira] [Comment Edited] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966657#comment-14966657 ] Shixiong Zhu edited comment on SPARK-11098 at 10/21/15 11:26 AM: --

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

2015-10-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966679#comment-14966679 ] Sergio Ramírez commented on SPARK-1473: --- Hi all, The related link SPARK-6531 has be

[jira] [Commented] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-10-21 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966731#comment-14966731 ] Kai Jiang commented on SPARK-10592: --- Hi [~mengxr], I am interested in this issue. Howev

[jira] [Commented] (SPARK-8542) PMML export for Decision Trees

2015-10-21 Thread Jasmine George (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966752#comment-14966752 ] Jasmine George commented on SPARK-8542: --- Hi Joseph, the changes are ready to be merg

[jira] [Created] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Matt Pollock (JIRA)
Matt Pollock created SPARK-11231: Summary: join returns schema with duplicated and ambiguous join columns Key: SPARK-11231 URL: https://issues.apache.org/jira/browse/SPARK-11231 Project: Spark

[jira] [Updated] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Matt Pollock (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Pollock updated SPARK-11231: - Description: In the case where the key column of two data frames are named the same thing, join

[jira] [Updated] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Matt Pollock (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Pollock updated SPARK-11231: - Description: In the case where the key column of two data frames are named the same thing, join

[jira] [Updated] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Matt Pollock (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Pollock updated SPARK-11231: - Description: In the case where the key column of two data frames are named the same thing, join

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967364#comment-14967364 ] Shivaram Venkataraman commented on SPARK-11231: --- [~Narine] [~sunrui] Is thi

[jira] [Commented] (SPARK-10754) table and column name are case sensitive when json Dataframe was registered as tempTable using JavaSparkContext.

2015-10-21 Thread Scott Lyons (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967387#comment-14967387 ] Scott Lyons commented on SPARK-10754: - I continue to have this issue, and can confirm

[jira] [Created] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11232: Summary: NettyRpcEndpointRef.send should not be interrupted Key: SPARK-11232 URL: https://issues.apache.org/jira/browse/SPARK-11232 Project: Spark Issue Type

[jira] [Updated] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11232: - Description: The current NettyRpcEndpointRef.send can be interrupted because it uses `LinkedBlock

[jira] [Assigned] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11232: Assignee: Apache Spark > NettyRpcEndpointRef.send should not be interrupted >

[jira] [Commented] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967432#comment-14967432 ] Apache Spark commented on SPARK-11232: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11232: Assignee: (was: Apache Spark) > NettyRpcEndpointRef.send should not be interrupted > -

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-21 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967456#comment-14967456 ] Zhan Zhang commented on SPARK-11087: [~patcharee] I tried again, used the step you pr

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

2015-10-21 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967488#comment-14967488 ] Yuhang Chen commented on SPARK-11144: - Thanks for your advice and sorry for the incon

[jira] [Commented] (SPARK-9595) Adding API to SparkConf for kryo serializers registration

2015-10-21 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967503#comment-14967503 ] Yuhang Chen commented on SPARK-9595: So you mean closures also support kryo? But I nev

[jira] [Created] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11233: --- Summary: cosh is not registered in function registry Key: SPARK-11233 URL: https://issues.apache.org/jira/browse/SPARK-11233 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

2015-10-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8835: - Description: Second part of [SPARK-7398|https://issues.apache.org/jira/browse/SPARK-7398]

[jira] [Resolved] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11037. - Resolution: Fixed Assignee: Pravin Gadakh Fix Version/s: 1.6.0 > Cleanup Option u

[jira] [Assigned] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11233: Assignee: Apache Spark > cosh is not registered in function registry > ---

[jira] [Commented] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967530#comment-14967530 ] Apache Spark commented on SPARK-11233: -- User 'shagunsodhani' has created a pull requ

[jira] [Resolved] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11179. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9167 [http

[jira] [Assigned] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11233: Assignee: (was: Apache Spark) > cosh is not registered in function registry >

[jira] [Issue Comment Deleted] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Shagun Sodhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shagun Sodhani updated SPARK-11233: --- Comment: was deleted (was: Submitted a PR: https://github.com/apache/spark/pull/9199) > cosh

[jira] [Commented] (SPARK-11233) cosh is not registered in function registry

2015-10-21 Thread Shagun Sodhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967536#comment-14967536 ] Shagun Sodhani commented on SPARK-11233: Submitted a PR: https://github.com/apach

[jira] [Assigned] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8835: --- Assignee: (was: Apache Spark) > Provide pluggable Congestion Strategies to deal with Stre

[jira] [Commented] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967542#comment-14967542 ] Apache Spark commented on SPARK-8835: - User 'huitseeker' has created a pull request fo

[jira] [Assigned] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8835: --- Assignee: Apache Spark > Provide pluggable Congestion Strategies to deal with Streaming load

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967564#comment-14967564 ] Felix Cheung commented on SPARK-11231: -- This should be addressed in the new merge im

[jira] [Commented] (SPARK-9595) Adding API to SparkConf for kryo serializers registration

2015-10-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967563#comment-14967563 ] holdenk commented on SPARK-9595: I'm not sure I get the question - do you have a bit of co

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967558#comment-14967558 ] holdenk commented on SPARK-11171: - Skimming the mailing list it seems that people mostly

[jira] [Resolved] (SPARK-11216) add encoder/decoder for external row

2015-10-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11216. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9184 [http

[jira] [Updated] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10534: - Assignee: Dilip Biswal > ORDER BY clause allows only columns that are present in SELECT statement > -

[jira] [Resolved] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10534. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request 9

[jira] [Commented] (SPARK-11021) SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version

2015-10-21 Thread Xiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967577#comment-14967577 ] Xiu commented on SPARK-11021: - I put hive 0.12 jar paths inside spark-defaults.conf, and am a

[jira] [Created] (SPARK-11234) What's cooking classification

2015-10-21 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-11234: - Summary: What's cooking classification Key: SPARK-11234 URL: https://issues.apache.org/jira/browse/SPARK-11234 Project: Spark Issue Type: Sub-task Repo

[jira] [Comment Edited] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

2015-10-21 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940102#comment-14940102 ] Mike Dusenberry edited comment on SPARK-6488 at 10/21/15 6:16 PM: --

[jira] [Commented] (SPARK-11171) PMML for Pipelines API

2015-10-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967608#comment-14967608 ] Joseph K. Bradley commented on SPARK-11171: --- Sounds great, thanks! > PMML for

[jira] [Created] (SPARK-11235) Support streaming data using network library

2015-10-21 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11235: -- Summary: Support streaming data using network library Key: SPARK-11235 URL: https://issues.apache.org/jira/browse/SPARK-11235 Project: Spark Issue Type:

[jira] [Created] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-10-21 Thread Calvin Jia (JIRA)
Calvin Jia created SPARK-11236: -- Summary: Upgrade Tachyon dependency to 0.8.0 Key: SPARK-11236 URL: https://issues.apache.org/jira/browse/SPARK-11236 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Yu Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967643#comment-14967643 ] Yu Gao commented on SPARK-10181: I reproduced this issue. Some hive metastore client thre

[jira] [Created] (SPARK-11237) PMML export for ML KMeans

2015-10-21 Thread holdenk (JIRA)
holdenk created SPARK-11237: --- Summary: PMML export for ML KMeans Key: SPARK-11237 URL: https://issues.apache.org/jira/browse/SPARK-11237 Project: Spark Issue Type: Sub-task Components: ML

[jira] [Created] (SPARK-11238) SparkR: Documentation change for merge function

2015-10-21 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-11238: - Summary: SparkR: Documentation change for merge function Key: SPARK-11238 URL: https://issues.apache.org/jira/browse/SPARK-11238 Project: Spark Iss

[jira] [Created] (SPARK-11240) PMML export for SVM models in ML pipeline

2015-10-21 Thread holdenk (JIRA)
holdenk created SPARK-11240: --- Summary: PMML export for SVM models in ML pipeline Key: SPARK-11240 URL: https://issues.apache.org/jira/browse/SPARK-11240 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-11239) PMML export for ML linear regression

2015-10-21 Thread holdenk (JIRA)
holdenk created SPARK-11239: --- Summary: PMML export for ML linear regression Key: SPARK-11239 URL: https://issues.apache.org/jira/browse/SPARK-11239 Project: Spark Issue Type: Sub-task Com

[jira] [Comment Edited] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-10-21 Thread Yu Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967643#comment-14967643 ] Yu Gao edited comment on SPARK-10181 at 10/21/15 6:49 PM: -- I rep

[jira] [Created] (SPARK-11241) Add a common trait for PMML exportable ML pipeline models

2015-10-21 Thread holdenk (JIRA)
holdenk created SPARK-11241: --- Summary: Add a common trait for PMML exportable ML pipeline models Key: SPARK-11241 URL: https://issues.apache.org/jira/browse/SPARK-11241 Project: Spark Issue Type: S

[jira] [Created] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-21 Thread Xiu (JIRA)
Xiu created SPARK-11242: --- Summary: In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly Key: SPARK-11242 URL: https://issues.apache.org/jira/browse/SPARK-11242 Project: Spark Is

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-21 Thread patcharee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967661#comment-14967661 ] patcharee commented on SPARK-11087: --- Hi [~zzhan] What version of hive and orc file you

[jira] [Commented] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967673#comment-14967673 ] Apache Spark commented on SPARK-11242: -- User 'xguo27' has created a pull request for

[jira] [Assigned] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11242: Assignee: Apache Spark > In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented i

[jira] [Assigned] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11242: Assignee: (was: Apache Spark) > In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is d

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967690#comment-14967690 ] Apache Spark commented on SPARK-10857: -- User 'rick-ibm' has created a pull request f

[jira] [Assigned] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10857: Assignee: (was: Apache Spark) > SQL injection bug in JdbcDialect.getTableExistsQuery()

[jira] [Assigned] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10857: Assignee: Apache Spark > SQL injection bug in JdbcDialect.getTableExistsQuery() >

[jira] [Commented] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-21 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967694#comment-14967694 ] Xin Wu commented on SPARK-11229: Here is what I tried: 1. start spark-shell with command

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-21 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967695#comment-14967695 ] Rick Hillegas commented on SPARK-10977: --- I have created a pull request for SPARK-10

[jira] [Created] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11243: -- Summary: Output UnsafeRow in InMemoryTableScan Key: SPARK-11243 URL: https://issues.apache.org/jira/browse/SPARK-11243 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11243: Assignee: Apache Spark > Output UnsafeRow in InMemoryTableScan > -

[jira] [Commented] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967697#comment-14967697 ] Apache Spark commented on SPARK-11243: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11243: Assignee: (was: Apache Spark) > Output UnsafeRow in InMemoryTableScan > --

[jira] [Assigned] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11236: Assignee: (was: Apache Spark) > Upgrade Tachyon dependency to 0.8.0 >

[jira] [Assigned] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11236: Assignee: Apache Spark > Upgrade Tachyon dependency to 0.8.0 > ---

[jira] [Commented] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-10-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967728#comment-14967728 ] Apache Spark commented on SPARK-11236: -- User 'calvinjia' has created a pull request

  1   2   3   >