[jira] [Created] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

2015-10-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11096: --- Summary: Post-hoc review Netty based RPC implementation - round 2 Key: SPARK-11096 URL: https://issues.apache.org/jira/browse/SPARK-11096 Project: Spark Issue

[jira] [Commented] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956390#comment-14956390 ] Apache Spark commented on SPARK-11096: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11096: Assignee: Apache Spark (was: Reynold Xin) > Post-hoc review Netty based RPC implementatio

[jira] [Assigned] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11096: Assignee: Reynold Xin (was: Apache Spark) > Post-hoc review Netty based RPC implementatio

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956394#comment-14956394 ] Reynold Xin commented on SPARK-11097: - cc [~vanzin] do you have time to do this? >

[jira] [Created] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-10-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11097: --- Summary: Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive Key: SPARK-11097 URL: https://issues.a

[jira] [Created] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11098: --- Summary: RPC message ordering is not guaranteed Key: SPARK-11098 URL: https://issues.apache.org/jira/browse/SPARK-11098 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956396#comment-14956396 ] Reynold Xin commented on SPARK-11098: - [~vanzin] zsxwing told me you were working on

[jira] [Created] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11099: -- Summary: Default conf property file is not loaded Key: SPARK-11099 URL: https://issues.apache.org/jira/browse/SPARK-11099 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Component/s: Spark Submit > Default conf property file is not loaded > -

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Component/s: Spark Shell > Default conf property file is not loaded > --

[jira] [Commented] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956399#comment-14956399 ] Jeff Zhang commented on SPARK-11099: Will create a pull request soon > Default conf

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Description: spark.driver.extraClassPath doesn't take effect in the latest code, and find the root c

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

2015-10-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956367#comment-14956367 ] Xiao Li edited comment on SPARK-10925 at 10/14/15 7:16 AM: --- Als

[jira] [Created] (SPARK-11100) HiveThriftServer not registering with Zookeeper

2015-10-14 Thread Xiaoyu Wang (JIRA)
Xiaoyu Wang created SPARK-11100: --- Summary: HiveThriftServer not registering with Zookeeper Key: SPARK-11100 URL: https://issues.apache.org/jira/browse/SPARK-11100 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11100) HiveThriftServer not registering with Zookeeper

2015-10-14 Thread Xiaoyu Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated SPARK-11100: Description: hive-site.xml config: {code} hive.server2.support.dynamic.service.discovery true hi

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-14 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956453#comment-14956453 ] Weizhong commented on SPARK-11083: -- I have retest on latest master branch(end at commit

[jira] [Created] (SPARK-11101) pipe() operation OOM

2015-10-14 Thread hotdog (JIRA)
hotdog created SPARK-11101: -- Summary: pipe() operation OOM Key: SPARK-11101 URL: https://issues.apache.org/jira/browse/SPARK-11101 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Updated] (SPARK-11101) pipe() operation OOM

2015-10-14 Thread hotdog (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hotdog updated SPARK-11101: --- Description: when using pipe() operation with large data(10TB), the pipe() operation always OOM. I use pipe

[jira] [Assigned] (SPARK-11100) HiveThriftServer not registering with Zookeeper

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11100: Assignee: Apache Spark > HiveThriftServer not registering with Zookeeper > ---

[jira] [Assigned] (SPARK-11100) HiveThriftServer not registering with Zookeeper

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11100: Assignee: (was: Apache Spark) > HiveThriftServer not registering with Zookeeper >

[jira] [Commented] (SPARK-11100) HiveThriftServer not registering with Zookeeper

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956467#comment-14956467 ] Apache Spark commented on SPARK-11100: -- User 'xiaowangyu' has created a pull request

[jira] [Commented] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956470#comment-14956470 ] Apache Spark commented on SPARK-11099: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11099: Assignee: Apache Spark > Default conf property file is not loaded > -

[jira] [Assigned] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11099: Assignee: (was: Apache Spark) > Default conf property file is not loaded > --

[jira] [Updated] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Issue Type: Improvement (was: Bug) > Not readable exception when specifing non-exist input for JSON

[jira] [Created] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

2015-10-14 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11102: -- Summary: Not readable exception when specifing non-exist input for JSON data source Key: SPARK-11102 URL: https://issues.apache.org/jira/browse/SPARK-11102 Project: Spark

[jira] [Updated] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Priority: Minor (was: Major) > Not readable exception when specifing non-exist input for JSON data s

[jira] [Commented] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956491#comment-14956491 ] Jeff Zhang commented on SPARK-11102: Will create a pull request soon > Not readable

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Affects Version/s: 1.5.1 > Default conf property file is not loaded > --

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-10-14 Thread qian, chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956508#comment-14956508 ] qian, chen commented on SPARK-6910: --- I'm using spark-sql (spark version 1.5.1 && hadoop

[jira] [Comment Edited] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-10-14 Thread qian, chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956508#comment-14956508 ] qian, chen edited comment on SPARK-6910 at 10/14/15 9:03 AM: -

[jira] [Resolved] (SPARK-7099) Floating point literals cannot be specified using exponent

2015-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7099. -- Resolution: Not A Problem > Floating point literals cannot be specified using exponent > ---

[jira] [Resolved] (SPARK-11101) pipe() operation OOM

2015-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11101. --- Resolution: Invalid If it's a question, you should ask as u...@spark.apache.org, not make a JIRA. It

[jira] [Resolved] (SPARK-11049) If a single executor fails to allocate memory, entire job fails

2015-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11049. --- Resolution: Not A Problem Pending more info > If a single executor fails to allocate memory, entire

[jira] [Commented] (SPARK-11058) failed spark job reports on YARN as successful

2015-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956640#comment-14956640 ] Sean Owen commented on SPARK-11058: --- I suspect that either: your job didn't actually fa

[jira] [Commented] (SPARK-11027) Better group distinct columns in query compilation

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956672#comment-14956672 ] Apache Spark commented on SPARK-11027: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11027) Better group distinct columns in query compilation

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11027: Assignee: (was: Apache Spark) > Better group distinct columns in query compilation > -

[jira] [Assigned] (SPARK-11027) Better group distinct columns in query compilation

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11027: Assignee: Apache Spark > Better group distinct columns in query compilation >

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

2015-10-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956832#comment-14956832 ] Yanbo Liang commented on SPARK-10513: - [~mengxr] A simple model training example has

[jira] [Created] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Dominic Ricard (JIRA)
Dominic Ricard created SPARK-11103: -- Summary: Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!) Key: SPARK-11103

[jira] [Created] (SPARK-11104) A potential deadlock in StreamingContext.stop and stopOnShutdown

2015-10-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11104: Summary: A potential deadlock in StreamingContext.stop and stopOnShutdown Key: SPARK-11104 URL: https://issues.apache.org/jira/browse/SPARK-11104 Project: Spark

[jira] [Commented] (SPARK-11104) A potential deadlock in StreamingContext.stop and stopOnShutdown

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956974#comment-14956974 ] Apache Spark commented on SPARK-11104: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11104) A potential deadlock in StreamingContext.stop and stopOnShutdown

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11104: Assignee: Apache Spark > A potential deadlock in StreamingContext.stop and stopOnShutdown

[jira] [Assigned] (SPARK-11104) A potential deadlock in StreamingContext.stop and stopOnShutdown

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11104: Assignee: (was: Apache Spark) > A potential deadlock in StreamingContext.stop and stop

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956988#comment-14956988 ] Hyukjin Kwon commented on SPARK-11103: -- I tested this case. The problem was, Parquet

[jira] [Updated] (SPARK-11102) Unreadable exception when specifing non-exist input for JSON data source

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Summary: Unreadable exception when specifing non-exist input for JSON data source (was: Not readable

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957080#comment-14957080 ] Thomas Graves commented on SPARK-10873: --- Has anyone discussed just using something

[jira] [Updated] (SPARK-10876) display total application time in spark history UI

2015-10-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10876: -- Assignee: Jean-Baptiste Onofré > display total application time in spark history UI > -

[jira] [Assigned] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2533: --- Assignee: (was: Apache Spark) > Show summary of locality level of completed tasks in the

[jira] [Assigned] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2533: --- Assignee: Apache Spark > Show summary of locality level of completed tasks in the each stage

[jira] [Commented] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957131#comment-14957131 ] Apache Spark commented on SPARK-2533: - User 'jbonofre' has created a pull request for

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957144#comment-14957144 ] Sandy Ryza commented on SPARK-: --- Maybe you all have thought through this as well, bu

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957170#comment-14957170 ] Xiao Li commented on SPARK-10925: - Hi, Alexis, The schema of your query results has the

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-10-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957194#comment-14957194 ] Cheolsoo Park commented on SPARK-6910: -- You're right that 2nd query is faster because

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957210#comment-14957210 ] Marcelo Vanzin commented on SPARK-10873: As part of trying to fix SPARK-10172 I p

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957230#comment-14957230 ] Marcelo Vanzin commented on SPARK-11097: Hi [~rxin], can you explain what would b

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957232#comment-14957232 ] Marcelo Vanzin commented on SPARK-11098: I'm not explicitly working on this a.t.m

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-11099: --- Affects Version/s: (was: 1.5.1) (Removing affected version. This code does not exist in b

[jira] [Created] (SPARK-11105) Dsitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Srinivasa Reddy Vundela (JIRA)
Srinivasa Reddy Vundela created SPARK-11105: --- Summary: Dsitribute the log4j.properties files from the client to the executors Key: SPARK-11105 URL: https://issues.apache.org/jira/browse/SPARK-11105

[jira] [Updated] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11105: Summary: Disitribute the log4j.properties files from the client to the exec

[jira] [Resolved] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11083. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 > insert overwrite tabl

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957281#comment-14957281 ] Davies Liu commented on SPARK-11083: Maybe this one: https://github.com/apache/spark/

[jira] [Resolved] (SPARK-10619) Can't sort columns on Executor Page

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10619. - Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > Can't sort columns on Ex

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-14 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957301#comment-14957301 ] Zhan Zhang commented on SPARK-11087: I will take a look at this one. > spark.sql.orc

[jira] [Created] (SPARK-11106) Should ML Models contains single models or Pipelines?

2015-10-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11106: - Summary: Should ML Models contains single models or Pipelines? Key: SPARK-11106 URL: https://issues.apache.org/jira/browse/SPARK-11106 Project: Spark

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957317#comment-14957317 ] Dominic Ricard commented on SPARK-11103: Strangely enough, this works perfectly:

[jira] [Updated] (SPARK-11107) spark.ml should support more input column types: umbrella

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11107: -- Issue Type: Umbrella (was: Improvement) > spark.ml should support more input column ty

[jira] [Updated] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7425: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-11107 > spark.ml Predictor

[jira] [Created] (SPARK-11107) spark.ml should support more input column types: umbrella

2015-10-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11107: - Summary: spark.ml should support more input column types: umbrella Key: SPARK-11107 URL: https://issues.apache.org/jira/browse/SPARK-11107 Project: Spark

[jira] [Comment Edited] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957317#comment-14957317 ] Dominic Ricard edited comment on SPARK-11103 at 10/14/15 5:24 PM: -

[jira] [Updated] (SPARK-11108) OneHotEncoder should support other numeric input types

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11108: -- Description: See parent JIRA for more info. Also see [SPARK-10513] for motivation behi

[jira] [Resolved] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11040. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > SaslRpcHa

[jira] [Created] (SPARK-11108) OneHotEncoder should support other numeric input types

2015-10-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11108: - Summary: OneHotEncoder should support other numeric input types Key: SPARK-11108 URL: https://issues.apache.org/jira/browse/SPARK-11108 Project: Spark

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957345#comment-14957345 ] Joseph K. Bradley commented on SPARK-10513: --- [~yanboliang] This is really help

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957360#comment-14957360 ] Thomas Graves commented on SPARK-10873: --- [~vanzin] I assume your comment about the

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957375#comment-14957375 ] Marcelo Vanzin commented on SPARK-10873: What I mean is that while replacing the

[jira] [Issue Comment Deleted] (SPARK-10943) NullType Column cannot be written to Parquet

2015-10-14 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason C Lee updated SPARK-10943: Comment: was deleted (was: I'd like to work on this. Thanx) > NullType Column cannot be written to

[jira] [Assigned] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-11078: - Assignee: Andrew Or > Ensure spilling tests are actually spilling >

[jira] [Created] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

2015-10-14 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11109: -- Summary: move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException Key: SPARK-11109 URL: https://issues.apache.org/jira/browse/SPARK-11109

[jira] [Commented] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957451#comment-14957451 ] Steve Loughran commented on SPARK-11109: This is compatible with Hadoop branch-1;

[jira] [Commented] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957539#comment-14957539 ] Apache Spark commented on SPARK-11105: -- User 'vundela' has created a pull request fo

[jira] [Commented] (SPARK-11068) Add callback to query execution

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957541#comment-14957541 ] Apache Spark commented on SPARK-11068: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11105: Assignee: Apache Spark > Disitribute the log4j.properties files from the client to the exe

[jira] [Commented] (SPARK-6235) Address various 2G limits

2015-10-14 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957540#comment-14957540 ] Glenn Strycker commented on SPARK-6235: --- Until this issue and sub-issue tickets are

[jira] [Assigned] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11105: Assignee: (was: Apache Spark) > Disitribute the log4j.properties files from the client

[jira] [Commented] (SPARK-6235) Address various 2G limits

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957546#comment-14957546 ] Reynold Xin commented on SPARK-6235: Is your data skewed? i.e. maybe there is a single

[jira] [Commented] (SPARK-6235) Address various 2G limits

2015-10-14 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957554#comment-14957554 ] Glenn Strycker commented on SPARK-6235: --- I don't think so, but I can check. My RDD

[jira] [Updated] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10845: Fix Version/s: 1.5.2 > SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v

[jira] [Resolved] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10845. - Resolution: Fixed I backported it. > SQL option "spark.sql.hive.version" doesn't show up in the

[jira] [Updated] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10577: Fix Version/s: 1.5.2 > [PySpark] DataFrame hint for broadcast join > --

[jira] [Commented] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957569#comment-14957569 ] Reynold Xin commented on SPARK-10577: - I also backported this into branch-1.5 so this

[jira] [Updated] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11105: Target Version/s: (was: 1.5.1) > Disitribute the log4j.properties files from the client to the ex

[jira] [Resolved] (SPARK-8386) DataFrame and JDBC regression

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8386. Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 1.6.0 1.5.2

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957587#comment-14957587 ] Reynold Xin commented on SPARK-10973: - [~josephkb] this should be closed now right?

[jira] [Resolved] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10973. - Resolution: Fixed Fix Version/s: 1.5.2 1.4.2 1.3.2 >

[jira] [Resolved] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11096. - Resolution: Fixed Fix Version/s: 1.6.0 > Post-hoc review Netty based RPC implementation -

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957641#comment-14957641 ] Joseph K. Bradley commented on SPARK-10973: --- Yes, thanks! > __gettitem__ metho

[jira] [Created] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-0: --- Summary: Scala 2.11 build fails due to compiler errors Key: SPARK-0 URL: https://issues.apache.org/jira/browse/SPARK-0 Project: Spark Issue Typ

[jira] [Created] (SPARK-11111) Fast null-safe join

2015-10-14 Thread Davies Liu (JIRA)
Davies Liu created SPARK-1: -- Summary: Fast null-safe join Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark Issue Type: Improvement Reporter:

  1   2   >