[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577552#comment-14577552 ] Kannan Rajah commented on SPARK-1403: - A similar problem has been reported while

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567746#comment-14567746 ] Kannan Rajah commented on SPARK-4048: - This fix has caused a regression for Spark

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567783#comment-14567783 ] Kannan Rajah commented on SPARK-4048: - Some clarification ... - My understanding of

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568012#comment-14568012 ] Kannan Rajah commented on SPARK-4048: - Just for completeness of this discussion, let

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567953#comment-14567953 ] Kannan Rajah commented on SPARK-4048: - I am going to make the curator jar as compile

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567989#comment-14567989 ] Kannan Rajah commented on SPARK-4048: - Yes, exactly. My question is whether curator

[jira] [Updated] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Summary: Support DFS based shuffle in addition to Netty shuffle (was: Support setting

[jira] [Updated] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Description: In some environments, like with MapR, local volumes are accessed through the Hadoop

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544563#comment-14544563 ] Kannan Rajah commented on SPARK-1529: - Just wanted to check if folks got a chance to

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493251#comment-14493251 ] Kannan Rajah commented on SPARK-1529: - You can use the Compare functionality to see a

[jira] [Commented] (SPARK-6511) Publish hadoop provided build with instructions for different distros

[ https://issues.apache.org/jira/browse/SPARK-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493585#comment-14493585 ] Kannan Rajah commented on SPARK-6511: - As requested by Patrick, here is an example of

[jira] [Commented] (SPARK-6511) Publish hadoop provided build with instructions for different distros

[ https://issues.apache.org/jira/browse/SPARK-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493592#comment-14493592 ] Kannan Rajah commented on SPARK-6511: - [~pwendell] Just wanted to let you know that we

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491834#comment-14491834 ] Kannan Rajah commented on SPARK-1529: - Thanks. FYI, I have pushed few more commits to

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491869#comment-14491869 ] Kannan Rajah commented on SPARK-1529: - [~pwendell] The default code path still uses

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484022#comment-14484022 ] Kannan Rajah commented on SPARK-1529: - [~liancheng] Will you be able to take a look at

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385648#comment-14385648 ] Kannan Rajah commented on SPARK-1529: - I have pushed the first round of commits to my

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Attachment: (was: SparkShuffleUsingHDFS_API.pdf) Support setting spark.local.dirs to a hadoop

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Attachment: Spark Shuffle using HDFS.pdf Support setting spark.local.dirs to a hadoop FileSystem

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361978#comment-14361978 ] Kannan Rajah commented on SPARK-1529: - Can someone assign this bug to me? I am working

[jira] [Commented] (SPARK-4852) Hive query plan deserialization failure caused by shaded hive-exec jar file when generating golden answers

[ https://issues.apache.org/jira/browse/SPARK-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356173#comment-14356173 ] Kannan Rajah commented on SPARK-4852: - We are hitting this issue in a production case,

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Attachment: SparkShuffleUsingHDFS_API.pdf Support setting spark.local.dirs to a hadoop FileSystem

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Attachment: (was: MapRShuffleOnSpark.pdf) Support setting spark.local.dirs to a hadoop

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288341#comment-14288341 ] Kannan Rajah commented on SPARK-1529: - [~pwendell] I would like us to consider the

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah updated SPARK-1529: Attachment: MapRShuffleOnSpark.pdf High level proposal of the changes to make shuffle use

[jira] [Comment Edited] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288343#comment-14288343 ] Kannan Rajah edited comment on SPARK-1529 at 1/22/15 10:30 PM:

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263928#comment-14263928 ] Kannan Rajah commented on SPARK-1529: - In a MapR distribution, these files need to go

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263603#comment-14263603 ] Kannan Rajah commented on SPARK-1529: - It cannot preclude the use of java.io

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263600#comment-14263600 ] Kannan Rajah commented on SPARK-1529: - [~lian cheng] Can you upload this prototype

[jira] [Comment Edited] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263287#comment-14263287 ] Kannan Rajah edited comment on SPARK-1529 at 1/2/15 10:53 PM: --

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263287#comment-14263287 ] Kannan Rajah commented on SPARK-1529: - [~lian cheng] [~pwendell]] I want to work on