[
https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577552#comment-14577552
]
Kannan Rajah commented on SPARK-1403:
-
A similar problem has been reported while runni
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568012#comment-14568012
]
Kannan Rajah commented on SPARK-4048:
-
Just for completeness of this discussion, let m
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567989#comment-14567989
]
Kannan Rajah commented on SPARK-4048:
-
Yes, exactly. My question is whether curator ja
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567953#comment-14567953
]
Kannan Rajah commented on SPARK-4048:
-
I am going to make the curator jar as compile t
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567783#comment-14567783
]
Kannan Rajah commented on SPARK-4048:
-
Some clarification ...
- My understanding of h
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567746#comment-14567746
]
Kannan Rajah commented on SPARK-4048:
-
This fix has caused a regression for Spark buil
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Description: In some environments, like with MapR, local volumes are
accessed through the Hadoop fil
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Summary: Support DFS based shuffle in addition to Netty shuffle (was:
Support setting spark.local.d
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544563#comment-14544563
]
Kannan Rajah commented on SPARK-1529:
-
Just wanted to check if folks got a chance to r
[
https://issues.apache.org/jira/browse/SPARK-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493592#comment-14493592
]
Kannan Rajah commented on SPARK-6511:
-
[~pwendell] Just wanted to let you know that we
[
https://issues.apache.org/jira/browse/SPARK-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493585#comment-14493585
]
Kannan Rajah commented on SPARK-6511:
-
As requested by Patrick, here is an example of
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493251#comment-14493251
]
Kannan Rajah commented on SPARK-1529:
-
You can use the Compare functionality to see a
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491869#comment-14491869
]
Kannan Rajah commented on SPARK-1529:
-
[~pwendell] The default code path still uses th
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491834#comment-14491834
]
Kannan Rajah commented on SPARK-1529:
-
Thanks. FYI, I have pushed few more commits to
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484022#comment-14484022
]
Kannan Rajah commented on SPARK-1529:
-
[~liancheng] Will you be able to take a look at
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385648#comment-14385648
]
Kannan Rajah commented on SPARK-1529:
-
I have pushed the first round of commits to my
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Attachment: (was: SparkShuffleUsingHDFS_API.pdf)
> Support setting spark.local.dirs to a hadoop
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Attachment: Spark Shuffle using HDFS.pdf
> Support setting spark.local.dirs to a hadoop FileSystem
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361978#comment-14361978
]
Kannan Rajah commented on SPARK-1529:
-
Can someone assign this bug to me? I am working
[
https://issues.apache.org/jira/browse/SPARK-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356173#comment-14356173
]
Kannan Rajah commented on SPARK-4852:
-
We are hitting this issue in a production case,
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Attachment: (was: MapRShuffleOnSpark.pdf)
> Support setting spark.local.dirs to a hadoop FileSys
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Attachment: SparkShuffleUsingHDFS_API.pdf
> Support setting spark.local.dirs to a hadoop FileSystem
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288343#comment-14288343
]
Kannan Rajah edited comment on SPARK-1529 at 1/22/15 10:30 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kannan Rajah updated SPARK-1529:
Attachment: MapRShuffleOnSpark.pdf
High level proposal of the changes to make shuffle use Distribute
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288341#comment-14288341
]
Kannan Rajah commented on SPARK-1529:
-
[~pwendell] I would like us to consider the opt
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263928#comment-14263928
]
Kannan Rajah commented on SPARK-1529:
-
In a MapR distribution, these files need to go
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263603#comment-14263603
]
Kannan Rajah commented on SPARK-1529:
-
It cannot preclude the use of java.io completel
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263600#comment-14263600
]
Kannan Rajah commented on SPARK-1529:
-
[~lian cheng] Can you upload this prototype pat
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263287#comment-14263287
]
Kannan Rajah edited comment on SPARK-1529 at 1/2/15 10:53 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263287#comment-14263287
]
Kannan Rajah commented on SPARK-1529:
-
[~lian cheng] [~pwendell]] I want to work on th
30 matches
Mail list logo