[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080351#comment-16080351
]
Wenchen Fan commented on SPARK-19659:
-
I think spark 1.6 client can talk to spark 2.2
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080340#comment-16080340
]
Thomas Graves commented on SPARK-19659:
---
can you be more specific here, do you mean
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069396#comment-16069396
]
Apache Spark commented on SPARK-19659:
--
User 'zsxwing' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025900#comment-16025900
]
Apache Spark commented on SPARK-19659:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971025#comment-15971025
]
jin xing commented on SPARK-19659:
--
[~cloud_fan]
I refined the the pr. In current change
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965452#comment-15965452
]
jin xing commented on SPARK-19659:
--
Yes, I think it's a good idea to leverage memory man
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965302#comment-15965302
]
Wenchen Fan commented on SPARK-19659:
-
Seems your model is, all shuffle blocks should
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964596#comment-15964596
]
jin xing commented on SPARK-19659:
--
*bytesShuffleToMemory* is different from *bytesInFli
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964587#comment-15964587
]
jin xing commented on SPARK-19659:
--
[~cloud_fan]
Thanks a lot for taking look into this
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964548#comment-15964548
]
Wenchen Fan commented on SPARK-19659:
-
[~jinxing6...@126.com] can you say more about
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964508#comment-15964508
]
jin xing commented on SPARK-19659:
--
[~irashid]
Tracking memory used by Netty by swapping
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964476#comment-15964476
]
Imran Rashid commented on SPARK-19659:
--
currently the smallest unit is an entire blo
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953968#comment-15953968
]
Wenchen Fan commented on SPARK-19659:
-
What's the smallest unit of fetching remote sh
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952401#comment-15952401
]
Imran Rashid commented on SPARK-19659:
--
[~cloud_fan] The memory is allocated by nett
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952303#comment-15952303
]
Wenchen Fan commented on SPARK-19659:
-
Is it possible to track shuffle fetch memory?
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900741#comment-15900741
]
jin xing commented on SPARK-19659:
--
[~irashid] [~rxin]
I uploaded SPARK-19659-design-v2.
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897244#comment-15897244
]
jin xing commented on SPARK-19659:
--
[~irashid]
Thanks a lot for your comments, really he
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895502#comment-15895502
]
Imran Rashid commented on SPARK-19659:
--
I think Reynold has a good point. I really
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895411#comment-15895411
]
jin xing commented on SPARK-19659:
--
[~rxin]
Thanks a lot for comment.
Tracking average s
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893900#comment-15893900
]
Reynold Xin commented on SPARK-19659:
-
Rather than this tracking the max for each N/2
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891999#comment-15891999
]
jin xing commented on SPARK-19659:
--
[~rxin] [~davies] [~andrewor14] [~joshrosen]
I've u
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884789#comment-15884789
]
jin xing commented on SPARK-19659:
--
[~irashid]
I've uploaded a design doc, please take
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878389#comment-15878389
]
jin xing commented on SPARK-19659:
--
[~irashid]
Thanks a lot for your comments. I will fi
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876466#comment-15876466
]
Imran Rashid commented on SPARK-19659:
--
[~jinxing6...@126.com] Thanks for taking th
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873616#comment-15873616
]
Apache Spark commented on SPARK-19659:
--
User 'jinxing64' has created a pull request
25 matches
Mail list logo
