[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043732#comment-16043732
]
Shixiong Zhu commented on SPARK-20952:
--
For `ParquetFileFormat#readFootersInParallel`, I would
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043714#comment-16043714
]
Robert Kruszewski commented on SPARK-20952:
---
Right, but how do I pass it downstream?
>
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043712#comment-16043712
]
Robert Kruszewski commented on SPARK-20952:
---
It doesn't but things underneath it do. It's weird
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043710#comment-16043710
]
Shixiong Zhu commented on SPARK-20952:
--
Although I don't know what you plan to do, you can save the
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043708#comment-16043708
]
Shixiong Zhu commented on SPARK-20952:
--
Why it needs TaskContext?
> TaskContext should be an
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043704#comment-16043704
]
Robert Kruszewski commented on SPARK-20952:
---
No modifications, it's this code
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043694#comment-16043694
]
Shixiong Zhu commented on SPARK-20952:
--
[~robert3005] could you show me your codes? Are you
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043669#comment-16043669
]
Robert Kruszewski commented on SPARK-20952:
---
I am not really attached to the solution. Would be
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043655#comment-16043655
]
Shixiong Zhu commented on SPARK-20952:
--
If TaskContext is not inheritable, we can always find a way
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043623#comment-16043623
]
Robert Kruszewski commented on SPARK-20952:
---
This is already an issue though on driver side
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035302#comment-16035302
]
Shixiong Zhu commented on SPARK-20952:
--
What I'm concerned about is global thread pools, such as
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035195#comment-16035195
]
Robert Kruszewski commented on SPARK-20952:
---
2 is already happening on executors where the Task
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035171#comment-16035171
]
Andrew Ash commented on SPARK-20952:
For the localProperties on SparkContext it does 2 things I can
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034427#comment-16034427
]
Robert Kruszewski commented on SPARK-20952:
---
You're right that this needs a bit of
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033915#comment-16033915
]
Shixiong Zhu commented on SPARK-20952:
--
InheritableThreadLocal only works when creating a new
[
https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033385#comment-16033385
]
Apache Spark commented on SPARK-20952:
--
User 'robert3005' has created a pull request for this issue:
16 matches
Mail list logo
