[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722561#comment-16722561
]
ASF GitHub Bot commented on SPARK-26222:
xuanyuanking opened a new pull request #23327:
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722533#comment-16722533
]
ASF GitHub Bot commented on SPARK-26222:
xuanyuanking closed pull request #23298:
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720974#comment-16720974
]
Yuanjian Li commented on SPARK-26222:
-
Copy that, thanks for your explain !
> Scan: track file
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720957#comment-16720957
]
Reynold Xin commented on SPARK-26222:
-
So I spent some time looking at the code base to understand
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720088#comment-16720088
]
Yuanjian Li commented on SPARK-26222:
-
Hi Reynold, the first PR track all file listing time into a
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719122#comment-16719122
]
ASF GitHub Bot commented on SPARK-26222:
xuanyuanking opened a new pull request #23298:
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719110#comment-16719110
]
Yuanjian Li commented on SPARK-26222:
-
Yes, I think I misunderstood your original intention. I'll
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715663#comment-16715663
]
Reynold Xin commented on SPARK-26222:
-
Do we do any file listing in non-physical phase? E.g. if
[
https://issues.apache.org/jira/browse/SPARK-26222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710303#comment-16710303
]
Yuanjian Li commented on SPARK-26222:
-
Leave some thoughts for further discussion:
* There's one