[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2019-03-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804873#comment-16804873 ] t oo commented on HIVE-15546: - Did this ever make release 2.3? I can't see it in

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840934#comment-15840934 ] Thejas M Nair commented on HIVE-15546: -- As agreed in the dev mailing list and documented in the wiki,

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836792#comment-15836792 ] Sahil Takiar commented on HIVE-15546: - Thanks Sergio! > Optimize Utilities.getInputPaths() so each

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836776#comment-15836776 ] Sergio Peña commented on HIVE-15546: Yes. Those tests are not related to this patch. > Optimize

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836769#comment-15836769 ] Sahil Takiar commented on HIVE-15546: - [~spena] can this be merged? > Optimize

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832652#comment-15832652 ] Sergey Shelukhin commented on HIVE-15546: - That makes sense > Optimize Utilities.getInputPaths()

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832644#comment-15832644 ] Sahil Takiar commented on HIVE-15546: - [~sershe] yes, when {{Utilities.getInputPaths()}} is called (it

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830635#comment-15830635 ] Sergey Shelukhin commented on HIVE-15546: - [~stakiar] wrt listStatuss, when NullScanFS is used, we

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830381#comment-15830381 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829016#comment-15829016 ] Thomas Poepping commented on HIVE-15546: I see how that could make sense -- just have the executor

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829006#comment-15829006 ] Sahil Takiar commented on HIVE-15546: - According to the code, dummy files are added to empty

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828994#comment-15828994 ] Thomas Poepping commented on HIVE-15546: What is the benefit of using dummy files in empty

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828961#comment-15828961 ] Sergio Peña commented on HIVE-15546: Patch looks good (reviewed on RB). +1 > Optimize

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828130#comment-15828130 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-17 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827365#comment-15827365 ] Sahil Takiar commented on HIVE-15546: - Thanks [~sershe] I'll take a look into those classes. [~spena]