[ 
https://issues.apache.org/jira/browse/HIVE-21312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780724#comment-16780724
 ] 

Zoltan Haindrich commented on HIVE-21312:
-----------------------------------------

{quote}<Void> is intentional and hence returning null. Getting the future value 
within the loop would be blocking call and would make it sequential as it has 
to wait for the result.
{quote}
I think future.get() will wait for the "null" which was returned from the 
Callable; I still think you should remove the concurrect collection.
{quote}Thread id `stats-updater-thread-%d` would be helpful in debugging
{quote}
well; it will not show up in a grep for the query's thread...but sure no big 
deal...it's in trace log anyway
{quote}Having fixed threadpool would help restricting the number of threads to 
corepool. If few files are used, it would not go beyond the threadpool size. 
But if cached thread pool is used, it can create too many number of threads 
(not boundeded). Hence the usage of fixed threadpool.
{quote}
damn...I keep forgetting this...the constructor of ThreadPoolExecutor lets this 
...but it's missing on the Executors api...

I've just noticed this...please don't catch (and handle Exception); the old 
behaviour was to log the exception and **return false** as the operation was 
unsuccessfull...
{code:java}
       } catch(Exception e)
                      Utilities.FILE_OP_LOGGER.error("Reading stats : " + 
file.getPath(), e)
       } finally {
{code}

> FSStatsAggregator::connect is slow
> ----------------------------------
>
>                 Key: HIVE-21312
>                 URL: https://issues.apache.org/jira/browse/HIVE-21312
>             Project: Hive
>          Issue Type: Improvement
>          Components: Statistics
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Trivial
>         Attachments: HIVE-21312.1.patch, HIVE-21312.2.patch, 
> HIVE-21312.3.patch, HIVE-21312.4.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to