[jira] [Updated] (HIVE-11689) minor flow changes to ORC split generation
[ https://issues.apache.org/jira/browse/HIVE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11689: Attachment: HIVE-11689.01.patch Fix CS to not be global; it's not thread-safe in a sense that multiple threads will get random futures from queue if they use it together, I didn't realize multiple input initializers will collide 0_o > minor flow changes to ORC split generation > -- > > Key: HIVE-11689 > URL: https://issues.apache.org/jira/browse/HIVE-11689 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11689.01.patch, HIVE-11689.patch > > > There are two changes that would help future work on split PPD into HBase > metastore. > 1) Move non-HDFS split strategy determination logic into main thread from > threadpool. > 2) Instead of iterating thru the futures and waiting, use CompletionService > to get futures in order of completion. That might be useful by itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11689) minor flow changes to ORC split generation
[ https://issues.apache.org/jira/browse/HIVE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11689: Attachment: HIVE-11689.01.patch > minor flow changes to ORC split generation > -- > > Key: HIVE-11689 > URL: https://issues.apache.org/jira/browse/HIVE-11689 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11689.01.patch, HIVE-11689.01.patch, > HIVE-11689.patch > > > There are two changes that would help future work on split PPD into HBase > metastore. > 1) Move non-HDFS split strategy determination logic into main thread from > threadpool. > 2) Instead of iterating thru the futures and waiting, use CompletionService > to get futures in order of completion. That might be useful by itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11689) minor flow changes to ORC split generation
[ https://issues.apache.org/jira/browse/HIVE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11689: Summary: minor flow changes to ORC split generation (was: minor changes to ORC split generation) minor flow changes to ORC split generation -- Key: HIVE-11689 URL: https://issues.apache.org/jira/browse/HIVE-11689 Project: Hive Issue Type: Bug Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Attachments: HIVE-11689.patch There are two changes that would help future work on split PPD into HBase metastore. 1) Move non-HDFS split strategy determination logic into main thread from threadpool. 2) Instead of iterating thru the futures and waiting, use CompletionService to get futures in order of completion. That might be useful by itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
