[jira] [Resolved] (HIVE-16738) Notification ID generation in DBNotification might not be unique across HS2 instances.

2017-08-09 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek resolved HIVE-16738. Resolution: Duplicate > Notification ID generation in DBNotification might not be unique across HS2 >

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-09 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119497#comment-16119497 ] anishek commented on HIVE-16886: [~spena] are you working on this one ? if not i am planning to have a go

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-09 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119453#comment-16119453 ] anishek commented on HIVE-16896: [~leftylev] added the configuration doc. > move replication load related

[jira] [Commented] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119448#comment-16119448 ] anishek commented on HIVE-16895: [~leftylev] added the required configuration in doc. > Multi-threaded

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-07 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117837#comment-16117837 ] anishek commented on HIVE-16896: Thanks [~sankarh] for the review. [~thejas]/[~daijy] please commit the

[jira] [Commented] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-07 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116346#comment-16116346 ] anishek commented on HIVE-16895: *

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-07 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: HIVE-16896.3.patch rebasing from master and resolving conflicts. > move replication load related

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-07 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116257#comment-16116257 ] anishek commented on HIVE-16896: [~sankarh] can you please do the review for this! > move replication

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-07 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: (was: HIVE-16896.3.patch) > move replication load related work in semantic analysis phase to

[jira] [Commented] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114031#comment-16114031 ] anishek commented on HIVE-17144: Thanks everyone for helping on this one !. > export of temporary tables

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: (was: HIVE-16896.3.patch) > move replication load related work in semantic analysis phase to

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: HIVE-16896.3.patch reattaching the patch so build can be triggered. > move replication load

[jira] [Commented] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114026#comment-16114026 ] anishek commented on HIVE-16895: Added patch with license header ! Thanks for review [~sankarh] >

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Attachment: HIVE-16895.2.patch > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Attachment: (was: HIVE-16895.2.patch) > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Attachment: HIVE-16895.2.patch > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Commented] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-03 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112612#comment-16112612 ] anishek commented on HIVE-16895: *

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-03 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: HIVE-16896.3.patch > move replication load related work in semantic analysis phase to execution

[jira] [Resolved] (HIVE-16714) make Task Dependency on Repl Load more intuitive

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek resolved HIVE-16714. Resolution: Not A Problem > make Task Dependency on Repl Load more intuitive >

[jira] [Commented] (HIVE-16714) make Task Dependency on Repl Load more intuitive

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112208#comment-16112208 ] anishek commented on HIVE-16714: not required since major rework as part of HIVE-16896 corrected this. >

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1672#comment-1672 ] anishek commented on HIVE-16886: Thanks [~spena] i didnt realize there were additional rows in between the

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: HIVE-16896.2.patch > move replication load related work in semantic analysis phase to execution

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Attachment: HIVE-16895.1.patch > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Work started] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16895 started by anishek. -- > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Status: Patch Available (was: In Progress) > Multi-threaded execution of bootstrap dump of partitions >

[jira] [Updated] (HIVE-16894) Multi-threaded execution of bootstrap dump of tables / functions

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16894: --- Description: after completing HIVE-16893 the bootstrap process will dump single table at a time and hence

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Description: to allow faster execution of bootstrap dump phase we dump multiple partitions from same table

[jira] [Commented] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-08-01 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110358#comment-16110358 ] anishek commented on HIVE-17144: *

[jira] [Assigned] (HIVE-17227) Incremental replication load should creates tasks in execution phase rather than semantic phase

2017-08-01 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-17227: -- Assignee: anishek > Incremental replication load should creates tasks in execution phase rather >

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-08-01 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110279#comment-16110279 ] anishek commented on HIVE-16896: not sure why the pull request is not shown here

[jira] [Commented] (HIVE-17212) Dynamic add partition by insert shouldn't generate INSERT event.

2017-08-01 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108433#comment-16108433 ] anishek commented on HIVE-17212: +1 > Dynamic add partition by insert shouldn't generate INSERT event. >

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Status: Patch Available (was: In Progress) > move replication load related work in semantic analysis phase

[jira] [Work started] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16896 started by anishek. -- > move replication load related work in semantic analysis phase to execution > phase using

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Attachment: HIVE-16896.1.patch > move replication load related work in semantic analysis phase to execution

[jira] [Updated] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17144: --- Status: Patch Available (was: In Progress) > export of temporary tables not working and it seems to be using

[jira] [Updated] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17144: --- Attachment: HIVE-17144.1.patch > export of temporary tables not working and it seems to be using distcp

[jira] [Work started] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-07-31 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17144 started by anishek. -- > export of temporary tables not working and it seems to be using distcp rather > than

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-07-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106834#comment-16106834 ] anishek commented on HIVE-16886: [~spena] I am not exactly sure why we dont use the NotificationLog Id, i

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-07-26 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101538#comment-16101538 ] anishek commented on HIVE-16896: self reminder to add docs for "hive.repl.approx.max.load.tasks" > move

[jira] [Assigned] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-07-21 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-17144: -- > export of temporary tables not working and it seems to be using distcp rather > than filesystem copy >

[jira] [Commented] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-06 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076130#comment-16076130 ] anishek commented on HIVE-16893: Thanks [~daijy]for the commit and [~sankarh] for the review. > move

[jira] [Comment Edited] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-05 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074482#comment-16074482 ] anishek edited comment on HIVE-16893 at 7/5/17 9:26 AM: removing only, an unused

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-05 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: HIVE-16893.4.patch removing only an unused comment > move replication dump related work in

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: HIVE-16893.3.patch fixed sankar's comments > move replication dump related work in semantic

[jira] [Commented] (HIVE-16901) Distcp optimization - One distcp per ReplCopyTask

2017-07-04 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073930#comment-16073930 ] anishek commented on HIVE-16901: +1 cc [~thejas]/[~daijy]/[~sushanth] > Distcp optimization - One distcp

[jira] [Commented] (HIVE-16750) Support change management for rename table/partition.

2017-07-03 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073078#comment-16073078 ] anishek commented on HIVE-16750: +1 cc [~thejas]/[~sushanth]/[~daijy] > Support change management for

[jira] [Commented] (HIVE-16750) Support change management for rename table/partition.

2017-07-03 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071955#comment-16071955 ] anishek commented on HIVE-16750: Please also look at the failure tests for the commit patch with age of 1

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Status: Patch Available (was: In Progress) > move replication dump related work in semantic analysis phase

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: (was: HIVE-16893.1.patch) > move replication dump related work in semantic analysis phase to

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-07-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: HIVE-16893.2.patch [~sankarh] /[~daijy] please review the patch. > move replication dump related

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-07-02 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071937#comment-16071937 ] anishek commented on HIVE-16892: Thanks [~sankarh] / [~thejas] for the review / commit. > Move creation

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069650#comment-16069650 ] anishek commented on HIVE-16892: [~sankarh] attached the latest patch removing the remote iterator. Please

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.6.patch removing the remote iterator. > Move creation of _files from ReplCopyTask to

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-28 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.5.patch fixing import > Move creation of _files from ReplCopyTask to analysis phase

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-28 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067772#comment-16067772 ] anishek commented on HIVE-16892: [~sankarh] responded to comments, please check ! > Move creation of

[jira] [Commented] (HIVE-16785) Ensure replication actions are idempotent if any series of events are applied again.

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065947#comment-16065947 ] anishek commented on HIVE-16785: +1 for other changes except the test failures > Ensure replication

[jira] [Commented] (HIVE-16785) Ensure replication actions are idempotent if any series of events are applied again.

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065946#comment-16065946 ] anishek commented on HIVE-16785: Tests failures for TestReplicationScenariosAcrossInstances needs to be

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: HIVE-16893.1.patch cannot submit this patch as it depends on HIVE-16892. So cant even run the

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065920#comment-16065920 ] anishek commented on HIVE-16892: [~sankarh]/[~sushanth]/[~thejas] please review. > Move creation of

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065919#comment-16065919 ] anishek commented on HIVE-16892: all the failures are from previous builds except *

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch > Move creation of _files from ReplCopyTask to analysis phase for boostrap >

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: (was: HIVE-16892.4.patch) > Move creation of _files from ReplCopyTask to analysis phase for

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch fixing *

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-23 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.3.patch fixing regressions > Move creation of _files from ReplCopyTask to analysis

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-21 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.2.patch using the correct path object for detecting the export directory file system

[jira] [Commented] (HIVE-16918) Skip ReplCopyTask distcp for _metadata copying. Also enable -pb for distcp

2017-06-21 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057031#comment-16057031 ] anishek commented on HIVE-16918: I think HIVE_IN_TEST is definitely better indicator. However I was

[jira] [Work started] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16893 started by anishek. -- > move replication dump related work in semantic analysis phase to execution > phase using

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Status: Patch Available (was: In Progress) > Move creation of _files from ReplCopyTask to analysis phase for

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.1.patch > Move creation of _files from ReplCopyTask to analysis phase for boostrap >

[jira] [Resolved] (HIVE-16900) optimization to give distcp a list of input files to copy to a destination target directory during repl load

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek resolved HIVE-16900. Resolution: Duplicate > optimization to give distcp a list of input files to copy to a destination >

[jira] [Commented] (HIVE-16918) Skip ReplCopyTask distcp for _metadata copying. Also enable -pb for distcp

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055527#comment-16055527 ] anishek commented on HIVE-16918: [~sushanth] shouldnt *pfile* scheme also do a regular copy ? > Skip

[jira] [Updated] (HIVE-16921) ability to trace the task tree created during repl load from logs

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16921: --- Summary: ability to trace the task tree created during repl load from logs (was: Trace the task tree created

[jira] [Assigned] (HIVE-16921) Trace the task tree created during repl load from logs

2017-06-20 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16921: -- > Trace the task tree created during repl load from logs >

[jira] [Commented] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-06-18 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053485#comment-16053485 ] anishek commented on HIVE-16896: We might have to have separate jira's to handle bootstrap repl load vs

[jira] [Work started] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-16 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16892 started by anishek. -- > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication >

[jira] [Comment Edited] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-16 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051522#comment-16051522 ] anishek edited comment on HIVE-16886 at 6/16/17 7:33 AM: - just to understand it

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-16 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051522#comment-16051522 ] anishek commented on HIVE-16886: just to understand it better, isolation level is for updates where as

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-15 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051390#comment-16051390 ] anishek commented on HIVE-16886: Not sure which transaction isolation level across sql db's (that

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-15 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050122#comment-16050122 ] anishek commented on HIVE-16886:

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-15 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050043#comment-16050043 ] anishek commented on HIVE-16886: Another mode to achieve the same would be the way hibernate versioning

[jira] [Commented] (HIVE-16738) Notification ID generation in DBNotification might not be unique across HS2 instances.

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050034#comment-16050034 ] anishek commented on HIVE-16738: No, I havent started on this one, please go ahead. > Notification ID

[jira] [Assigned] (HIVE-16904) during repl load for large number of partitions the metadata file can be huge and can lead to out of memory

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16904: -- > during repl load for large number of partitions the metadata file can be huge > and can lead to out of

[jira] [Comment Edited] (HIVE-16865) Handle replication bootstrap of large databases

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048991#comment-16048991 ] anishek edited comment on HIVE-16865 at 6/14/17 9:59 AM: - h4. Bootstrap

[jira] [Commented] (HIVE-16865) Handle replication bootstrap of large databases

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048991#comment-16048991 ] anishek commented on HIVE-16865: h4. Bootstrap Replication Dump * db metadata one at a time * function

[jira] [Updated] (HIVE-16900) optimization to give distcp a list of input files to copy to a destination target directory during repl load

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16900: --- Description: During repl Copy currently we only allow operations per file as against list of files supported

[jira] [Updated] (HIVE-16900) optimization to give distcp a list of input files to copy to a destination target directory during repl load

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16900: --- Summary: optimization to give distcp a list of input files to copy to a destination target directory during

[jira] [Assigned] (HIVE-16900) optimization to give distcp a list of input files to copy to a destination target directory

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16900: -- > optimization to give distcp a list of input files to copy to a destination > target directory >

[jira] [Updated] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions / functions

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16895: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > Multi-threaded execution of bootstrap

[jira] [Updated] (HIVE-16897) repl load does not lead to excessive memory consumption for multiple functions from same binary jar

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16897: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > repl load does not lead to excessive

[jira] [Updated] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16896: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > move replication load related work in

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > move replication dump related work in

[jira] [Updated] (HIVE-16894) Multi-threaded execution of bootstrap dump of tables.

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16894: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > Multi-threaded execution of bootstrap

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > Move creation of _files from

[jira] [Assigned] (HIVE-16898) Validation of file after distcp in repl load

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16898: -- > Validation of file after distcp in repl load > - > >

[jira] [Updated] (HIVE-16898) Validation of source file after distcp in repl load

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16898: --- Summary: Validation of source file after distcp in repl load (was: Validation of file after distcp in repl

[jira] [Assigned] (HIVE-16897) repl load does not lead to excessive memory consumption for multiple functions from same binary jar

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16897: -- > repl load does not lead to excessive memory consumption for multiple > functions from same binary jar

[jira] [Assigned] (HIVE-16896) move replication load related work in semantic analysis phase to execution phase using a task

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16896: -- > move replication load related work in semantic analysis phase to execution > phase using a task >

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Summary: move replication dump related work in semantic analysis phase to execution phase using a task (was:

[jira] [Updated] (HIVE-16894) Multi-threaded execution of bootstrap dump of tables.

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16894: --- Description: after completing HIVE-16893 the bootstrap process will dump single table at a time and hence

[jira] [Assigned] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions / functions

2017-06-14 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-16895: -- > Multi-threaded execution of bootstrap dump of partitions / functions >

<    1   2   3   4   5   6   7   8   9   >