[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-04 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Resolution: Fixed
Status: Resolved  (was: Patch Available)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Fix For: 4.0.0, 3.2.0
>
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-04 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Fix Version/s: 3.2.0

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Fix For: 4.0.0, 3.2.0
>
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-04 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Fix Version/s: 4.0.0

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-02 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Patch Available  (was: Open)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-02 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Open  (was: Patch Available)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-02 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: (was: HIVE-20476.01.patch)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-09-02 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: HIVE-20476.01.patch

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Patch Available  (was: Open)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: HIVE-20476.01.patch

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: (was: HIVE-20476.01.patch)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Open  (was: Patch Available)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: HIVE-20476.01.patch

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Patch Available  (was: Open)

Flaky test failure. Re-attaching same patch.

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: (was: HIVE-20476.01.patch)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Open  (was: Patch Available)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HIVE-20476:
--
Labels: DR Export Import Replication pull-request-available  (was: DR 
Export Import Replication)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication, pull-request-available
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Status: Patch Available  (was: Open)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: (was: HIVE-20476.01.patch)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: HIVE-20476.01.patch

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Attachment: HIVE-20476.01.patch

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication
> Attachments: HIVE-20476.01.patch
>
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20476) CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

2018-08-28 Thread Sankar Hariappan (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-20476:

Summary: CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore 
distcp error.  (was: REPL LOAD and EXPORT/IMPORT operations ignores distcp 
failures.)

> CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.
> -
>
> Key: HIVE-20476
> URL: https://issues.apache.org/jira/browse/HIVE-20476
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2, repl
>Affects Versions: 3.1.0
>Reporter: Sankar Hariappan
>Assignee: Sankar Hariappan
>Priority: Major
>  Labels: DR, Export, Import, Replication
>
> CopyUtils uses FileUtils.distCp to copy files but doesn't check the return 
> value. It returns false if the copy fails.
> Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy 
> data files across clusters and here it may return success even if file copy 
> fails and may cause data loss.
> Need to throw error and retry.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)