[jira] [Updated] (BEAM-3782) Do not ignore FileSystem errors and document expected behavior

2018-03-05 Thread Udi Meiri (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Udi Meiri updated BEAM-3782:

Description: 
Cloned from BEAM-3600:

copy/rename:
 * it should be an error if the dst file exists
 * it should be an error if the src file doesn't exist

delete:
 * it should be an error if the file/dir doesn't exist

FileBasedSink.finalize_write:
 * should check (src, dst) pairs for existence:
 ** src only - regular rename
 ** dst only - skip rename
 ** both src and dst - if files don't match on metadata (checksum or size), 
delete dst then rename, otherwise delete src and skip rename
 ** neither exist - return error: bad state

 

  was:
copy/rename:
 * it should be an error if the dst file exists
 * it should be an error if the src file doesn't exist

delete:
 * it should be an error if the file/dir doesn't exist

FileBasedSink.finalize_write:
 * should check (src, dst) pairs for existence:
 ** src only - regular rename
 ** dst only - skip rename
 ** both src and dst - if files don't match on metadata (checksum or size), 
delete dst then rename, otherwise delete src and skip rename
 ** neither exist - return error: bad state

 


> Do not ignore FileSystem errors and document expected behavior
> --
>
> Key: BEAM-3782
> URL: https://issues.apache.org/jira/browse/BEAM-3782
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Udi Meiri
>Assignee: Udi Meiri
>Priority: Major
>
> Cloned from BEAM-3600:
> copy/rename:
>  * it should be an error if the dst file exists
>  * it should be an error if the src file doesn't exist
> delete:
>  * it should be an error if the file/dir doesn't exist
> FileBasedSink.finalize_write:
>  * should check (src, dst) pairs for existence:
>  ** src only - regular rename
>  ** dst only - skip rename
>  ** both src and dst - if files don't match on metadata (checksum or size), 
> delete dst then rename, otherwise delete src and skip rename
>  ** neither exist - return error: bad state
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-3782) Do not ignore FileSystem errors and document expected behavior

2018-03-05 Thread Udi Meiri (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Udi Meiri updated BEAM-3782:

Component/s: (was: sdk-py-core)
 sdk-java-core

> Do not ignore FileSystem errors and document expected behavior
> --
>
> Key: BEAM-3782
> URL: https://issues.apache.org/jira/browse/BEAM-3782
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Udi Meiri
>Assignee: Udi Meiri
>Priority: Major
>
> copy/rename:
>  * it should be an error if the dst file exists
>  * it should be an error if the src file doesn't exist
> delete:
>  * it should be an error if the file/dir doesn't exist
> FileBasedSink.finalize_write:
>  * should check (src, dst) pairs for existence:
>  ** src only - regular rename
>  ** dst only - skip rename
>  ** both src and dst - if files don't match on metadata (checksum or size), 
> delete dst then rename, otherwise delete src and skip rename
>  ** neither exist - return error: bad state
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)