[GitHub] [hadoop] mukul1987 commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly

2019-03-13 Thread GitBox
mukul1987 commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly URL: https://github.com/apache/hadoop/pull/585#issuecomment-472708501 Thanks for working on this @xiaoyuyao. +1, the changes looks good to me.

[GitHub] [hadoop] dineshchitlangia opened a new pull request #603: HADOOP-16026:Replace incorrect use of system property user.name

2019-03-13 Thread GitBox
dineshchitlangia opened a new pull request #603: HADOOP-16026:Replace incorrect use of system property user.name URL: https://github.com/apache/hadoop/pull/603 This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-16026) Replace incorrect use of system property user.name

2019-03-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HADOOP-16026: --- Description: This jira has been created to track the suggested changes for Hadoop

[jira] [Updated] (HADOOP-16026) Replace incorrect use of system property user.name

2019-03-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HADOOP-16026: --- Description: This jira has been created to track the suggested changes for Hadoop

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472694043 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265408144 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265407768 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265407576 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265407334 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265407031 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265406128 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265406128 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix.

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix. URL: https://github.com/apache/hadoop/pull/591#issuecomment-472672056 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16181) HadoopExecutors shutdown Cleanup

2019-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792241#comment-16792241 ] Hadoop QA commented on HADOOP-16181: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13656) fs -expunge to take a filesystem

2019-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792234#comment-16792234 ] Hadoop QA commented on HADOOP-13656: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-472668114 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16180) LocalFileSystem throw Malformed input or input contains unmappable characters

2019-03-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HADOOP-16180: - Description: How to reproduce: {code:java} export LANG= export LC_CTYPE="POSIX" export

[jira] [Updated] (HADOOP-16181) HadoopExecutors shutdown Cleanup

2019-03-13 Thread David Mollitor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16181: Attachment: HADOOP-16181.2.patch > HadoopExecutors shutdown Cleanup >

[jira] [Updated] (HADOOP-16181) HadoopExecutors shutdown Cleanup

2019-03-13 Thread David Mollitor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16181: Status: Open (was: Patch Available) > HadoopExecutors shutdown Cleanup >

[jira] [Updated] (HADOOP-16181) HadoopExecutors shutdown Cleanup

2019-03-13 Thread David Mollitor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16181: Status: Patch Available (was: Open) > HadoopExecutors shutdown Cleanup >

[jira] [Commented] (HADOOP-13656) fs -expunge to take a filesystem

2019-03-13 Thread Shweta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792187#comment-16792187 ] Shweta commented on HADOOP-13656: - Uploaded patch v003 to fix review and checkstyle. The patch still

[jira] [Updated] (HADOOP-13656) fs -expunge to take a filesystem

2019-03-13 Thread Shweta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shweta updated HADOOP-13656: Attachment: HADOOP-13656.003.patch > fs -expunge to take a filesystem >

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265365974 ## File path:

[GitHub] [hadoop] ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265363618 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265362487 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265361659 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265361576 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265361659 ## File path:

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Fix Version/s: 3.3.0 > S3A input stream to use etags/version number to detect changed

[GitHub] [hadoop] hadoop-yetus commented on issue #485: HDFS-14244. Refactor the libhdfspp cmake build files.

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #485: HDFS-14244. Refactor the libhdfspp cmake build files. URL: https://github.com/apache/hadoop/pull/485#issuecomment-472633936 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472632756 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix.

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix. URL: https://github.com/apache/hadoop/pull/591#issuecomment-472631703 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792158#comment-16792158 ] Steve Loughran commented on HADOOP-15625: - PR 602 is the branch-3.2 version; tested s3 london

[GitHub] [hadoop] hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix.

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix. URL: https://github.com/apache/hadoop/pull/591#issuecomment-472631183 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #602: HADOOP-15625. S3A input stream to use etags/version number to detect changed source files.

2019-03-13 Thread GitBox
steveloughran commented on issue #602: HADOOP-15625. S3A input stream to use etags/version number to detect changed source files. URL: https://github.com/apache/hadoop/pull/602#issuecomment-472629079 This is the 3.2 branch, a bit of backport pain from the openFile changes. Tested: S3

[GitHub] [hadoop] steveloughran opened a new pull request #602: HADOOP-15625. S3A input stream to use etags/version number to detect changed source files.

2019-03-13 Thread GitBox
steveloughran opened a new pull request #602: HADOOP-15625. S3A input stream to use etags/version number to detect changed source files. URL: https://github.com/apache/hadoop/pull/602 HADOOP-15625. S3A input stream to use etags/version number to detect changed source files. Author:

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472624236 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#discussion_r265345701 ## File path:

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#discussion_r265341868 ## File path:

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
bharatviswa504 commented on a change in pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#discussion_r265341530 ## File path:

[GitHub] [hadoop] bharatviswa504 commented on issue #591: HDDS-1250: Initial patch with the proposed fix.

2019-03-13 Thread GitBox
bharatviswa504 commented on issue #591: HDDS-1250: Initial patch with the proposed fix. URL: https://github.com/apache/hadoop/pull/591#issuecomment-472610721 In this also PR also changed OzoneManagerRequestHandler to implement from RequestHandler, as for UT's we can test it without

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792097#comment-16792097 ] Hudson commented on HADOOP-15625: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16204 (See

[jira] [Commented] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792090#comment-16792090 ] Steve Loughran commented on HADOOP-16188: - https://github.com/aws/aws-sdk-java/issues/1141 -SDK

[GitHub] [hadoop] hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-472585268 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792061#comment-16792061 ] Steve Loughran commented on HADOOP-16188: - {code}

[jira] [Updated] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16188: Parent Issue: HADOOP-15620 (was: HADOOP-15619) > s3a rename failed during copy, "Unable

[jira] [Created] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16188: --- Summary: s3a rename failed during copy, "Unable to copy part" + 200 error code Key: HADOOP-16188 URL: https://issues.apache.org/jira/browse/HADOOP-16188

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792046#comment-16792046 ] Steve Loughran commented on HADOOP-15625: - +1 on this, doing commit to 3.3 and then backport to

[jira] [Commented] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792011#comment-16792011 ] Steve Loughran commented on HADOOP-16118: - set capacity trying to change just the read or write

[GitHub] [hadoop] hadoop-yetus commented on issue #600: HDFS-14348: Fix JNI exception handling issues in libhdfs

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #600: HDFS-14348: Fix JNI exception handling issues in libhdfs URL: https://github.com/apache/hadoop/pull/600#issuecomment-472566910 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] toddlipcon commented on a change in pull request #595: HDFS-14304: High lock contention on hdfsHashMutex in libhdfs

2019-03-13 Thread GitBox
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock contention on hdfsHashMutex in libhdfs URL: https://github.com/apache/hadoop/pull/595#discussion_r265286707 ## File path: hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/jclasses.h

[GitHub] [hadoop] ajayydv merged pull request #598: HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageCon…

2019-03-13 Thread GitBox
ajayydv merged pull request #598: HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageCon… URL: https://github.com/apache/hadoop/pull/598 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792008#comment-16792008 ] Steve Loughran commented on HADOOP-16118: - bucket-info reports read-capacity == write-capacity

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472560201 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #597: HDFS-3246: pRead equivalent for direct read path

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #597: HDFS-3246: pRead equivalent for direct read path URL: https://github.com/apache/hadoop/pull/597#issuecomment-472559781 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792013#comment-16792013 ] Steve Loughran commented on HADOOP-16118: - And trying to set both read and write => fail with

[jira] [Comment Edited] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792011#comment-16792011 ] Steve Loughran edited comment on HADOOP-16118 at 3/13/19 6:54 PM: -- set

[jira] [Commented] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792010#comment-16792010 ] Steve Loughran commented on HADOOP-16118: - set capacity with no changes {code} bin/hadoop

[GitHub] [hadoop] ajayydv merged pull request #596: HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contr…

2019-03-13 Thread GitBox
ajayydv merged pull request #596: HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contr… URL: https://github.com/apache/hadoop/pull/596 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] ajayydv commented on issue #596: HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contr…

2019-03-13 Thread GitBox
ajayydv commented on issue #596: HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contr… URL: https://github.com/apache/hadoop/pull/596#issuecomment-472557307 +1 This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472557433 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16118: Priority: Major (was: Minor) Summary: S3Guard to support on-demand DDB tables

[GitHub] [hadoop] ajayydv opened a new pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-13 Thread GitBox
ajayydv opened a new pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601 …ion. Contributed by Ajay Kumar. This is an automated message from

[jira] [Commented] (HADOOP-16187) ITestS3GuardToolDynamoDB test failures

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791997#comment-16791997 ] Steve Loughran commented on HADOOP-16187: - First of these is that if the original DDB table is

[GitHub] [hadoop] jnp commented on issue #598: HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageCon…

2019-03-13 Thread GitBox
jnp commented on issue #598: HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageCon… URL: https://github.com/apache/hadoop/pull/598#issuecomment-472552901 +1 for the patch. This is an automated message from

[jira] [Comment Edited] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791959#comment-16791959 ] Steve Loughran edited comment on HADOOP-16186 at 3/13/19 6:27 PM: --

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Ben Roling (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791986#comment-16791986 ] Ben Roling commented on HADOOP-15625: - Is part of it bad fs.s3a.s3guard.ddb.table and/or

[jira] [Commented] (HADOOP-16187) ITestS3GuardToolDynamoDB test failures

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791982#comment-16791982 ] Steve Loughran commented on HADOOP-16187: - {code} ERROR] Tests run: 16, Failures: 0, Errors: 2,

[jira] [Created] (HADOOP-16187) ITestS3GuardToolDynamoDB test failures

2019-03-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16187: --- Summary: ITestS3GuardToolDynamoDB test failures Key: HADOOP-16187 URL: https://issues.apache.org/jira/browse/HADOOP-16187 Project: Hadoop Common Issue

[GitHub] [hadoop] sahilTakiar commented on issue #600: HDFS-14348: Fix JNI exception handling issues in libhdfs

2019-03-13 Thread GitBox
sahilTakiar commented on issue #600: HDFS-14348: Fix JNI exception handling issues in libhdfs URL: https://github.com/apache/hadoop/pull/600#issuecomment-472545746 Fixing cc warnings. This is an automated message from the

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Attachment: HADOOP-15625-017.patch > S3A input stream to use etags/version number to

[jira] [Created] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16186: --- Summary: NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren Key: HADOOP-16186 URL: https://issues.apache.org/jira/browse/HADOOP-16186

[jira] [Resolved] (HADOOP-16166) TestRawLocalFileSystemContract fails with build Docker container running on Mac

2019-03-13 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-16166. - Resolution: Fixed > TestRawLocalFileSystemContract fails with build Docker container running

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791968#comment-16791968 ] Steve Loughran commented on HADOOP-15625: - Those test failures. None of these are in a codepath

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791965#comment-16791965 ] Steve Loughran commented on HADOOP-15625: - patch LGTM but I need to get an error free test run.

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Status: Open (was: Patch Available) > S3A input stream to use etags/version number to

[jira] [Commented] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791959#comment-16791959 ] Steve Loughran commented on HADOOP-16186: - note test was s3 bucket in london > NPE in

[jira] [Commented] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791957#comment-16791957 ] Steve Loughran commented on HADOOP-16186: - {code} [INFO] Running

[GitHub] [hadoop] hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix.

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #591: HDDS-1250: Initial patch with the proposed fix. URL: https://github.com/apache/hadoop/pull/591#issuecomment-472539893 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-15947) Fix ITestDynamoDBMetadataStore test error issues

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791951#comment-16791951 ] Steve Loughran commented on HADOOP-15947: - This actually caused HADOOP-15827 to resurface. >

[jira] [Commented] (HADOOP-16182) Update abfs storage back-end with "close" flag when application is done writing to a file

2019-03-13 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791943#comment-16791943 ] Da Zhou commented on HADOOP-16182: -- +1. Tests: Applied and tested this patch locally, all tests passed

[jira] [Updated] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16184: Description: When a file is deleted in S3 using S3Guard a tombstone marker will be added for

[GitHub] [hadoop] mattf-apache closed pull request #580: HADOOP-16166. TestRawLocalFileSystemContract fails with build Docker …

2019-03-13 Thread GitBox
mattf-apache closed pull request #580: HADOOP-16166. TestRawLocalFileSystemContract fails with build Docker … URL: https://github.com/apache/hadoop/pull/580 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] mattf-apache commented on issue #580: HADOOP-16166. TestRawLocalFileSystemContract fails with build Docker …

2019-03-13 Thread GitBox
mattf-apache commented on issue #580: HADOOP-16166. TestRawLocalFileSystemContract fails with build Docker … URL: https://github.com/apache/hadoop/pull/580#issuecomment-472532640 Committed to trunk as SHA1 f74159c8fc5. Thanks for the help, @steveloughran .

[GitHub] [hadoop] ajayydv closed pull request #574: HDDS-1119. DN get OM certificate from SCM CA for block token validation.

2019-03-13 Thread GitBox
ajayydv closed pull request #574: HDDS-1119. DN get OM certificate from SCM CA for block token validation. URL: https://github.com/apache/hadoop/pull/574 This is an automated message from the Apache Git Service. To respond

[jira] [Created] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16185: --- Summary: S3Guard: Optimize performance of handling OOB operations in non-authoritative mode Key: HADOOP-16185 URL: https://issues.apache.org/jira/browse/HADOOP-16185

[jira] [Created] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16184: --- Summary: S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker Key: HADOOP-16184 URL: https://issues.apache.org/jira/browse/HADOOP-16184

[jira] [Commented] (HADOOP-16109) Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791901#comment-16791901 ] Matt Foley commented on HADOOP-16109: - Thanks very much [~ste...@apache.org]! > Parquet reading

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-13 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791892#comment-16791892 ] Gabor Bota commented on HADOOP-15999: - I get random failures/timeouts with integration tests but

[GitHub] [hadoop] hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-13 Thread GitBox
hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-472515044 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Comment Edited] (HADOOP-16167) "hadoop CLASSFILE" prints error messages on Ubuntu 18

2019-03-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791873#comment-16791873 ] Eric Yang edited comment on HADOOP-16167 at 3/13/19 4:52 PM: -

[jira] [Commented] (HADOOP-16167) "hadoop CLASSFILE" prints error messages on Ubuntu 18

2019-03-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791873#comment-16791873 ] Eric Yang commented on HADOOP-16167: Hadoop_subcommand unit test is failing in Jenkins using

[GitHub] [hadoop] steveloughran commented on issue #590: HADOOP-16109. Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread GitBox
steveloughran commented on issue #590: HADOOP-16109. Parquet reading S3AFileSystem causes EOF URL: https://github.com/apache/hadoop/pull/590#issuecomment-472494199 this was only a cherry pick, so I fixed by rerunning tests locally till I was happy.

[GitHub] [hadoop] steveloughran closed pull request #590: HADOOP-16109. Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread GitBox
steveloughran closed pull request #590: HADOOP-16109. Parquet reading S3AFileSystem causes EOF URL: https://github.com/apache/hadoop/pull/590 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-16180) LocalFileSystem throw Malformed input or input contains unmappable characters

2019-03-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791848#comment-16791848 ] Yuming Wang commented on HADOOP-16180: -- Thanks [~ste...@apache.org] I have updated the

[jira] [Updated] (HADOOP-16180) LocalFileSystem throw Malformed input or input contains unmappable characters

2019-03-13 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HADOOP-16180: - Description: How to reproduce: {code:java} export LANG= export LC_CTYPE="POSIX" export

[jira] [Commented] (HADOOP-16109) Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791836#comment-16791836 ] Steve Loughran commented on HADOOP-16109: - branch-2 patch in & backported to 2.9 and eventually

[jira] [Resolved] (HADOOP-16109) Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16109. - Resolution: Fixed > Parquet reading S3AFileSystem causes EOF >

[jira] [Updated] (HADOOP-16109) Parquet reading S3AFileSystem causes EOF

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16109: Fix Version/s: 2.9.3 2.8.6 3.0.4

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791820#comment-16791820 ] Steve Loughran commented on HADOOP-15625: - bq. Re: troubleshooting_s3a.md and the tab removal

  1   2   >