[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:51 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:51 PM: -- There is no

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:44 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:44 PM: -- Just a

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:40 PM: -- Just a

[jira] [Commented] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624144#comment-16624144 ] Gabor Bota commented on HADOOP-15621: - Just a note: There is no call from {{S3AFileSytem}} to

[jira] [Comment Edited] (HADOOP-15621) s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store

[ https://issues.apache.org/jira/browse/HADOOP-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607040#comment-16607040 ] Gabor Bota edited comment on HADOOP-15621 at 9/21/18 8:31 PM: -- Based on

[jira] [Commented] (HADOOP-15774) Discovery of HA servers

[ https://issues.apache.org/jira/browse/HADOOP-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624003#comment-16624003 ] Anu Engineer commented on HADOOP-15774: --- {quote}[~anu] any thoughts on the general approach? I'm

[jira] [Commented] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623975#comment-16623975 ] Andrew Purtell commented on HADOOP-15775: - FWIW the 003 patch doesn't address some cases, like

[jira] [Comment Edited] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623975#comment-16623975 ] Andrew Purtell edited comment on HADOOP-15775 at 9/21/18 6:02 PM: --

[jira] [Commented] (HADOOP-15711) Fix branch-2 builds

[ https://issues.apache.org/jira/browse/HADOOP-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623935#comment-16623935 ] Konstantin Shvachko commented on HADOOP-15711: -- [~aw] thanks a lot for your insight, this

[jira] [Commented] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623926#comment-16623926 ] Da Zhou commented on HADOOP-15723: -- The error indicates the reason: "URI scheme must be *abfss* when

[jira] [Comment Edited] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623926#comment-16623926 ] Da Zhou edited comment on HADOOP-15723 at 9/21/18 5:35 PM: --- The error

[jira] [Comment Edited] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623725#comment-16623725 ] Yuan Gao edited comment on HADOOP-15723 at 9/21/18 5:14 PM: patch 004: -

[jira] [Commented] (HADOOP-15765) Can not find login module class for IBM due to hard codes

[ https://issues.apache.org/jira/browse/HADOOP-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623890#comment-16623890 ] Eric Yang commented on HADOOP-15765: [~jiangjianfei] How about IBM Java version detection to make

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623885#comment-16623885 ] Hadoop QA commented on HADOOP-15691: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623882#comment-16623882 ] Hadoop QA commented on HADOOP-15679: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15774) Discovery of HA servers

[ https://issues.apache.org/jira/browse/HADOOP-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623860#comment-16623860 ] Eric Yang commented on HADOOP-15774: RegistryDNS is a tool to provide DNS resolution. If namenode

[jira] [Commented] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623805#comment-16623805 ] Steve Loughran commented on HADOOP-15723: - h3. ITestAzureBlobFileSystemAuthorization * needs

[jira] [Commented] (HADOOP-15760) Include Apache Commons Collections4

[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623771#comment-16623771 ] Steve Loughran commented on HADOOP-15760: - LGTM. what's your overall migration plan? >

[jira] [Commented] (HADOOP-15774) Discovery of HA servers

[ https://issues.apache.org/jira/browse/HADOOP-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623767#comment-16623767 ] Steve Loughran commented on HADOOP-15774: - bq. Would it make sense to make the registry a

[jira] [Commented] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623761#comment-16623761 ] Steve Loughran commented on HADOOP-15679: - issue was that in the backport, the checkstyle

[jira] [Commented] (HADOOP-15774) Discovery of HA servers

[ https://issues.apache.org/jira/browse/HADOOP-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623736#comment-16623736 ] Billie Rinaldi commented on HADOOP-15774: - bq. Would it make sense to make the registry a

[jira] [Comment Edited] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623725#comment-16623725 ] Yuan Gao edited comment on HADOOP-15723 at 9/21/18 2:45 PM: patch 004: -

[jira] [Commented] (HADOOP-15723) ABFS: Ranger Support

[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623725#comment-16623725 ] Yuan Gao commented on HADOOP-15723: --- patch 004: - called makeQualified() before authz checks -

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Attachment: HADOOP-15679-branch-2-004.patch > ShutdownHookManager shutdown time needs to

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Target Version/s: 3.0.3, 2.10.0, 2.9.2, 2.8.5 (was: 2.10.0, 2.9.2, 3.0.3, 2.8.5)

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Target Version/s: 3.0.3, 2.10.0, 2.9.2, 2.8.5 (was: 2.10.0, 2.9.2, 3.0.3, 2.8.5)

[jira] [Commented] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623692#comment-16623692 ] Steve Loughran commented on HADOOP-15679: - {code} [WARNING]

[jira] [Updated] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15691: Description: Add a {{PathCapabilities}} interface to both FileSystem and FileContext to

[jira] [Updated] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15691: Status: Patch Available (was: Open) > Add PathCapabilities to FS and FC to complement

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623684#comment-16623684 ] Steve Loughran commented on HADOOP-15691: - Patch 003 * revise based on feedback * catch up

[jira] [Updated] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15691: Attachment: HADOOP-15691-003.patch > Add PathCapabilities to FS and FC to complement

[jira] [Commented] (HADOOP-15566) Remove HTrace support

[ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623548#comment-16623548 ] Carlos Alberto Cortez commented on HADOOP-15566: Hi all, I went ahead and did a

[jira] [Commented] (HADOOP-8977) multiple FsShell test failures on Windows

[ https://issues.apache.org/jira/browse/HADOOP-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623505#comment-16623505 ] Vinayakumar B commented on HADOOP-8977: --- HDFS-13911 seems to be broken by this change. After this

[jira] [Commented] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623491#comment-16623491 ] Hadoop QA commented on HADOOP-15775: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623450#comment-16623450 ] Steve Loughran commented on HADOOP-15691: - bq. Should we document a well defined capabilities?

[jira] [Commented] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623447#comment-16623447 ] Hadoop QA commented on HADOOP-15679: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623443#comment-16623443 ] Hadoop QA commented on HADOOP-15775: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15662) ABFS: Better exception handling of DNS errors

[ https://issues.apache.org/jira/browse/HADOOP-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15662: Parent Issue: HADOOP-15763 (was: HADOOP-15407) > ABFS: Better exception handling of DNS

[jira] [Updated] (HADOOP-15778) ABFS: Fix client side throttling for read

[ https://issues.apache.org/jira/browse/HADOOP-15778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15778: Resolution: Fixed Fix Version/s: HADOOP-15407 Status: Resolved (was:

[jira] [Commented] (HADOOP-15779) S3guard: add inconsistency detection metrics

[ https://issues.apache.org/jira/browse/HADOOP-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623362#comment-16623362 ] Steve Loughran commented on HADOOP-15779: - this'd be good. I could imagine pumping out (CSV?

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Target Version/s: 3.0.3, 2.10.0, 2.9.2, 2.8.5 (was: 2.10.0, 2.9.2, 3.0.3, 2.8.5)

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Target Version/s: 3.0.3, 2.10.0, 2.9.2, 2.8.5 (was: 2.10.0, 2.9.2, 3.0.3, 2.8.5)

[jira] [Updated] (HADOOP-15679) ShutdownHookManager shutdown time needs to be configurable & extended

[ https://issues.apache.org/jira/browse/HADOOP-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15679: Attachment: HADOOP-15679-branch-2-003.patch > ShutdownHookManager shutdown time needs to

[jira] [Commented] (HADOOP-15711) Fix branch-2 builds

[ https://issues.apache.org/jira/browse/HADOOP-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623338#comment-16623338 ] Steve Loughran commented on HADOOP-15711: - bq. My guess is something in hadoop-common (and

[jira] [Updated] (HADOOP-15735) backport HADOOP-11687 for hadoop-aws 2.7.x

[ https://issues.apache.org/jira/browse/HADOOP-15735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15735: Resolution: Fixed Fix Version/s: 2.7.8 Status: Resolved (was: Patch

[jira] [Assigned] (HADOOP-15735) backport HADOOP-11687 for hadoop-aws 2.7.x

[ https://issues.apache.org/jira/browse/HADOOP-15735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15735: --- Assignee: MunShik JOUNG > backport HADOOP-11687 for hadoop-aws 2.7.x >

[jira] [Updated] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15775: --- Summary: [JDK9] Add missing javax.activation-api dependency (was: [JDK9] Add

[jira] [Commented] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623302#comment-16623302 ] Akira Ajisaka commented on HADOOP-15775: 03 patch * Shaded the third-party dependency from

[jira] [Updated] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15775: --- Attachment: HADOOP-15775.03.patch > [JDK9] Add "--add-modules java.activation" to java

[jira] [Commented] (HADOOP-15711) Fix branch-2 builds

[ https://issues.apache.org/jira/browse/HADOOP-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623288#comment-16623288 ] Allen Wittenauer commented on HADOOP-15711: --- bq. Can we disable parallel tests for full

[jira] [Commented] (HADOOP-15774) Discovery of HA servers

[ https://issues.apache.org/jira/browse/HADOOP-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623272#comment-16623272 ] Steve Loughran commented on HADOOP-15774: - even though it says YARN, is explicitly not

[jira] [Commented] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623259#comment-16623259 ] Akira Ajisaka commented on HADOOP-15775: 02 patch: * Add javax.activation-api dependency. *

[jira] [Updated] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15775: --- Attachment: HADOOP-15775.02.patch > [JDK9] Add "--add-modules java.activation" to java

[jira] [Commented] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623248#comment-16623248 ] Akira Ajisaka commented on HADOOP-15775: bq. Is the third party dependency is available in Java

[jira] [Commented] (HADOOP-15711) Fix branch-2 builds

[ https://issues.apache.org/jira/browse/HADOOP-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623202#comment-16623202 ] Arun Suresh commented on HADOOP-15711: -- Yeah... figured out with [~jhung] that isolating and

[jira] [Commented] (HADOOP-15775) [JDK9] Add "--add-modules java.activation" to java option in unit tests

[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623165#comment-16623165 ] Akira Ajisaka commented on HADOOP-15775: Thank you for the information, [~apurtell]! Is the

[jira] [Commented] (HADOOP-14775) Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4.

[ https://issues.apache.org/jira/browse/HADOOP-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623162#comment-16623162 ] Akira Ajisaka commented on HADOOP-14775: Note: Apache Hadoop sets reuseForks=false and when

[jira] [Commented] (HADOOP-14775) Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4.

[ https://issues.apache.org/jira/browse/HADOOP-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623105#comment-16623105 ] Akira Ajisaka commented on HADOOP-14775: Thanks [~ajayydv]! Yes. If we want to run JUnit4 and