[GitHub] [hadoop] torarvid commented on issue #1688: HADOOP-16742. Possible NPE in S3A MultiObjectDeleteSupport error handling.

2019-12-04 Thread GitBox
torarvid commented on issue #1688: HADOOP-16742. Possible NPE in S3A MultiObjectDeleteSupport error handling. URL: https://github.com/apache/hadoop/pull/1688#issuecomment-561536370 Your last analysis seems good to me. Just to clarify, this was the first time I ever looked at hadoop source

[GitHub] [hadoop] bgaborg merged pull request #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-12-04 Thread GitBox
bgaborg merged pull request #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] bgaborg merged pull request #1732: HADOOP-16729. Extract version numbers to head of pom.xml

2019-12-04 Thread GitBox
bgaborg merged pull request #1732: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1732 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] bgaborg commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-12-04 Thread GitBox
bgaborg commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-56171 +1, committing. This is an automated message from the Apache Gi

[jira] [Resolved] (HADOOP-16729) Extract version numbers to head of pom.xml

2019-12-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16729. - Resolution: Fixed > Extract version numbers to head of pom.xml > --

[jira] [Commented] (HADOOP-16729) Extract version numbers to head of pom.xml

2019-12-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987685#comment-16987685 ] Gabor Bota commented on HADOOP-16729: - +1 on #1730 and #1732. Committing. > Extrac

[jira] [Commented] (HADOOP-16729) Extract version numbers to head of pom.xml

2019-12-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987693#comment-16987693 ] Hudson commented on HADOOP-16729: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2019-12-04 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987695#comment-16987695 ] Yuxuan Wang commented on HADOOP-16254: -- After review the jira, I think the *safegu

[GitHub] [hadoop] iwasakims opened a new pull request #1737: HDFS-14522. Allow compact property description in xml in httpfs.

2019-12-04 Thread GitBox
iwasakims opened a new pull request #1737: HDFS-14522. Allow compact property description in xml in httpfs. URL: https://github.com/apache/hadoop/pull/1737 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HADOOP-16731) Unable to build Hadoop 3.2.1 from source code

2019-12-04 Thread zhaobaoquan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaobaoquan updated HADOOP-16731: - Priority: Blocker (was: Major) > Unable to build Hadoop 3.2.1 from source code > -

[GitHub] [hadoop] hadoop-yetus commented on issue #1737: HDFS-14522. Allow compact property description in xml in httpfs.

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1737: HDFS-14522. Allow compact property description in xml in httpfs. URL: https://github.com/apache/hadoop/pull/1737#issuecomment-561637351 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] hadoop-yetus commented on issue #1737: HDFS-14522. Allow compact property description in xml in httpfs.

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1737: HDFS-14522. Allow compact property description in xml in httpfs. URL: https://github.com/apache/hadoop/pull/1737#issuecomment-561652279 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] steveloughran commented on issue #1733: HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN

2019-12-04 Thread GitBox
steveloughran commented on issue #1733: HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN URL: https://github.com/apache/hadoop/pull/1733#issuecomment-561653910 multiple ways * through the UI. Can lose the author in

[GitHub] [hadoop] steveloughran commented on issue #1733: HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN

2019-12-04 Thread GitBox
steveloughran commented on issue #1733: HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN URL: https://github.com/apache/hadoop/pull/1733#issuecomment-561654134 oh, and then manually close the PR & JIRA. Some people includ

[GitHub] [hadoop] elek closed pull request #1609: HDDS-2070. Create insight point to debug one specific pipeline

2019-12-04 Thread GitBox
elek closed pull request #1609: HDDS-2070. Create insight point to debug one specific pipeline URL: https://github.com/apache/hadoop/pull/1609 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [hadoop] elek commented on issue #1609: HDDS-2070. Create insight point to debug one specific pipeline

2019-12-04 Thread GitBox
elek commented on issue #1609: HDDS-2070. Create insight point to debug one specific pipeline URL: https://github.com/apache/hadoop/pull/1609#issuecomment-561665145 Moved to the new repository: https://github.com/apache/hadoop-ozone/pull/299

[jira] [Created] (HADOOP-16745) S3Guard fsck: Use enum instead of int for severity in violations

2019-12-04 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16745: --- Summary: S3Guard fsck: Use enum instead of int for severity in violations Key: HADOOP-16745 URL: https://issues.apache.org/jira/browse/HADOOP-16745 Project: Hadoop Comm

[GitHub] [hadoop] bgaborg commented on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore

2019-12-04 Thread GitBox
bgaborg commented on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore URL: https://github.com/apache/hadoop/pull/1691#issuecomment-561666553 > One question though: what should we be doing in this specific case? As I believe it is a sign that this en

[GitHub] [hadoop] bgaborg edited a comment on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore

2019-12-04 Thread GitBox
bgaborg edited a comment on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore URL: https://github.com/apache/hadoop/pull/1691#issuecomment-561666553 > One question though: what should we be doing in this specific case? As I believe it is a sign that

[jira] [Commented] (HADOOP-13144) Enhancing IPC client throughput via multiple connections per user

2019-12-04 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987944#comment-16987944 ] Janus Chow commented on HADOOP-13144: - The result is not very good. With default im

[GitHub] [hadoop] hadoop-yetus commented on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1691: HADOOP-16424. S3Guard fsck: Check internal consistency of the MetadataStore URL: https://github.com/apache/hadoop/pull/1691#issuecomment-561695888 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |:-

[GitHub] [hadoop] hadoop-yetus commented on issue #1530: HDFS-14869 Copy renamed files which are not excluded anymore by filter

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1530: HDFS-14869 Copy renamed files which are not excluded anymore by filter URL: https://github.com/apache/hadoop/pull/1530#issuecomment-561704162 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[jira] [Updated] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16716: Status: Patch Available (was: Open) > slf4j-log4j12 Should Not Be Included as Dependency

[jira] [Updated] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16716: Attachment: HADOOP-16716.1.patch > slf4j-log4j12 Should Not Be Included as Dependency > -

[jira] [Work started] (HADOOP-16697) audit/tune s3a authoritative flag in s3guard DDB Table

2019-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16697 started by Steve Loughran. --- > audit/tune s3a authoritative flag in s3guard DDB Table > -

[jira] [Commented] (HADOOP-16711) With S3Guard + authmode, consider skipping "verifyBuckets" check in S3A fs init()

2019-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987995#comment-16987995 ] Steve Loughran commented on HADOOP-16711: - We do a lot of stuff in init time; m

[jira] [Commented] (HADOOP-16327) s3a test docs to mention non-auth; or s3a tests to default to non-auth

2019-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987996#comment-16987996 ] Steve Loughran commented on HADOOP-16327: - going to make the default non-auth i

[jira] [Created] (HADOOP-16746) s3a empty dir markers are not created in s3guard as authoritative

2019-12-04 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16746: --- Summary: s3a empty dir markers are not created in s3guard as authoritative Key: HADOOP-16746 URL: https://issues.apache.org/jira/browse/HADOOP-16746 Project: Ha

[jira] [Commented] (HADOOP-16327) s3a test docs to mention non-auth; or s3a tests to default to non-auth

2019-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988006#comment-16988006 ] Steve Loughran commented on HADOOP-16327: - I'm mistaken -must have been working

[jira] [Resolved] (HADOOP-16327) s3a test docs to mention non-auth; or s3a tests to default to non-auth

2019-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16327. - Resolution: Invalid > s3a test docs to mention non-auth; or s3a tests to default to non

[jira] [Commented] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2019-12-04 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988048#comment-16988048 ] Andrew Olson commented on HADOOP-16090: --- Not sure if the best place for this ques

[GitHub] [hadoop] goiri commented on a change in pull request #1737: HDFS-14522. Allow compact property description in xml in httpfs.

2019-12-04 Thread GitBox
goiri commented on a change in pull request #1737: HDFS-14522. Allow compact property description in xml in httpfs. URL: https://github.com/apache/hadoop/pull/1737#discussion_r353898282 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/util/Te

[jira] [Commented] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988066#comment-16988066 ] Hadoop QA commented on HADOOP-16716: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-16727) KMS Jetty server does not startup if trust store password is null

2019-12-04 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-16727: Attachment: HADOOP-16727.003.patch > KMS Jetty server does not startup if trust store pas

[jira] [Commented] (HADOOP-16727) KMS Jetty server does not startup if trust store password is null

2019-12-04 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988120#comment-16988120 ] Hanisha Koneru commented on HADOOP-16727: - Thanks [~smeng] for the review. I ha

[jira] [Commented] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988181#comment-16988181 ] David Mollitor commented on HADOOP-16716: - [~aajisaka] Would you mind reviewing

[jira] [Commented] (HADOOP-16727) KMS Jetty server does not startup if trust store password is null

2019-12-04 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988182#comment-16988182 ] Siyao Meng commented on HADOOP-16727: - +1 on v003, pending jenkins > KMS Jetty ser

[jira] [Commented] (HADOOP-16590) IBM Java has deprecated OS login module classes and OS principal classes.

2019-12-04 Thread Nicholas Marion (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988212#comment-16988212 ] Nicholas Marion commented on HADOOP-16590: -- Is there any insight onto what err

[GitHub] [hadoop] hadoop-yetus commented on issue #1707: HADOOP-16697. Tune/audit auth mode

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1707: HADOOP-16697. Tune/audit auth mode URL: https://github.com/apache/hadoop/pull/1707#issuecomment-561846150 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| |

[jira] [Commented] (HADOOP-16727) KMS Jetty server does not startup if trust store password is null

2019-12-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988232#comment-16988232 ] Hadoop QA commented on HADOOP-16727: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16696) Adding an option to Always use Read Ahead, even for non sequential reads

2019-12-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988348#comment-16988348 ] Hadoop QA commented on HADOOP-16696: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads.

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads. URL: https://github.com/apache/hadoop/pull/1708#issuecomment-561914676 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comm

[GitHub] [hadoop] virajith commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-12-04 Thread GitBox
virajith commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r354065398 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java ##

[GitHub] [hadoop] virajith commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-12-04 Thread GitBox
virajith commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r354065533 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/AzureNativeFileSystemStore.jav

[GitHub] [hadoop] hadoop-yetus commented on issue #1725: HDFS-13616. Batch listing of multiple directories

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1725: HDFS-13616. Batch listing of multiple directories URL: https://github.com/apache/hadoop/pull/1725#issuecomment-561924323 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|

[GitHub] [hadoop] hadoop-yetus commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads.

2019-12-04 Thread GitBox
hadoop-yetus commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads. URL: https://github.com/apache/hadoop/pull/1708#issuecomment-561935405 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Com

[jira] [Commented] (HADOOP-16696) Adding an option to Always use Read Ahead, even for non sequential reads

2019-12-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988386#comment-16988386 ] Hadoop QA commented on HADOOP-16696: | (/) *{color:green}+1 overall{color}* | \\ \\

[GitHub] [hadoop] sapant-msft commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads.

2019-12-04 Thread GitBox
sapant-msft commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads. URL: https://github.com/apache/hadoop/pull/1708#issuecomment-561945698 @DadanielZ Thanks for the suggestion, I made a minor fix to the test, please kindly help rev

[jira] [Updated] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16716: --- Hadoop Flags: Incompatible change > slf4j-log4j12 Should Not Be Included as Dependency > --

[jira] [Commented] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-12-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988420#comment-16988420 ] Akira Ajisaka commented on HADOOP-16716: Now I'm +1 for this change. [~ste...@a

[GitHub] [hadoop] sapant-msft commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads.

2019-12-04 Thread GitBox
sapant-msft commented on issue #1708: HADOOP-16696: Always read ahead config, to use read ahead even for non sequential reads. URL: https://github.com/apache/hadoop/pull/1708#issuecomment-561958608 The 1 test (ITestAzureBlobFileSystemCLI) which was failing earlier was fixed in [PR](https:

[jira] [Resolved] (HADOOP-9493) Replace popen2 module with subprocess in HOD to eliminate deprecation warning

2019-12-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-9493. --- Fix Version/s: (was: 1.1.2) Resolution: Won't Fix branch-1 is EoL. Closing. > Re

[jira] [Resolved] (HADOOP-9491) HOD fails to run under python 2.6.1

2019-12-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-9491. --- Fix Version/s: (was: 1.1.2) Resolution: Won't Fix branch-1 is EoL. Closing. > HO

[jira] [Created] (HADOOP-16747) Support Python 3

2019-12-04 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-16747: -- Summary: Support Python 3 Key: HADOOP-16747 URL: https://issues.apache.org/jira/browse/HADOOP-16747 Project: Hadoop Common Issue Type: Improvement

[jira] [Commented] (HADOOP-16747) Support Python 3

2019-12-04 Thread Kengo Seki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988548#comment-16988548 ] Kengo Seki commented on HADOOP-16747: - Example scripts in the document such as htt

[jira] [Updated] (HADOOP-16747) Support Python 3

2019-12-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16747: --- Target Version/s: 3.3.0 > Support Python 3 > > > Key: HADO