[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408627634 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsOutputStreamS

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408680852 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStr

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408681962 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStr

[jira] [Commented] (HADOOP-16933) Backport HADOOP-16890- "ABFS: Change in expiry calculation for MSI token provider" & HADOOP-16825 "ITestAzureBlobFileSystemCheckAccess failing" to branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083930#comment-17083930 ] Akira Ajisaka commented on HADOOP-16933: Hi [~DanielZhou] and [~bilahari.th] 2.

[jira] [Comment Edited] (HADOOP-16933) Backport HADOOP-16890- "ABFS: Change in expiry calculation for MSI token provider" & HADOOP-16825 "ITestAzureBlobFileSystemCheckAccess failing" to branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083930#comment-17083930 ] Akira Ajisaka edited comment on HADOOP-16933 at 4/15/20, 8:57 AM: ---

[jira] [Updated] (HADOOP-16933) Backport HADOOP-16890- "ABFS: Change in expiry calculation for MSI token provider" & HADOOP-16825 "ITestAzureBlobFileSystemCheckAccess failing" to branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16933: --- Fix Version/s: (was: 2.11.0) > Backport HADOOP-16890- "ABFS: Change in expiry calculati

[jira] [Created] (HADOOP-16988) Remove source code from branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-16988: -- Summary: Remove source code from branch-2 Key: HADOOP-16988 URL: https://issues.apache.org/jira/browse/HADOOP-16988 Project: Hadoop Common Issue Type: Ta

[GitHub] [hadoop] steveloughran commented on a change in pull request #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
steveloughran commented on a change in pull request #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#discussion_r408691832 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/performance.md #

[GitHub] [hadoop] steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-613915399 tested: s3 london with `-Dparallel-tests -DtestsThreadCount=6 -Dscale -Dmarkers=delete -Ds3guard -Ddynamo` and fs.s3a.ssl.ch

[jira] [Updated] (HADOOP-16840) AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16840: --- Fix Version/s: (was: 2.11.0) > AliyunOSS: getFileStatus throws FileNotFoundException in

[GitHub] [hadoop] steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-613920202 * checkstyle on length of comments and debug logs; fixed. * fixed site issues, also did another review of the openssl sect

[GitHub] [hadoop] steveloughran edited a comment on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
steveloughran edited a comment on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-613920202 * checkstyle on length of comments and debug logs; fixed. * fixed site issues, also did another review of the opens

[jira] [Updated] (HADOOP-16778) ABFS: Backport HADOOP-16660 ABFS: Make RetryCount in ExponentialRetryPolicy Configurable to Branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16778: --- Fix Version/s: (was: 2.10.0) > ABFS: Backport HADOOP-16660 ABFS: Make RetryCount in Ex

[jira] [Commented] (HADOOP-16778) ABFS: Backport HADOOP-16660 ABFS: Make RetryCount in ExponentialRetryPolicy Configurable to Branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083950#comment-17083950 ] Akira Ajisaka commented on HADOOP-16778: Hi [~DanielZhou], would you cherry-pic

[jira] [Commented] (HADOOP-16734) Backport HADOOP-16455- "ABFS: Implement FileSystem.access() method" to branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083955#comment-17083955 ] Akira Ajisaka commented on HADOOP-16734: Hi [~DanielZhou], would you cherry-pic

[jira] [Updated] (HADOOP-16734) Backport HADOOP-16455- "ABFS: Implement FileSystem.access() method" to branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16734: --- Fix Version/s: (was: 2.10.0) > Backport HADOOP-16455- "ABFS: Implement FileSystem.acces

[jira] [Assigned] (HADOOP-16988) Remove source code from branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-16988: -- Assignee: Akira Ajisaka > Remove source code from branch-2 > ---

[jira] [Updated] (HADOOP-16988) Remove source code from branch-2

2020-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16988: --- Status: Patch Available (was: Open) > Remove source code from branch-2 > -

[GitHub] [hadoop] aajisaka opened a new pull request #1959: HADOOP-16988. Remove source code from branch-2.

2020-04-15 Thread GitBox
aajisaka opened a new pull request #1959: HADOOP-16988. Remove source code from branch-2. URL: https://github.com/apache/hadoop/pull/1959 JIRA: https://issues.apache.org/jira/browse/HADOOP-16988 This is an automated message f

[GitHub] [hadoop] steveloughran commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-04-15 Thread GitBox
steveloughran commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-613967462 I've been convinced that we should just move to long off volatile for the stream statistics * it's only stati

[GitHub] [hadoop] mukund-thakur opened a new pull request #1960: Forked branch 3.3

2020-04-15 Thread GitBox
mukund-thakur opened a new pull request #1960: Forked branch 3.3 URL: https://github.com/apache/hadoop/pull/1960 Ran test in ap-south-1 bucket with command: mvn clean verify -Ds3guard -Ddynamo -Dparallel-tests -DtestsThreadCount=8 All good.

[GitHub] [hadoop] mukund-thakur commented on issue #1960: HADOOP-16465 listLocatedStatus() optimisation (#1943)

2020-04-15 Thread GitBox
mukund-thakur commented on issue #1960: HADOOP-16465 listLocatedStatus() optimisation (#1943) URL: https://github.com/apache/hadoop/pull/1960#issuecomment-613991295 @steveloughran Backporting #1943 to branch 3.3 This is an a

[GitHub] [hadoop] hadoop-yetus commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
hadoop-yetus commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-614000250 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|

[GitHub] [hadoop] iwasakims commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
iwasakims commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-614001981 I tested the patch on CentOS 8 and openssl-1.1.1-8.el8.x86_64. I got expected behaviour. Without wildfly, `fs.s3a.ssl.cha

[jira] [Commented] (HADOOP-16972) Ignore AuthenticationFilterInitializer for KMSWebServer

2020-04-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084038#comment-17084038 ] Wei-Chiu Chuang commented on HADOOP-16972: -- Hi [~iwasakims] when you say KMS d

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408805468 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStr

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408805468 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStr

[jira] [Commented] (HADOOP-16972) Ignore AuthenticationFilterInitializer for KMSWebServer

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084052#comment-17084052 ] Masatake Iwasaki commented on HADOOP-16972: --- [~weichiu] The error is the repr

[GitHub] [hadoop] iwasakims commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
iwasakims commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-614021477 LGTM. TestOpenSSLClasspaths passed. I got no relevant failure on `mvn verify -T 1C -Dparallel-tests -Ds3guard -Ddynamo` against

[GitHub] [hadoop] hadoop-yetus commented on issue #1960: HADOOP-16465 listLocatedStatus() optimisation (#1943)

2020-04-15 Thread GitBox
hadoop-yetus commented on issue #1960: HADOOP-16465 listLocatedStatus() optimisation (#1943) URL: https://github.com/apache/hadoop/pull/1960#issuecomment-614036066 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|-

[GitHub] [hadoop] steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-614059053 @iwasakims -nice to see tokyo tested; been playing with stockholm today after some reports of trouble with our SDK version,

[GitHub] [hadoop] steveloughran commented on a change in pull request #1955: HADOOP-13873 log DNS addresses on s3a init

2020-04-15 Thread GitBox
steveloughran commented on a change in pull request #1955: HADOOP-13873 log DNS addresses on s3a init URL: https://github.com/apache/hadoop/pull/1955#discussion_r408869592 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @

[GitHub] [hadoop] iwasakims edited a comment on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-15 Thread GitBox
iwasakims edited a comment on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath URL: https://github.com/apache/hadoop/pull/1948#issuecomment-614001981 I tested the patch on CentOS 8 and openssl-1.1.1-8.el8.x86_64. I got expected behaviour. Without wildfly, `fs.s3a.

[GitHub] [hadoop] steveloughran commented on a change in pull request #1955: HADOOP-13873 log DNS addresses on s3a init

2020-04-15 Thread GitBox
steveloughran commented on a change in pull request #1955: HADOOP-13873 log DNS addresses on s3a init URL: https://github.com/apache/hadoop/pull/1955#discussion_r408870229 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @

[jira] [Commented] (HADOOP-16465) Tune S3AFileSystem.listLocatedStatus

2020-04-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084126#comment-17084126 ] Mukund Thakur commented on HADOOP-16465: [https://github.com/apache/hadoop/pull

[jira] [Work started] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-04-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16965 started by Mukund Thakur. -- > Introduce StreamContext for Abfs Input and Output streams. > ---

[GitHub] [hadoop] hadoop-yetus commented on issue #1956: HADOOP-16965 Refactor abfs stream configuration.

2020-04-15 Thread GitBox
hadoop-yetus commented on issue #1956: HADOOP-16965 Refactor abfs stream configuration. URL: https://github.com/apache/hadoop/pull/1956#issuecomment-614093856 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:

[GitHub] [hadoop] vinayakumarb closed pull request #1957: HADOOP-16985. Handle release package related issues

2020-04-15 Thread GitBox
vinayakumarb closed pull request #1957: HADOOP-16985. Handle release package related issues URL: https://github.com/apache/hadoop/pull/1957 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-16985) Handle release package related issues

2020-04-15 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084183#comment-17084183 ] Hudson commented on HADOOP-16985: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-16465) Tune S3AFileSystem.listLocatedStatus

2020-04-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16465: Fix Version/s: (was: 3.4.0) 3.3.0 > Tune S3AFileSystem.listLocated

[jira] [Commented] (HADOOP-16579) Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.6 in Hadoop

2020-04-15 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084222#comment-17084222 ] Íñigo Goiri commented on HADOOP-16579: -- [~fengnanli], I recently upgraded to ZK 3.

[jira] [Created] (HADOOP-16989) Update JaegerTracing

2020-04-15 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16989: Summary: Update JaegerTracing Key: HADOOP-16989 URL: https://issues.apache.org/jira/browse/HADOOP-16989 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-16990) Update Mockserver

2020-04-15 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16990: Summary: Update Mockserver Key: HADOOP-16990 URL: https://issues.apache.org/jira/browse/HADOOP-16990 Project: Hadoop Common Issue Type: Task

[jira] [Assigned] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned HADOOP-16361: Assignee: Jim Brennan > TestSecureLogins#testValidKerberosName fails on branch-2 > -

[jira] [Updated] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-16361: - Attachment: HADOOP-16361-branch-2.10.001.patch Status: Patch Available (was: Open) [~d

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-15 Thread GitBox
mehakmeet commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#discussion_r408992189 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStr

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-15 Thread GitBox
DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#discussion_r408990548 ## File path: hadoop-tools/hadoop-azure/src/main

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-15 Thread GitBox
DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#discussion_r409003424 ## File path: hadoop-tools/hadoop-azure/src/main

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-15 Thread GitBox
DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#discussion_r408994094 ## File path: hadoop-tools/hadoop-azure/src/main

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-15 Thread GitBox
DadanielZ commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#discussion_r408998437 ## File path: hadoop-tools/hadoop-azure/src/main

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084273#comment-17084273 ] Hadoop QA commented on HADOOP-16361: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Resolved] (HADOOP-16985) Handle release package related issues

2020-04-15 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HADOOP-16985. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to br

[jira] [Commented] (HADOOP-16579) Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.6 in Hadoop

2020-04-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084282#comment-17084282 ] Wei-Chiu Chuang commented on HADOOP-16579: -- I don't think we tested Hadoop 3.3

[jira] [Comment Edited] (HADOOP-16579) Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.6 in Hadoop

2020-04-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084282#comment-17084282 ] Wei-Chiu Chuang edited comment on HADOOP-16579 at 4/15/20, 5:52 PM: -

[GitHub] [hadoop] goiri commented on a change in pull request #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
goiri commented on a change in pull request #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#discussion_r409032699 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/nam

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084298#comment-17084298 ] Jim Brennan commented on HADOOP-16361: -- [~daryn], [~kihwal], [~jhung] I've put up

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084301#comment-17084301 ] Eric Yang commented on HADOOP-16361: [~Jim_Brennan] Thank you for the patch.  This

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084316#comment-17084316 ] Jim Brennan commented on HADOOP-16361: -- Thanks for the review [~eyang]! I will ad

[jira] [Updated] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-16361: - Attachment: HADOOP-16361-branch-2.10.002.patch > TestSecureLogins#testValidKerberosName fails o

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084346#comment-17084346 ] Hadoop QA commented on HADOOP-16361: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084351#comment-17084351 ] Eric Yang commented on HADOOP-16361: +1 for patch 002. > TestSecureLogins#testVali

[GitHub] [hadoop] brfrn169 commented on a change in pull request #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
brfrn169 commented on a change in pull request #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#discussion_r409103492 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/

[GitHub] [hadoop] goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614267348 @brfrn169 thanks for updating. One concern I have is the added overhead. Specially, the overhead within the write

[GitHub] [hadoop] brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614281809 @goiri I don't think the overhead is not large because building the lock report message happens only when the lock i

[GitHub] [hadoop] brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614281809 @goiri I don't think the overhead is very large because building the lock report message happens only when th

[jira] [Commented] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2020-04-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084394#comment-17084394 ] Jim Brennan commented on HADOOP-16361: -- Thanks for the review [~eyang]! Can you p

[GitHub] [hadoop] hadoop-yetus commented on issue #1861: HADOOP-13230. Optionally retain directory markers

2020-04-15 Thread GitBox
hadoop-yetus commented on issue #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#issuecomment-614321549 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:

[GitHub] [hadoop] goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614338796 @brfrn169 I also believe that the Supplier logic should only be trigger if we log it. Can we do some benchmarking or

[GitHub] [hadoop] brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614352034 @goiri Okay. Will do that. This is an automa

[GitHub] [hadoop] brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-15 Thread GitBox
brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-614352034 @brfrn169 Okay. Will do that. This is an automated

[jira] [Updated] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16982: -- Attachment: HADOOP-16982-branch-3.2.001.patch > Update Netty to 4.1.48.Final > --

[jira] [Commented] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084481#comment-17084481 ] Masatake Iwasaki commented on HADOOP-16982: --- I'm backporting this to lower br

[jira] [Updated] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16982: -- Fix Version/s: 3.2.2 > Update Netty to 4.1.48.Final > >

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > --

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > ---

[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Status: Patch Available (was: In Progress) > Optimizing the upload buffer in Hadoop-cos >

[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Status: Open (was: Patch Available) > Optimizing the upload buffer in Hadoop-cos > ---

[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: (was: HADOOP-16968-branch-3.3.001.patch) > Optimizing the upload buffer in Hadoop-cos > ---

[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: HADOOP-16968-branch-3.3.001.patch Status: Patch Available (was: Open) This patch aims

[jira] [Updated] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16982: -- Attachment: HADOOP-16982-branch-3.1.001.patch > Update Netty to 4.1.48.Final > --

[jira] [Updated] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16982: -- Fix Version/s: 3.1.4 > Update Netty to 4.1.48.Final > >

[jira] [Commented] (HADOOP-16982) Update Netty to 4.1.48.Final

2020-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084523#comment-17084523 ] Masatake Iwasaki commented on HADOOP-16982: --- committed to branch-3.2 and bran

[jira] [Updated] (HADOOP-16971) testFileContextResolveAfs creates dangling link and fails for subsequent runs

2020-04-15 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HADOOP-16971: --- Component/s: fs Description: In the test testFileContextResolveAfs, the symlink TestFileContextResolveA

[jira] [Updated] (HADOOP-16971) testFileContextResolveAfs creates dangling link and fails for subsequent runs

2020-04-15 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HADOOP-16971: --- Labels: easyfix fs symlink test (was: easyfix) > testFileContextResolveAfs creates dangling link and fails

[jira] [Updated] (HADOOP-16971) testFileContextResolveAfs creates dangling link and fails for subsequent runs

2020-04-15 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HADOOP-16971: --- Description: In the test testFileContextResolveAfs, the symlink TestFileContextResolveAfs2 (linked to Test

[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084538#comment-17084538 ] Hadoop QA commented on HADOOP-16959: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2020-04-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084545#comment-17084545 ] Hadoop QA commented on HADOOP-16968: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > ---

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-15 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > --

[GitHub] [hadoop] iwasakims opened a new pull request #1961: HADOOP-16972. Ignore AuthenticationFilterInitializer for KMSWebServer.

2020-04-15 Thread GitBox
iwasakims opened a new pull request #1961: HADOOP-16972. Ignore AuthenticationFilterInitializer for KMSWebServer. URL: https://github.com/apache/hadoop/pull/1961 This is an automated message from the Apache Git Service. To r