[GitHub] [hadoop] hadoop-yetus commented on issue #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#issuecomment-580997948 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:

[GitHub] [hadoop] hadoop-yetus commented on issue #1828: Bump checkstyle from 8.26 to 8.29

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1828: Bump checkstyle from 8.26 to 8.29 URL: https://github.com/apache/hadoop/pull/1828#issuecomment-580994601 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +

[jira] [Assigned] (HADOOP-16834) Replace com.sun.istack.Nullable with javax.annotation.Nullable in DNS.java

2020-01-31 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li reassigned HADOOP-16834: --- Assignee: Xieming Li > Replace com.sun.istack.Nullable with javax.annotation.Nullable in D

[GitHub] [hadoop] lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373748571 ## File path: hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nat

[GitHub] [hadoop] hadoop-yetus commented on issue #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#issuecomment-580967422 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:

[GitHub] [hadoop] dependabot[bot] opened a new pull request #1828: Bump checkstyle from 8.26 to 8.29

2020-01-31 Thread GitBox
dependabot[bot] opened a new pull request #1828: Bump checkstyle from 8.26 to 8.29 URL: https://github.com/apache/hadoop/pull/1828 Bumps [checkstyle](https://github.com/checkstyle/checkstyle) from 8.26 to 8.29. Release notes *Sourced from [checkstyle's releases](https://gith

[GitHub] [hadoop] hadoop-yetus commented on issue #1819: HDFS-14989. Add a 'swapBlockList' operation to Namenode.

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1819: HDFS-14989. Add a 'swapBlockList' operation to Namenode. URL: https://github.com/apache/hadoop/pull/1819#issuecomment-580951570 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[jira] [Commented] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027866#comment-17027866 ] Hadoop QA commented on HADOOP-16833: | (/) *{color:green}+1 overall{color}* | \\ \\

[GitHub] [hadoop] lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373711257 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/

[GitHub] [hadoop] lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373711295 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/

[GitHub] [hadoop] lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
lukmajercak commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373711031 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/

[GitHub] [hadoop] goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373709478 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/Native

[GitHub] [hadoop] goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373708397 ## File path: hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/

[GitHub] [hadoop] goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373709672 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/Native

[GitHub] [hadoop] goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer

2020-01-31 Thread GitBox
goiri commented on a change in pull request #1825: HDFS-15151 Use TransmitFile for file to socket data transfer URL: https://github.com/apache/hadoop/pull/1825#discussion_r373709113 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/Native

[GitHub] [hadoop] hadoop-yetus commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#issuecomment-580925538 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] avijayanhwx commented on a change in pull request #1819: HDFS-14989. Add a 'swapBlockList' operation to Namenode.

2020-01-31 Thread GitBox
avijayanhwx commented on a change in pull request #1819: HDFS-14989. Add a 'swapBlockList' operation to Namenode. URL: https://github.com/apache/hadoop/pull/1819#discussion_r373685220 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode

[jira] [Updated] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-16833: --- Attachment: HADOOP-16833.002.patch > InstrumentedLock should log lock queue time >

[jira] [Commented] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027787#comment-17027787 ] Hadoop QA commented on HADOOP-16833: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027715#comment-17027715 ] Stephen O'Donnell commented on HADOOP-16833: I have uploaded a patch for th

[jira] [Updated] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-16833: --- Status: Patch Available (was: Open) > InstrumentedLock should log lock queue time

[jira] [Updated] (HADOOP-16833) InstrumentedLock should log lock queue time

2020-01-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-16833: --- Attachment: HADOOP-16833.001.patch > InstrumentedLock should log lock queue time >

[GitHub] [hadoop] hadoop-yetus commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs.

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs. URL: https://github.com/apache/hadoop/pull/1827#issuecomment-580772623 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] steveloughran commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs.

2020-01-31 Thread GitBox
steveloughran commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs. URL: https://github.com/apache/hadoop/pull/1827#issuecomment-580750766 + @DadanielZ @ThomasMarquardt @sahilTakiar .

[GitHub] [hadoop] steveloughran commented on issue #1821: HADOOP-16825: Checkaccess testcase fix

2020-01-31 Thread GitBox
steveloughran commented on issue #1821: HADOOP-16825: Checkaccess testcase fix URL: https://github.com/apache/hadoop/pull/1821#issuecomment-580749450 FWIW I've done a local test run in my configuration, but I need that test run info from @bilaharith too. --

[GitHub] [hadoop] hadoop-yetus commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#issuecomment-580742619 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] steveloughran commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs.

2020-01-31 Thread GitBox
steveloughran commented on issue #1827: HADOOP-16835. Recover from all failures loading openssl native libs. URL: https://github.com/apache/hadoop/pull/1827#issuecomment-580733178 ran the abfs tests; failures fixed in #1821 and the "no http support " test, otherwise all good -

[GitHub] [hadoop] steveloughran opened a new pull request #1827: HADOOP-16835. Recover from all failures loading openssl native libs.

2020-01-31 Thread GitBox
steveloughran opened a new pull request #1827: HADOOP-16835. Recover from all failures loading openssl native libs. URL: https://github.com/apache/hadoop/pull/1827 Change-Id: I6bdf8ac7a2a8ee82eda3eadac20f03888af24496 This

[GitHub] [hadoop] steveloughran commented on issue #1821: HADOOP-16825: Checkaccess testcase fix

2020-01-31 Thread GitBox
steveloughran commented on issue #1821: HADOOP-16825: Checkaccess testcase fix URL: https://github.com/apache/hadoop/pull/1821#issuecomment-580732813 thanks. Where did you test this, -and have you tried without the oauth settings? ---

[GitHub] [hadoop] hadoop-yetus commented on issue #1823: HADOOP-16794 S3 Encryption key is not getting set properly during put operation.

2020-01-31 Thread GitBox
hadoop-yetus commented on issue #1823: HADOOP-16794 S3 Encryption key is not getting set properly during put operation. URL: https://github.com/apache/hadoop/pull/1823#issuecomment-580732492 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16835) catch and downgrade all exceptions trying to load openssl native libs through wildfly

2020-01-31 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16835: --- Summary: catch and downgrade all exceptions trying to load openssl native libs through wildfly Key: HADOOP-16835 URL: https://issues.apache.org/jira/browse/HADOOP-16835

[jira] [Commented] (HADOOP-16798) job commit failure in S3A MR test, executor rejected submission

2020-01-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027463#comment-17027463 ] Steve Loughran commented on HADOOP-16798: - Worth considering we put a lot of ef

[GitHub] [hadoop] mukund-thakur commented on issue #1823: HADOOP-16794 S3 Encryption key is not getting set properly during put operation.

2020-01-31 Thread GitBox
mukund-thakur commented on issue #1823: HADOOP-16794 S3 Encryption key is not getting set properly during put operation. URL: https://github.com/apache/hadoop/pull/1823#issuecomment-580710341 I was able to reproduce the test failure AbstractTestS3AEncryption#testEncryptionOverRename using

[GitHub] [hadoop] steveloughran opened a new pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
steveloughran opened a new pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826 Currently AWS S3 throttling is initially handled in the AWS SDK, only reaching the S3 client code after it has given up. This

[GitHub] [hadoop] steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-580692164 oops, accidentally closed this. Will resubmit This i

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579956366 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-580001843 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-31 Thread GitBox
hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-576887564 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-01-31 Thread GitBox
hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-579435366 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-01-31 Thread GitBox
hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-578998841 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-