[GitHub] [hadoop] bshashikant commented on pull request #2355: HDFS-15611. Add list Snapshot command in WebHDFS.

2020-10-01 Thread GitBox
bshashikant commented on pull request #2355: URL: https://github.com/apache/hadoop/pull/2355#issuecomment-702536750 > Thanks @bshashikant . Should we add `SnapshotStatus[] getSnapshotListing(Path snapshotRoot)` > to FileSystem? If yes, we should move SnapshotStatus to

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=493820=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493820 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-10-01 Thread GitBox
viirya commented on a change in pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#discussion_r498622029 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/lz4/Lz4Compressor.java ## @@ -236,7 +237,7 @@ public

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=493819=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493819 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-10-01 Thread GitBox
viirya commented on a change in pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#discussion_r498621489 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -143,22 +143,16 @@ public void

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=493818=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493818 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-10-01 Thread GitBox
viirya commented on a change in pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#discussion_r498621151 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/CompressDecompressTester.java ## @@ -494,8 +494,7 @@ public

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205970#comment-17205970 ] Attila Doroszlai commented on HADOOP-16990: --- Sure, I ran these tests before uploading the

[GitHub] [hadoop] szetszwo commented on a change in pull request #2355: HDFS-15611. Add list Snapshot command in WebHDFS.

2020-10-01 Thread GitBox
szetszwo commented on a change in pull request #2355: URL: https://github.com/apache/hadoop/pull/2355#discussion_r498605120 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java ## @@ -1459,6 +1460,19 @@

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205919#comment-17205919 ] Wei-Chiu Chuang commented on HADOOP-16990: -- Looks good... Attila. Can you also manually

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205903#comment-17205903 ] Hadoop QA commented on HADOOP-16990: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Work logged] (HADOOP-17265) ABFS: Support for Client Correlation ID

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17265?focusedWorklogId=493703=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493703 ] ASF GitHub Bot logged work on HADOOP-17265: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on pull request #2344: HADOOP-17265. ABFS: Support for Client Correlation ID

2020-10-01 Thread GitBox
sumangala-patki commented on pull request #2344: URL: https://github.com/apache/hadoop/pull/2344#issuecomment-702413487 Test Results HNS-Enabled Account (Location: East US 2) ``` Authentication type: SharedKey [INFO] Tests run: 87, Failures: 0, Errors: 0, Skipped: 0

[jira] [Work logged] (HADOOP-17265) ABFS: Support for Client Correlation ID

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17265?focusedWorklogId=493698=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493698 ] ASF GitHub Bot logged work on HADOOP-17265: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2344: HADOOP-17265. ABFS: Support for Client Correlation ID

2020-10-01 Thread GitBox
sumangala-patki commented on a change in pull request #2344: URL: https://github.com/apache/hadoop/pull/2344#discussion_r498524223 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/utils/TrackingContext.java ## @@ -0,0 +1,61 @@ +/** + *

[jira] [Work logged] (HADOOP-17183) ABFS: Enable checkaccess API

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17183?focusedWorklogId=493676=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493676 ] ASF GitHub Bot logged work on HADOOP-17183: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2331: HADOOP-17183. ABFS: Enabling checkaccess on ABFS

2020-10-01 Thread GitBox
steveloughran commented on pull request #2331: URL: https://github.com/apache/hadoop/pull/2331#issuecomment-702380473 +1, merged to 3.3 and trunk This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HADOOP-17183) ABFS: Enable checkaccess API

2020-10-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17183: Fix Version/s: 3.3.1 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Work logged] (HADOOP-17183) ABFS: Enable checkaccess API

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17183?focusedWorklogId=493675=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493675 ] ASF GitHub Bot logged work on HADOOP-17183: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2331: HADOOP-17183. ABFS: Enabling checkaccess on ABFS

2020-10-01 Thread GitBox
steveloughran merged pull request #2331: URL: https://github.com/apache/hadoop/pull/2331 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Comment Edited] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205803#comment-17205803 ] Attila Doroszlai edited comment on HADOOP-16990 at 10/1/20, 8:25 PM:

[jira] [Updated] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HADOOP-16990: -- Status: Patch Available (was: In Progress) > Update Mockserver > -

[jira] [Comment Edited] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205803#comment-17205803 ] Attila Doroszlai edited comment on HADOOP-16990 at 10/1/20, 8:22 PM:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
steveloughran commented on a change in pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#discussion_r498491655 ## File path:

[jira] [Updated] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HADOOP-16990: -- Attachment: HADOOP-16990.001.patch > Update Mockserver > - > >

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205803#comment-17205803 ] Attila Doroszlai commented on HADOOP-16990: --- MockServer 5.11.0 and 5.11.1 (latest release)

[jira] [Work logged] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17281?focusedWorklogId=493672=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493672 ] ASF GitHub Bot logged work on HADOOP-17281: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran removed a comment on pull request #2354: HADOOP-17281 Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread GitBox
steveloughran removed a comment on pull request #2354: URL: https://github.com/apache/hadoop/pull/2354#issuecomment-702371522 Looks good. Annoying about the return types which force you to do that wrapping/casting. Can't you just forcibly cast the return type of the inner iterator? after

[jira] [Work logged] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17281?focusedWorklogId=493671=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493671 ] ASF GitHub Bot logged work on HADOOP-17281: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2354: HADOOP-17281 Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread GitBox
steveloughran commented on pull request #2354: URL: https://github.com/apache/hadoop/pull/2354#issuecomment-702371522 Looks good. Annoying about the return types which force you to do that wrapping/casting. Can't you just forcibly cast the return type of the inner iterator? after all,

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=493666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493666 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-10-01 Thread GitBox
steveloughran commented on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-702364693 @mehakmeet * duration tracking for classic function. Issue: are the names of the `trackDuration` calls correct now? * class DurationStatisticSummary to store and

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205783#comment-17205783 ] Wei-Chiu Chuang commented on HADOOP-16990: -- {noformat} [INFO] +-

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205779#comment-17205779 ] Ayush Saxena commented on HADOOP-16990: --- What advantages do we get with upgrading MockServer? Is

[jira] [Commented] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205778#comment-17205778 ] Wei-Chiu Chuang commented on HADOOP-16990: -- Thanks for picking this up! [~adoroszlai] >

[jira] [Work started] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16990 started by Attila Doroszlai. - > Update Mockserver > - > > Key:

[jira] [Assigned] (HADOOP-16990) Update Mockserver

2020-10-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HADOOP-16990: - Assignee: Attila Doroszlai > Update Mockserver > - > >

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493632=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493632 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
ferhui commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498437024 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -114,6 +115,12 @@ public String toString()

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493630=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493630 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
ferhui commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498433031 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -109,11 +114,53 @@ public String toString()

[GitHub] [hadoop] smengcl edited a comment on pull request #2352: HDFS-15607. Create trash dir when allowing snapshottable dir

2020-10-01 Thread GitBox
smengcl edited a comment on pull request #2352: URL: https://github.com/apache/hadoop/pull/2352#issuecomment-701586546 > Do we need to add provisionTrash command for WebHdfs as well? Good point. I think so, yes. Update: As I was attempting to add `PROVISIONSNAPSHOTTRASH` to

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493609 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
goiri commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498413903 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -109,11 +114,53 @@ public String toString()

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=493595=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493595 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-10-01 Thread GitBox
viirya commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-702273856 Hmm, for CompressDecompressTester.java, it seems to me that it is from original code? ```java else if (compressor.getClass().isAssignableFrom(ZlibCompressor.class))

[jira] [Commented] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205644#comment-17205644 ] Michael Stack commented on HADOOP-17288: {quote}Ideally if the downstream has to upgrade guava,

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493544=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493544 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
ferhui commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498337876 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -114,6 +115,12 @@ public String toString()

[GitHub] [hadoop] jbrennan333 commented on pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
jbrennan333 commented on pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#issuecomment-702176681 @steveloughran It's hard to think of a terse warning for this. I think your comment above gets close. Maybe something like "The v2 commit algorithm assumes that the

[GitHub] [hadoop] steveloughran commented on pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
steveloughran commented on pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#issuecomment-702161929 (Yetus failure is from no new tests) This is an automated message from the Apache Git Service. To respond

[jira] [Work logged] (HADOOP-17265) ABFS: Support for Client Correlation ID

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17265?focusedWorklogId=493507=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493507 ] ASF GitHub Bot logged work on HADOOP-17265: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17021) Add concat fs command

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17021?focusedWorklogId=493506=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493506 ] ASF GitHub Bot logged work on HADOOP-17021: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya commented on a change in pull request #2344: HADOOP-17265. ABFS: Support for Client Correlation ID

2020-10-01 Thread GitBox
snvijaya commented on a change in pull request #2344: URL: https://github.com/apache/hadoop/pull/2344#discussion_r498266654 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/utils/TrackingContext.java ## @@ -0,0 +1,61 @@ +/** + * Licensed to

[GitHub] [hadoop] steveloughran commented on pull request #1993: HADOOP-17021. Add concat fs command

2020-10-01 Thread GitBox
steveloughran commented on pull request #1993: URL: https://github.com/apache/hadoop/pull/1993#issuecomment-702161263 OK, yetus is happy, it's just changed where to report I'm going to merge: what do you want to have in your Contributed by: credits as your full name? I think we need

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=493505=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493505 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-10-01 Thread GitBox
steveloughran commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-702159088 ok, yetus is running, it's just reporting isn't quite there...if you follow the link you see the results. Test failures in hdfs: unrelated. ASF licence warning: unrelated.

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=493504=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493504 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-10-01 Thread GitBox
hadoop-yetus removed a comment on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-690909475 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=493503=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493503 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2159: HADOOP-17124. Support LZO Codec using aircompressor

2020-10-01 Thread GitBox
steveloughran commented on pull request #2159: URL: https://github.com/apache/hadoop/pull/2159#issuecomment-702155803 @dbtsai yes, lets do snappy first This is an automated message from the Apache Git Service. To respond to

[jira] [Work logged] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13327?focusedWorklogId=493502=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493502 ] ASF GitHub Bot logged work on HADOOP-13327: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17021) Add concat fs command

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17021?focusedWorklogId=493501=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493501 ] ASF GitHub Bot logged work on HADOOP-17021: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #1993: HADOOP-17021. Add concat fs command

2020-10-01 Thread GitBox
steveloughran commented on pull request #1993: URL: https://github.com/apache/hadoop/pull/1993#issuecomment-702154756 there's been ongoing work with a yetus update this week and its been playing up. I've suggested some minor change, either do that or just a rebase and forced push to see

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2102: HADOOP-13327. Specify Output Stream and Syncable

2020-10-01 Thread GitBox
hadoop-yetus removed a comment on pull request #2102: URL: https://github.com/apache/hadoop/pull/2102#issuecomment-696402075 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-17021) Add concat fs command

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17021?focusedWorklogId=493500=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493500 ] ASF GitHub Bot logged work on HADOOP-17021: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #1993: HADOOP-17021. Add concat fs command

2020-10-01 Thread GitBox
steveloughran commented on a change in pull request #1993: URL: https://github.com/apache/hadoop/pull/1993#discussion_r498263927 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Concat.java ## @@ -0,0 +1,91 @@ +/** + * Licensed to the

[GitHub] [hadoop] steveloughran commented on pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
steveloughran commented on pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#issuecomment-702137474 @jbrennan333 what do you think we should say instead of deprecated? "not recommended". I was thinking of adding a link to the JIRA and changing the issue text

[GitHub] [hadoop] steveloughran commented on a change in pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
steveloughran commented on a change in pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#discussion_r498242126 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-10-01 Thread GitBox
steveloughran commented on a change in pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#discussion_r498242247 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml ## @@ -1562,10

[GitHub] [hadoop] bshashikant opened a new pull request #2355: HDFS-15611. Add list Snapshot command in WebHDFS.

2020-10-01 Thread GitBox
bshashikant opened a new pull request #2355: URL: https://github.com/apache/hadoop/pull/2355 please check https://issues.apache.org/jira/browse/HDFS-15611 This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493458=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493458 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
aajisaka commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498191019 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -114,6 +115,12 @@ public String

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=493456=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493456 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on a change in pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-10-01 Thread GitBox
aajisaka commented on a change in pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#discussion_r498189901 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -114,6 +115,12 @@ public String

[GitHub] [hadoop] aajisaka closed pull request #2346: [DO NOT MERGE] Avoid YETUS-994 for testing

2020-10-01 Thread GitBox
aajisaka closed pull request #2346: URL: https://github.com/apache/hadoop/pull/2346 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka commented on pull request #2346: [DO NOT MERGE] Avoid YETUS-994 for testing

2020-10-01 Thread GitBox
aajisaka commented on pull request #2346: URL: https://github.com/apache/hadoop/pull/2346#issuecomment-702078340 The new token worked as expected, so we don't need to revert YETUS-994 in our setting. Closing. This is an

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=493435=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493435 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-10-01 Thread GitBox
mehakmeet commented on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-702072245 In IOStatisticsBinding class we have methods for tracking duration but, I am not able to wrap it around a normal function. There are 3 methods for tracking durations which

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=493363=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493363 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2353: HADOOP-17272. ABFS Streams to support IOStatistics API

2020-10-01 Thread GitBox
mehakmeet commented on pull request #2353: URL: https://github.com/apache/hadoop/pull/2353#issuecomment-702011782 Have to force push since am rebasing Steve's branch on my commits. Also, Don't know why Yetus isn't running.

[jira] [Comment Edited] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205340#comment-17205340 ] Ayush Saxena edited comment on HADOOP-17288 at 10/1/20, 7:49 AM: -

[jira] [Commented] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205340#comment-17205340 ] Ayush Saxena commented on HADOOP-17288: --- Transitive dependency as the dependencies which hadoop

[jira] [Comment Edited] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205340#comment-17205340 ] Ayush Saxena edited comment on HADOOP-17288 at 10/1/20, 7:47 AM: -

[jira] [Updated] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HADOOP-17288: --- Fix Version/s: 3.4.0 > Use shaded guava from thirdparty >

[jira] [Commented] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205329#comment-17205329 ] Michael Stack commented on HADOOP-17288: {quote}but guava as of now would be still packaged as

[jira] [Commented] (HADOOP-17288) Use shaded guava from thirdparty

2020-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205309#comment-17205309 ] Ayush Saxena commented on HADOOP-17288: --- [~stack] yes the intentions are like that only. The

[jira] [Updated] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17281: Labels: pull-request-available (was: ) > Implement FileSystem.listStatusIterator() in

[jira] [Work logged] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17281?focusedWorklogId=493316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493316 ] ASF GitHub Bot logged work on HADOOP-17281: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur opened a new pull request #2354: HADOOP-17281 Implement FileSystem.listStatusIterator() in S3AFileSystem

2020-10-01 Thread GitBox
mukund-thakur opened a new pull request #2354: URL: https://github.com/apache/hadoop/pull/2354 Ran the new test using ap-south-1 bucket. O/P- `(ContractTestUtils.java:end(1847)) - Duration of listing 1000 files using listFiles() api with batch size of 10 including 10ms of