[jira] [Updated] (HADOOP-14627) Support MSI and DeviceCode token provider in ADLS

2017-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14627: Summary: Support MSI and DeviceCode token provider in ADLS (was: Support MSI and DeviceCode

[jira] [Commented] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119410#comment-16119410 ] Lantao Jin commented on HADOOP-14708: - Can the title change to "Allow client with KERBEROS_SSL auth

[jira] [Updated] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0-M1

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14628: --- Fix Version/s: 3.0.0-beta1 > Upgrade maven enforcer plugin to 3.0.0-M1 >

[jira] [Updated] (HADOOP-14355) Update maven-war-plugin to 3.1.0

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14355: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0-M1

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14628: --- Summary: Upgrade maven enforcer plugin to 3.0.0-M1 (was: Upgrade maven enforcer plugin to

[jira] [Updated] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14628: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-14741) Refactor curator based ZooKeeper communication into common library

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119352#comment-16119352 ] Hadoop QA commented on HADOOP-14741: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14726) Remove FileStatus#isDir

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119327#comment-16119327 ] Hadoop QA commented on HADOOP-14726: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14743) CompositeGroupsMapping should not swallow exceptions

2017-08-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119321#comment-16119321 ] Kai Zheng commented on HADOOP-14743: +1 for the nice change. Thanks! > CompositeGroupsMapping

[jira] [Commented] (HADOOP-12077) Provide a multi-URI replication Inode for ViewFs

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119300#comment-16119300 ] Hadoop QA commented on HADOOP-12077: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14741) Refactor curator based ZooKeeper communication into common library

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-14741: - Attachment: HADOOP-14741-004.patch Fixed unit tests. > Refactor curator based ZooKeeper

[jira] [Commented] (HADOOP-14741) Refactor curator based ZooKeeper communication into common library

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119218#comment-16119218 ] Hadoop QA commented on HADOOP-14741: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14598) Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

2017-08-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-14598: - Fix Version/s: 3.0.0-beta1 > Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory >

[jira] [Updated] (HADOOP-14598) Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-14598: Fix Version/s: 2.9.0 > Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory >

[jira] [Updated] (HADOOP-14598) Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-14598: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HADOOP-14598) Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-14598: Priority: Major (was: Blocker) > Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory >

[jira] [Updated] (HADOOP-14598) Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-14598: Summary: Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory (was: Wasb connection

[jira] [Commented] (HADOOP-14284) Shade Guava everywhere

2017-08-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119162#comment-16119162 ] Haibo Chen commented on HADOOP-14284: - Following through the discussions, folks seem to prefer

[jira] [Updated] (HADOOP-12077) Provide a multi-URI replication Inode for ViewFs

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-12077: --- Attachment: HADOOP-12077.009.patch > Provide a multi-URI replication Inode for ViewFs >

[jira] [Updated] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14715: Component/s: test > TestWasbRemoteCallHelper failing > >

[jira] [Updated] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14715: Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119141#comment-16119141 ] Steve Loughran commented on HADOOP-14715: - +1 committed to trunk; doing a built & test on

[jira] [Commented] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119127#comment-16119127 ] Steve Loughran commented on HADOOP-14749: - Testing All well apart from existing failures

[jira] [Commented] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119123#comment-16119123 ] Steve Loughran commented on HADOOP-14749: - {{S3Guard.assertQualified}} added a vargs version to

[jira] [Commented] (HADOOP-14598) Wasb connection failing: FsUrlConnection cannot be cast to HttpURLConnection

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119124#comment-16119124 ] Haohui Mai commented on HADOOP-14598: - So essentially the downstream users assume that an

[jira] [Comment Edited] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119111#comment-16119111 ] Steve Loughran edited comment on HADOOP-14749 at 8/8/17 10:24 PM: -- Big

[jira] [Updated] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14749: Attachment: HADOOP-14749-HADOOP-13345-001.patch Big review * docs reviewed, edited.

[jira] [Commented] (HADOOP-14750) s3guard to provide better diags on ddb init failures

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119100#comment-16119100 ] Steve Loughran commented on HADOOP-14750: - This was actually a parallel test run with 10 threads

[jira] [Updated] (HADOOP-14747) S3AInputStream to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14747: Parent Issue: HADOOP-13204 (was: HADOOP-13345) > S3AInputStream to implement CanUnbuffer

[jira] [Commented] (HADOOP-14750) s3guard to provide better diags on ddb init failures

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119099#comment-16119099 ] Steve Loughran commented on HADOOP-14750: - Got a test failure during; laptop doing other

[jira] [Created] (HADOOP-14750) s3guard to provide better diags on ddb init failures

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14750: --- Summary: s3guard to provide better diags on ddb init failures Key: HADOOP-14750 URL: https://issues.apache.org/jira/browse/HADOOP-14750 Project: Hadoop Common

[jira] [Commented] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119090#comment-16119090 ] John Zhuge commented on HADOOP-14708: - [~cltlfcjin] Added you as a contributor. Assigned the JIRA to

[jira] [Assigned] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HADOOP-14708: --- Assignee: Lantao Jin > FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL >

[jira] [Commented] (HADOOP-14691) Shell command "hadoop fs -put" multiple close problem

2017-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119087#comment-16119087 ] John Zhuge commented on HADOOP-14691: - Can we just add {{out = null}} after {{out.close()}} to

[jira] [Updated] (HADOOP-14726) Remove FileStatus#isDir

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-14726: --- Attachment: HADOOP-14726.003.patch Some of the test failures are related to the

[jira] [Updated] (HADOOP-14741) Refactor curator based ZooKeeper communication into common library

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-14741: - Attachment: HADOOP-14741-003.patch Fixed unit tests. > Refactor curator based ZooKeeper

[jira] [Commented] (HADOOP-14598) Wasb connection failing: FsUrlConnection cannot be cast to HttpURLConnection

2017-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119055#comment-16119055 ] John Zhuge commented on HADOOP-14598: - +1 LGTM. Wrap {{LOG.debug}} with {{if

[jira] [Commented] (HADOOP-13917) Ensure nightly builds run the integration tests for the shaded client

2017-08-08 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118973#comment-16118973 ] Sean Busbey commented on HADOOP-13917: -- yeah i think it's needed. I'll try to add it at the same

[jira] [Commented] (HADOOP-14089) Shaded Hadoop client runtime includes non-shaded classes

2017-08-08 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118971#comment-16118971 ] Sean Busbey commented on HADOOP-14089: -- yeah, the test catches the problem this jira was filed

[jira] [Updated] (HADOOP-14716) SwiftNativeFileSystem should not eat the exception when rename

2017-08-08 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HADOOP-14716: - Attachment: HADOOP-14716-WIP.patch WIP patch. > SwiftNativeFileSystem should not eat the exception

[jira] [Commented] (HADOOP-14738) Deprecate S3N in hadoop 3.0/2,9, target removal in Hadoop 3.1

2017-08-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118841#comment-16118841 ] Aaron Fabbri commented on HADOOP-14738: --- I'd vote to remove s3n in 3.0.. and make this JIRA a

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Esfandiar Manii (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118826#comment-16118826 ] Esfandiar Manii commented on HADOOP-14715: -- All the tests ran against:

[jira] [Commented] (HADOOP-14743) CompositeGroupsMapping should not swallow exceptions

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118579#comment-16118579 ] Wei-Chiu Chuang commented on HADOOP-14743: -- [~drankye] could you help review this patch? Thx >

[jira] [Commented] (HADOOP-14698) Make copyFromLocal's -t option available for put as well

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118545#comment-16118545 ] Andras Bokor commented on HADOOP-14698: --- TestKDiag is not related. > Make copyFromLocal's -t

[jira] [Commented] (HADOOP-14698) Make copyFromLocal's -t option available for put as well

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118538#comment-16118538 ] Hadoop QA commented on HADOOP-14698: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118432#comment-16118432 ] Steve Loughran commented on HADOOP-14749: - + * review javadocs * arranging imports in roughly

[jira] [Updated] (HADOOP-14698) Make copyFromLocal's -t option available for put as well

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-14698: -- Attachment: HADOOP-14698.05.patch Attaching patch to address check style issues. > Make

[jira] [Work started] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14749 started by Steve Loughran. --- > review s3guard docs & code prior to merge >

[jira] [Commented] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118429#comment-16118429 ] Lantao Jin commented on HADOOP-14708: - Sorry I don't know why the ugi client in NN (in FSCK servlet)

[jira] [Created] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14749: --- Summary: review s3guard docs & code prior to merge Key: HADOOP-14749 URL: https://issues.apache.org/jira/browse/HADOOP-14749 Project: Hadoop Common

[jira] [Commented] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118414#comment-16118414 ] Lantao Jin commented on HADOOP-14708: - Hi [~jojochuang], [^FSCK-2.log] is the new log I added some

[jira] [Commented] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118413#comment-16118413 ] Hadoop QA commented on HADOOP-14708: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14708) FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL

2017-08-08 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated HADOOP-14708: Attachment: FSCK-2.log > FsckServlet can not create SaslRpcClient with auth KERBEROS_SSL >

[jira] [Commented] (HADOOP-14733) ITestS3GuardConcurrentOps failing with -Ddynamodblocal -Ds3guard

2017-08-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118368#comment-16118368 ] Aaron Fabbri commented on HADOOP-14733: --- +1 LGTM. > ITestS3GuardConcurrentOps failing with

[jira] [Commented] (HADOOP-14698) Make copyFromLocal's -t option available for put as well

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118363#comment-16118363 ] Hadoop QA commented on HADOOP-14698: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14643) Clean up Test(HDFS|LocalFS)FileContextMainOperations and FileContextMainOperationsBaseTest

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118360#comment-16118360 ] Andras Bokor commented on HADOOP-14643: --- JUnits are not related. > Clean up

[jira] [Comment Edited] (HADOOP-14691) Shell command "hadoop fs -put" multiple close problem

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118303#comment-16118303 ] Andras Bokor edited comment on HADOOP-14691 at 8/8/17 2:02 PM: --- It's a

[jira] [Updated] (HADOOP-14680) Azure: IndexOutOfBoundsException in BlockBlobInputStream

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14680: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-14748) Wasb input streams to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14748: Affects Version/s: 2.9.0 Priority: Minor (was: Major) > Wasb input streams

[jira] [Created] (HADOOP-14748) Wasb input streams to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14748: --- Summary: Wasb input streams to implement CanUnbuffer Key: HADOOP-14748 URL: https://issues.apache.org/jira/browse/HADOOP-14748 Project: Hadoop Common

[jira] [Commented] (HADOOP-12805) Annotate CanUnbuffer with @InterfaceAudience.Public

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118339#comment-16118339 ] Steve Loughran commented on HADOOP-12805: - Would have been nice for a new public API do have had

[jira] [Created] (HADOOP-14747) S3AInputStream to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14747: --- Summary: S3AInputStream to implement CanUnbuffer Key: HADOOP-14747 URL: https://issues.apache.org/jira/browse/HADOOP-14747 Project: Hadoop Common

[jira] [Commented] (HADOOP-14598) Wasb connection failing: FsUrlConnection cannot be cast to HttpURLConnection

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118327#comment-16118327 ] Steve Loughran commented on HADOOP-14598: - HADOOP-14383 was designed to allow anyone to use an

[jira] [Commented] (HADOOP-14355) Update maven-war-plugin to 3.1.0

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118320#comment-16118320 ] Steve Loughran commented on HADOOP-14355: - +1 > Update maven-war-plugin to 3.1.0 >

[jira] [Resolved] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14745. - Resolution: Invalid > s3a getFileStatus can't return expect result when existing a file

[jira] [Updated] (HADOOP-14698) Make copyFromLocal's -t option available for put as well

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-14698: -- Attachment: HADOOP-14698.04.patch Attaching the same patch to kick [~hadoopqa]. > Make

[jira] [Commented] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118315#comment-16118315 ] Steve Loughran commented on HADOOP-14745: - Sorry, no. it is possible to create s3 data through

[jira] [Commented] (HADOOP-14691) Shell command "hadoop fs -put" multiple close problem

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118303#comment-16118303 ] Andras Bokor commented on HADOOP-14691: --- It's a very good catch but the solution seems makes the

[jira] [Commented] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118295#comment-16118295 ] Steve Loughran commented on HADOOP-14628: - OK +1 > Upgrade maven enforcer plugin to 3.0.0 >

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118292#comment-16118292 ] Steve Loughran commented on HADOOP-14715: - OK, checkstyle is happy. I just need the declaration

[jira] [Commented] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118259#comment-16118259 ] Hadoop QA commented on HADOOP-14628: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-5943) IOUtils#copyBytes methods should not close streams that are passed in as parameters

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor reassigned HADOOP-5943: Assignee: Andras Bokor > IOUtils#copyBytes methods should not close streams that are

[jira] [Commented] (HADOOP-14730) Support protobuf FileStatus in AdlFileSystem

2017-08-08 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118212#comment-16118212 ] Vishwajeet Dusane commented on HADOOP-14730: Thanks a lot [~chris.douglas] and [~jzhuge]. >

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118190#comment-16118190 ] Hadoop QA commented on HADOOP-14715: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14739) Add build instruction for docker for Mac instead of docker toolbox.

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118188#comment-16118188 ] Akira Ajisaka commented on HADOOP-14739: Nice catch, Elek! My user id is 1000. It is not

[jira] [Commented] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118177#comment-16118177 ] Yonger commented on HADOOP-14745: - I create that path structure through s3cmd, and yes , we can't do

[jira] [Updated] (HADOOP-5943) IOUtils#copyBytes methods should not close streams that are passed in as parameters

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-5943: - Summary: IOUtils#copyBytes methods should not close streams that are passed in as parameters

[jira] [Commented] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118156#comment-16118156 ] Steve Loughran commented on HADOOP-14745: - You shouldn't have a file and path with the same

[jira] [Updated] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14715: Status: Patch Available (was: Open) looks reasonable. I've hit the submit button for

[jira] [Created] (HADOOP-14746) Cut S3AOutputStream

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14746: --- Summary: Cut S3AOutputStream Key: HADOOP-14746 URL: https://issues.apache.org/jira/browse/HADOOP-14746 Project: Hadoop Common Issue Type: Sub-task

[jira] [Updated] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14628: --- Attachment: (was: HADOOP-14628.001-tests.patch) > Upgrade maven enforcer plugin to

[jira] [Commented] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-08-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118147#comment-16118147 ] Akira Ajisaka commented on HADOOP-14628: I ran all the tests by {{dev-support/bin/qbt

[jira] [Commented] (HADOOP-14738) Deprecate S3N in hadoop 3.0/2,9, target removal in Hadoop 3.1

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118144#comment-16118144 ] Steve Loughran commented on HADOOP-14738: - Good Q. On one hand: we've not given any warning On

[jira] [Commented] (HADOOP-12143) Add a style guide to the Hadoop documentation

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118136#comment-16118136 ] Steve Loughran commented on HADOOP-12143: - Given how controversial some options are, we may want

[jira] [Commented] (HADOOP-14726) Remove FileStatus#isDir

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118126#comment-16118126 ] Hadoop QA commented on HADOOP-14726: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HADOOP-14745: Description: {code} [ hadoop-aws]# /root/hadoop/s3cmd/s3cmd ls s3://test-aws-s3a/user/root/

[jira] [Commented] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118026#comment-16118026 ] Yonger commented on HADOOP-14745: - On the other hand, I saw hdfs implementation not allow existing any

[jira] [Commented] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118009#comment-16118009 ] Yonger commented on HADOOP-14745: - So i think we should call getFileStatus with explicitly expect, e.g.

[jira] [Created] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Yonger (JIRA)
Yonger created HADOOP-14745: --- Summary: s3a getFileStatus can't return expect result when existing a file and directory with the same name Key: HADOOP-14745 URL: https://issues.apache.org/jira/browse/HADOOP-14745

[jira] [Commented] (HADOOP-14705) Add batched reencryptEncryptedKey interface to KMS

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117919#comment-16117919 ] Hadoop QA commented on HADOOP-14705: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||