[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13781383#comment-13781383 ] Hudson commented on HADOOP-8545: FAILURE: Integrated in Hadoop-Mapreduce-trunk #1563 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1563/]) HADOOP-8545 findbugs patches from the final -037 patch (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527189) * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support/findbugs-exclude.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Fix For: 2.3.0 > > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-037.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13781368#comment-13781368 ] Hudson commented on HADOOP-8545: SUCCESS: Integrated in Hadoop-Hdfs-trunk #1537 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1537/]) HADOOP-8545 findbugs patches from the final -037 patch (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527189) * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support/findbugs-exclude.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Fix For: 2.3.0 > > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-037.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13781339#comment-13781339 ] Hudson commented on HADOOP-8545: FAILURE: Integrated in Hadoop-Yarn-trunk #347 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/347/]) HADOOP-8545 findbugs patches from the final -037 patch (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527189) * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support/findbugs-exclude.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Fix For: 2.3.0 > > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-037.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780853#comment-13780853 ] Hudson commented on HADOOP-8545: SUCCESS: Integrated in Hadoop-trunk-Commit #4492 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4492/]) HADOOP-8545 findbugs patches from the final -037 patch (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527189) * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/dev-support/findbugs-exclude.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Fix For: 2.3.0 > > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-037.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780828#comment-13780828 ] Hudson commented on HADOOP-8545: SUCCESS: Integrated in Hadoop-Hdfs-trunk #1536 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1536/]) HADOOP-8545. Filesystem Implementation for OpenStack Swift (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526854) * /hadoop/common/trunk * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Seekable.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/core * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FSMainOperationsBaseTest.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/native * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs * /hadoop/common/trunk/hadoop-mapreduce-project * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml * /hadoop/common/trunk/hadoop-project/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequestWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationResponse.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeystoneApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/Roles.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/AccessToken.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Catalog.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Endpoint.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780773#comment-13780773 ] Hudson commented on HADOOP-8545: FAILURE: Integrated in Hadoop-Yarn-trunk #346 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/346/]) HADOOP-8545. Filesystem Implementation for OpenStack Swift (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526854) * /hadoop/common/trunk * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Seekable.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/core * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FSMainOperationsBaseTest.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/native * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs * /hadoop/common/trunk/hadoop-mapreduce-project * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml * /hadoop/common/trunk/hadoop-project/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequestWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationResponse.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeystoneApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/Roles.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/AccessToken.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Catalog.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Endpoint.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/s
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779963#comment-13779963 ] Hudson commented on HADOOP-8545: FAILURE: Integrated in Hadoop-Mapreduce-trunk #1561 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1561/]) HADOOP-8545. Filesystem Implementation for OpenStack Swift (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526854) * /hadoop/common/trunk * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Seekable.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/core * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FSMainOperationsBaseTest.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/native * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs * /hadoop/common/trunk/hadoop-mapreduce-project * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml * /hadoop/common/trunk/hadoop-project/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequestWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationResponse.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeystoneApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/Roles.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/AccessToken.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Catalog.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Endpoint.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779847#comment-13779847 ] Hudson commented on HADOOP-8545: SUCCESS: Integrated in Hadoop-trunk-Commit #4482 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4482/]) HADOOP-8545. Filesystem Implementation for OpenStack Swift (stevel: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526854) * /hadoop/common/trunk * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Seekable.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/core * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FSMainOperationsBaseTest.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/native * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs * /hadoop/common/trunk/hadoop-mapreduce-project * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/conf * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml * /hadoop/common/trunk/hadoop-project/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/pom.xml * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/ApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationRequestWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationResponse.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/AuthenticationWrapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/KeystoneApiKeyCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/PasswordCredentials.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/Roles.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/AccessToken.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Catalog.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/auth/entities/Endpoint.java * /hadoop/common/trunk/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoo
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778668#comment-13778668 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12605233/HADOOP-8545-037.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1152 javac compiler warnings (more than the trunk's current 1147 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3126//testReport/ Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3126//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3126//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-037.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778100#comment-13778100 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12605085/HADOOP-8545-036.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1152 javac compiler warnings (more than the trunk's current 1147 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3125//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3125//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3125//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3125//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777993#comment-13777993 ] Suresh Srinivas commented on HADOOP-8545: - +1 for the patch with Jenkins +1 for findbugs. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-036.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776461#comment-13776461 ] Suresh Srinivas commented on HADOOP-8545: - [~ste...@apache.org], if these are false alarms, can you please add them to the findbugs exceptions. +1 with that change. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769348#comment-13769348 ] Steve Loughran commented on HADOOP-8545: Suresh, the findbugs warnings are false alarms -they are warning that a stream isn't closed in the method where it is opened. This is the input stream that is kept open across methods in the Swift Input Stream -it is always closed in the close() method > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768346#comment-13768346 ] Suresh Srinivas commented on HADOOP-8545: - +1 for the patch with Jenkins -1 for findbugs addressed. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766403#comment-13766403 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12602992/HADOOP-8545-035.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1152 javac compiler warnings (more than the trunk's current 1147 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3091//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3091//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3091//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3091//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-035.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765823#comment-13765823 ] Steve Loughran commented on HADOOP-8545: cancelling patch due to stack trace seen in some exception reporting {code} Exception in thread "main" java.lang.NullPointerException at org.apache.hadoop.fs.swift.exceptions.SwiftInvalidResponseException.toString(SwiftInvalidResponseException.java:97) at java.lang.String.valueOf(String.java:2826) at java.io.PrintWriter.println(PrintWriter.java:710) at java.lang.Throwable.printStackTrace(Throwable.java:509) at org.apache.hadoop.util.StringUtils.stringifyException(StringUtils.java:60) {code} > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765728#comment-13765728 ] Suresh Srinivas commented on HADOOP-8545: - [~ste...@apache.org], HDFS-5038 has been committed to branch-1. This adds some of the newer APIs (isDir vs. isDirectory in particular), with which you should be able to keep trunk and branch-1 patch more in sync. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765669#comment-13765669 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12602825/HADOOP-8545-035.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1152 javac compiler warnings (more than the trunk's current 1147 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3084//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3084//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3084//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3084//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-035.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764599#comment-13764599 ] Matthew Farrellee commented on HADOOP-8545: --- Please add 1.x as a target for this feature. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750893#comment-13750893 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12600076/HADOOP-8545-034.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1154 javac compiler warnings (more than the trunk's current 1149 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3022//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3022//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3022//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-034.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705903#comment-13705903 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12591852/HADOOP-8545-033.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 31 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1158 javac compiler warnings (more than the trunk's current 1153 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2769//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2769//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2769//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2769//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-033.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705662#comment-13705662 ] Steve Loughran commented on HADOOP-8545: compilation broke w/ HADOOP-9287; didn't show up in jenkins because the build of src/test is skipped if the {{auth-keys.xml}} file isn't present. If we could move {{FileSystemContractTestBase}} off JUnit3 tests we could eliminate this need & have the openstack test runs skip tests it doesn't support -which is how HADOOP-9361 is doing it > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705552#comment-13705552 ] Stephen Chu commented on HADOOP-8545: - Hey, Steve. I am trying to run the unit tests against a one-node Swift setup. I can cleanly apply HADOOP-8545-032.patch to trunk and run _mvn clean install -DskipTests_ successfully from the base directory. However, when I create _hadoop-tools/hadoop-openstack/src/test/resources/auth-keys.xml_ and run _mvn clean install -DskipTests_ from the base directory again, I fail to compile the openstack tests because of the errors below. {code} [INFO] Apache Hadoop OpenStack support ... FAILURE [0.274s] [INFO] Apache Hadoop Tools Dist .. SKIPPED [INFO] Apache Hadoop Tools ... SKIPPED [INFO] Apache Hadoop Distribution SKIPPED [INFO] Apache Hadoop Client .. SKIPPED [INFO] Apache Hadoop Mini-Cluster SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 1:17.111s [INFO] Finished at: Thu Jul 11 00:10:08 PDT 2013 [INFO] Final Memory: 103M/3246M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-openstack: Compilation failure: Compilation failure: [ERROR] /home/schu/hadoop-2/hadoop-tools/hadoop-openstack/src/test/java/org/apache/hadoop/fs/swift/TestFSMainOperationsSwift.java:[35,7] org.apache.hadoop.fs.swift.TestFSMainOperationsSwift is not abstract and does not override abstract method createFileSystem() in org.apache.hadoop.fs.FSMainOperationsBaseTest [ERROR] /home/schu/hadoop-2/hadoop-tools/hadoop-openstack/src/test/java/org/apache/hadoop/fs/swift/TestFSMainOperationsSwift.java:[59,43] non-static method getTestRootPath(org.apache.hadoop.fs.FileSystem,java.lang.String) cannot be referenced from a static context [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-openstack [schu@a1711 hadoop-2]$ {code} > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13700036#comment-13700036 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12590873/HADOOP-8545-032.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 30 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1158 javac compiler warnings (more than the trunk's current 1153 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2741//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2741//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2741//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2741//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-032.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13699012#comment-13699012 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12590632/HADOOP-8545-031.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 30 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1159 javac compiler warnings (more than the trunk's current 1153 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 3 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 4 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2728//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2728//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2728//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2728//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-031.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697765#comment-13697765 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12590420/HADOOP-8545-030.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 29 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1170 javac compiler warnings (more than the trunk's current 1153 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 3 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 4 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2717//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2717//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2717//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2717//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-030.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch, HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697728#comment-13697728 ] Steve Loughran commented on HADOOP-8545: The auth package classes are all designed for Jackson binding and MUST NOT be final, else you see a stack trace. Test to replicate this is {{TestSwiftRestClient}} {code} at org.apache.hadoop.fs.swift.util.JSONUtil.toObject(JSONUtil.java:81) at org.apache.hadoop.fs.swift.http.SwiftRestClient$AuthenticationPost.extractResult(SwiftRestClient.java:1127) at org.apache.hadoop.fs.swift.http.SwiftRestClient$AuthenticationPost.extractResult(SwiftRestClient.java:1085) at org.apache.hadoop.fs.swift.http.SwiftRestClient.perform(SwiftRestClient.java:1407) at org.apache.hadoop.fs.swift.http.SwiftRestClient.authenticate(SwiftRestClient.java:1080) at org.apache.hadoop.fs.swift.http.TestSwiftRestClient.testPutAndDelete(TestSwiftRestClient.java:84) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:62) Caused by: org.codehaus.jackson.map.JsonMappingException: No suitable constructor found for type [simple type, class org.apache.hadoop.fs.swift.auth.AuthenticationWrapper]: can not instantiate from JSON object (need to add/enable type information?) at [Source: java.io.StringReader@7d0c3a08; line: 1, column: 2] at org.codehaus.jackson.map.JsonMappingException.from(JsonMappingException.java:163) at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:483) at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:350) at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2402) at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1602) at org.apache.hadoop.fs.swift.util.JSONUtil.toObject(JSONUtil.java:75) ... 14 more {code} Same for {{SwiftObjectFileStatus}} {code} Running org.apache.hadoop.fs.swift.TestSwiftFileSystemBasicOps Tests run: 16, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 130.317 sec <<< FAILURE! testLsRoot(org.apache.hadoop.fs.swift.TestSwiftFileSystemBasicOps) Time elapsed: 3267 sec <<< ERROR! org.apache.hadoop.fs.swift.exceptions.SwiftJsonMarshallingException: org.codehaus.jackson.map.JsonMappingException: No suitable constructor found for type [simple type, class org.apache.hadoop.fs.swift.snative.SwiftObjectFileStatus]: can not instantiate from JSON object (need to add/enable type information?) at [Source: java.io.StringReader@6179d854; line: 1, column: 3] source: [{"hash": "d41d8cd98f00b204e9800998ecf8427e", "last_modified": "2013-05-13T21:05:26.066260", "bytes": 0, "name": "user", "content_type": "application/octet-stream"}, {"subdir": "user/"}] at org.apache.hadoop.fs.swift.util.JSONUtil.toObject(JSONUtil.java:121) at org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.listDirectory(SwiftNativeFileSystemStore.java:354) at org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.listSubPaths(SwiftNativeFileSystemStore.java:399) at org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem.listStatus(SwiftNativeFileSystem.java:436) at org.apache.hadoop.fs.swift.TestSwiftFileSystemBasicOps.testLsRoot(TestSwiftFileSystemBasicOps.java:51) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13685784#comment-13685784 ] Suresh Srinivas commented on HADOOP-8545: - bq. that is done explicitly to produce a source tree which compiles and tests against the 1.x branch; were it not for that I'd gladly swap them out. Can you have two different versions of the patch at the time of committing to trunk, to avoid using deprecated method? > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13684159#comment-13684159 ] Steve Loughran commented on HADOOP-8545: Suresh, I'll look at this soon. Regarding the use of the (deprecated) method call {{ FileStatus#isDir()}}, that is done explicitly to produce a source tree which compiles and tests against the 1.x branch; were it not for that I'd gladly swap them out. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683867#comment-13683867 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12587906/HADOOP-8545.suresh.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 28 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1158 javac compiler warnings (more than the trunk's current 1152 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 4 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-tools/hadoop-openstack. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2649//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2649//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2649//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2649//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch, > HADOOP-8545.suresh.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683757#comment-13683757 ] Suresh Srinivas commented on HADOOP-8545: - Steve, I could not compile the code without the following change in hadoop-project/pom.xml: {code} Index: pom.xml === --- pom.xml (revision 1492984) +++ pom.xml (working copy) @@ -309,6 +309,11 @@ 3.1 +org.apache.httpcomponents +httpclient +4.2.5 + + commons-codec commons-codec 1.4 {code} Are you missing it in your patch? > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13677162#comment-13677162 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12586518/HADOOP-8545-029.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 28 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to cause Findbugs (version 1.3.9) to fail. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-tools/hadoop-openstack. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2610//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2610//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-029.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673686#comment-13673686 ] Larry McCay commented on HADOOP-8545: - Hi Steve - I notice that the potential for logging credentials exists in the SwiftRestClient. While this is intended to only ever be done in testing and not production environments, I don't think that we should ever do it. 1. it provides an attacker a means to try and turn on credential logging 2. log files may be long lived given regulatory compliance - we don't want to archive passwords I would like to see this possibility removed. My two cents. --larry > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673155#comment-13673155 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12585852/HADOOP-8545-028.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 29 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1168 javac compiler warnings (more than the trunk's current 1156 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 4 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2594//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2594//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2594//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2594//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-028.patch, HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661158#comment-13661158 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12583703/HADOOP-8545-027.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 29 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1379 javac compiler warnings (more than the trunk's current 1367 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 4 new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 2 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2546//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2546//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2546//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2546//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2546//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 1.2.0, 2.0.3-alpha >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-027.patch, > HADOOP-8545-10.patch, HADOOP-8545-11.patch, HADOOP-8545-12.patch, > HADOOP-8545-13.patch, HADOOP-8545-14.patch, HADOOP-8545-15.patch, > HADOOP-8545-16.patch, HADOOP-8545-17.patch, HADOOP-8545-18.patch, > HADOOP-8545-19.patch, HADOOP-8545-1.patch, HADOOP-8545-20.patch, > HADOOP-8545-21.patch, HADOOP-8545-22.patch, HADOOP-8545-23.patch, > HADOOP-8545-24.patch, HADOOP-8545-25.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660238#comment-13660238 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12583599/HADOOP-8545-026.patch against trunk revision . {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2545//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-026.patch, HADOOP-8545-10.patch, > HADOOP-8545-11.patch, HADOOP-8545-12.patch, HADOOP-8545-13.patch, > HADOOP-8545-14.patch, HADOOP-8545-15.patch, HADOOP-8545-16.patch, > HADOOP-8545-17.patch, HADOOP-8545-18.patch, HADOOP-8545-19.patch, > HADOOP-8545-1.patch, HADOOP-8545-20.patch, HADOOP-8545-21.patch, > HADOOP-8545-22.patch, HADOOP-8545-23.patch, HADOOP-8545-24.patch, > HADOOP-8545-25.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13655912#comment-13655912 ] Hadoop QA commented on HADOOP-8545: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12582917/HADOOP-8545-25.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 30 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2538//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2538//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-25.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651069#comment-13651069 ] Steve Loughran commented on HADOOP-8545: [~leoniz] -if the streaming run is set up to use the gzip codecs for input (or output) then the streaming run should unzip/zip data on the run. We don't have any tests for that -yet. If you want to help with that testing, we'd love to have you involved. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650553#comment-13650553 ] Dmitry Mezhensky commented on HADOOP-8545: -- Hi SangRho, Swift supports streaming, but as I know Swift won't unzip file on download. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650485#comment-13650485 ] SangRho Lee commented on HADOOP-8545: - hello.im korean openstack user. nice to meet you. can i ask something about swift? In swift, streaming service works? for example, On downloading, gzip file is unzipping. Is it work?? Sent from my iPhone > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650462#comment-13650462 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12582020/HADOOP-8545-24.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 27 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1379 javac compiler warnings (more than the trunk's current 1367 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2520//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2520//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2520//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2520//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-24.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650314#comment-13650314 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12581839/HADOOP-8545-23.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 26 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1379 javac compiler warnings (more than the trunk's current 1367 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 1 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 3 new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2514//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2514//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2514//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2514//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2514//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-23.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635541#comment-13635541 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12579382/HADOOP-8545-22.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 26 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1376 javac compiler warnings (more than the trunk's current 1367 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 6 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2457//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2457//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2457//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2457//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-22.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627928#comment-13627928 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12578018/HADOOP-8545-21.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 23 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1376 javac compiler warnings (more than the trunk's current 1367 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-tools-dist. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2435//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2435//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2435//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2435//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-21.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > ,Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13624127#comment-13624127 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12577298/HADOOP-8545-20.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 22 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1375 javac compiler warnings (more than the trunk's current 1367 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2422//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2422//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2422//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2422//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-20.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13624060#comment-13624060 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12577272/HADOOP-8545-19.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 22 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1375 javac compiler warnings (more than the trunk's current 1367 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 2 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 6 new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2420//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2420//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2420//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-openstack.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2420//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2420//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-19.patch, HADOOP-8545-1.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614118#comment-13614118 ] Hadoop QA commented on HADOOP-8545: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12575523/HADOOP-8545-18.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2364//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2364//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-18.patch, HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13613710#comment-13613710 ] Hadoop QA commented on HADOOP-8545: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12575506/HADOOP-8545-17.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2363//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2363//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-17.patch, > HADOOP-8545-1.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612707#comment-13612707 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12575319/HADOOP-8545-16.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2360//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2360//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2360//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-16.patch, HADOOP-8545-1.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612699#comment-13612699 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12575318/HADOOP-8545-15.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2359//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2359//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2359//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-15.patch, HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603268#comment-13603268 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12573851/HADOOP-8545-14.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:red}-1 one of tests included doesn't have a timeout.{color} {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2332//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2332//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-14.patch, > HADOOP-8545-1.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13596242#comment-13596242 ] Alexander Kuznetsov commented on HADOOP-8545: - Patch for Swift (https://review.openstack.org/#/c/21015/) that exposes data locality information to avoid network overhead was accepted. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-1.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595784#comment-13595784 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12572522/HADOOP-8545-13.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 21 new or modified test files. {color:red}-1 one of tests included doesn't have a timeout.{color} {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2288//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2288//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-13.patch, HADOOP-8545-1.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595770#comment-13595770 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12572521/HADOOP-8545-12.patch against trunk revision . {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2287//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-12.patch, HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594841#comment-13594841 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12572341/HADOOP-8545-11.patch against trunk revision . {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2277//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-1.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594836#comment-13594836 ] Dmitry Mezhensky commented on HADOOP-8545: -- Ok @Matt, i'll in this way > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Attachments: HADOOP-8545-10.patch, HADOOP-8545-11.patch, > HADOOP-8545-1.patch, HADOOP-8545-2.patch, HADOOP-8545-3.patch, > HADOOP-8545-4.patch, HADOOP-8545-5.patch, HADOOP-8545-6.patch, > HADOOP-8545-7.patch, HADOOP-8545-8.patch, HADOOP-8545-9.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13592069#comment-13592069 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12571851/HADOOP-8545-10.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:red}-1 one of tests included doesn't have a timeout.{color} {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2256//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2256//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Labels: hadoop, patch > Fix For: 1.1.2 > > Attachments: HADOOP-8545-10.patch, HADOOP-8545-1.patch, > HADOOP-8545-2.patch, HADOOP-8545-3.patch, HADOOP-8545-4.patch, > HADOOP-8545-5.patch, HADOOP-8545-6.patch, HADOOP-8545-7.patch, > HADOOP-8545-8.patch, HADOOP-8545-9.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13574234#comment-13574234 ] Steve Loughran commented on HADOOP-8545: [~daryn]: bq. The custom isDirectory behavior is probably better implemented in a FileStatus subclass. Otherwise, {{stat = fs.isDirectory(path) != stat.isDirectory()}} Looks like we'll need more FS contract tests to check all of this stuff. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13573274#comment-13573274 ] Dmitry Mezhensky commented on HADOOP-8545: -- |1. Can you instantiate a swift fs with Path#getFileSystem(conf)? This is how a fs should work since it means that existing code will work just by changing the scheme or defaultFS to swift. It instantiates correctly if required configuration present | 2. You probably don't want to store the full uri since when a filesystem is obtained for a Path, it's going to be a full URI of the Path. Should probably do this: this.uri = URI.create(uri.getScheme()+"://"+uri.getAuthority()); I need full url for different containers and swift installations support, for example different containers: swift://data.rackspace/var/runs and swift://result.rackspace/home/hadoop (data and result are different containers in Swift) | 3. I don't understand the contortions to set the initial working directory. Maybe this.workingDir = getHomeDirectory() like DFS since I think it's doing what you want in a cleaner way. I'll try to simplify it | 4. The custom isDirectory behavior is probably better implemented in a FileStatus subclass. Otherwise, stat = fs.isDirectory(path) != stat.isDirectory()}} Directory support in Swift is quite complicated, I think we can't do so. | The main reason I looked at this is integration with security. You seem to have your own token implementation, but it's not tied into getDelegationToken. If you don't implement that, I don't think jobs are going to be able to use this fs. Yes, Swift has it's ouw token implementation. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13572611#comment-13572611 ] Daryn Sharp commented on HADOOP-8545: - I can't even hope to review this, but I'll offer some observations: # Can you instantiate a swift fs with {{Path#getFileSystem(conf)}}? This is how a fs should work since it means that existing code will work just by changing the scheme or defaultFS to swift. # You probably don't want to store the full uri since when a filesystem is obtained for a {{Path}}, it's going to be a full URI of the {{Path}}. Should probably do this: {{this.uri = URI.create(uri.getScheme()+"://"+uri.getAuthority());}} # I don't understand the contortions to set the initial working directory. Maybe {{this.workingDir = getHomeDirectory()}} like DFS since I think it's doing what you want in a cleaner way. # The custom {{isDirectory}} behavior is probably better implemented in a {{FileStatus}} subclass. Otherwise, {{stat = fs.isDirectory(path)}} != stat.isDirectory()}} # Seems like there's duplication of {{Path}} and output stream behavior (like the metrics) The main reason I looked at this is integration with security. You seem to have your own token implementation, but it's not tied into {{getDelegationToken}}. If you don't implement that, I don't think jobs are going to be able to use this fs. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13572511#comment-13572511 ] Hadoop QA commented on HADOOP-8545: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12568233/HADOOP-8545-8.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2158//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2158//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-8.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13572385#comment-13572385 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12568217/HADOOP-8545-7.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 7 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2157//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2157//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2157//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-7.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567903#comment-13567903 ] Steve Loughran commented on HADOOP-8545: I think we need some kind of contrib/ project, maybe a hadoop-incubation thing where people w/ commit rights can push stuff in but which isn't forced in to core. Otherwise it ends up on github where maintenance and contributions (including provenance) are less well managed # It is designed to be self-contained. # It'd need to go out on a faster release cycle until stable # It's coupled tightly enough to the hadoop FS contract tests that it does benefit from being close to that -so that changes to those contract tests get checked by jenkins automatically. I'll have a look at the the header dependencies, there shouldn't be anything, as that path implies the apache http library, which I thought was in trunk. I can turn those headers to const as it's only a constant for Content-Length and a couple of RFC-standardised header that won't change without breaking HTTP 1.1 > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567682#comment-13567682 ] Tom White commented on HADOOP-8545: --- I wonder whether this would be better hosted outside Hadoop Common, since it's an optional feature, and won't get tested against Swift during routine Hadoop development. We recommended this course of action for KFS when it became QFS recently: http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201210.mbox/%3ccc946699.1c97b%25thi...@quantcast.com%3E It's a non-trivial amount of code: it adds over 35 Java classes in 9 packages to core. Does it add any new dependencies? I tried compiling and it complained about not being able to find org.apache.http.HttpHeaders. It looks like the native implementation supports large files now. If so, then the block store implementation is redundant and can be removed. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566547#comment-13566547 ] Steve Loughran commented on HADOOP-8545: Dmitry: release audit was about some missing headers; I can do that {code} !? src/test/org/apache/hadoop/fs/swift/NativeSwiftFileSystemContractBaseTest.java !? src/test/org/apache/hadoop/fs/swift/snative/SwiftFileSystemForFunctionalTests.java !? src/test/org/apache/hadoop/fs/swift/functional/tests/SwiftFileSystemTest.java !? src/test/org/apache/hadoop/fs/swift/InMemorySwiftNativeStore.java !? src/test/org/apache/hadoop/fs/swift/TestSwiftConfig.java !? src/test/org/apache/hadoop/fs/swift/TestSwiftObjectPath.java !? src/core/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java !? src/core/org/apache/hadoop/fs/swift/block/SwiftBlockInputStream.java {code} I'll look at that > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566520#comment-13566520 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567143/HADOOP-8545-6.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 8 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13564373#comment-13564373 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12566775/HADOOP-8545-5.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:red}-1 javac{color:red}. The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2102//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542272#comment-13542272 ] Steve Loughran commented on HADOOP-8545: my branch of Dmitry's patch is at [https://github.com/steveloughran/Hadoop-and-Swift-integration] > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542184#comment-13542184 ] Steve Loughran commented on HADOOP-8545: I'm looking at this. One thing I don't understand is the logic in {{SwiftNativeFileSystem.create()}}, after getting the file status: {code} if (fileStatus != null && !fileStatus.isDir()) { if (overwrite) { delete(file, true); } else { throw new IOException("File already exists: " + file); } } else { Path parent = file.getParent(); if (parent != null) { if (!mkdirs(parent)) { throw new IOException("Mkdirs failed to create " + parent.toString()); } } } {code} I can see that the "don't overwrite an existing file unless {{overwrite==true}}" is there, but what does it mean if the path exists and is a directory? That it's just a no-op? If so I'd like to change the logic to make it more explicit what is going on. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540895#comment-13540895 ] Hadoop QA commented on HADOOP-8545: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12562666/HADOOP-8545-4.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 4 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1935//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1935//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540466#comment-13540466 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12562582/HADOOP-8545-3.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 4 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 2028 javac compiler warnings (more than the trunk's current 2016 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1932//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/1932//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-common.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/1932//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1932//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13538198#comment-13538198 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12562098/HADOOP-8545-2.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 30 new or modified test files. {color:red}-1 javac{color:red}. The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1919//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535735#comment-13535735 ] Dmitry Mezhensky commented on HADOOP-8545: -- @Tom, I can use the same format for large files after OpenStack Swift fixes bug with manifest file for large files: 1. Divide large file into blocks less than 5Gb, make part upload of each block 2. Create manifest for blocks (Swift will know that it is one file) Manifest creation fails than path is not like host/account/container/object (e.g. swift.host.com/v1/AUTH_89425098234759/container/home/user/data) This is a bug, which will be reported to Openstack Swift. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534024#comment-13534024 ] Tom White commented on HADOOP-8545: --- Dmitry, can you use the same large file format as Swift, even if some of it is handled on the Hadoop side? I think we should avoid creating a new file format. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533905#comment-13533905 ] Steve Loughran commented on HADOOP-8545: @Dmitry, I can't get the new test to pass by running it: {code} mvn test -Dtest=NativeSwiftFileSystemContractBaseTest {code} I've slightly changed the test and the NativeSwiftFileSystem class so that the null pointer exceptions go away but the tests are pretty much all failing you can grab my changes from: https://github.com/steveloughran/hadoop-trunk/tree/HADOOP-8545-mirantis > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532520#comment-13532520 ] Steve Loughran commented on HADOOP-8545: I've had an initial look through the code h3. Rest Client * swift rest client should be called {{SwiftRestClient}}, not {{RestClient}} * rest client should throw {{SwiftException}} over {{IllegalArgumentException}} when parsing configs. * Rest client API: we *must* have a way of avoiding the static HttpClient {{Protocol.registerProtocol()}} operations. The HTTP protocol is clearly something to remove; the HTTPS one looks trickier. We can't break any hadoop code that is already using HTTPS * {{DeleteMethodProcessor}} is creating a {{PutMethod()}} -surely it should be deleting things * {{RestClient.perform()}} doesn't release request on all exceptions - {{method.releaseConnection();}} should be in a {{finally}} block * {{RestClient.perform()}} needs better error handling -swift (&proxies) return JSON data -that coul be turned into a SwiftRemoteException (with status code, URL, body, etc), so enable better failure handing upstream. It's particularly critical that the body gets retained, as that is how you find things like throttling reponses (assuming they apply to swift as well as nova) h3. Other * new exceptions should extend IOException, not RuntimeException. Proposed a {{SwiftException extends IOException}}; {{SwiftConnectionException}} could be a subclass of this * needs ASF headers * google guava snipped class, {{Preconditions}} needs to be pulled, somehow. * move swift auth keys into a class of their own for ease of reference (to be fair -you did define constants, which is more than a lot of existing hadoop code does) > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532134#comment-13532134 ] Dmitry Mezhensky commented on HADOOP-8545: -- @Eli, @Tom, regarding block fs implementation I tried to implement correct working support of big files (more than 5 Gb) in Swift and faced several bugs in Swift. I'll try to fix them, but contribution to OpenStack will take much time. So block implementation will be auxiliary to native until all patches to Swift will be applied. Also, old Swift versions won't work with Hadoop API. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13531598#comment-13531598 ] Eli Collins commented on HADOOP-8545: - Agree with Tom, think this will be much more valuable if you can use Hadoop on existing swift objects w/o conversion. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13530930#comment-13530930 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12560387/HADOOP-8545.patch against trunk revision . {color:red}-1 @author{color}. The patch appears to contain 5 @author tags which the Hadoop community has agreed to not allow in code contributions. {color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 2020 javac compiler warnings (more than the trunk's current 2013 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 12 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1859//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/1859//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-common.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/1859//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1859//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529812#comment-13529812 ] Tom White commented on HADOOP-8545: --- I'm not sure whether the blockstore implementation is the right approach. The main drawback is that it's a Hadoop-specific format, which other tools can't read, and which will introduce a support burden. The S3 blockstore was introduced when there was a limit on the size of files, which has since been removed, so if I was doing it today I would probably not have a S3 blockstore implementation. I would encourage you to look at more general support for large files in Swift, e.g. http://docs.openstack.org/developer/swift/overview_large_objects.html. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526214#comment-13526214 ] Dmitry Mezhensky commented on HADOOP-8545: -- Native client was implemented in reason of data locality API, which we implemented in Swift. Patch for Hadoop retrieves information about each block/file (block or native impl) for local data processing or rack awareness. We can contribute this feature to rackspace/java-clouds and move to rackspace client. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13512072#comment-13512072 ] Steve Loughran commented on HADOOP-8545: @Dmitry -your patch looks interesting, especially the locality feature. in comparison with the rackspace/java-clouds version # that uses the java-clouds library # it only has the native swift: filesystem, not any blockstore # it has tests # it uses the {{FileSystemContractBaseTest}} class to verify compliance with the Hadoop Filesytem required semantics. # The {{SwiftFileSystemTest}} contains fixes for HADOOP-9118 and HADOOP-9119 items 3 and 4 can be added to your code; the fixes for a stricter contract should go into the base class, as they are requirements for all FileSystem implementations. I don't think anyone is committed to the java-clouds library, though I would very much prefer to have the maintenance and testing of the swift client API to be done by someone other than the Hadoop project. The maintenance cost of a module that is not core to Hadoop would mean that it would end up in {{contrib/}} and would end up being neglected. With an external library it could go into the core; a new POM would trigger incorporation of that library, a new RPM would install it. How do you think we could combine everyone's work? I could host a Google+ meetup with everyone who is interested in this so we can discuss it -the minutes would go up here to record the discussion. -steve > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13511420#comment-13511420 ] Dmitry Mezhensky commented on HADOOP-8545: -- Commit procedure to OpenStack Swift data locality API is in progress > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13510062#comment-13510062 ] Nirmal Ranganathan commented on HADOOP-8545: Setting up a local swift install for testing. In a clean vm run the following git clone https://github.com/openstack-dev/devstack cd devstack echo "ENABLED_SERVICES=key,swift SWIFT_HASH=66a3d6b56c1f479c8b4e70ab5c2000f5 SWIFT_REPLICAS=1 SWIFT_DATA_DIR=$DEST/data" > localrc ./stack.sh This will pull down the latest swift code.. install dependencies and setup all the services required for swift. Note: this is just a dev setup. To test: source openrc swift --help > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Reporter: Tim Miller >Priority: Minor > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira