[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988804#comment-14988804
]
Hadoop QA commented on HADOOP-10420:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 10s
{color} | {color:blue} docker + precommit patch detected. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s {color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
19s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 13s
{color} | {color:green} trunk passed with JDK v1.8.0_60 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 12s
{color} | {color:green} trunk passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
8s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 18s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
12s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
32s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 14s
{color} | {color:green} trunk passed with JDK v1.8.0_60 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 15s
{color} | {color:green} trunk passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
14s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 11s
{color} | {color:green} the patch passed with JDK v1.8.0_60 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 11s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 12s
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 12s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
7s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 19s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
12s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s {color} | {color:green} Patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
38s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 13s
{color} | {color:green} the patch passed with JDK v1.8.0_60 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 15s
{color} | {color:green} the patch passed with JDK v1.7.0_79 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 11s
{color} | {color:green} hadoop-openstack in the patch passed with JDK
v1.8.0_60. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 13s
{color} | {color:green} hadoop-openstack in the patch passed with JDK
v1.7.0_79. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
25s {color} | {color:green} Patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 9m 42s {color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=1.7.1 Server=1.7.1
Image:test-patch-base-hadoop-date2015-11-04 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12770467/HADOOP-10420-014.patch
|
| JIRA Issue | HADOOP-10420 |
| Optional Tests | asflicense javac javadoc mvninstall unit findbugs
checkstyle compile site mvnsite |
| uname | Linux 63ff64730d11 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740804#comment-14740804
]
Steve Loughran commented on HADOOP-10420:
-
-1
fails {{TestSwiftRestClient}}
Failed tests:
TestSwiftRestClient.testUsernameAuthException:137 Expected authentication
failed exception. but got
AccessToken{id='AUTH_tk8c9403b42264465bacb57b2d4adc535c', tenant=null,
expires='null'}
TestSwiftRestClient.testApikeyAuthException:160 Expected authentication
failed exception. but got
AccessToken{id='AUTH_tk8c9403b42264465bacb57b2d4adc535c', tenant=null,
expires='null'}
These are both expected to fail auth, yet the caller does end up connecting.
Presumably its the different auth mechanism: the test needs to set things up so
that auth fails for tempAuth as well as the other mechanisms
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420-010.patch, HADOOP-10420-011.patch, HADOOP-10420-012.patch,
> HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740821#comment-14740821 ] Steve Loughran commented on HADOOP-10420: - I should add; the test failures were against IBM softlayer; the other swift endpoints are happy -this patch doesn't appear to cause any regressions. > Add support to Swift-FS to support tempAuth > --- > > Key: HADOOP-10420 > URL: https://issues.apache.org/jira/browse/HADOOP-10420 > Project: Hadoop Common > Issue Type: Improvement > Components: fs, fs/swift, tools >Affects Versions: 2.3.0 >Reporter: Jinghui Wang > Labels: BB2015-05-TBR > Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, > HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, > HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch, > HADOOP-10420-010.patch, HADOOP-10420-011.patch, HADOOP-10420-012.patch, > HADOOP-10420-013.patch, HADOOP-10420.patch > > > Currently, hadoop-openstack Swift FS supports keystone authentication. The > attached patch adds support for tempAuth. Users will be able to configure > which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740897#comment-14740897
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 16m 0s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 51s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 52s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 25s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 19s | The applied patch generated 1
new checkstyle issues (total was 276, now 277). |
| {color:green}+1{color} | whitespace | 0m 2s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 28s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 45s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 14s | Tests passed in
hadoop-openstack. |
| | | 37m 33s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12755406/HADOOP-10420-013.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 486d5cb |
| checkstyle |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7638/artifact/patchprocess/diffcheckstylehadoop-openstack.txt
|
| hadoop-openstack test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7638/artifact/patchprocess/testrun_hadoop-openstack.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7638/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7638/console |
This message was automatically generated.
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420-010.patch, HADOOP-10420-011.patch, HADOOP-10420-012.patch,
> HADOOP-10420-013.patch, HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729428#comment-14729428
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 15m 39s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 38s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 50s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 23s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 0m 19s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 3s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 27s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 46s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 14s | Tests passed in
hadoop-openstack. |
| | | 36m 55s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12754028/HADOOP-10420-012.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 0ebc658 |
| hadoop-openstack test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7593/artifact/patchprocess/testrun_hadoop-openstack.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7593/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7593/console |
This message was automatically generated.
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420-010.patch, HADOOP-10420-011.patch, HADOOP-10420-012.patch,
> HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728612#comment-14728612
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 16m 48s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 52s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 19s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 24s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 19s | The applied patch generated 2
new checkstyle issues (total was 277, now 278). |
| {color:green}+1{color} | whitespace | 0m 2s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 29s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 48s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 14s | Tests passed in
hadoop-openstack. |
| | | 38m 55s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12753920/HADOOP-10420-010.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 09c64ba |
| checkstyle |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7585/artifact/patchprocess/diffcheckstylehadoop-openstack.txt
|
| hadoop-openstack test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7585/artifact/patchprocess/testrun_hadoop-openstack.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7585/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7585/console |
This message was automatically generated.
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420-010.patch, HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728945#comment-14728945
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | patch | 0m 0s | The patch command could not apply
the patch during dryrun. |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12753976/HADOOP-10420-011.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / b469ac5 |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7587/console |
This message was automatically generated.
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420-010.patch, HADOOP-10420-011.patch, HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724765#comment-14724765
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 15m 45s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 40s | There were no new javac warning
messages. |
| {color:red}-1{color} | javadoc | 9m 53s | The applied patch generated 4
additional warning messages. |
| {color:green}+1{color} | release audit | 0m 23s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 20s | The applied patch generated 7
new checkstyle issues (total was 276, now 283). |
| {color:green}+1{color} | whitespace | 0m 2s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 28s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 48s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 14s | Tests passed in
hadoop-openstack. |
| | | 37m 8s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12753450/HADOOP-10420-009.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 7ad3556 |
| javadoc |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7567/artifact/patchprocess/diffJavadocWarnings.txt
|
| checkstyle |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7567/artifact/patchprocess/diffcheckstylehadoop-openstack.txt
|
| hadoop-openstack test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7567/artifact/patchprocess/testrun_hadoop-openstack.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7567/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7567/console |
This message was automatically generated.
> Add support to Swift-FS to support tempAuth
> ---
>
> Key: HADOOP-10420
> URL: https://issues.apache.org/jira/browse/HADOOP-10420
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/swift, tools
>Affects Versions: 2.3.0
>Reporter: Jinghui Wang
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
> HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
> HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch,
> HADOOP-10420.patch
>
>
> Currently, hadoop-openstack Swift FS supports keystone authentication. The
> attached patch adds support for tempAuth. Users will be able to configure
> which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724735#comment-14724735 ] Jim VanOosten commented on HADOOP-10420: Gil, HADOOP-10420-009.patch has the fix that you outlined above. > Add support to Swift-FS to support tempAuth > --- > > Key: HADOOP-10420 > URL: https://issues.apache.org/jira/browse/HADOOP-10420 > Project: Hadoop Common > Issue Type: Improvement > Components: fs, fs/swift, tools >Affects Versions: 2.3.0 >Reporter: Jinghui Wang > Labels: BB2015-05-TBR > Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, > HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, > HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420-009.patch, > HADOOP-10420.patch > > > Currently, hadoop-openstack Swift FS supports keystone authentication. The > attached patch adds support for tempAuth. Users will be able to configure > which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720376#comment-14720376 ] Joseph Fourny commented on HADOOP-10420: I can't wait until this is officially part of Hadoop (and bundled with Spark). Lot's of IBMer's and SoftLayer customers are stuck on this. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Labels: BB2015-05-TBR Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720428#comment-14720428
]
Hadoop QA commented on HADOOP-10420:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 15m 57s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 59s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 9s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 23s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 20s | The applied patch generated
40 new checkstyle issues (total was 262, now 302). |
| {color:red}-1{color} | whitespace | 0m 1s | The patch has 6 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 28s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 47s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 14s | Tests passed in
hadoop-openstack. |
| | | 37m 54s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12707226/HADOOP-10420-008.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / b6ceee9 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7547/artifact/patchprocess/diffcheckstylehadoop-openstack.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7547/artifact/patchprocess/whitespace.txt
|
| hadoop-openstack test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7547/artifact/patchprocess/testrun_hadoop-openstack.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7547/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/7547/console |
This message was automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Labels: BB2015-05-TBR
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708059#comment-14708059
]
Gil Vernik commented on HADOOP-10420:
-
Even this patch is stuck, i still want to share this one:
I just played with this patch again, used Hadoop 2.6.0 and Swift ( the latest
version). While trying to access Swift i got
java.io.EOFException: No content to map to Object due to end of input
at
org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2775)
at
org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2718)
at
org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
at org.apache.hadoop.fs.swift.util.JSONUtil.toObject(JSONUtil.java:85)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient$TempAuthGet.extractResult(SwiftRestClient.jav
a:1329)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient$TempAuthGet.extractResult(SwiftRestClient.jav
a:1264)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.perform(SwiftRestClient.java:1557)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.perform(SwiftRestClient.java:1493)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.authenticate(SwiftRestClient.java:1102)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.authIfNeeded(SwiftRestClient.java:1449)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.preRemoteCommand(SwiftRestClient.java:1465)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.headRequest(SwiftRestClient.java:1036)
The reason for this, is that method public AccessToken extractResult(GetMethod
method) throws IOException is written wrong.
It tries to read JSON body, which can be null or empty. First thing it should
check header and not body, otherwise it will cause an exception.
The normal behavior for authentication GET method is to read header, not a
body.
This is the correct code ( just changed order )
URI finalEndpointURI = null;
Header storageURL = method.getResponseHeader(HEADER_STORAGE_URL);
if (storageURL != null) {
try {
finalEndpointURI = new URI(storageURL.getValue());
} catch (URISyntaxException ex) {
LOG.error(TempAuth received a bad url, + storageURL.getValue() +
, in the authentication response header.);
throw new SwiftAuthenticationFailedException(
Bad URL + storageURL.getValue(), GET, authUri, method);
}
}
if (finalEndpointURI == null) {
final TempAuthStorage storage =
JSONUtil.toObject(method.getResponseBodyAsString(),
TempAuthAuthenticationWrapper.class).getStorage();
if (storage != null) {
String url =
usePublicURL ? storage.getPublicURL() :
storage.getPrivateURL();
if (url != null) {
try {
if (!useEncryption) {
url = url.replaceFirst(https:, http:);
}
finalEndpointURI = new URI(url);
} catch (URISyntaxException ex) {
LOG.error(TempAuth received a bad url, + url + , in the
authentication response body.);
throw new SwiftAuthenticationFailedException(
Bad URL + url, GET, authUri, method);
}
}
}
}
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Labels: BB2015-05-TBR
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494722#comment-14494722 ] Jim VanOosten commented on HADOOP-10420: Steve, I didn't have any luck getting a public SoftLayer Object Storage endpoint to test against. Can the Hadoop community open a SoftLayer Object Storage account? I have run the hadoop-openstack test suite successfully against a private SoftLayer Object Storage endpoint and can post the results if that would help. Jim V.O. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380181#comment-14380181
]
Hadoop QA commented on HADOOP-10420:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12707226/HADOOP-10420-008.patch
against trunk revision c906a1d.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-openstack.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5998//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5998//console
This message is automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
HADOOP-10420-007.patch, HADOOP-10420-008.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362464#comment-14362464 ] Jim VanOosten commented on HADOOP-10420: I was not able to reproduce a build failure. With the patch applied, I executed mvn clean test -DskipTests -DHadoopPatchProcess -Pnative -Ptest-patch in the hadoop-tools directory: [INFO] Executed tasks [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Streaming . SUCCESS [11.182s] [INFO] Apache Hadoop Distributed Copy SUCCESS [8.727s] [INFO] Apache Hadoop Archives SUCCESS [5.091s] [INFO] Apache Hadoop Rumen ... SUCCESS [7.904s] [INFO] Apache Hadoop Gridmix . SUCCESS [8.774s] [INFO] Apache Hadoop Data Join ... SUCCESS [6.043s] [INFO] Apache Hadoop Ant Tasks ... SUCCESS [2.577s] [INFO] Apache Hadoop Extras .. SUCCESS [5.984s] [INFO] Apache Hadoop Pipes ... SUCCESS [8.081s] [INFO] Apache Hadoop OpenStack support ... SUCCESS [7.499s] [INFO] Apache Hadoop Amazon Web Services support . SUCCESS [4.464s] [INFO] Apache Hadoop Azure support ... SUCCESS [8.680s] [INFO] Apache Hadoop Scheduler Load Simulator SUCCESS [6.811s] [INFO] Apache Hadoop Tools Dist .. SUCCESS [0.185s] [INFO] Apache Hadoop Tools ... SUCCESS [0.048s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 1:33.651s [INFO] Finished at: Sun Mar 15 12:40:14 CDT 2015 [INFO] Final Memory: 23M/288M [ Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, HADOOP-10420-007.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362048#comment-14362048 ] Steve Loughran commented on HADOOP-10420: - Jim: test runs create data but clean up afterwards, for any non-scale a few hundred KB and files. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, HADOOP-10420-007.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360079#comment-14360079
]
Hadoop QA commented on HADOOP-10420:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12704369/HADOOP-10420-007.patch
against trunk revision 387f271.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:red}-1 javac{color:red}. The patch appears to cause the build to
fail.
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5935//console
This message is automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch,
HADOOP-10420-007.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359981#comment-14359981 ] Jim VanOosten commented on HADOOP-10420: Steve, For the public endpoint for testing with SoftLayer's object storage. Do you have a rough idea on how much space you'll need and how long the endpoint needs to be active? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420-006.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293912#comment-14293912 ] Jim VanOosten commented on HADOOP-10420: Steve, If SoftLayer provides a public endpoint to use for testing, how much space would be needed and how long will the endpoint be needed? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291836#comment-14291836 ] Jim VanOosten commented on HADOOP-10420: Steve, I am not aware of a public endpoint. I am checking with some folks at SoftLayer whether they can provide credentials for a SoftLayer Object Store endpoint. Jim Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291751#comment-14291751 ] Gil Vernik commented on HADOOP-10420: - Assuming setup local test Swift cluster is not an option for you - can you test it with SoftLayer object store? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289026#comment-14289026 ] Steve Loughran commented on HADOOP-10420: - Gil: I test the existing code against: RAX US, RAX UK (different throttle policy), HP cloud. Rackspace and HP have different auth mechanisms; HP is the keystone one I believe. Authentication has proven to be the main tangible difference between endpoints —which is why I'd like to know where there's something on the network with this new auth mechanism. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287450#comment-14287450 ] Gil Vernik commented on HADOOP-10420: - I think the best way, is to check it against private Swift cluster that you can setup very fast on any Ubuntu based VM. This authentication method of this patch is the default for any vanilla Swift. One way is to follow Swift All in One or if i am not mistaken than Ubuntu has Swift in it's repository already which makes it very easy to setup. About public providers... any provider that offer Swift object store ( for example SoftLayer and many others) I wonder how the original driver was tested? The one that have Keystone only... was it tested against public Swift cluster? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287360#comment-14287360 ] Steve Loughran commented on HADOOP-10420: - Jim # is there a public swift endpoint I can try this against? Not just for the patch test but for future regression testing # are there any changes to the documentation needed? If so, I'd like to see them in the patch Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285531#comment-14285531 ] Steve Loughran commented on HADOOP-10420: - Jim: I'm planning to go through the patch-available S3 patches and test them this week... Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274328#comment-14274328 ] Jim VanOosten commented on HADOOP-10420: Is there anything more required to have the patch committed? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269208#comment-14269208
]
Hadoop QA commented on HADOOP-10420:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12662347/HADOOP-10420-005.patch
against trunk revision a6ed489.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-openstack.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5381//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5381//console
This message is automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269182#comment-14269182 ] Nathan Bijnens commented on HADOOP-10420: - Has any progress being made on this issue? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099956#comment-14099956 ] Steve Loughran commented on HADOOP-10420: - bq. Verified no regressions by running: mvn -rf hadoop-openstack test in the hadoop-tools directory. # this was against trunk, with the relevant custom XML files to trigger tests rather than the skip of all the tests? # which openstack systems did you test against? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100045#comment-14100045 ] Jim VanOosten commented on HADOOP-10420: 1. The test was in executed in my fix branch with a custom hadoop-openstack/src/test/resources/auth-keys.xml file. [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hadoop-openstack --- [INFO] Surefire report directory: /Users/jimvo/src/hadoop-git/hadoop/hadoop-tools/hadoop-openstack/target/surefire-reports ... Results : Tests run: 273, Failures: 0, Errors: 0, Skipped: 44 ... main: [INFO] Executed tasks [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop OpenStack support ... SUCCESS [14:33.358s] [INFO] Apache Hadoop Azure support ... SUCCESS [1:38.364s] [INFO] Apache Hadoop Scheduler Load Simulator SUCCESS [2:18.379s] [INFO] Apache Hadoop Tools Dist .. SUCCESS [13.944s] [INFO] Apache Hadoop Tools ... SUCCESS [0.129s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 18:48.136s [INFO] Finished at: Sat Aug 16 12:08:15 CDT 2014 [INFO] Final Memory: 27M/81M [INFO] 2. I tested against SoftLayer's Object Storage. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099580#comment-14099580 ] Gil Vernik commented on HADOOP-10420: - I found a bit hard to apply path-003 or patch-004 I am doing git apply from hadoop-common-2.3.0 and it doesn't work claiming that root@ubuntu:/usr/local/hadoop-2.3.0-src/hadoop-common-2.3.0# git apply --check HADOOP-10420-004.patch error: hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/RestClientBindings.java: No such file or directory error: hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/SwiftProtocolConstants.java: No such file or directory error: hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/SwiftRestClient.java: No such file or directory error: hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/JSONUtil.java: No such file or directory I noticed that both patch 002 and original patch use diff --git a/hadoop-tools/ b/hadoop-tools/ while patch 003 and 004 doesn't. I manually edited patch 004 and added a/... and b/.. and all worked fine. Anyone can explain me why i had that problem with patch 004 and 003? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/swift, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch, HADOOP-10420-004.patch, HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099617#comment-14099617
]
Steve Loughran commented on HADOOP-10420:
-
Gil
# you should really be trying to apply patches to branch-2 or trunk; trunk is
where all changes go in
# try {{patch -p0 HADOOP-10420-004.patch}}
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099629#comment-14099629
]
Hadoop QA commented on HADOOP-10420:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12657626/HADOOP-10420-004.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-openstack.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/4485//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/4485//console
This message is automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099633#comment-14099633
]
Gil Vernik commented on HADOOP-10420:
-
Great to have this driver. I only started to test it and have few comments so
far:
1. Remove all 'SoftLayer' words which are still appears.
2. There is no 'objectURI' for the temp auth. TempAuthGet class contains
// There is no object location in the authentication response in this case
URI objectLocation = null;
setAuthDetails(finalEndpointURI, objectLocation, accessToken);
But, the problem that
private URI pathToObjectLocation(SwiftObjectPath path) throws SwiftException {
URI uri;
String dataLocationURI = objectLocationURI.toString();
try {
if (path.toString().startsWith(/)) {
dataLocationURI = dataLocationURI.concat(path.toUriPath());
} else {
dataLocationURI = dataLocationURI.concat(/).concat(path.toUriPath());
}
uri = new URI(dataLocationURI);
} catch (URISyntaxException e) {
throw new SwiftException(e);
}
return uri;
}
Still requires object URI, which is null in case of temp auth.
Therefore:
14/08/16 15:20:43 TRACE org.apache.hadoop.fs.swift.http.SwiftRestClient:
SwiftRestClient: Executing getObjectLocation
java.lang.NullPointerException
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.pathToObjectLocation(SwiftRestClient.java:769)
at
org.apache.hadoop.fs.swift.http.SwiftRestClient.getObjectLocation(SwiftRestClient.java:721)
at
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.getObjectLocation(SwiftNativeFileSystemStore.java:444)
at
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem.getFileBlockLocations(SwiftNativeFileSystem.java:267)
...
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[
https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099852#comment-14099852
]
Hadoop QA commented on HADOOP-10420:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12662347/HADOOP-10420-005.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-openstack.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/4491//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/4491//console
This message is automatically generated.
Add support to Swift-FS to support tempAuth
---
Key: HADOOP-10420
URL: https://issues.apache.org/jira/browse/HADOOP-10420
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/swift, tools
Affects Versions: 2.3.0
Reporter: Jinghui Wang
Attachments: HADOOP-10420-002.patch, HADOOP-10420-003.patch,
HADOOP-10420-004.patch, HADOOP-10420-005.patch, HADOOP-10420.patch
Currently, hadoop-openstack Swift FS supports keystone authentication. The
attached patch adds support for tempAuth. Users will be able to configure
which authentication to use.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008284#comment-14008284 ] Gil Vernik commented on HADOOP-10420: - I see the patch you provided. Why did you called classes as SoftLayer authentication? It shouldn't be using such names. You added a TempAuth authentication support, which is normally used by Swift. The names of the classes should be TempAuth... This way it will be clear what is it about, otherwise it looks like someone need SoftLayer account and it's very confusing. Tempauth is standard with any Swift installation. Can you please provide example of the configuration file to activate TempAuth and not KeyStone? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14006164#comment-14006164 ] Gil Vernik commented on HADOOP-10420: - It certainly not related SoftLayer. Swift uses tempauth by default and every Swift installation contains tempauth authentication module. What is the status of this patch? Someone already working on it? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947173#comment-13947173 ] Jinghui Wang commented on HADOOP-10420: --- I understand your concern on adding multiple authentication mechanisms to the client can be problematic, however the authentication scheme that the patch adds is not necessarily specific to Softlayer, the TempAuth mechanism from OpenStack uses GET request to authenticate and uses the token from the authentication for the subsequent requests. I do agree that a pluggable authentication mechanism is needed eventually to support multiple authentication schemes. In the meantime, would you be more open to accept the patch it can be used by TempAuth as well. I have ran the unit tests that the open stack module included and all tests passed exception one, which I opened another JIRA HADOOP-10351. Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: fs, tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10420) Add support to Swift-FS to support tempAuth
[ https://issues.apache.org/jira/browse/HADOOP-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13945484#comment-13945484 ] Steve Loughran commented on HADOOP-10420: - is this a softlayer-only auth policy? if it is, then we need to think about how to support 1 pluggable auth mechanism, rather than grow the client code to being a collection of all the many mechanisms likely to appear. usual question: test plan? Have you run the existing tests against the new system For the rest of the swift code the regression tests consist of openstack teams testing locally, plus remote tests againt RAX US, RAX UK and HP Cloud. Is there a public softlayer service we could get remote access to? Add support to Swift-FS to support tempAuth --- Key: HADOOP-10420 URL: https://issues.apache.org/jira/browse/HADOOP-10420 Project: Hadoop Common Issue Type: Improvement Components: tools Affects Versions: 2.3.0 Reporter: Jinghui Wang Attachments: HADOOP-10420.patch Currently, hadoop-openstack Swift FS supports keystone authentication. The attached patch adds support for tempAuth. Users will be able to configure which authentication to use. -- This message was sent by Atlassian JIRA (v6.2#6252)
