[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258847#comment-13258847 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Hdfs-0.23-Build #234 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/234/]) svn merge -c 1328541 from trunk for HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. (Revision 1328543) Result = UNSTABLE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328543 Files : * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258850#comment-13258850 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Hdfs-trunk #1021 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1021/]) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328541) Revert r1328482 for HDFS-3308. (Revision 1328487) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328482) Result = FAILURE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328541 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328487 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328482 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report
[
https://issues.apache.org/jira/browse/HDFS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashish Singhi reassigned HDFS-3295:
---
Assignee: Ashish Singhi
> Mismatch in number of bytes already moved and number of bytes being moved in
> balancer report
>
>
> Key: HDFS-3295
> URL: https://issues.apache.org/jira/browse/HDFS-3295
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: balancer
>Affects Versions: 0.23.0
>Reporter: J.Andreina
>Assignee: Ashish Singhi
> Fix For: 0.24.0
>
>
> Scenario:
> Replication factor =
> 1,fs.defaultFS=hdfs://namenodeip:port,dfs.namenode.rpc-address=namenodeip:port.
> step 1: started DN1.Pumped 4.67GB of data
> step 2: started DN2.
> step 3: issued the balancer cmd(./start-balancer.sh -threshold 1)
> Totally 848.41 MB has been moved to 2DN and took 4 iterations to move the
> blocks to 2DN.
> But in balancer output in all the iterations the number of bytes already
> moved is alway 0KB and there is mismatch in the Bytes being moved with the
> bytes left to move
> Balancer output for 2nd Iteration
> =
> {noformat}
> Time Stamp Iteration# Bytes Already Moved Bytes Left To Move
> Bytes Being Moved
> Apr 18, 2012 12:41:20 PM 0 0 KB 848.41 MB
> 151.18 MB
> Apr 18, 2012 1:06:46 PM 1 0 KB 646.02 MB
> 151.18 MB
> Apr 18, 2012 1:10:28 PM 2 0 KB 417.43 MB
> 151.18 MB
> Apr 18, 2012 1:14:04 PM 3 0 KB 223.84 MB
> 151.18 MB
> Apr 18, 2012 1:18:10 PM 4 0 KB30.34 MB
> 151.18 MB{noformat}
> In the above balancer output
> •Bytes already moved is 0KB
> • In 3 rd iterarion Bytes left to move is 223.84 MB but Bytes being moved is
> 151.18 MB . So in next iteration the bytes left to move should be 223.84 MB -
> 151.18 MB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258853#comment-13258853 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Mapreduce-trunk #1056 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1056/]) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328541) Revert r1328482 for HDFS-3308. (Revision 1328487) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328482) Result = FAILURE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328541 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328487 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328482 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3311) Httpfs: Cannot build because of wrong pom file
[
https://issues.apache.org/jira/browse/HDFS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258995#comment-13258995
]
Show You commented on HDFS-3311:
Excuse me. I use cloudera's hoop git instead of apache.
> Httpfs: Cannot build because of wrong pom file
> --
>
> Key: HDFS-3311
> URL: https://issues.apache.org/jira/browse/HDFS-3311
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Show You
>
> On httpfs master 43f595d77d9d42ade5220bfba55ec13e558afb7a
> {code}
> hoop]$ mvn clean package site assembly:single
> ...
> [WARNING] Unable to create Maven project from repository.
> org.apache.maven.project.InvalidProjectModelException: 1 problem was
> encountered while building the effective model for
> com.sun.jersey:jersey-server:1.4
> [FATAL] Non-parseable POM
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom:
> end tag name must match start tag name from line 5 (position:
> TEXT seen ...\r\n... @6:8) @
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom,
> line 6, column 8
> for project com.sun.jersey:jersey-server:1.4 for project
> com.sun.jersey:jersey-server:1.4
> at
> org.apache.maven.project.DefaultMavenProjectBuilder.transformError(DefaultMavenProjectBuilder.java:193)
> at
> ...
> {code}
> and
> {code}
> hoop]$ cat
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom
>
> 301 Moved Permanently
>
> 301 Moved Permanently
> nginx/0.6.39
>
>
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-3311) Httpfs: Cannot build because of wrong pom file
[
https://issues.apache.org/jira/browse/HDFS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sho Shimauchi resolved HDFS-3311.
-
Resolution: Cannot Reproduce
np, closing the ticket
> Httpfs: Cannot build because of wrong pom file
> --
>
> Key: HDFS-3311
> URL: https://issues.apache.org/jira/browse/HDFS-3311
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Show You
>
> On httpfs master 43f595d77d9d42ade5220bfba55ec13e558afb7a
> {code}
> hoop]$ mvn clean package site assembly:single
> ...
> [WARNING] Unable to create Maven project from repository.
> org.apache.maven.project.InvalidProjectModelException: 1 problem was
> encountered while building the effective model for
> com.sun.jersey:jersey-server:1.4
> [FATAL] Non-parseable POM
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom:
> end tag name must match start tag name from line 5 (position:
> TEXT seen ...\r\n... @6:8) @
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom,
> line 6, column 8
> for project com.sun.jersey:jersey-server:1.4 for project
> com.sun.jersey:jersey-server:1.4
> at
> org.apache.maven.project.DefaultMavenProjectBuilder.transformError(DefaultMavenProjectBuilder.java:193)
> at
> ...
> {code}
> and
> {code}
> hoop]$ cat
> /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom
>
> 301 Moved Permanently
>
> 301 Moved Permanently
> nginx/0.6.39
>
>
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
