[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258847#comment-13258847 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Hdfs-0.23-Build #234 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/234/]) svn merge -c 1328541 from trunk for HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. (Revision 1328543) Result = UNSTABLE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328543 Files : * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258850#comment-13258850 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Hdfs-trunk #1021 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1021/]) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328541) Revert r1328482 for HDFS-3308. (Revision 1328487) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328482) Result = FAILURE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328541 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328487 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328482 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report
[ https://issues.apache.org/jira/browse/HDFS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi reassigned HDFS-3295: --- Assignee: Ashish Singhi > Mismatch in number of bytes already moved and number of bytes being moved in > balancer report > > > Key: HDFS-3295 > URL: https://issues.apache.org/jira/browse/HDFS-3295 > Project: Hadoop HDFS > Issue Type: Bug > Components: balancer >Affects Versions: 0.23.0 >Reporter: J.Andreina >Assignee: Ashish Singhi > Fix For: 0.24.0 > > > Scenario: > Replication factor = > 1,fs.defaultFS=hdfs://namenodeip:port,dfs.namenode.rpc-address=namenodeip:port. > step 1: started DN1.Pumped 4.67GB of data > step 2: started DN2. > step 3: issued the balancer cmd(./start-balancer.sh -threshold 1) > Totally 848.41 MB has been moved to 2DN and took 4 iterations to move the > blocks to 2DN. > But in balancer output in all the iterations the number of bytes already > moved is alway 0KB and there is mismatch in the Bytes being moved with the > bytes left to move > Balancer output for 2nd Iteration > = > {noformat} > Time Stamp Iteration# Bytes Already Moved Bytes Left To Move > Bytes Being Moved > Apr 18, 2012 12:41:20 PM 0 0 KB 848.41 MB > 151.18 MB > Apr 18, 2012 1:06:46 PM 1 0 KB 646.02 MB > 151.18 MB > Apr 18, 2012 1:10:28 PM 2 0 KB 417.43 MB > 151.18 MB > Apr 18, 2012 1:14:04 PM 3 0 KB 223.84 MB > 151.18 MB > Apr 18, 2012 1:18:10 PM 4 0 KB30.34 MB > 151.18 MB{noformat} > In the above balancer output > •Bytes already moved is 0KB > • In 3 rd iterarion Bytes left to move is 223.84 MB but Bytes being moved is > 151.18 MB . So in next iteration the bytes left to move should be 223.84 MB - > 151.18 MB -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3308) hftp/webhdfs can't get tokens if authority has no port
[ https://issues.apache.org/jira/browse/HDFS-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258853#comment-13258853 ] Hudson commented on HDFS-3308: -- Integrated in Hadoop-Mapreduce-trunk #1056 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1056/]) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328541) Revert r1328482 for HDFS-3308. (Revision 1328487) HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp (Revision 1328482) Result = FAILURE szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328541 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328487 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328482 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HftpFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestHftpDelegationToken.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java > hftp/webhdfs can't get tokens if authority has no port > -- > > Key: HDFS-3308 > URL: https://issues.apache.org/jira/browse/HDFS-3308 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client >Affects Versions: 0.23.0, 0.24.0 >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Critical > Fix For: 0.23.3 > > Attachments: HDFS-3308.patch > > > Token acquisition fails if a hftp or webhdfs filesystem is obtained with no > port in the authority. Building a token service requires a port, and the > renewer needs the port. The default port is not being used when there is no > port in the uri. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3311) Httpfs: Cannot build because of wrong pom file
[ https://issues.apache.org/jira/browse/HDFS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258995#comment-13258995 ] Show You commented on HDFS-3311: Excuse me. I use cloudera's hoop git instead of apache. > Httpfs: Cannot build because of wrong pom file > -- > > Key: HDFS-3311 > URL: https://issues.apache.org/jira/browse/HDFS-3311 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Show You > > On httpfs master 43f595d77d9d42ade5220bfba55ec13e558afb7a > {code} > hoop]$ mvn clean package site assembly:single > ... > [WARNING] Unable to create Maven project from repository. > org.apache.maven.project.InvalidProjectModelException: 1 problem was > encountered while building the effective model for > com.sun.jersey:jersey-server:1.4 > [FATAL] Non-parseable POM > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom: > end tag name must match start tag name from line 5 (position: > TEXT seen ...\r\n... @6:8) @ > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom, > line 6, column 8 > for project com.sun.jersey:jersey-server:1.4 for project > com.sun.jersey:jersey-server:1.4 > at > org.apache.maven.project.DefaultMavenProjectBuilder.transformError(DefaultMavenProjectBuilder.java:193) > at > ... > {code} > and > {code} > hoop]$ cat > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom > > 301 Moved Permanently > > 301 Moved Permanently > nginx/0.6.39 > > > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-3311) Httpfs: Cannot build because of wrong pom file
[ https://issues.apache.org/jira/browse/HDFS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sho Shimauchi resolved HDFS-3311. - Resolution: Cannot Reproduce np, closing the ticket > Httpfs: Cannot build because of wrong pom file > -- > > Key: HDFS-3311 > URL: https://issues.apache.org/jira/browse/HDFS-3311 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Show You > > On httpfs master 43f595d77d9d42ade5220bfba55ec13e558afb7a > {code} > hoop]$ mvn clean package site assembly:single > ... > [WARNING] Unable to create Maven project from repository. > org.apache.maven.project.InvalidProjectModelException: 1 problem was > encountered while building the effective model for > com.sun.jersey:jersey-server:1.4 > [FATAL] Non-parseable POM > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom: > end tag name must match start tag name from line 5 (position: > TEXT seen ...\r\n... @6:8) @ > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom, > line 6, column 8 > for project com.sun.jersey:jersey-server:1.4 for project > com.sun.jersey:jersey-server:1.4 > at > org.apache.maven.project.DefaultMavenProjectBuilder.transformError(DefaultMavenProjectBuilder.java:193) > at > ... > {code} > and > {code} > hoop]$ cat > /home/yuki/.m2/repository/com/sun/jersey/jersey-project/1.4/jersey-project-1.4.pom > > 301 Moved Permanently > > 301 Moved Permanently > nginx/0.6.39 > > > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira