[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060428#comment-14060428 ] Hadoop QA commented on HDFS-6378: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12655504/HDFS-6378.003.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-nfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7334//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7334//console This message is automatically generated. NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Assignee: Abhiraj Butala Attachments: HDFS-6378.002.patch, HDFS-6378.003.patch, HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061289#comment-14061289 ] Brandon Li commented on HDFS-6378: -- +1 NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Assignee: Abhiraj Butala Attachments: HDFS-6378.002.patch, HDFS-6378.003.patch, HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054200#comment-14054200 ] Brandon Li commented on HDFS-6378: -- Thanks for the new patch! {quote}I moved the Shutdown hook registration to be after the registration itself, because it would be redundant if the registration itself exited with exception.{quote} Shutdown hook should be called first so we can see the shutdown message when the registration fails. Please also fix the findbug warnings as suggested by the Jenkins run. NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Assignee: Abhiraj Butala Attachments: HDFS-6378.002.patch, HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049797#comment-14049797 ] Hadoop QA commented on HDFS-6378: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12653555/HDFS-6378.002.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-nfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7271//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/7271//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-nfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7271//console This message is automatically generated. NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Assignee: Abhiraj Butala Attachments: HDFS-6378.002.patch, HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048360#comment-14048360 ] Brandon Li commented on HDFS-6378: -- [~abutala], thanks for the fix. 500ms looks ok to me since portmap/rpcbind is supposed to be local. If Nfs3Base and MountdBase can catch the exception thrown by RpcProgram.register, they can choose to shutdown when the registration fails. NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Attachments: HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047094#comment-14047094 ] Hadoop QA commented on HDFS-6378: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12653049/HDFS-6378.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-nfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7241//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7241//console This message is automatically generated. NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li Attachments: HDFS-6378.patch When portmap/rpcbind is not available, NFS could be stuck at registration. Instead, NFS gateway should shut down automatically with proper error message. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995835#comment-13995835 ] Brandon Li commented on HDFS-6378: -- Ctrl-C can’t kill NFS if portmap is not started: {noformat} 14/05/08 15:58:06 INFO nfs3.IdUserGroup: Updated user map size:85 14/05/08 15:58:06 INFO nfs3.IdUserGroup: Updated group map size:110 14/05/08 15:58:06 INFO nfs3.WriteManager: Stream timeout is 1ms. 14/05/08 15:58:06 INFO nfs3.WriteManager: Reset stream timeout to minimum value 1ms. 14/05/08 15:58:06 INFO nfs3.WriteManager: Maximum open streams is 2 14/05/08 15:58:06 INFO nfs3.OpenFileCtxCache: Maximum open streams is 2 2014-05-08 15:58:07.119 java[19176:1003] Unable to load realm info from SCDynamicStore 14/05/08 15:58:07 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/05/08 15:58:07 INFO nfs3.RpcProgramNfs3: Create new dump directory /tmp/.hdfs-nfs 14/05/08 15:58:07 INFO nfs3.Nfs3Base: NFS server port set to: 2049 14/05/08 15:58:07 INFO oncrpc.SimpleUdpServer: Started listening to UDP requests at port 9009 for Rpc program: mountd at localhost:9009 with workerCount 1 14/05/08 15:58:07 INFO oncrpc.SimpleTcpServer: Started listening to TCP requests at port 9009 for Rpc program: mountd at localhost:9009 with workerCount 1 ^C14/05/08 15:58:57 ERROR nfs3.Nfs3Base: RECEIVED SIGNAL 2: SIGINT ^C14/05/08 15:59:00 ERROR nfs3.Nfs3Base: RECEIVED SIGNAL 2: SIGINT ^C14/05/08 15:59:03 ERROR nfs3.Nfs3Base: RECEIVED SIGNAL 2: SIGINT {noformat} The stack trace: {noformat} main prio=5 tid=7fe77c000800 nid=0x102a8e000 runnable [102a8d000] java.lang.Thread.State: RUNNABLE at java.net.PlainDatagramSocketImpl.receive0(Native Method) - locked 77df4def8 (a java.net.PlainDatagramSocketImpl) at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:188) - locked 77df4def8 (a java.net.PlainDatagramSocketImpl) at java.net.DatagramSocket.receive(DatagramSocket.java:725) - locked 77df4e978 (a java.net.DatagramPacket) - locked 77df4cfb8 (a java.net.DatagramSocket) at org.apache.hadoop.oncrpc.SimpleUdpClient.run(SimpleUdpClient.java:65) at org.apache.hadoop.oncrpc.RpcProgram.register(RpcProgram.java:119) at org.apache.hadoop.oncrpc.RpcProgram.register(RpcProgram.java:90) at org.apache.hadoop.mount.MountdBase.start(MountdBase.java:77) at org.apache.hadoop.hdfs.nfs.nfs3.Nfs3.startServiceInternal(Nfs3.java:58) at org.apache.hadoop.hdfs.nfs.nfs3.Nfs3.startService(Nfs3.java:66) at org.apache.hadoop.hdfs.nfs.nfs3.Nfs3.main(Nfs3.java:70) {noformat} NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging --- Key: HDFS-6378 URL: https://issues.apache.org/jira/browse/HDFS-6378 Project: Hadoop HDFS Issue Type: Bug Components: nfs Reporter: Brandon Li -- This message was sent by Atlassian JIRA (v6.2#6252)