RE: [jira] [Created] (HADOOP-9674) RPC#Server#start does not block until server is fully initialized and listening
Is the solution for the call to block till the initialization completes?
> Date: Thu, 27 Jun 2013 04:39:20 +
> From: j...@apache.org
> To: common-dev@hadoop.apache.org
> Subject: [jira] [Created] (HADOOP-9674) RPC#Server#start does not block until
> server is fully initialized and listening
>
> Chris Nauroth created HADOOP-9674:
> -
>
> Summary: RPC#Server#start does not block until server is fully
> initialized and listening
> Key: HADOOP-9674
> URL: https://issues.apache.org/jira/browse/HADOOP-9674
> Project: Hadoop Common
> Issue Type: Bug
> Components: ipc
> Affects Versions: 3.0.0, 2.2.0
> Reporter: Chris Nauroth
> Priority: Minor
>
>
> This problem was originally mentioned in discussion on HADOOP-8980. When
> calling {{RPC#Server#start}}, initialization of the server's internal
> {{Listener}} and {{Reader}} threads happens in the background. This
> initialization is not guaranteed to complete by the time the caller returns
> from {{RPC#Server#start}}. This may be misleading to a caller that expects
> the server has been fully initialized. This problem sometimes manifests as a
> test failure in {{TestRPC#testStopsAllThreads}}. This test looks at the
> stack frames of all running threads, expecting to find the {{Listener}} and
> {{Reader}} threads, but sometimes it doesn't find them.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9674) RPC#Server#start does not block until server is fully initialized and listening
Chris Nauroth created HADOOP-9674:
-
Summary: RPC#Server#start does not block until server is fully
initialized and listening
Key: HADOOP-9674
URL: https://issues.apache.org/jira/browse/HADOOP-9674
Project: Hadoop Common
Issue Type: Bug
Components: ipc
Affects Versions: 3.0.0, 2.2.0
Reporter: Chris Nauroth
Priority: Minor
This problem was originally mentioned in discussion on HADOOP-8980. When
calling {{RPC#Server#start}}, initialization of the server's internal
{{Listener}} and {{Reader}} threads happens in the background. This
initialization is not guaranteed to complete by the time the caller returns
from {{RPC#Server#start}}. This may be misleading to a caller that expects the
server has been fully initialized. This problem sometimes manifests as a test
failure in {{TestRPC#testStopsAllThreads}}. This test looks at the stack
frames of all running threads, expecting to find the {{Listener}} and
{{Reader}} threads, but sometimes it doesn't find them.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9673) NetworkTopology: when a node can't be added, print out its location for diagnostic purposes
Colin Patrick McCabe created HADOOP-9673: Summary: NetworkTopology: when a node can't be added, print out its location for diagnostic purposes Key: HADOOP-9673 URL: https://issues.apache.org/jira/browse/HADOOP-9673 Project: Hadoop Common Issue Type: Improvement Components: net Affects Versions: 2.2.0 Reporter: Colin Patrick McCabe Priority: Trivial It would be nice if NetworkTopology would print out the network location of anode if it couldn't be added. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 2.1.0-beta
On 26 June 2013 09:17, Arun C Murthy wrote: > Folks, > > > The RC tag in svn is here: > http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 > > The maven artifacts are available via repository.apache.org. > > did all the poms go up? [INFO] [INFO] Building Hoya: HBase on YARN 0.0.1-SNAPSHOT [INFO] Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-common/2.1.0-beta/hadoop-common-2.1.0-beta.pom [WARNING] The POM for org.apache.hadoop:hadoop-common:jar:2.1.0-beta is missing, no dependency information available Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-minicluster/2.1.0-beta/hadoop-minicluster-2.1.0-beta.pom [WARNING] The POM for org.apache.hadoop:hadoop-minicluster:jar:2.1.0-beta is missing, no dependency information available Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs/2.1.0-beta/hadoop-hdfs-2.1.0-beta.pom [WARNING] The POM for org.apache.hadoop:hadoop-hdfs:jar:2.1.0-beta is missing, no dependency information available [WARNING] The POM for org.apache.hadoop:hadoop-common:jar:tests:2.1.0-beta is missing, no dependency information available Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-yarn-server-common/2.1.0-beta/hadoop-yarn-server-common-2.1.0-beta.pom [WARNING] The POM for org.apache.hadoop:hadoop-yarn-server-common:jar:2.1.0-beta is missing, no dependency information available Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-common/2.1.0-beta/hadoop-common-2.1.0-beta.jar Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-minicluster/2.1.0-beta/hadoop-minicluster-2.1.0-beta.jar Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs/2.1.0-beta/hadoop-hdfs-2.1.0-beta.jar Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-common/2.1.0-beta/hadoop-common-2.1.0-beta-tests.jar Downloading: http://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-yarn-server-common/2.1.0-beta/hadoop-yarn-server-common-2.1.0-beta.jar [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 2.137s [INFO] Finished at: Wed Jun 26 20:45:22 BST 2013 [INFO] Final Memory: 6M/265M [INFO] [ERROR] Failed to execute goal on project hoya: Could not resolve dependencies for project org.apache.hadoop.hoya:hoya:jar:0.0.1-SNAPSHOT: The following artifacts could not be resolved: org.apache.hadoop:hadoop-common:jar:2.1.0-beta, org.apache.hadoop:hadoop-minicluster:jar:2.1.0-beta, org.apache.hadoop:hadoop-hdfs:jar:2.1.0-beta, org.apache.hadoop:hadoop-common:jar:tests:2.1.0-beta, org.apache.hadoop:hadoop-yarn-server-common:jar:2.1.0-beta: Could not find artifact org.apache.hadoop:hadoop-common:jar:2.1.0-beta in central ( http://repo.maven.apache.org/maven2) -> [Help 1]
Re: Heads up: branch-2.1-beta
Have anybody from the HDFS side of things had a chance to look at the OOM that Roman was reporting? Thanks. On Wed, Jun 26, 2013 at 12:26 AM, Arun C Murthy wrote: > Ok, the last of the blockers is done. > > I'll roll an RC tonight. > > thanks, > Arun > > On Jun 20, 2013, at 2:40 PM, Arun C Murthy wrote: > > > I think I've shared this before, but here you go again… > > > > http://s.apache.org/hadoop-2.1.0-beta-blockers > > > > At this point, HADOOP-9421 seems like the most important. > > > > thanks, > > Arun > > > > On Jun 20, 2013, at 8:31 AM, Alejandro Abdelnur > wrote: > > > >> Arun, > >> > >> It seems there are still a few things to iron out before getting 2.1 > out of > >> the door. > >> > >> As RM for the release, would you mind sharing the current state of > things > >> and your estimate on when it could happen? > >> > >> Thanks. > >> > >> > >> On Wed, Jun 19, 2013 at 4:29 PM, Roman Shaposhnik > wrote: > >> > >>> On Tue, Jun 18, 2013 at 11:58 PM, Arun C Murthy > >>> wrote: > Ping. Any luck? > >>> > >>> Unfortunately I've ran into: > >>> https://issues.apache.org/jira/browse/HADOOP-9654 > >>> > >>> which was caused by the unrelated memory pressure on the NN, > >>> but it had an unfortunate side effect of making the rest of the > >>> testing stuck. I'll correct the problem now and re-run. > >>> > >>> Thanks, > >>> Roman. > >>> > >> > >> > >> > >> -- > >> Alejandro > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > > > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ > > > -- Alejandro
[VOTE] Release Apache Hadoop 2.1.0-beta
Folks, I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would like to get released. This release represents a *huge* amount of work done by the community (639 fixes) which includes several major advances including: # HDFS Snapshots # Windows support # YARN API stabilization # MapReduce Binary Compatibility with hadoop-1.x # Substantial amount of integration testing with rest of projects in the ecosystem The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.1.0-beta-rc0/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
[jira] [Created] (HADOOP-9672) Upgrade Avro dependency
Sandy Ryza created HADOOP-9672: -- Summary: Upgrade Avro dependency Key: HADOOP-9672 URL: https://issues.apache.org/jira/browse/HADOOP-9672 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.0.5-alpha Reporter: Sandy Ryza Assignee: Sandy Ryza Hadoop still depends on Avro-1.5.3, when the latest release is 1.7.4. I've observed this cause problems when using Hadoop 2 with Crunch, which uses a more recent version of Avro. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Heads up: branch-2.1-beta
Ok, the last of the blockers is done. I'll roll an RC tonight. thanks, Arun On Jun 20, 2013, at 2:40 PM, Arun C Murthy wrote: > I think I've shared this before, but here you go again… > > http://s.apache.org/hadoop-2.1.0-beta-blockers > > At this point, HADOOP-9421 seems like the most important. > > thanks, > Arun > > On Jun 20, 2013, at 8:31 AM, Alejandro Abdelnur wrote: > >> Arun, >> >> It seems there are still a few things to iron out before getting 2.1 out of >> the door. >> >> As RM for the release, would you mind sharing the current state of things >> and your estimate on when it could happen? >> >> Thanks. >> >> >> On Wed, Jun 19, 2013 at 4:29 PM, Roman Shaposhnik wrote: >> >>> On Tue, Jun 18, 2013 at 11:58 PM, Arun C Murthy >>> wrote: Ping. Any luck? >>> >>> Unfortunately I've ran into: >>> https://issues.apache.org/jira/browse/HADOOP-9654 >>> >>> which was caused by the unrelated memory pressure on the NN, >>> but it had an unfortunate side effect of making the rest of the >>> testing stuck. I'll correct the problem now and re-run. >>> >>> Thanks, >>> Roman. >>> >> >> >> >> -- >> Alejandro > > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ > > -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
