+1 (non-binding)
- Built source- Deployed a single node cluster- Ran a sample streaming job- Ran
basic hadoop fs commands.
Thanks Junping!Regards,Kuhu
On Tuesday, February 9, 2016 8:46 AM, Wangda Tan <wheele...@gmail.com>
wrote:
+1 (binding)
- Deployed a local cluster.
- Configured node labels on queues/nodes.
* Run job with node labels successfully.
Regards,
Wangda
On Tue, Feb 9, 2016 at 10:36 PM, Wangda Tan <wheele...@gmail.com> wrote:
> Hi Eric,
>
> replaceLabelsOnNode CLI syntax is different between 2.6 and 2.7.
>
> As mentioned by Naga, In 2.6, you should use "node1<:port>,label
> node2,label ..."
> And in 2.7, you can use either "," or "=" to separate host and label.
>
> So 2.7 is backward-compatible to 2.6, but it's not guaranteed that 2.7's
> CLI works on 2.6.
>
> Please let me know if you have any concern for this.
>
> Thanks,
> Wangda
>
> On Tue, Feb 9, 2016 at 4:19 AM, Eric Payne <
> eric.payne1...@yahoo.com.invalid> wrote:
>
>> Naganarasimha Garla, thanks for the reply.
>>
>> Yes, I used the node ID. I did not include a port. Here are the steps I
>> used, which work for me on 2.7:
>>
>> - yarn rmadmin -addToClusterNodeLabels abc
>> - yarn rmadmin -replaceLabelsOnNode hostname.company.com=abc
>> - configure queue properties as appropriate
>> - yarn rmadmin -refreshQueues
>>
>> As I say, this works for me when I try it on 2.7 and later. It's probably
>> something with my environment. I will continue to look into it.
>>
>> Thanks for your help
>> -Eric
>>
>>
>> ________________________________
>> From: Naganarasimha Garla <naganarasimha...@gmail.com>
>> To: mapreduce-...@hadoop.apache.org; Eric Payne <eric.payne1...@yahoo.com
>> >
>> Cc: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>; "
>> hdfs-...@hadoop.apache.org" <hdfs-...@hadoop.apache.org>; "
>> yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org>
>> Sent: Monday, February 8, 2016 1:01 PM
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.4 RC0
>>
>>
>>
>> +1 (non binding)
>>
>> * Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
>> install, and verified the MD5 checksum
>>
>> * Did a Pseudo cluster and tested basic hdfs operations
>> * Ran sleep job and Pi job
>> * Added node label and ran job under the label by configuring
>> default-node-label-expression and it ran fine
>>
>> Eric Payne,
>> Hope you tried adding/replacing the labels using NodeId/Node Address and
>> not the HTTP address!
>> I executed the following command to configure the label and node
>> "./yarn rmadmin -replaceLabelsOnNode "localhost:43795,test1" "
>> After this was able to submit the job for a label
>>
>> Regards,
>> + Naga
>>
>>
>> On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne
>> <eric.payne1...@yahoo.com.invalid> wrote:
>>
>> Hi Junping Du. Thank you for your work preparing this release.
>> >I did the following things to test release Hadoop 2.6.4 rc0:- Downloaded
>> hadoop-2.6.4-RC0-src.tar.gz- built from source both package, install, and
>> eclipse:eclipse- Set up a 3-node, unsecured cluster with 3 queues, one of
>> which has preemption enabled- Ran a successful test to ensure that
>> preemption would happen to containers on the preemptable queue if they were
>> needed for an application on another queue.- Ran successful streaming and
>> yarn shell tests
>> >Junping, I did have a concern about labelled nodes and queues. Is full
>> label support backported to 2.6.4? I see that the syntax for the rmadmin
>> command lists label commands like -addToClusterNodeLabels and
>> -replaceLabelsOnNode. I was able to add a label (using
>> -addToClusterNodeLabels) and I was able to define a queue whose accessible
>> node label was listed with my specified label. However, when I tried to set
>> the node label to a specific node using -replaceLabelsOnNode, the label
>> does not show up on the specified node in cluster nodes UI (
>> http://RM:8088/cluster/nodes). I also confirmed that submitting a job to
>> the labelled queue gets accepted but never runs, which is the behavior I
>> would expect if no node had the specified label. I will also add that this
>> procedure works fine in 2.7.
>> >Thanks,-Eric Payne
>> >
>> > From: Junping Du <j...@hortonworks.com>
>> > To: "hdfs-...@hadoop.apache.org" <hdfs-...@hadoop.apache.org>; "
>> yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org>; "
>> mapreduce-...@hadoop.apache.org" <mapreduce-...@hadoop.apache.org>; "
>> common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
>> > Sent: Wednesday, February 3, 2016 1:01 AM
>> > Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
>> >
>> >
>> >Hi community folks,
>> > I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
>> maintenance release to follow up 2.6.3.) according to email thread of
>> release plan 2.6.4 [1]. Below is details of this release candidate:
>> >
>> >The RC is available for validation at:
>> >*http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
>> ><http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/>*
>> >
>> >The RC tag in git is: release-2.6.4-RC0
>> >
>> >The maven artifacts are staged via repository.apache.org at:
>> >*
>> https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
>> ><
>> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
>> >*
>> >
>> >You can find my public key at:
>> >http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> >Please try the release and vote. The vote will run for the usual 5 days.
>> >
>> >Thanks!
>> >
>> >
>> >Cheers,
>> >
>> >Junping
>> >
>> >
>> >[1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
>> >
>> >
>> >
>>
>
>
