Re: unsubscribe

[Tushar Kapila]

Hello

Please stop spamming all of us. If you want to unsubscribe, your software
folks, Google the instructions and follow it.

*Instructions for this group, to unsubscribe is to send an email to :
user-unsubscr...@hadoop.apache.org *

You do not need to also email all of us by marking this group.

Thank you

On Mon, 30 Jan, 2023, 17:00 Destin Ashwin,  wrote:

> unsubscribe
>
> On Mon, 30 Jan, 2023, 4:58 pm Lake Chang,  wrote:
>
>> unsubscribe
>>
>

Re: Running pig script on a remote cluster

[Tushar Kapila]

Depends on what the script does? Of it's launching a job on a remote
cluster then yes.

Bit of script does something more and needs to run for longer than no.

But if script it on a remote system, not what you asked but an alternative
see
https://stackoverflow.com/questions/39574653/error-executing-pigserver-in-java

On Sat, 15 Feb, 2020, 19:16 Daniel Santos,  wrote:

> Hello,
>
> What I was thinking was : launching the pig script on my laptop, the
> hadoop cluster would be left executing it, and I could shut down the laptop.
>
> Is this possible ?
>
> Thanks,
> Regards
>
> On 12 Feb 2020, at 02:06, Shashwat Shriparv 
> wrote:
>
> nohup  &
>
>
> *Warm Regards,*
> *Shashwat Shriparv*
> *http://bit.ly/14cHpad  *
>
> *http://goo.gl/rxz0z8 *
> *http://goo.gl/RKyqO8 *
> http://helpmetocode.blogspot.in/
> http://photoinfinity.blogspot.in/
> http://writingishabit.blogspot.in/
> http://realiq.blogspot.in/
> http://sshriparv.blogspot.in/
> https://goo.gl/M8Us3B
> https://goo.gl/nrI2mv
> https://500px.com/shriparv
> https://www.flickr.com/photos/55141469@N02/
> https://about.me/shriparv
> ISBN - 10: 1783985941
> ISBN - 13: 9781783985944
> [image: https://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]
> [image:
> https://twitter.com/shriparv] [image:
> https://www.facebook.com/shriparv] [image:
> http://google.com/+ShashwatShriparv] 
> [image:
> http://www.youtube.com/user/sShriparv/videos]
> [image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] 
>
>
>
> On Wed, 12 Feb 2020 at 04:48, Daniel Santos  wrote:
>
>> Hello,
>>
>> I managed to create a properties file with the following contents :
>>
>> fs.defaultFS=hdfs://hadoopnamenode:9000
>> mapreduce.framework.name=yarn
>> yarn.resourcemanager.address=hadoopresourcemanager:8032
>>
>> It is now submitting the jobs to the cluster. I also set the HADOOP_HOME
>> on my laptop to point to the same version of hadoop that is running on the
>> cluster (2.7.0). I am running pig version  0.17
>>
>> Then a main class not found error happened on the yarn nodes where the
>> job was scheduled to run. I had to add the following to yarn-site.xml and
>> restart yarn and the nodes :
>>
>> 
>> mapreduce.application.classpath
>>
>> /home/hadoop/hadoop-2.7.0/share/hadoop/mapreduce/*,/home/hadoop/hadoop-2.7.0/share/hadoop/mapreduce/lib/*,/home/hadoop/hadoop-2.7.0/share/hadoop/common/*,/home/hadoop/hadoop-2.7.0/share/hadoop/common/lib/*,/home/hadoop/hadoop-2.7.0/share/hadoop/yarn/*,/home/hadoop/hadoop-2.7.0/share/hadoop/yarn/lib/*,/home/hadoop/hadoop-2.7.0/share/hadoop/hdfs/*,/home/hadoop/hadoop-2.7.0/share/hadoop/hdfs/lib/*
>> 
>>
>> After this change, the script ran. But the pig command only returned
>> after the job finished.
>> Does anyone know how to launch the script and exit immediately to the
>> shell ?
>> If the job takes a long time I will have to keep the terminal open.
>>
>> Thanks,
>> Regards
>>
>>
>> > On 11 Feb 2020, at 05:25, Vinod Kumar Vavilapalli 
>> wrote:
>> >
>> > It’s running the job in local mode (LocalJobRunner), that’s why. Please
>> check your configuration files and make sure that the right directories are
>> on the classpath. Also look in mapred-site.xml for
>> mapreduce.framework.name (should be yarn).
>> >
>> > Thanks
>> > +Vinod
>> >
>> >> On Feb 11, 2020, at 2:09 AM, Daniel Santos 
>> wrote:
>> >>
>> >> Hello all,
>> >>
>> >> I have developed a script in my laptop. The script is now ready to be
>> unleashed in a non secured cluster.
>> >> But when I do : pig -x mapreduce 

Re: Hetergeneous Hadoop Cluster

[Tushar Kapila]

Would only matter if OS specific communication was being used between
nodes. I assume they do not do that.
If that is true -> It would depend on the network and each nodes config for
the work it is doing. Cluster performance would not suffer just because it
is heterogeneous.

On Mon, Sep 21, 2015 at 8:09 PM, Ashish Kumar9  wrote:

> Hi :
>
> Has anyone tried a heterogeneous hadoop cluster with management nodes and
> data nodes running on multiple linux distros. and on multiple h/w
> architecture .
>
> If so , what is the performance of such cluster .
>
> Thanks
> Ashish




-- 
Regards
Tushar Kapila