Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread Ted Yu
Have you considered using Apache Phoenix ? That way all your data is stored in one place. See http://phoenix.apache.org/ Cheers On Tue, Feb 3, 2015 at 6:44 PM, 임정택 kabh...@gmail.com wrote: Hello all. We're periodically scan HBase tables to aggregate statistic information, and store it to

Re: Re: Can not start HA namenode with security enabled

2015-02-04 Thread daemeon reiydelle
No Kerberos TGT was issued. This looks like an auth issue to Kerberos for e.g. user hadoop. Check your Kerb server. *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of

Re: Simple example for Cluster configuration of Hadoop 2.6.0

2015-02-04 Thread Frank Lanitz
Am 04.02.2015 um 15:01 schrieb Andre Kelpe: See here: https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/ClusterSetup.html This is not simple. This is just giving a newbie a headache. Cheers, Frank

Re: Simple example for Cluster configuration of Hadoop 2.6.0

2015-02-04 Thread Telles Nobrega
Agreed Frank Lanitz. The link I sent is very helpful and worked with just few changes. On Wed Feb 04 2015 at 15:11:31 Frank Lanitz frank.lan...@sql-ag.de wrote: Am 04.02.2015 um 15:01 schrieb Andre Kelpe: See here: https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/

Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread daemeon reiydelle
Null map step (at a guess?), 3 step reduce. No problem. Suspect 3 may be rather long running? *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used

Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread 임정택
Yes, it takes more than 10 hours in per CP. And we don't have enough resource to run all regions concurrently, it needs about one day to complete. On 2015년 2월 5일 (목) at 오전 4:51 daemeon reiydelle daeme...@gmail.com wrote: Null map step (at a guess?), 3 step reduce. No problem. Suspect 3 may be

Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread daemeon reiydelle
I see this frequently as long runninng output phase to relational db's. So your experience is reasonable. Sometimes it is possible to partition the mysequel table, but if you need agreggates over the whole, you are sort of stuck. (Good luck, may your business case never require you to run a

Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread Ted Yu
bq. Can Oozie handle this workflow? I think so. Better confirm on oozie mailing list. Cheers On Wed, Feb 4, 2015 at 2:30 PM, 임정택 kabh...@gmail.com wrote: This cluster is in service for manipulating OLTP (HBase), so I'm finding simpler solution which may not required to modify cluster. Can

Re: Can I configure multiple M/Rs and normal processes to one workflow?

2015-02-04 Thread 임정택
This cluster is in service for manipulating OLTP (HBase), so I'm finding simpler solution which may not required to modify cluster. Can Oozie handle this workflow? On 2015년 2월 5일 (목) at 오전 5:03 Ted Yu yuzhih...@gmail.com wrote: Have you considered using Apache Phoenix ? That way all your data

Unsubscribe

2015-02-04 Thread Himanshu Vijay
Unsubscribe

Re: Unsubscribe

2015-02-04 Thread Ted Yu
See hadoop.apache.org/mailing_lists.html#User On Wed, Feb 4, 2015 at 2:27 PM, Himanshu Vijay himansh...@gmail.com wrote: Unsubscribe

Acl property not working - reg

2015-02-04 Thread kumar r
Hi, I am using hadoop-2.6.0 enabled with kerberos and ldap with Active Directory in Windows. I have tested some ACL property. Below property is not working for me. security.job.client.protocol.acl security.admin.operations.protocol.acl I have set true for the following properties but still

Re: Compilation failing for AuthenticatedURL (no suitable constructor found) Hadoop 2.6.0

2015-02-04 Thread Venkat Ramakrishnan
I need to compile Hadoop, and I am not able to figure out why this error is occuring. Can someone please help? Thanks, Venkat. On Fri, Dec 26, 2014 at 10:48 AM, Venkat Ramakrishnan venkat.archit...@gmail.com wrote: Forgot to mention that I'm on Windows 7. Thx, Venkat. On Fri, Dec 26,

Re: Application Master fails due to Invalid AMRM token

2015-02-04 Thread bharath vissapragada
Might be this https://issues.apache.org/jira/browse/YARN-2964. This bug was injected due https://issues.apache.org/jira/browse/YARN-2704. On Thu, Feb 5, 2015 at 1:04 PM, Rahul Chhiber rahul.chhi...@cumulus-systems.com wrote: Hi all, I am running a Hadoop cluster of 4 nodes (Hadoop 2.6).

Re:Re: Re: Can not start HA namenode with security enabled

2015-02-04 Thread 郝东
Hi, Manoj and Daemeon I have figured it out. The cause lies in the SPNEGO principal name. I use 'http/_h...@bgdt.dev.hrb', not the 'HTTP/_h...@bgdt.dev.hrb'. I did not that the SPNEGO principal name must use the capitalized HTTP before. Thanks all the same. At 2015-02-05 04:10:18, daemeon

Application Master fails due to Invalid AMRM token

2015-02-04 Thread Rahul Chhiber
Hi all, I am running a Hadoop cluster of 4 nodes (Hadoop 2.6). I am facing an irregular error, relating to an Invalid AMRM token that causes my YARN application to crash anytime from 1 day up to a week after starting. Application launches successfully and runs for a period of time which is not

Re: QueueMetrics.AppsKilled/Failed metrics and failure reasons

2015-02-04 Thread Suma Shivaprasad
Thanks for your inputs. The cluster Metrics API is giving correct numbers for the failed/killed apps and is matching with the RM audit logs and we are planning to use that instead. Suma On Wed, Feb 4, 2015 at 12:04 PM, Rohith Sharma K S rohithsharm...@huawei.com wrote: There are several ways

Re: Simple example for Cluster configuration of Hadoop 2.6.0

2015-02-04 Thread Telles Nobrega
Fernando Carvalho, I recently had the same problem you are having. I first tried using the hadoop tutorial but I had no success. This link https://raseshmori.wordpress.com/2012/10/14/install-hadoop-nextgen-yarn-multi-node-cluster/ was very helpful and my cluster is running without a problem

Fwd: Simple example for Cluster configuration of Hadoop 2.6.0

2015-02-04 Thread Fernando Carvalho
Dear Hadoop users, I would like to know if some have an simple example of how to setup Hadoop 2.6.0 in Cluster mode. I'm googling for this, but I'm only able to find examples for earlier versions of Hadoop which are not fully compatible with the current. Can someone help me? -- Fernando

Re: Simple example for Cluster configuration of Hadoop 2.6.0

2015-02-04 Thread Andre Kelpe
See here: https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/ClusterSetup.html - André On Wed, Feb 4, 2015 at 2:47 PM, Fernando Carvalho fernandocarvalhocoe...@gmail.com wrote: Dear Hadoop users, I would like to know if some have an simple example of how to setup Hadoop