Lock in_use.lock failed when using nfs in namenode

2011-06-26 Thread 吕鹏
Hi I want to use nfs to save a copy of the data in namenode, and the nfs dir /mnt/nfs/dfs/ can be read and written. Things seem to be right, but when i format the hdfs, ERROR common.Storage: Cannot create lock on /mnt/nfs/dfs/name/in_use.lock occur. how to solve the problem? Peng

Re: How to configure a multi-tenancy hadoop cluster?

2011-06-26 Thread 俊平堵
The problem is fixed after chmod 777 to /user directory. Thanks. Best Regards, J.P 在 2011年6月25日 下午12:26,俊平堵 dujunp...@gmail.com写道: Hello Harsh, Thanks for your suggestion here. I modified the /tmp to 777, and something different error happens there: 11/06/26 11:13:42 INFO

Re: Eclipse plugin

2011-06-26 Thread clakshminarasu
Hi, I am new to this Hadoop programming. I tried downloading the vm ware appliance and Eclipse/Hadoop plugin. I got the same error while configuring the eclipse plugin for Hadoop DFS. I started by configuring the VM Ware server formation; entered the IP address that appeared in the appliance.

Framework for global optimization

2011-06-26 Thread Tim Shephard
Are there any good frameworks for performing and perhaps visualizing global optimization such as simulated annealing?

Re: Queue support from HDFS

2011-06-26 Thread Bharath Mundlapudi
One solution i am thinking is lets say you have Kafka or some JMS implementation where your job client is subscribed to and submits job dynamically based on queue input size. You may need to run final job to combine them all. -Bharath From: Saumitra

Re: Comparing two logs, finding missing records

2011-06-26 Thread Bharath Mundlapudi
If you have Serde or PigLoader for your log format, probably Pig or Hive will be a quicker solution with the join. -Bharath From: Mark Kerzner markkerz...@gmail.com To: Hadoop Discussion Group core-u...@hadoop.apache.org Sent: Saturday, June 25, 2011 9:39 PM

Re: Comparing two logs, finding missing records

2011-06-26 Thread Mark Kerzner
Interesting, Bharath, I will look at these. Mark On Sun, Jun 26, 2011 at 5:12 PM, Bharath Mundlapudi bharathw...@yahoo.comwrote: If you have Serde or PigLoader for your log format, probably Pig or Hive will be a quicker solution with the join. -Bharath

Re: Eclipse plugin

2011-06-26 Thread Jack Ye
I found that Hadoop 0.20.2 and eclipse Helios can work correctly. It's really hard to make them work together properly. clakshminarasu clakshminar...@gmail.com编写: Hi, I am new to this Hadoop programming. I tried downloading the vm ware appliance and Eclipse/Hadoop plugin. I got the same error

Re: Comparing two logs, finding missing records

2011-06-26 Thread Mark Kerzner
Bharath, how would a Pig query look like? Thank you, Mark On Sun, Jun 26, 2011 at 5:12 PM, Bharath Mundlapudi bharathw...@yahoo.comwrote: If you have Serde or PigLoader for your log format, probably Pig or Hive will be a quicker solution with the join. -Bharath

Re: Comparing two logs, finding missing records

2011-06-26 Thread Bharath Mundlapudi
SQL: SELECT * FROM LOG1 LEFT OUTER JOIN LOG2 ON LOG1.recordid = LOG2.recordid; PIG: data = JOIN LOG1 BY recordid LEFT OUTER, LOG2 BY recordid; DUMP data; If you need more PIG help, please post in PIG email alias. -Bharath From: Mark Kerzner