A basic question-Hadoop input from memory

2010-09-15 Thread lamchith.chathukutty
Hi,



A basic question. The input for the map program is usually from the a
file in HDFS. Is it possible to use input from memory, like from a xml
dom constructed in memory from by Dom pareser ?



Thanks in advance.



Regards,

Lamchith




Please do not print this email unless it is absolutely necessary. 

The information contained in this electronic message and any attachments to 
this message are intended for the exclusive use of the addressee(s) and may 
contain proprietary, confidential or privileged information. If you are not the 
intended recipient, you should not disseminate, distribute or copy this e-mail. 
Please notify the sender immediately and destroy all copies of this message and 
any attachments. 

WARNING: Computer viruses can be transmitted via email. The recipient should 
check this email and any attachments for the presence of viruses. The company 
accepts no liability for any damage caused by any virus transmitted by this 
email. 

www.wipro.com


RE: Hadoop and BDB Java edition

2010-04-09 Thread lamchith.chathukutty
Hi Sagar,

Thank you for your reply.

I have seen that and it is not suited for me. It is talking about creating read 
only store using hadoop. What i want to know whether the same can be done for 
BDB JE, ie creating the .BDB file using Hadoop.

I am aware that the following issues are there if you are going to use BDB JE 
API.

com.sleepycat.je.Environment which needs File to be given as an input.
So that the location of the database can be given.
But in the HDFS org.apache.hadoop.fs.Path is used to give location of the .index
and .data files for readonly store as given the below mentioned link.

Regards,

Lamchith



From: Sagar Shukla [mailto:sagar_shu...@persistent.co.in]
Sent: Fri 4/9/2010 12:14 PM
To: common-user@hadoop.apache.org
Subject: RE: Hadoop and BDB Java edition



Hi Lamchith,
 There are couple of direct solutions available for Voldemort and Hadoop 
integration e.g. 
http://project-voldemort.com/blog/2009/06/voldemort-and-hadoop/ . This does not 
require BDB Java edition.

Does this help for your project ?

Thanks,
Sagar

-Original Message-
From: lamchith.chathuku...@wipro.com [mailto:lamchith.chathuku...@wipro.com]
Sent: Friday, April 09, 2010 10:40 AM
To: common-user@hadoop.apache.org
Subject: Hadoop and BDB Java edition

Is it advisable to create the BDB file of BDB Java edition using Hadoop?
I know that read only store data and index files for Voldemort can be
generated using Hadoop. As we are using BDB rather than read only store
for  voldemort I have this requirement.



Regards,

Lamchith




Please do not print this email unless it is absolutely necessary.

The information contained in this electronic message and any attachments to 
this message are intended for the exclusive use of the addressee(s) and may 
contain proprietary, confidential or privileged information. If you are not the 
intended recipient, you should not disseminate, distribute or copy this e-mail. 
Please notify the sender immediately and destroy all copies of this message and 
any attachments.

WARNING: Computer viruses can be transmitted via email. The recipient should 
check this email and any attachments for the presence of viruses. The company 
accepts no liability for any damage caused by any virus transmitted by this 
email.

www.wipro.com

DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.



Please do not print this email unless it is absolutely necessary. 

The information contained in this electronic message and any attachments to 
this message are intended for the exclusive use of the addressee(s) and may 
contain proprietary, confidential or privileged information. If you are not the 
intended recipient, you should not disseminate, distribute or copy this e-mail. 
Please notify the sender immediately and destroy all copies of this message and 
any attachments. 

WARNING: Computer viruses can be transmitted via email. The recipient should 
check this email and any attachments for the presence of viruses. The company 
accepts no liability for any damage caused by any virus transmitted by this 
email. 

www.wipro.com