Re: Two simple question about hadoop 2

2013-07-21 Thread Harsh J
Hi, On Mon, Jul 22, 2013 at 7:26 AM, Yexi Jiang wrote: > Hi, all, > > I have two simple questions about hadoop 2 (or YARN). > 1. When will the stable version of hadoop 2.x come out? No fixed date yet, but probably later this year. There is a formal beta that should release soon (2.1.0-beta), whi

Two simple question about hadoop 2

2013-07-21 Thread Yexi Jiang
Hi, all, I have two simple questions about hadoop 2 (or YARN). 1. When will the stable version of hadoop 2.x come out? 2. We currently have a cluster deployed with hadoop 1.x, is there any way to upgrade it to hadoop 2.x without damaging the existing data in current HDFS? Thank you very much! Re

Re: Running hadoop for processing sources in full sky maps

2013-07-21 Thread Jens Scheidtmann
Dear Andrea, you write: a few tenth of sky maps, each 600 MB = some TB. a few thousand sources, lat/long for each = let's say 10k = 1 MB. Sounds to me, like you should turn your problem around: - Distribute your sources. - work on chunks of your sky maps files. - search for sources fully covered

Data Import via Sqoop from Postgresql to HDFS

2013-07-21 Thread Fatih Haltas
Hi everyone, I had another problem while trying to import or list tables on postgresql via sqoop. I am using this command ./sqoop list-databases --connect jdbc:postgresql:// 192.168.194.158:5432/pgsql --username pgsql -P It does see only the tables under the public schema, other are not listed.