Re: I am about to lose all my data please help

2014-03-23 Thread Fatih Haltas
No, not ofcourse I blinded it. On Wed, Mar 19, 2014 at 5:09 PM, praveenesh kumar praveen...@gmail.comwrote: Is this property correct ? property namefs.default.name/name value-BLANKED/value /property Regards Prav On Wed, Mar 19, 2014 at 12:58 PM, Fatih Haltas fatih.hal

Re: I am about to lose all my data please help

2014-03-19 Thread Fatih Haltas
?sortby=publicationDate which helps solving such type of problems as well. Best wishes Mirko 2014-03-16 9:07 GMT+00:00 Fatih Haltas fatih.hal...@nyu.edu: Dear All, I have just restarted machines of my hadoop clusters. Now, I am trying to restart hadoop clusters again, but getting error

Re: ERROR orm.ClassWriter: Cannot resolve SQL type 1111

2013-07-23 Thread Fatih Haltas
://docs.oracle.com/javase/6/docs/api/constant-values.html#java.sql.Types.OTHER On Mon, Jul 22, 2013 at 04:03:42PM +0400, Fatih Haltas wrote: Hi everyone, I am trying to import data from postgre to hdfs but unfortunately, I am taking this error. What should I do? I would be really obliged

Re: Data Import via Sqoop from Postgresql to HDFS

2013-07-22 Thread Fatih Haltas
argument --schema to specify schema other than the default public, for example: sqoop list-tables --connect ... -- --schema private_schema Jarcec On Sun, Jul 21, 2013 at 03:18:53PM +0400, Fatih Haltas wrote: Hi everyone, I had another problem while trying to import or list tables

Re: Data Import via Sqoop from Postgresql to HDFS

2013-07-22 Thread Fatih Haltas
Is there any --schema option to be able to list schemas other than public, because, I am not able to list other tables under non-public schemas? On Mon, Jul 22, 2013 at 12:39 PM, Fatih Haltas fatih.hal...@nyu.edu wrote: Hi Jarek, Thanks for your help. But I am using sqoop 1.4.3 but --schema

Listing spesific schema

2013-07-22 Thread Fatih Haltas
Finally I found the mails between Jarek and Vantesh true usage is sqoop import --connect jdbc:postgresql://192.168.194.158:5432/pgsql--username pgsql --password XXX -- --schema fatih As far as I read emails, it was a bug then solved by Vantesh, Thanks.

Data Import via Sqoop from Postgresql to HDFS

2013-07-21 Thread Fatih Haltas
Hi everyone, I had another problem while trying to import or list tables on postgresql via sqoop. I am using this command ./sqoop list-databases --connect jdbc:postgresql:// 192.168.194.158:5432/pgsql --username pgsql -P It does see only the tables under the public schema, other are not

Re: java.io.IOException: error=2, No such file or directory

2013-07-17 Thread Fatih Haltas
solved it? Thanks. Regards, Shahab On Tue, Jul 16, 2013 at 9:58 AM, Fatih Haltas fatih.hal...@nyu.eduwrote: Thanks Shahab, I solved my problem, in anyother way,

java.io.IOException: error=2, No such file or directory

2013-07-16 Thread Fatih Haltas
Hi everyone, I am trying to import data from postgresql to hdfs. But I am having some problems, Here is the problem details: Sqoop Version: 1.4.3 Hadoop Version:1.0.4 *1) When I use this command:* * * *./sqoop import-all-tables --connect jdbc:postgresql:// 192.168.194.158:5432/IMS --username

Re: java.io.IOException: error=2, No such file or directory

2013-07-16 Thread Fatih Haltas
Thanks Shahab, I solved my problem, in anyother way,

Sqoop and Hadoop

2013-07-10 Thread Fatih Haltas
Hi Everyone, I am trying to import data from postgresql to hdfs via sqoop, however, all examples, i got on internet is talking about hive,hbase etc. kind of system,running within hadoop. I am not using, any of these systems, isnt it possible to import data without having those kind of

Re: Sqoop and Hadoop

2013-07-10 Thread Fatih Haltas
-into-hadoop-hdfs Regards On Jul 10, 2013, at 9:59 AM, Fatih Haltas fatih.hal...@nyu.edu wrote: Hi Everyone, I am trying to import data from postgresql to hdfs via sqoop, however, all examples, i got on internet is talking about hive,hbase etc. kind of system,running within hadoop. I am

Sqoop Version for Hadoop 1.0.4

2013-07-08 Thread Fatih Haltas
Hi everyone, Does anybody know that which version of sqoop supports hadoop-1.0.4? Is sqoop true usage for importing data in PostgreSQL to hadoop? I will be really obliged if you can help me. Thank you very much.

Re: Sqoop Version for Hadoop 1.0.4

2013-07-08 Thread Fatih Haltas
What about Postgresql? Do you think that it differs? On Mon, Jul 8, 2013 at 2:04 PM, Fatih Haltas fatih.hal...@nyu.edu wrote: I just tried sqoop 1.4.3 with hadoop 1.0.4 and did some data import from mysql and it works. And other answer is enough for me. Thank you so much. On Mon, Jul 8

Re: Sqoop Version for Hadoop 1.0.4

2013-07-08 Thread Fatih Haltas
Thanks Nitin. I really appreciate your quick answers. On Mon, Jul 8, 2013 at 3:17 PM, Nitin Pawar nitinpawar...@gmail.com wrote: technically it should not make a difference as long as you have correct jdbc drivers on java classpath On Mon, Jul 8, 2013 at 4:44 PM, Fatih Haltas fatih.hal

2 Reduce method in one Job

2013-03-24 Thread Fatih Haltas
I want to get reduce output as key and value then I want to pass them to a new reduce as input key and input value. So is there any Map-Reduce-Reduce kind of method? Thanks to all.

Re: 2 Reduce method in one Job

2013-03-24 Thread Fatih Haltas
://incubator.apache.org/projects/tez.html soon. Meanwhile, you can read the proposal behind this project at http://wiki.apache.org/incubator/TezProposal. Initial sources are at https://svn.apache.org/repos/asf/incubator/tez/trunk/. On Sun, Mar 24, 2013 at 6:33 PM, Fatih Haltas fatih.hal...@nyu.edu

Re: Combiner in Secondary Sort

2013-03-21 Thread Fatih Haltas
is at http://search-hadoop.com/m/RH5AP11ob2o1. On Wed, Mar 20, 2013 at 6:10 PM, Fatih Haltas fatih.hal...@nyu.edu wrote: Hi Everyone, I am trying to implement Secondary Sort Algorithm on mydata. But I am having a trouble with my Combiner. When I donot use Combiner, grouping is done well

Combiner in Secondary Sort

2013-03-20 Thread Fatih Haltas
Hi Everyone, I am trying to implement Secondary Sort Algorithm on mydata. But I am having a trouble with my Combiner. When I donot use Combiner, grouping is done well, I mean one reduce task is running for every pair, sharing the same first element. However, when I set Combiner as Reducer class

Multiple outputs

2013-03-12 Thread Fatih Haltas
Hi Everyone, I would like to have 2 different output (having different columns of a same input text file.) When I googled a bit, I got multipleoutputs classes, is this the common way of doing it or is there any way to create contextiterable kind of things/is there context array/is it possible to

Re: Need help optimizing reducer

2013-03-05 Thread Fatih Haltas
Hi Austin, I am not sure whether you had this kind of mistake or not but in any case, I would like to state: that you might be trying to read whole input values,(corresponding key values) to reducer function from beginning to end(which is the output value of mapper) while merging them into one

Re: Need help optimizing reducer

2013-03-05 Thread Fatih Haltas
I mean, while trying to add newcoming reducer input value to already merged input values,to construct whole input values of corresponding key value to reducer, you might be reading every input values(which are output value of mapper) from beginning to end. On Tue, Mar 5, 2013 at 1:46 PM, Fatih

Re: WholeFileInputFormat with streaming

2013-03-02 Thread Fatih Haltas
Hi Ring, Can you write output of jar tf filename command to see package organization of jar, you created? 2 Mart 2013 Cumartesi tarihinde springring adlı kullanıcı şöyle yazdı: Hi, I want to use: hadoop jar my dir/hadoop-streaming-0.20.2-cdh3u3.jar -inputformat

java.lang.NumberFormatException and Thanks to Hemanth and Harsh

2013-02-26 Thread Fatih Haltas
Hi all, First, I would like to thank you all, espacially to Hemanth and Harsh. I solved my problem, this was exactly the about java version and hadoop version incompatibility, now, I can run my compiled and jarred MapReduce program. I have a different question now. I created a code, finding the

Fwd: Trouble in running MapReduce application

2013-02-24 Thread Fatih Haltas
| grep version minor version: 0 major version: 50 Please paste the output of this - we can verify what the problem is. Thanks Hemanth On Sat, Feb 23, 2013 at 4:45 PM, Fatih Haltas fatih.hal...@nyu.eduwrote: Hi again, Thanks for your help but now, I am struggling with the same

childerror

2013-02-24 Thread Fatih Haltas
I am always getting the Child Error, I googled but I could not solve the problem, did anyone encounter with same problem before? [hadoop@ADUAE042-LAP-V conf]$ hadoop jar /home/hadoop/project/hadoop-1.0.4/hadoop-examples-1.0.4.jar aggregatewordcount /home/hadoop/project/hadoop-data/NetFlow

ClassNotFoundException in Main

2013-02-19 Thread Fatih Haltas
Hi everyone, I know this is the common mistake to not specify the class adress while trying to run a jar, however, although I specified, I am still getting the ClassNotFound exception. What may be the reason for it? I have been struggling for this problem more than a 2 days. I just wrote

Trouble in running MapReduce application

2013-02-19 Thread Fatih Haltas
Hi everyone, I know this is the common mistake to not specify the class adress while trying to run a jar, however, although I specified, I am still getting the ClassNotFound exception. What may be the reason for it? I have been struggling for this problem more than a 2 days. I just wrote

Re: ClassNotFoundException in Main

2013-02-19 Thread Fatih Haltas
(java.lang.Class) On Tuesday, February 19, 2013, Fatih Haltas wrote: Hi everyone, I know this is the common mistake to not specify the class adress while trying to run a jar, however, although I specified, I am still getting the ClassNotFound exception. What may be the reason for it? I have

Re: ClassNotFoundException in Main

2013-02-19 Thread Fatih Haltas
to reflect the right package structure. Also, the error you are getting seems to indicate that you aphave compiled using Jdk 7. Note that some versions of Hadoop are supported only on Jdk 6. Which version of Hadoop are you using. Thanks Hemanth On Tuesday, February 19, 2013, Fatih Haltas