I want to get reduce output as key and value then I want to pass them to a
new reduce as input key and input value.
So is there any Map-Reduce-Reduce kind of method?
Thanks to all.
; should hopefully appear at
> http://incubator.apache.org/projects/tez.html soon. Meanwhile, you can
> read the proposal behind this project at
> http://wiki.apache.org/incubator/TezProposal. Initial sources are at
> https://svn.apache.org/repos/asf/incubator/tez/trunk/.
>
> On Sun, Mar 24,
Hi everyone,
Does anybody know that which version of sqoop supports hadoop-1.0.4?
Is sqoop true usage for importing data in PostgreSQL to hadoop?
I will be really obliged if you can help me.
Thank you very much.
itional databases.
> Please let us know if you run into any issues related to hadoop on this
> email list.
>
> for sqoop related issues you can send a mail to sqoop user list.
>
>
> On Mon, Jul 8, 2013 at 2:06 PM, Fatih Haltas wrote:
>
>> Hi everyone,
>>
>>
What about Postgresql? Do you think that it differs?
On Mon, Jul 8, 2013 at 2:04 PM, Fatih Haltas wrote:
> I just tried sqoop 1.4.3 with hadoop 1.0.4 and did some data import from
> mysql and it works.
>
> And other answer is enough for me.
>
> Thank you so much.
>
>
Thanks Nitin. I really appreciate your quick answers.
On Mon, Jul 8, 2013 at 3:17 PM, Nitin Pawar wrote:
> technically it should not make a difference as long as you have correct
> jdbc drivers on java classpath
>
>
> On Mon, Jul 8, 2013 at 4:44 PM, Fatih Haltas wrote:
Hi Everyone,
I am trying to import data from postgresql to hdfs via sqoop, however, all
examples, i got on internet is talking about hive,hbase etc. kind of
system,running within hadoop.
I am not using, any of these systems, isnt it possible to import data
without having those kind of systems,run
porting-postgres-data-into-hadoop-hdfs
>
> Regards
>
> On Jul 10, 2013, at 9:59 AM, Fatih Haltas wrote:
>
> > Hi Everyone,
> >
> > I am trying to import data from postgresql to hdfs via sqoop, however,
> all examples, i got on internet is talking about hive,hbase
Hi everyone,
I am trying to import data from postgresql to hdfs. But I am having some
problems, Here is the problem details:
Sqoop Version: 1.4.3
Hadoop Version:1.0.4
*1) When I use this command:*
*
*
*./sqoop import-all-tables --connect jdbc:postgresql://
192.168.194.158:5432/IMS --username pg
Thanks Shahab, I solved my problem, in anyother way,
Thanks.
>
> Regards,
> Shahab
>
>
> On Tue, Jul 16, 2013 at 9:58 AM, Fatih Haltas wrote:
>
>> Thanks Shahab, I solved my problem, in anyother way,
>>
>
>
Hi everyone,
I had another problem while trying to import or list tables on postgresql
via sqoop.
I am using this command
./sqoop list-databases --connect jdbc:postgresql://
192.168.194.158:5432/pgsql --username pgsql -P
It does see only the tables under the public schema, other are not listed.
--schema to specify schema other than
> the default "public", for example:
>
> sqoop list-tables --connect ... -- --schema private_schema
>
> Jarcec
>
> On Sun, Jul 21, 2013 at 03:18:53PM +0400, Fatih Haltas wrote:
> > Hi everyone,
> >
> > I ha
Is there any --schema option to be able to list schemas other than public,
because, I am not able to list other tables under non-public schemas?
On Mon, Jul 22, 2013 at 12:39 PM, Fatih Haltas wrote:
> Hi Jarek,
>
> Thanks for your help. But I am using sqoop 1.4.3 but --schema ve
Finally I found the mails between Jarek and Vantesh true usage is
sqoop import --connect
jdbc:postgresql://192.168.194.158:5432/pgsql--username pgsql
--password XXX -- --schema fatih
As far as I read emails, it was a bug then solved by Vantesh, Thanks.
t;
> Jarcec
>
> Links:
> 1:
> http://docs.oracle.com/javase/6/docs/api/constant-values.html#java.sql.Types.OTHER
>
> On Mon, Jul 22, 2013 at 04:03:42PM +0400, Fatih Haltas wrote:
> > Hi everyone,
> >
> > I am trying to import data from postgre to hdfs but unfortuna
I think, he just wants to learn the approximate storage capacity of each
datanode that he should configure , 1 PB is just a made up amount of
storage, I guess. Probably, in my opinion, he already knows that even not
caring hadoop, this is too much for any server, but he made just a made up
mistake
Hi everyone,
I know this is the common mistake to not specify the class adress while
trying to run a jar, however,
although I specified, I am still getting the ClassNotFound exception.
What may be the reason for it? I have been struggling for this problem more
than a 2 days.
I just wrote differen
Hi everyone,
I know this is the common mistake to not specify the class adress while
trying to run a jar, however,
although I specified, I am still getting the ClassNotFound exception.
What may be the reason for it? I have been struggling for this problem more
than a 2 days.
I just wrote differen
Api setJarByClass in your main program?
>
>
> http://hadoop.apache.org/docs/r1.0.4/api/org/apache/hadoop/mapreduce/Job.html#setJarByClass(java.lang.Class)
>
>
> On Tuesday, February 19, 2013, Fatih Haltas wrote:
>
>> Hi everyone,
>>
>> I know this is the common mis
cs/r1.0.4/api/org/apache/hadoop/mapreduce/Job.html#setJarByClass(java.lang.Class)
>>
>> On Tuesday, February 19, 2013, Fatih Haltas wrote:
>>
>>> Hi everyone,
>>>
>>> I know this is the common mistake to not specify the class adress while
>>> trying to
F/
> META-INF/MANIFEST.MF
> org/
> org/myorg/
> org/myorg/WordCount.class
> org/myorg/WordCount$TokenizerMapper.class
> org/myorg/WordCount$IntSumReducer.class
>
> On Tue, Feb 19, 2013 at 9:29 PM, Fatih Haltas
> wrote:
> > Hi everyone,
> >
> > I know this
;
> On Tuesday, February 19, 2013, Fatih Haltas wrote:
>
> Thank you very much.
> When i tried with wordcount_classes.org.myorg.WordCount, I am getting the
> following error:
>
> [hadoop@ADUAE042-LAP-V project]$ hadoop jar wordcount_19_02.jar
> wordcount_classes.org.m
; >
> > The new error usually happens if you compile using Java 7 and try to
> > run via Java 6 (for example). That is, an incompatibility in the
> > runtimes for the binary artifact produced.
> >
> > On Tue, Feb 19, 2013 at 10:09 PM, Fatih Haltas
> wrote:
>
er? (Hadoop version and java
version)
Thank you very much.
On Tue, Feb 19, 2013 at 10:26 PM, Fatih Haltas wrote:
> Thank you all very much
>
> 19 Şubat 2013 Salı tarihinde Harsh J adlı kullanıcı şöyle yazdı:
>
>> Oops. I just noticed Hemanth has been answering on a dupe thread as
y class:
>
> $ javap -verbose WCMapper | grep version
> minor version: 0
> major version: 50
>
> Please paste the output of this - we can verify what the problem is.
>
> Thanks
> Hemanth
>
>
> On Sat, Feb 23, 2013 at 4:45 PM, Fatih Haltas wrote:
>
>> Hi again
ifying the input directory in local file system not in
> HDFS, Copy some text file to using '-put' or '-copyFromLoca'l to HDFS user
> home directory then try to execute word count by specifying home as input
> directory.
>
> On Sun, Feb 24, 2013 at 3:29 PM, Fatih Hal
I am always getting the Child Error, I googled but I could not solve the
problem, did anyone encounter with same problem before?
[hadoop@ADUAE042-LAP-V conf]$ hadoop jar
/home/hadoop/project/hadoop-1.0.4/hadoop-examples-1.0.4.jar
aggregatewordcount /home/hadoop/project/hadoop-data/NetFlow test16
Hi all,
First, I would like to thank you all, espacially to Hemanth and Harsh.
I solved my problem, this was exactly the about java version and hadoop
version incompatibility, now, I can run my compiled and jarred MapReduce
program.
I have a different question now. I created a code, finding the
Hi Ring,
Can you write output of "jar tf filename" command to see package
organization of jar, you created?
2 Mart 2013 Cumartesi tarihinde springring adlı kullanıcı şöyle yazdı:
> Hi,
>
> I want to use:
> hadoop jar /hadoop-streaming-0.20.2-cdh3u3.jar -inputformat
> org.apache.hadoop.streami
Hi Austin,
I am not sure whether you had this kind of mistake or not but in any case,
I would like to state:
that you might be trying to read whole input values,(corresponding key
values) to reducer function from beginning to end(which is the output value
of mapper) while merging them into one ou
I mean,
while trying to add newcoming reducer input value to already merged input
values,to construct whole input values of corresponding key value to
reducer, you might be reading every input values(which are output value of
mapper) from beginning to end.
On Tue, Mar 5, 2013 at 1:46 PM, Fatih
Hi Everyone,
I would like to have 2 different output (having different columns of a same
input text file.)
When I googled a bit, I got multipleoutputs classes, is this the common way
of doing it or is there any way to create context kind of
things/is there context array/is it possible to have two
Hi Everyone,
I would like to have 2 different output (having different columns of a same
input text file.)
When I googled a bit, I got multipleoutputs classes, is this the common way
of doing it or is there any way to create context kind of
things/is there context array/is it possible to have two
Hi Everyone,
I am trying to implement Secondary Sort Algorithm on mydata. But I am
having a trouble with my Combiner.
When I donot use Combiner, grouping is done well, I mean one reduce task is
running for every pair, sharing the same first element.
However, when I set Combiner as Reducer class
hris is at
> http://search-hadoop.com/m/RH5AP11ob2o1.
>
> On Wed, Mar 20, 2013 at 6:10 PM, Fatih Haltas
> wrote:
> > Hi Everyone,
> >
> > I am trying to implement Secondary Sort Algorithm on mydata. But I am
> having
> > a trouble with my Combiner.
> >
&g
Dear All,
I have just restarted machines of my hadoop clusters. Now, I am trying to
restart hadoop clusters again, but getting error on namenode restart. I am
afraid of loosing my data as it was properly running for more than 3
months. Currently, I believe if I do namenode formatting, it will work
rk with a Secondary NameNode or a Standby NameNode for
>>>> checkpointing?
>>>>
>>>> Where are your HDFS blocks located, are those still safe?
>>>>
>>>> With this information at hand, one might be able to fix your setup, but
>>>> do
No, not ofcourse I blinded it.
On Wed, Mar 19, 2014 at 5:09 PM, praveenesh kumar wrote:
> Is this property correct ?
>
>
>
> fs.default.name
> -BLANKED
>
>
> Regards
> Prav
>
>
> On Wed, Mar 19, 2014 at 12:58 PM, Fatih Haltas wrote:
>
&g
gt; Regards,
>> *Stanley Shi,*
>>
>>
>>
>> On Sun, Mar 23, 2014 at 6:24 PM, Fatih Haltas wrote:
>>
>>> No, not ofcourse I blinded it.
>>>
>>>
>>> On Wed, Mar 19, 2014 at 5:09 PM, praveenesh kumar
>>> wrote:
>>>
40 matches
Mail list logo
