Re: Mapping MySQL schema to Avro

2012-11-24 Thread Bart Verwilst
Hi! I will subscribe to the avro users mailinglist as well for this, thanks! I'm not sure that i understand your comment about repeating values in fmsswitchvalues, since they are different from the ones in fmssession? Kind regards, Bart Ted Dunning schreef op 23.11.2012 23:20: This

Re: Mapping MySQL schema to Avro

2012-11-24 Thread Bart Verwilst
Hey Ruslan, I'm not using Sqoop because my avro exist of a couple of subsets, which (afaik) are impossible to reproduce with a single query and thus sqoop. Or am I wrong? Kind regards, Bart Ruslan Al-Fakikh schreef op 24.11.2012 01:06: Hey Bart, Why not using Sqoop for

Re: Mapping MySQL schema to Avro

2012-11-24 Thread Ted Dunning
On Sat, Nov 24, 2012 at 5:19 AM, Bart Verwilst li...@verwilst.be wrote: ** ... I'm not sure that i understand your comment about repeating values in fmsswitchvalues, since they are different from the ones in fmssession? I was just pointing out that there were fields in the fmssession record

Mapping MySQL schema to Avro

2012-11-23 Thread Bart Verwilst
Hello! I'm currently writing an importer to import our MySQL data into hadoop ( as Avro files ). Attached you can find the schema i'm converting to Avro, along with the corresponding Avro schema i would like to use for my imported data. I was wondering if you guys could go over the schema

Re: Mapping MySQL schema to Avro

2012-11-23 Thread Ruslan Al-Fakikh
Hey Bart, Why not using Sqoop for trasforming data from/to hadoop to/from MySQL? http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html see the parameter: -as-avrodatafile Ruslan On Sat, Nov 24, 2012 at 2:20 AM, Ted Dunning tdunn...@maprtech.com wrote: This is probably the wrong list for