Re: Aggregating data nested into JSON documents

2013-06-20 Thread Tecno Brain
, some-subgroup-identifier, 23, [ f1#abc, f2#a, f3#/ ] ) ( some-group-identifier , some-subgroup-identifier, 23, [ f1#xyz, f2#q, f3#/ ] ) Close, but not exactly what I want. Do I require to use ProtoBuf ? -Jorge On Wed, Jun 19, 2013 at 3:44 PM, Tecno Brain cerebrotecnolog...@gmail.comwrote

Re: Aggregating data nested into JSON documents

2013-06-19 Thread Tecno Brain
PM, Tecno Brain cerebrotecnolog...@gmail.comwrote: I also tried: doc = LOAD '/json-pcr/pcr-01.json' USING com.twitter.elephantbird.pig.load.JsonLoader() AS (json:map[]); flat = FOREACH doc GENERATE (chararray)json#'a' AS first, (long)json#'b' AS second ; DUMP flat; but I got

Re: Aggregating data nested into JSON documents

2013-06-13 Thread Tecno Brain
or at least train of thought. HTH -Mike On Jun 12, 2013, at 7:57 PM, Tecno Brain cerebrotecnolog...@gmail.com wrote: Hello, I'm new to Hadoop. I have a large quantity of JSON documents with a structure similar to what is shown below. { g : some-group-identifier, sg: some

Aggregating data nested into JSON documents

2013-06-12 Thread Tecno Brain
Hello, I'm new to Hadoop. I have a large quantity of JSON documents with a structure similar to what is shown below. { g : some-group-identifier, sg: some-subgroup-identifier, j : some-job-identifier, page : 23, ... // other fields omitted