Hi Pig Users/Dev,

We are using PIG for largescale log analysis of our server logs.
Our log records are of the format,
instance_name, host_name, processing_time, 
[component1#1,component2#322,component3]

A line in our CSV file looks like,
Instance1,host1.ms.com,323,[component1#22,componentprocessor#33,third_component#299]


We are attempting to load the data as <string,string,int,map[string,int]> type.

A snapshot from our pig script looks like,

A = LOAD 'dlink_data.pig' using PigStorage(',') AS 
(instance_name:chararray,host_name:chararray,processing_time:int, 
components_map:map[]);
DUMP A;

The first 3 fields load correctly.  The Map, however, does not get loaded.
Can someone please advise on this?



Jagadish Venkatraman
Data Architecture Group
Morgan Stanley | IM Technology
jagadish.venkatra...@morganstanley.com<mailto:jagadish.venkatra...@morganstanley.com>


--------------------------------------------------------------------------
NOTICE: Morgan Stanley is not acting as a municipal advisor and the opinions or 
views contained herein are not intended to be, and do not constitute, advice 
within the meaning of Section 975 of the Dodd-Frank Wall Street Reform and 
Consumer Protection Act. If you have received this communication in error, 
please destroy all electronic and paper copies and notify the sender 
immediately. Mistransmission is not intended to waive confidentiality or 
privilege. Morgan Stanley reserves the right, to the extent permitted under 
applicable law, to monitor electronic communications. This message is subject 
to terms available at the following link: 
http://www.morganstanley.com/disclaimers. If you cannot access these links, 
please notify us by reply message and we will send the contents to you. By 
messaging with Morgan Stanley you consent to the foregoing.

Reply via email to