1. The HBase client from any 0.90.x should be compatible across all 0.90.x
versions.
2. No idea.
On Sun, Aug 7, 2011 at 8:56 AM, lulynn_2008 wrote:
> Hello,
> I found pig-0.8.1 included classes of Hbase-0.90.0.
> My question is:
> 1. If I replace Hbase-0.90.3 with Hbase-0.90.0, could pig-0.8.1 w
I was wondering if there is an implementation of a Pig store function that
writes HFiles (wrapper around HFileOutputFormat)? I was able to find
http://pig.apache.org/docs/r0.9.1/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.htmlbut
would prefer to write the hfiles directly and bulk upload.
my_data = LOAD 'location' AS (name:chararray, val1:int, val2:int);
by_name = foreach (group my_data by name) generate group as name,
my_data.(val1, val2) as my_data;
store by_name into 'new_location';
grouped_data = LOAD 'new_location') AS (name:chararray,
my_bag:bag{T2:tuple(val1:int, val2:int)})
Yong,
If your data is not in the form of a bag, then there is no reason to load
it in as a bag. You should load it in as chararray, int, int, and then you
can transform it into the form you want via the script itself.
2012/6/11 yonghu
> Dear Russell,
>
> My pig version is 0.91. I have tried a l
Dear Russell,
My pig version is 0.91. I have tried a little bit. But I got a problem. My
data is looks like:
henrietta125
sally182
fred2120
elsie345
tom182
tom498
sally287
the delimiter is '\t'.
I use the command to load the data
A = LOAD
High five! o/\o
On Mon, Jun 11, 2012 at 11:51 AM, yonghu wrote:
> Dear Russell,
>
> Thanks for your response.
>
> Yong
>
> On Mon, Jun 11, 2012 at 7:33 PM, Russell Jurney >wrote:
>
> > Doesn't need a UDF (if it's PigStorage or something else supported),
> just a
> > cast.
> >
> > foo = LOAD 'lo
Dear Russell,
Thanks for your response.
Yong
On Mon, Jun 11, 2012 at 7:33 PM, Russell Jurney wrote:
> Doesn't need a UDF (if it's PigStorage or something else supported), just a
> cast.
>
> foo = LOAD 'location' as B:bag{T2:tuple(t1:float,t2:float)};
>
> Pulled from the docs: http://pig.apache.
I am looking at how to parse URL with query parameters to process
clickstream data. Are there any examples I can look at? My steps that I
envision are:
1) Read lines and convert query parameters into bags that is a group of
fields for a particular dimension table. So if Geo is one of the dimension
Doesn't need a UDF (if it's PigStorage or something else supported), just a
cast.
foo = LOAD 'location' as B:bag{T2:tuple(t1:float,t2:float)};
Pulled from the docs: http://pig.apache.org/docs/r0.7.0/piglatin_ref2.html
A = LOAD 'mydata' AS (T1:tuple(f1:int, f2:int),
B:bag{T2:tuple(t1:float,t2:flo
nice !
On Sun, Jun 10, 2012 at 12:51 AM, Cheolsoo Park wrote:
> Hi Subir,
>
> Thanks for asking. In fact, I found out what's the issue and filed a jira:
> https://issues.apache.org/jira/browse/PIG-2745. Please find details from
> the jira.
>
> Cheolsoo
>
> On Sat, Jun 9, 2012 at 5:42 AM, Subir S
What I mean is: are the versions in the pom for pig 0.10.0 inconsistent with
the versions specified in the ivy file used to build pig? To be clear, I am
building a separate project, and I am getting pig and its dependencies using
ivy.
Looking in ivy.xml in the pig 0.10.0 release:
...
sorry,I already got the problem and address it, sorry to trouble with you!
Best Regards
Malone
2012-06-11
yingnan.ma
发件人： yingnan.ma
发送时间： 2012-06-11 21:57:15
收件人： user
抄送：
主题： lzo error
Hi
I already install the lzo, and from the log it sould like successful
mapred.compress.map.
Hi
I already install the lzo, and from the log it sould like successful
mapred.compress.map.output true
&&
syslog logs
2012-06-11 21:50:39,749 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to
load native-hadoop library for your platform... using builtin-java classes
where applicable
20
13 matches
Mail list logo
