Dear john Wu,
Thank you very much for reply.
I got your point about where condition.
As I looked inside the code (regarding to ierr=-2):
The error message come from : filter.cpp : ibis:filter::sift2S() :
ierr = merges[lg2]->merge(*tmp, tms);
if (ierr < 0) {
LOGGER(ibis::gVerbose > 1)
<< " Warning -- " << mesg
<< " failed to merge partial results, ierr = " << ierr;
return 0;
}
Or maybe : same method:
// merge in the lower degree accumulator
ierr = merges[newlg2]->merge(*merges[lg2], tms);
if (ierr < 0) {
LOGGER(ibis::gVerbose > 1)
<< "Warning -- " << mesg
<< " failed to merge partial results, ierr = "
<< ierr;
return 0;
}
Which the both calls :bord.cpp(line 2717): ibis:bord::merge() :
if (keys.size() != keyr.size() || vals.size() != valr.size())
{
return -2;
}
I hope this help you to find the solution and debug faster.
Regards,
Hassan Hamzehlooee Monfared
Directing Manager
Imen Rayaneh Shargh Co. Ltd.
Tel : +9821 88104832
Cell Phone: +98912 2973770
Web site : http://www.imenrayaneh.com
Please consider the environment before printing this email.*
----------------------------------------
From: "K. John Wu" <[email protected]>
Sent: 11 February 2012 21:50
To: [email protected], "FastBit Users" <[email protected]>
Subject: Re: [FastBit-users] fw: merge fails when CATGORY field is used in
select statement
Hi, Hassan,
Thanks for the report. Looks like there might be a bug inside the
merge function. Unfortunately, it might be a few week before we can
get around to look into this.
Regarding the where clause, the example program ibis.cpp always wants
a where clause. A simple one to tell it to select everything is '1=1'.
Hope this helps.
John
On 2/11/12 5:15 AM, Hassan H. Monfared wrote:
> Hi all,
>
> I have following structure of partitions for my fastbit data :
>
> /var/fbdata/YYYY/MM/DD/HH/MM/ which includes (SRC_IP,IN_BYTES,DST_IP,.
> ) + metaTags = year=YYYY,month=MM,day=DD,hour=HH
>
> * 1 - This query is OK : ibis -d /var/fbdata -q "select
> SUM(IN_BYTES) where year='2012'" // or any other conditions like
> 1=1 IN_BYTES>0 ..
> * 2- This query gives me error : : ibis -d /var/fbdata -q "select
> SUM(IN_BYTES) " ( fails with msg : tableSelect::
> select(sum(in_bytes), ) failed on table T-00 )
>
> Seams we have to set a where condition anyway
>
> * 3- This query is ok : ibis -d /var/fbdata/2012/02/06/11 -q "select
> hour,sum(in_bytes) where year='2012'" -v=4
>
> Result :
>
> "11", 307445
>
> I repeat the same query with ../06/12 , .06/13, .. ( all partitions
> inside day 06 one by one) and I get correct result.
>
> Now ! when I try to do the same query on all hour partions for one day
> ( 06) , here is my try result :
>
> * 4- This query gives me error : ibis -d /var/fbdata/2012/02/06 -q
> "select hour,sum(in_bytes) where year='2012'" -v=4
>
> Message :
>
> Warning -- filter::sift2S(SELECT hour,sum(in_bytes) FROM 56 data
> partitions WHERE year *...) failed to merge partial results*, ierr = -2
>
> clearing data partition W2eOV
>
> clearing data partition WVeO
>
> clearing data partition Z1mMt
>
> filter::sift2S(SELECT hour,sum(in_bytes) FROM 56 data partitions WHERE
> year ...) -- duration: 0.004001 sec(CPU), 0.00199199 sec(elapsed)
>
> Freeing selectClause @ 0xbf8e1880
>
> tableSelect:: select(hour,sum(in_bytes), year='2012') *failed on table
> T-00*
>
> seems that merging partitions when we use category fields raises error.
>
> Is there any way to avoid querying hours of day one by one to get this
> output result ?
>
> ibis -d /var/fbdata/2012/02/06 -q "select hour,sum(in_bytes) where
> year='2012'"
>
> H1,SUM1
>
> H2,SUM2
>
> H3,SUM3
>
> Regards,
>
>
>
> */Hassan Hamzehlooee Monfared/*
>
> */Directing Manager/*
>
> */Imen /**/Rayaneh /**/Shargh Co. Ltd./*
>
> */Tel : +9821 88104832 /*
>
> */Cell Phone: +98912 2973770/*
>
> */Web site : http://www.imenrayaneh.com <http://www.imenrayaneh.com/>/*
>
> */ /*
>
> *Please consider the environment before printing this email.**
>
>
>
>
> _______________________________________________
> FastBit-users mailing list
> [email protected]
> https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
_______________________________________________
FastBit-users mailing list
[email protected]
https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
