Hi John, This problem is resolved on the csv file I was testing. Thanks a lot for fixing this! I'll keep you posted I encounter this elsewhere.
-cheers, guarav On Sat, Jul 7, 2012 at 3:12 AM, K. John Wu <[email protected]> wrote: > Hi, Gaurav, > > I have located the cause of the problem with unexpected mask file. A > fix has been checked in with SVN revision 522. Please give it a try > when you get the chance. > > Thanks. > > John > > > On 7/3/12 5:58 PM, Gaurav Agarwal wrote: >> Hi John, >> >> Thanks for the reply. I'm using fastbit 1.3.0. >> >> -gaurav >> >> On Wed, Jul 4, 2012 at 12:37 AM, K. John Wu <[email protected]> wrote: >>> Hi, Gaurav, >>> >>> Thanks for the interest in FastBit. Looks like there might be some >>> issue with the reading of text fields. I will need some time to look >>> into this further. I will let you know as soon as I able to determine >>> the source of the problem. >>> >>> In the mean time, would you mind tell me which version of FastBit you >>> are using? >>> >>> John >>> >>> >>> On 7/2/12 10:40 AM, Gaurav Agarwal wrote: >>>> Hi, >>>> >>>> (first of all thank you for creating such a useful tool!!) >>>> >>>> I am an absolute beginner to FastBit; I am playing with fastbit to get >>>> an initial understanding. I am noticing something weird which I cannot >>>> seem to understand: >>>> When I use ardea to load a csv file into fastbit's columnar format, I >>>> sometimes see a .msk file being created for the last column. I cannot >>>> understand why is this file being created only for last column. >>>> Reading the help pages, it appears that this file will be created for >>>> columns having 'null' values but the file I'm trying to load >>>> definitely does not have 'null' values. The file has just 5 rows and 3 >>>> columns. >>>> >>>> Here is the console output of what I'm doing- (any insight will be >>>> greatly appreciated) >>>> >>>> -------------------------------------------- >>>> Gauravs-MacBook-Pro:tests gaurav$ cat test.csv >>>> 1,a,p >>>> 2,b,q >>>> 3,c,r >>>> 4,d,s >>>> 5,e,t >>>> >>>> Gauravs-MacBook-Pro:tests gaurav$ ardea -d tmp -m "a:int, b:text, >>>> c:text" -t test.csv >>>> ardea: verbose level 0 >>>> Will attempt to parse 1 CSV file >>>> test.csv >>>> with the following column names and types >>>> a:int, b:text, c:text >>>> >>>> >>>> ardea to read CSV file test.csv ... >>>> ardea read 5 rows from test.csv >>>> >>>> Gauravs-MacBook-Pro:tests gaurav$ ls tmp/ >>>> -part.txtabcc.msk >>>> Gauravs-MacBook-Pro:tests gaurav$ cat tmp/-part.txt >>>> # meta data for data partition tmp written by ibis::tafel::write on >>>> Mon Jul 2 23:07:16 2012 >>>> >>>> BEGIN HEADER >>>> Name = tmp >>>> Description = ardea -d tmp -m a:int, b:text, c:text -t test.csv >>>> Number_of_rows = 5 >>>> Number_of_columns = 3 >>>> Timestamp = 1341250636 >>>> END HEADER >>>> >>>> Begin Column >>>> name = a >>>> data_type = INT >>>> End Column >>>> >>>> Begin Column >>>> name = b >>>> data_type = TEXT >>>> index=none >>>> End Column >>>> >>>> Begin Column >>>> name = c >>>> data_type = TEXT >>>> index=none >>>> End Column >>>> >>>> >>>> cheers, >>>> gaurav >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> FastBit-users mailing list >>>> [email protected] >>>> https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users >>>> >>> > _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
