Re: Loading into hbase from csv file issue

2016-10-04 Thread Mich Talebzadeh
Thanks again. If I wanted to store TSCO for a row and not bother for the rest of the rows how will it work for the row key. Currently this is trhe way table tsco is defined: create 'tsco','stock_daily' and this is the attributes of stock_daily fc hbase(main):144:0* scan 'tsco', LIMIT => 1 ROW

Re: Loading into hbase from csv file issue

2016-10-03 Thread Jean-Marc Spaggiari
Hi Mich, that's better already, but now you have to think about the read pattern. How do you want to read this data? Are you going to read just one column at a time? Like reading stock_daily:high without reading stock_daily:close? If so, fine, keep it that way. But if you mostly read all of them t

Re: Loading into hbase from csv file issue

2016-10-03 Thread Mich Talebzadeh
Hi Jean-Marc I decided to create a composite key *ticker-date* from the csv file I just did some manipulation on CSV file export IFS=",";sed -i 1d tsco.csv; cat tsco.csv | while read a b c d e f; do echo "TSCO-$a,TESCO PLC,TSCO,$a,$b,$c,$d,$e,$f"; done > temp; mv -f temp tsco.csv Which basicall

Re: Loading into hbase from csv file issue

2016-10-03 Thread Jean-Marc Spaggiari
Hi Mich, As you said, it's most probably because it's all the same key... If you want to be 200% sure, just alter VERSIONS => '1' to be greater (like, 10) and scan all the versions of the cells. You should see the others. JMS 2016-10-03 3:41 GMT-04:00 Mich Talebzadeh : > Hi, > > when I use the

Loading into hbase from csv file issue

2016-10-03 Thread Mich Talebzadeh
Hi, when I use the command line utility ImportTsv to load a file into Hbase with the following table format describe 'marketDataHbase' Table marketDataHbase is ENABLED marketDataHbase COLUMN FAMILIES DESCRIPTION {NAME => 'price_info', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false',