Hi,i found a problem in my hbase mapreduce case.
when first running mapreduce TableMapReduceUtil runs ok.
and i use hbase shell to delete some data from the table that mapreduce one
.
then ran mapreduce to insert some new data.
no thing data changed, mapreduce didnt work.
after that i drop th
i found that if i didnt control timestamp of the put
mapreduce can run, otherwise just one time mapreduce.
the question is i scan by timestamp to get my data
so to put timestamp is my scan thing.
any ideas ? thanks.
2010/12/1 梁景明
> Hi,i found a problem in my hbase mapreduce case.
>
> when
What version of HBase are you using?
On Dec 1, 2010, at 9:24, 梁景明 wrote:
> i found that if i didnt control timestamp of the put
> mapreduce can run, otherwise just one time mapreduce.
> the question is i scan by timestamp to get my data
> so to put timestamp is my scan thing.
>
> any ideas
0.20.6
2010/12/2 Lars George
> What version of HBase are you using?
>
> On Dec 1, 2010, at 9:24, 梁景明 wrote:
>
> > i found that if i didnt control timestamp of the put
> > mapreduce can run, otherwise just one time mapreduce.
> > the question is i scan by timestamp to get my data
> > so to p
So you are using explicit time stamps for the put calls? Is this related to
https://issues.apache.org/jira/browse/HBASE-3300
by any chance? You have to be extra careful with explicit timestamps
as newer deletes can mask readding puts that have an older timestamp.
Try this:
1. Do the MR job
2. D
here is the thing what i do ,i think not only mapreduce error .
shell_1:
create 't1','f'
shell_2:
scan 't1'
shell_3:
deleteall 't1','a'
shell_4:
major_compact 't1'
javacode:
HBaseConfiguration hconf = new HBaseConfiguration(new
Configuration());
hconf.addResource(HbaseMapr.cla
Did you check that the compaction was completed? Please "tail -f" or
so the master log to see when it is done. You may have tried too quick
for it to do its magic.
On Fri, Dec 3, 2010 at 3:40 AM, 梁景明 wrote:
> here is the thing what i do ,i think not only mapreduce error .
>
> shell_1:
> create 't
it is just a column data, if it's so slow to do the thing , i cann't use it
in my case.
i am trying javacode to delete instead of using the shell to delete data .
javacode is ok. i am thinking weather the shell delete thing setting some
current timestamp in hbase.
so, when i put the data timest
Understood. It would have been nice to know if this would have worked
given the major compaction had completed. Just to check what the issue
is. Setting values with absolute timestamps is always difficult, there
are simply a few architectural issues that need to be handled before
this works for eve
