Thansk, that set me on the right path. For anyone else reading along, I
also needed to add:
org.scala-lang
scala-library
2.9.0
test
cglib
cglib
test
2.2
My row key is relatively small so that's why RowFilter is not making any
difference. Thanks.
I am scanning a single table/cf for a particular qualifier. The scan has a
start row and stop row with a filter. In my test case, only 1 result is
returned. I put this call in a 10 iteration loop to
its compaiible with hadoop 2.x, I dont think HBase tested under hdfs 0.23?
--Send from my Sony mobile.
On Jun 25, 2013 1:49 AM, "Arnab Mukherjee" wrote:
> Thanks.
>
> --
> Arnab Mukherjee
> 510-304-0881
>
>
TTL is enforced when compactions are running so there's no need to
rewrite the data. The alter is sufficient.
J-D
On Mon, Jun 24, 2013 at 4:15 PM, Kireet wrote:
> I need to remove the TTL setting from an existing HBase table and remove the
> TTL from all existing rows. I think this is the proper
Have you tried something like
alter 't1', METHOD => 'table_att_unset', NAME => 'TTL'
?
And I don't think you will need to rewrite anything.
JM
2013/6/24 Kireet :
> I need to remove the TTL setting from an existing HBase table and remove the
> TTL from all existing rows. I think this is the pro
I need to remove the TTL setting from an existing HBase table and remove
the TTL from all existing rows. I think this is the proper command for
removing the TTL setting:
alter 't', {NAME => 'cf', TTL => '2147483647'}
After doing this, do I need to rewrite all the existing data to remove
the T
Yup I hear ya. MiniHBaseCluster adds an extra minute to the tests which kind of
sucks. It gives me peace of mind though
Regards,
Dhaval
- Original Message -
From: Adam Phelps
To: user@hbase.apache.org
Cc:
Sent: Monday, 24 June 2013 6:00 PM
Subject: Re: Writing unit tests against HBas
Hey Adam,
Here is how to use fake-hbase from Java:
final Configuration conf = new Configuration();
final FakeHBase fakeHBase = new FakeHBase();
final HBaseAdmin admin = fakeHBase.getAdminFactory().create(conf);
final HTableDescriptor desc = new HTableDescriptor("table");
desc.addFamily(new
HC
What I'm currently looking for is a method of adding quick unit tests
(ie preferably run time of a few seconds) to test some algorithms that
read hbase data and perform some operations on it. Mocking seems a much
better way to handle this, though I'm open to other suggestions. I'll
try out MiniHB
Why don't you spin up a mini cluster for your tests (there is a
MiniHBaseCluster which brings up an in-memory cluster for testing and you can
tear it down at the end of your test)? The benefit you get is that you no
longer need to mock HBase responses and you will be talking to an actual
cluste
On 6/18/13 4:22 PM, Stack wrote:
> On Tue, Jun 18, 2013 at 4:17 PM, Varun Sharma wrote:
>
>> Hi,
>>
>> If I wanted to write to write a unit test against HTable/HBase, is there an
>> already available utility to that for unit testing my application logic.
>>
>> I don't want to write code that eith
RowFilter can help. It depends on the setup.
RowFilter skip all column of the row when the row key does not match.
That will help with IO *if* your rows are larger than the HFile block size (64k
by default). Otherwise it still needs to touch each block.
An HTable does some priming when it is crea
Lars,
I'm waiting for some time to exchange out hbase jars in cluster (that support
FuzzyRow filter) in order to try out. In the meantime, I'm wondering why
RowFilter regex is not more helpful. I'm guessing that FuzzyRow filter helps
in disk io while Row filter just filters after the disk io h
Hi James,
I do plan on looking more closely at Phoenix for SQL access to HBase. Thanks.
-Original Message-
From: James Taylor [mailto:jtay...@salesforce.com]
Sent: Saturday, June 22, 2013 1:18 PM
To: user@hbase.apache.org
Subject: Re: Scan performance
Hi Tony,
Have you had a look at Ph
Given that the region server writes to a single WAL at a time, doing
it with multiple threads might be hard. You also have to manage the
correct position up in ZK. It might be easier with multiple WALs.
In any case, Inserting at such date might not be doable over long
periods of time. How long wer
Thanks.
--
Arnab Mukherjee
510-304-0881
Hello,
In my Hbase table I have four families. Not all rows have data for all the
families. And not all rows have the same qualifiers either. So imagine this
scenario:
rowid |f1 |f2 |f3|
---
row1 |q1, q2 |q4 |q6 |
row2 |q1, q3 |q4,q5 |
--config arguments of a command will be parsed by hbase-config.sh
which is imported in hbase script.
It will work.
{code}
. "$bin"/hbase-config.sh
{code}
Thanks,
Rajeshbabu
From: Shahab Yunus [shahab.yu...@gmail.com]
Sent: Monday, June 24, 2013 7:41 PM
'hbase' does not seem to have --config/-config parameter.
Regards,
Shahab
On Mon, Jun 24, 2013 at 8:39 AM, rajeshbabu chintaguntla <
rajeshbabu.chintagun...@huawei.com> wrote:
> Can you try copying hbase-site.xml to other folder and change
> hbase.zookeeper.quorum to remote server and then use
Can you try copying hbase-site.xml to other folder and change
hbase.zookeeper.quorum to remote server and then use below command.
./hbase --config shell
Then shell will start with the configurations in hbase-site.xml of new folder.
I didnt try this, but it should help you.
Thanks,
Rajeshbabu
Have you tried creating your own small script in which you set the relevant
environment variables per session (using 'export' for example)?
On Mon, Jun 24, 2013 at 1:33 AM, Stephen Boesch wrote:
> We want to connect to a non-default / remote hbase server by setting
> hbase.zookeeper.quorum=ou
Hi, all,
when I configure ipc pool in hbase-site.xml as follows:
hbase.client.ipc.pool.type
RoundRobinPool
hbase.client.ipc.pool.size
1
the start and stop processes of hbase run without any problem.
But if I set hbase.client.ipc.pool.size to 10 (20, 30, or possibly some
other
Hi Rajkumar,
bq. my hdfs-site.xml file is
The configurations you have mentioned should be in hbase-site.xml.
Can you check zk quorum,Namenode and DataNode are running fine?
One more thing is fs.defaultFs or fs.default.name in core-site.xml of hadoop
should be hdfs://localhost:9000/
fs.default.n
23 matches
Mail list logo
