Re: Custom filter appears to just hang

2019-09-17 Thread Mike Thomsen
Do you know of any third party filters that are posted somewhere where I could do that? On Mon, Sep 16, 2019 at 5:55 PM Stack wrote: > On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen > wrote: > > > So that's just it, I don't see any errors at all on either the client > side >

Re: Custom filter appears to just hang

2019-09-15 Thread Mike Thomsen
see > where you should create the proto files and which jar should be used > (shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf > > thanks, > esteban. > > -- > Cloudera, Inc. > > > > On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen > wrote: &

Custom filter appears to just hang

2019-09-13 Thread Mike Thomsen
https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176 I'm running this in standalone mode, with the jar file in the HBase lib folder. When I run the client side of it, it gets to the print statement that says Fetching and then just hangs. When I take the filter off the Get, it

Re: Sorting keys with HFile.Writer

2019-01-01 Thread Mike Thomsen
Thanks. Is there any value in me specifying the comparator? On Tue, Jan 1, 2019 at 9:07 AM 张铎(Duo Zhang) wrote: > Yes, the keys should be sorted, before passing them to HFile.Writer. The > way we build index for HFile is based on this assumption, that the keys are > sorted. > >

Sorting keys with HFile.Writer

2019-01-01 Thread Mike Thomsen
I took some of the code from the JUnit test for setting up a HFile writer and it looked like it should work. Path f = new Path("/", "test-something.hfile"); HFileContext context = new HFileContextBuilder() .withBlockSize(4096) .withIncludesTags(true)

Re: AntsDB is released with MySQL compatibility for HBase

2018-05-08 Thread Mike Thomsen
That's my understanding as well, and why so many projects choose ASL or BSD/MIT now. I am not a lawyer, but my understanding is that you also cannot change the license to ASL now, even if you remove all of the GPL'd code, without getting written permission from every contributor to the code base.

Re: Visibility auths only visible to hbase user

2018-05-06 Thread Mike Thomsen
lease you downloaded > ? > > Did you install it on the docker image ? > > Please share hbase-site.xml (thru pastebin) if possible. > > Thanks > > On Sun, May 6, 2018 at 8:04 AM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > Ted, > > > >

Re: Visibility auths only visible to hbase user

2018-05-06 Thread Mike Thomsen
To my knowledge, this feature works in Apache hbase releases. > > Cheers > > On Sun, May 6, 2018 at 7:55 AM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > I've tried this in the HDP docker sandbox and outside that with a basic > > installation of HBas

Visibility auths only visible to hbase user

2018-05-06 Thread Mike Thomsen
I've tried this in the HDP docker sandbox and outside that with a basic installation of HBase. su - hbase hbase shell set_auths 'test_user', ['OPEN', 'BILLING', 'PII'] get_auths 'test_user' OPEN BILLING PII So far so good. su - test_user hbase shell get_auths 'test_user' 0 returned If su back

Re: New installation of HBase ignoring cell visibility (even though it's active)

2018-02-25 Thread Mike Thomsen
e log a JIRA. > > On Sat, Feb 24, 2018 at 9:06 AM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > Ted/Anoop, > > > > I realized what the problem was. When I installed HBase previously (and > had > > this working) it was on a Linux machine with a

Incrementally load HFiles outside of MR/Spark

2018-02-25 Thread Mike Thomsen
I'm looking into creating HFiles directly from NiFi using the HBase API. It seems pretty straight forward: 1. Open a HFile.Writer pointing to a file path in HDFS. 2. Write the cells with the HFile API. 3. Call the incremental loader API to have it tell HBase to load the generated segments. Is

Re: New installation of HBase ignoring cell visibility (even though it's active)

2018-02-24 Thread Mike Thomsen
uthentication" have value of "kerberos" ? > > If it does, please pastebin your hbase-site.xml > > Thanks > > On Sat, Feb 24, 2018 at 4:59 AM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > (hbase-site.xml is attached) > > > > I rei

Re: New installation of HBase ignoring cell visibility (even though it's active)

2018-02-24 Thread Mike Thomsen
s like the user > running the command is the hbase super user who started the RS process. > Then all cells will be returned irrespective of its visibility and scan > auths. > > Anoop > > On Saturday, February 24, 2018, Mike Thomsen <mikerthom...@gmail.com> > wrote:

New installation of HBase ignoring cell visibility (even though it's active)

2018-02-24 Thread Mike Thomsen
(hbase-site.xml is attached) I reinstalled HBase on my development machine and the console shows that it's just ignoring the cell visibility settings even though it shows they're active: hbase(main):001:0> list TABLE 0 row(s) in 0.1630 seconds => [] hbase(main):002:0> get_auths

Re: HBaseTestingUtility with visibility labels enabled

2018-02-23 Thread Mike Thomsen
StartMaster(). > > You can add the following call in the @BeforeClass method: > > > TEST_UTIL.waitTableEnabled(LABELS_TABLE_NAME.getName(), 5); > > > See TestVisibilityLabelsWithACL for complete example. > > > > On Thu, Feb 22, 2018 a

HBaseTestingUtility with visibility labels enabled

2018-02-22 Thread Mike Thomsen
I'm trying to spin up a mini cluster for integration testing. Can someone give me an idea of what I'm doing wrong? public static void main(String[] args) throws Throwable { Configuration conf = org.apache.hadoop.hbase.HBaseConfiguration.create();

Re: Deletes with cell visibility labels

2017-09-21 Thread Mike Thomsen
isibility labels. > > And to answer your question in a simple way > Since you are not sure what were the labels added for a PUT you need to re > run the algo that generated the labels and add it with deletes if that > specific row needs to be masked. > > Regards > Ram > >

Re: Deletes with cell visibility labels

2017-09-21 Thread Mike Thomsen
ells with visibility cells as passed in the > AUTHORIZATIONS are returned back. > > Hope you find this useful. Let us know if you need further inputs. > > Regards > Ram > > On Thu, Sep 21, 2017 at 6:04 PM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > According to the ja

Deletes with cell visibility labels

2017-09-21 Thread Mike Thomsen
According to the javadocs and some examples I've seen, it looks like with the Java client you have to know the visibility label of the cell you want to delete. You cannot just pass a token list like you can in the shell (delete TABLE, ROW, COLUMN, {AUTHORIZATIONS => ["token", "token"]}) Is this

Solution to my NPE issue I just posted

2017-09-06 Thread Mike Thomsen
It appeared to be a problem with HBase in the HortonWorks sandbox. No idea what was going on. Tried another Docker image, this seems to work. Docker Compose configuration: version: '3' services: hbase-docker: container_name: hbase-docker image: "dajobe/hbase-docker" ports: -

NullPointerException thrown in the client driver when trying to scan

2017-09-06 Thread Mike Thomsen
I wrote a simple Groovy script to test the connection: @Grab(group='org.apache.hbase', module='hbase-client', version='1.1.5') @Grab(group='org.hamcrest', module='hamcrest-core', version='1.2') @Grab(group='org.apache.hbase', module='hbase-common', version='1.1.5')

Visibility labels without Kerberos

2017-09-06 Thread Mike Thomsen
Is it possible to use visibility labels without Kerberos? Our admins are still figuring out how to set up Kerberos, and we just need something really simple to get started like being able to set a list of tokens on a scanner and go with that. Is that possible? Thanks, Mike

Re: Fully distributed mode on Windows

2016-08-13 Thread Mike Thomsen
You probably shouldn't be using Windows servers for this. For example, Cloudera doesn't list any version of Windows at all as a supported OS: http://www.cloudera.com/documentation/cdh/5-0-x/CDH5-Requirements-and-Supported-Versions/cdhrsv_os.html You'd almost certainly be better off setting up a

Lily and HBase cell level security

2016-07-08 Thread Mike Thomsen
Does anyone have experience with using cell level security and Lily? Doing some basic research on Google didn't yield anything positive. Thanks, Mike

Can a put delete other values?

2015-12-13 Thread Mike Thomsen
I noticed that our test data set is suddenly missing a lot of data, and I am wondering if it's because I'm misunderstanding how HBase handles puts. Suppose we have 3 families: ca, cb and cc. Before on row abcde-fgh-ijkl ca:q1= ca:q2= ca:q3= cb:q1= cb:q2= cc:q1= We send

Re: Can a put delete other values?

2015-12-13 Thread Mike Thomsen
able ? > > Thanks > > On Sun, Dec 13, 2015 at 12:36 PM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > I noticed that our test data set is suddenly missing a lot of data, and I > > am wondering if it's because I'm misunderstanding how HBase handles puts. &

Re: Can a put delete other values?

2015-12-13 Thread Mike Thomsen
o the row. > In your case, subsequent writes cause the max versions to be reached, > leading to the behavior you observed. > > See also http://hbase.apache.org/book.html#specify.number.of.versions > > Cheers > > > On Sun, Dec 13, 2015 at 2:39 PM, Mike Thomsen <mikerthom...@gm

Question about reading data very recently written to hbase

2015-10-05 Thread Mike Thomsen
My team has a set of web services that read data from HBase and prepare it to be exported as a report. The first call is an AJAX call that reads all of the requested rows, generates the report pieces and returns a JSON map to the calling web app saying what level of success it had in building up

Re: Question about reading data very recently written to hbase

2015-10-05 Thread Mike Thomsen
ts()) > > -Vlad > > > > On Mon, Oct 5, 2015 at 1:30 PM, Mike Thomsen <mikerthom...@gmail.com> > wrote: > > > My team has a set of web services that read data from HBase and prepare > it > > to be exported as a report. The first call is an AJAX call that read