Re: Writing visibility labels with HFileOutputFormat2

2016-06-29 Thread Huaxiang Sun
Hi Tom, Not sure if the following question has been answered. If not, you can use hfile tool to dump the hfile content. "HBASE-15707 - am I able to read the HFile manually to determine if Tags have been written properly?” ${HBASE_HOME}/bin/hbase org.apache.hadoop.hbase.io.hfile.HFile -f

Re: Writing visibility labels with HFileOutputFormat2

2016-06-22 Thread Anoop John
adIncrementalHFiles.doBulkLoad - so long as only the HBase user and the >> spark user can read/write to the file, I'm not sure what the risk is? >> >> HBASE-15707 - am I able to read the HFile manually to determine if Tags >> have been written properly? >> >> Cheer

RE: Writing visibility labels with HFileOutputFormat2

2016-06-16 Thread Ellis, Tom (Financial Markets IT)
anually to determine if Tags have been written properly? Cheers, Tom -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 16 June 2016 06:01 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
t: www.lloydsbankinggroup-cr.com/downloads > > > -Original Message- > From: Ellis, Tom (Financial Markets IT) [mailto: > tom.el...@lloydsbanking.com.INVALID] > Sent: 15 June 2016 17:42 > To: user@hbase.apache.org > Subject: RE: Writing visibility labels with H

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
IT) [mailto:tom.el...@lloydsbanking.com.INVALID] Sent: 15 June 2016 17:42 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- Looking at the source for how DefaultCellLabelServiceImpl checks authorisation I noted

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
IT) [mailto:tom.el...@lloydsbanking.com.INVALID] Sent: 15 June 2016 16:56 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- I see now from some other examples I've found that actually this form

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
Responsibility Report: www.lloydsbankinggroup-cr.com/downloads -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: 15 June 2016 17:01 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
...@lloydsbanking.com.INVALID] Sent: 15 June 2016 16:25 To: user@hbase.apache.org Subject: RE: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- So I have a working prototype using just bulk puts on a table and using setCellVisibility as necessary

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ted Yu
d the low carbon > economy. > Corporate Responsibility Report: www.lloydsbankinggroup-cr.com/downloads > > > -Original Message- > From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 15 June 2016 12:31 > To: user@hbase.apache.org

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
oads -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 15 June 2016 12:31 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- >>We could I gu

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 15 June 2016 11:24 > To: user@hbase.apache.org > Subject: Re: Writing visibility labels with HFileOutputFormat2 > > -- This email has reached the Bank via an external source -- > > > The visibi

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 15 June 2016 11:24 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- The visibility expression resolver tries to scan the labels table an

Re: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread ramkrishna vasudevan
commercial.com > , , , > Reduce printing. Lloyds Banking Group is helping to build the low carbon > economy. > Corporate Responsibility Report: www.lloydsbankinggroup-cr.com/downloads > > -Original Message- > From: Anoop John [mailto:anoop.hb...@gmail.com] > Sent: 08 June 2016 11

RE: Writing visibility labels with HFileOutputFormat2

2016-06-15 Thread Ellis, Tom (Financial Markets IT)
Report: www.lloydsbankinggroup-cr.com/downloads -Original Message- From: Anoop John [mailto:anoop.hb...@gmail.com] Sent: 08 June 2016 11:58 To: user@hbase.apache.org Subject: Re: Writing visibility labels with HFileOutputFormat2 -- This email has reached the Bank via an external source -- Thanks Ra

Re: Writing visibility labels with HFileOutputFormat2

2016-06-08 Thread Anoop John
bviously @InterfaceAudience.Private) but it seems to be able to use that >> I'd need to know Label ordinality client side.. >> >> Thanks for your help, >> >> Tom >> >> -Original Message- >> From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...

Re: Writing visibility labels with HFileOutputFormat2

2016-06-08 Thread ramkrishna vasudevan
amkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > Sent: 07 June 2016 11:19 > To: user@hbase.apache.org > Subject: Re: Writing visibility labels with HFileOutputFormat2 > > -- This email has reached the Bank via an external source -- > > > Hi Ellis > &g

RE: Writing visibility labels with HFileOutputFormat2

2016-06-07 Thread Ellis, Tom (Financial Markets IT)
to be able to use that I'd need to know Label ordinality client side.. Thanks for your help, Tom -Original Message- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] Sent: 07 June 2016 11:19 To: user@hbase.apache.org Subject: Re: Writing visibility labels

Re: Writing visibility labels with HFileOutputFormat2

2016-06-07 Thread ramkrishna vasudevan
Hi Ellis How is the HFileOutputFormat2 files created? Are you using the ImportTsv tool? If you are using the ImportTsv tool then yes there is a way to specify visibility tags while loading from the ImportTsv tool and those visibility tags are also bulk loaded as HFile. There is an attribute

Writing visibility labels with HFileOutputFormat2

2016-06-07 Thread Ellis, Tom (Financial Markets IT)
Hi, I was wondering if it's possible/how to write Visibility Labels to an HFileOutputFormat2? I believe Visibility Labels are just implemented as Tags, but with the normal way of writing them with Mutation#setCellVisibility these are formally written as Tags to the cells during the