RE: Best way to disable & enable HBASE replication

[Chien Le]

The documentation for disabling the peer sounds wrong, I think it applies to 
option #1, not #2.

>From my memory, disabling/re-enabling the peer did not require any manual 
>intervention, it just resumed from whatever info was in zk but admittedly, 
>this was back on 0.94 so things might've changed.

-Chien

-Original Message-
From: spats [mailto:spatil.sud...@gmail.com] 
Sent: Monday, October 3, 2016 8:18 PM
To: user@hbase.apache.org
Subject: Best way to disable & enable HBASE replication

If we have to stop hbase replication and re enable after sometime, which one
is better way to do
1. stop_replication, later enable by running start_replication and copy
missing data for that duration using copyTable command.
2. disable_peer("1") , later enable_peer("1")

2nd option looks better as we don't have to copy missing data manually &
data gets replicated automatically when we enable peer. But i see warning
here
https://www.cloudera.com/documentation/enterprise/5-5-x/topics/cdh_bdr_hbase_replication.html#topic_20_11_5
 
"If you disable replication, and then later decide to enable it again, you
must manually remove the old replication data from ZooKeeper by deleting the
contents of the replication queue", don't understand statement clearly. Is
it really required to delete znode?

I would like to go ahead with option 2, is there any risk? deleting znode is
mandatory in that case?

Thanks in advance



--
View this message in context: 
http://apache-hbase.679495.n3.nabble.com/Best-way-to-disable-enable-HBASE-replication-tp4083081.html
Sent from the HBase User mailing list archive at Nabble.com.

Re: HBase thrift C# impersonation

[Dima Spivak]

Hey Kumar,

The ref guide section on enabling security for the Thrift gateway [1] is a
good place to start. Have you gone through that?

1. http://hbase.apache.org/book.html#security.gateway.thrift.doas

-Dima

On Tue, Oct 4, 2016 at 4:59 AM, kumar r  wrote:

> Hi,
>
> I need example for C# HBase thrift with doAs header.
>
> First of all, setting the below property isn't enough to enable
> authentication/impersonation?
>
>   
> hbase.thrift.security.qop
> auth-conf
>   
>
> After setting this property, i cannot access HBase via C# thrift. I need
> example to access HBase with doAs via C# thrift client.
>
> Help me to get it work.
>
> Thanks in advance,
> Kumar
>

RE: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool to build windows ODBC (#116)

[Dave Birdsall]

Oops... my apologies. (Failed to note carefully the effects of
auto-complete.)

-Original Message-
From: Dima Spivak [mailto:dimaspi...@apache.org]
Sent: Tuesday, October 4, 2016 8:33 AM
Subject: Re: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool to
build windows ODBC (#116)

You hit the HBase user list instead of the Trafodion one. :) Moving
user@hbase.apache.org to bcc.

-Dima

On Tue, Oct 4, 2016 at 8:21 AM, Dave Birdsall 
wrote:

> Forwarding this to the Trafodion user list.
>
>
>
> *From:* helloHuiW [mailto:notificati...@github.com]
> *Sent:* Tuesday, October 4, 2016 6:48 AM
> *To:* apache/incubator-trafodion
> 
> *Cc:* DaveBirdsall ; Mention <
> ment...@noreply.github.com>
> *Subject:* Re: [apache/incubator-trafodion] [TRAFODION-1519]Use free
> tool to build windows ODBC (#116)
>
>
>
> Who can provide the ODBC Driver for Windows
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
>  issuecomment-251392666>,
> or mute the thread
>  Jmm-
> enXUEgeA_ks5qwlkqgaJpZM4GNFgD>
> .
>

Re: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool to build windows ODBC (#116)

[Dima Spivak]

You hit the HBase user list instead of the Trafodion one. :) Moving
user@hbase.apache.org to bcc.

-Dima

On Tue, Oct 4, 2016 at 8:21 AM, Dave Birdsall 
wrote:

> Forwarding this to the Trafodion user list.
>
>
>
> *From:* helloHuiW [mailto:notificati...@github.com]
> *Sent:* Tuesday, October 4, 2016 6:48 AM
> *To:* apache/incubator-trafodion 
> *Cc:* DaveBirdsall ; Mention <
> ment...@noreply.github.com>
> *Subject:* Re: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool
> to build windows ODBC (#116)
>
>
>
> Who can provide the ODBC Driver for Windows
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
>  issuecomment-251392666>,
> or mute the thread
>  enXUEgeA_ks5qwlkqgaJpZM4GNFgD>
> .
>

RE: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool to build windows ODBC (#116)

[Dave Birdsall]

Forwarding this to the Trafodion user list.



*From:* helloHuiW [mailto:notificati...@github.com]
*Sent:* Tuesday, October 4, 2016 6:48 AM
*To:* apache/incubator-trafodion 
*Cc:* DaveBirdsall ; Mention <
ment...@noreply.github.com>
*Subject:* Re: [apache/incubator-trafodion] [TRAFODION-1519]Use free tool
to build windows ODBC (#116)



Who can provide the ODBC Driver for Windows

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
,
or mute the thread

.

HBase thrift C# impersonation

[kumar r]

Hi,

I need example for C# HBase thrift with doAs header.

First of all, setting the below property isn't enough to enable
authentication/impersonation?

  
hbase.thrift.security.qop
auth-conf
  

After setting this property, i cannot access HBase via C# thrift. I need
example to access HBase with doAs via C# thrift client.

Help me to get it work.

Thanks in advance,
Kumar

Re: Loading into hbase from csv file issue

[Mich Talebzadeh]

Thanks again.

If I wanted to store TSCO for a row and not bother for the rest of the rows
how will it work for the row key.

Currently this is trhe way table tsco is defined:

 create 'tsco','stock_daily'

and this is the attributes of stock_daily fc

hbase(main):144:0* scan 'tsco', LIMIT => 1
ROWCOLUMN+CELL
 TSCO-1-Apr-08
column=stock_daily:Date, timestamp=1475525222488, value=1-Apr-08
 TSCO-1-Apr-08
column=stock_daily:close, timestamp=1475525222488, value=405.25
 TSCO-1-Apr-08
column=stock_daily:high, timestamp=1475525222488, value=406.75
 TSCO-1-Apr-08
column=stock_daily:low, timestamp=1475525222488, value=379.25
 TSCO-1-Apr-08
column=stock_daily:open, timestamp=1475525222488, value=380.00
 TSCO-1-Apr-08
column=stock_daily:stock, timestamp=1475525222488, value=TESCO PLC
 TSCO-1-Apr-08
column=stock_daily:ticker, timestamp=1475525222488, value=TSCO
 TSCO-1-Apr-08
column=stock_daily:volume, timestamp=1475525222488, value=49664486

Note that column=stock_daily:stock and column=stock_daily:ticker is
repeated in every row. That may not be efficient?

Kindly suggest the best way of creating row key and whether it is necessary
to store those above columns?

regards












Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.



On 4 October 2016 at 01:53, Jean-Marc Spaggiari 
wrote:

> Hi Mich,
>
> that's better already, but now you have to think about the read pattern.
> How do you want to read this data? Are you going to read just one column at
> a time? Like reading stock_daily:high without reading stock_daily:close? If
> so, fine, keep it that way. But if you mostly read all of them together,
> then why not just keep them together instead of separating them into
> different columns? That way you save the key overhead storage for each new
> column...
>
> Also, I suspect you will have one row per stock per day, right? Does it
> mean you will repeat the stock_info information again and again and again?
> If so, why not just also storing  it once for the row "TSCO" and not repeat
> it for "TSCO-DATE"? That way you store it just one, you have an easy way to
> retrieve it and you can safe one column family?
>
> HTH,
>
> JMS
>
> 2016-10-03 11:16 GMT-04:00 Mich Talebzadeh :
>
> > Hi Jean-Marc
> >
> > I decided to create a composite key *ticker-date* from the csv file
> >
> > I just did some manipulation on CSV file
> >
> > export IFS=",";sed -i 1d tsco.csv; cat tsco.csv | while read a b c d e f;
> > do echo "TSCO-$a,TESCO PLC,TSCO,$a,$b,$c,$d,$e,$f"; done > temp; mv -f
> temp
> > tsco.csv
> >
> > Which basically takes the csv file, tells the shell that field separator
> > IFS=",", drops the header, reads every field in every line (1,b,c ..),
> > creates the composite key TSCO-$a, adds the stock name and ticker to the
> > csv file. The whole process can be automated and parameterised.
> >
> > Once the csv file is put into HDFS then, I run the following command
> >
> > $HBASE_HOME/bin/hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
> > -Dimporttsv.separator=',' -Dimporttsv.columns="HBASE_ROW
> > _KEY,stock_info:stock,stock_info:ticker,stock_daily:Date,sto
> > ck_daily:open,stock_daily:high,stock_daily:low,stock_daily:
> > close,stock_daily:volume" tsco hdfs://rhes564:9000/data/stocks/tsco.csv
> >
> > The Hbase table is created as below
> >
> > create 'tsco','stock_info','stock_daily'
> >
> > and this is the data (2 rows each 2 family and with 8 attributes)
> >
> > hbase(main):132:0> scan 'tsco', LIMIT => 2
> > ROWCOLUMN+CELL
> >  TSCO-1-Apr-08
> > column=stock_daily:Date, timestamp=1475507091676, value=1-Apr-08
> >  TSCO-1-Apr-08
> > column=stock_daily:close, timestamp=1475507091676, value=405.25
> >  TSCO-1-Apr-08
> > column=stock_daily:high, timestamp=1475507091676, value=406.75
> >  TSCO-1-Apr-08
> > column=stock_daily:low, timestamp=1475507091676, value=379.25
> >  TSCO-1-Apr-08
> > column=stock_daily:open, timestamp=1475507091676, value=380.00
> >  TSCO-1-Apr-08
> > column=stock_daily:volume, timestamp=1475507091676, value=49664486
> >  TSCO-1-Apr-08
> > column=stock_info:stock, timestamp=1475507091676, value=TESCO PLC
> >  TSCO-1-Apr-08
> > column=stock_info:ticker, timestamp=1475507091676, value=TSCO
> >
> >  TSCO-1-Apr-09
> > column=stock_daily:Date, timestamp=1475507091676, value=1-Apr-09
> >  TSCO-1-Apr-09
> > column=stock_daily:close, timestamp=1475507091676, value=333.30
> >  TSCO-1-Apr-09