My apologies, I should have been more explicit.
For changing any log related settings, you'd need to modify
"$DRILL_HOME/conf/logback.xml" on all Drillbit nodes and add the following
snippet
<logger name="org.apache.drill.exec.store.hbase" additivity="false">
<level value="debug" />
<appender-ref ref="FILE" />
</logger>
On Wed, Mar 16, 2016 at 1:05 PM, Kevin Verhoeven <[email protected]>
wrote:
> Thanks Aditya,
>
>
>
> Where do I set the "org.apache.drill.exec.store.hbase.HBaseRecordReader"
> parameter? I set it under the drill-override.conf file and restarted Drill
> but I do not see this appear in the log.
>
>
>
> My drill-override.conf looks something like this (I abbreviated the file):
>
>
>
> drill.exec: {
>
> cluster-id: "drillbits1"
>
> rpc: {
>
> user: {
>
> server: {
>
> port: 31010
>
> threads: 1
>
> }
>
> client: {
>
> threads: 1
>
> }
>
> },
>
> bit: {
>
> server: {
>
> port : 31011,
>
> retry:{
>
> count: 7200,
>
> delay: 500
>
> },
>
> threads: 1
>
> }
>
> },
>
> use.ip : false
>
> },
>
> debug.error_on_leak: true,
>
> store.hbase.HBaseRecordReader: true
>
> }
>
>
>
> Thanks!
>
>
>
> Kevin
>
>
>
> *From:* Aditya [mailto:[email protected]]
> *Sent:* Wednesday, March 16, 2016 11:11 AM
> *To:* Kevin Verhoeven <[email protected]>
> *Cc:* [email protected]
> *Subject:* Re: Drill Storage Plugin for HBase 1.0
>
>
>
> Could you please enable debug logging for
> "org.apache.drill.exec.store.hbase.HBaseRecordReader" and look for
> following log message in drillbit.log from this logger.
>
> > Took xxxx ms to get yyyyy records
>
> Does sum(yyyyy) for a query matches the expected number of record?
>
>
>
> On Wed, Mar 16, 2016 at 10:58 AM, Kevin Verhoeven <
> [email protected]> wrote:
>
> Thanks Aditya,
>
> We see a problem when we query HBase 1.0 tables with more than five column
> qualifiers, where only a small amount of data is returned. We are able to
> repro the problem with Drill 1.5 against HBase 1.0 tables of just about any
> size, for example with 1,000,000 rows. A query against the table may return
> less than 1,300 rows.
>
> We use Drill 1.5 against CDH 5.4.2, running HBase 1.0.0-cdh5.4.2.
>
> Do you have any recommendations?
>
> Kevin
>
>
> -----Original Message-----
> From: Aditya [mailto:[email protected]]
> Sent: Wednesday, March 16, 2016 9:41 AM
> To: user <[email protected]>
> Subject: Re: Drill Storage Plugin for HBase 1.0
>
> Hi Kevin,
>
> HBase 0.98.x and 1.x are wire compatible[1] and hence the HBase 0.98
> client included in Drill distribution can access HBase 1.x cluster.
>
> [1] https://blogs.apache.org/hbase/entry/start_of_a_new_era
>
> On Tue, Mar 15, 2016 at 10:18 AM, Kevin Verhoeven <
> [email protected]
> > wrote:
>
> > Currently the HBase Storage plugin supports HBase 0.98. Is there a
> > plan to update the storage plugin to support HBase 1.0?
> >
> > Thanks!
> >
> > Kevin
> >
>
>
>
