Re: unknown host exception

Siva: I am not familiar with PDI I assume C15740 is reachable from the machine where you ran Pentaho. Which release of hbase are you using ? Cheers On Fri, Sep 25, 2015 at 6:40 AM, siva kumar wrote: > Hi Ted Yu, > Im tring using PDI. here is the full error m

Re: unknown host exception

Can you provide a bit more information? Your code snippet Release of hbase Pastebin of complete stack trace Thanks > On Sep 25, 2015, at 6:02 AM, siva kumar wrote: > > Hi Folks, >Im trying to write some data into hbase using pentaho. > Im facing issue in connecting to hbas

Re: Connection closes prematurely

See if this helps: http://pastebin.com/s9e86JHW On Thu, Sep 24, 2015 at 11:46 PM, Lydia Ickler wrote: > > > Hi Ted, > > I was running against hadoop-2. > Yeah, the Hbase-protocol seems to ne missing? > How would I add it? > > Best regards, > Lydia > > > &g

Re: Timeouts on snapshot restore

ion:org.apache.hadoop.hbase.errorhandling.TimeoutException: Timeout > elapsed! Source:Timeout caused Foreign Exception Start:1443145459635, > End:1443146059635, diff:60, max:60 ms > > Thanks! > > On Thu, Sep 24, 2015 at 6:34 PM, Ted Yu wrote: > > > 0.94.6 is reall

Re: Timeouts on snapshot restore

0.94.6 is really old. There have been quite a few bug fixes / improvements to snapshot feature since its release. The error happens when SnapshotDescription corresponding to kiji.prod.table.site.DI... was not found by ProcedureCoordinator. bq. does the timeout necessarily mean that the restore fa

Re: Prefetching Indexes of HFiles

I think the option you mentioned is for data blocks. As for index blocks, please refer to HFile V2 design doc. Also see this: https://issues.apache.org/jira/browse/HBASE -3857?focusedCommentId=13031489&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13031489 Cheers

Re: what can I do with create table configuration ?

Which release of hbase do you use ? I used command similar to yours and I got : hbase(main):005:0> describe 't3' Table t3 is ENABLED t3 COLUMN FAMILIES DESCRIPTION {NAME => 'cf', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE',

Re: Large number of column qualifiers

;*/ > > >> > > > byte[] getQualifierArray(); > > >> > > > > > >> > > > On Thu, Sep 24, 2015 at 12:10 AM, Gaurav Agarwal < > > gau...@arkin.net> > > >> > > wrote: > > >> > > > > >

Re: Connection closes prematurely

22:28:10,233 DEBUG org.apache.hadoop.hbase.util.ByteStringer - Failed to classload HBaseZeroCopyByteString: java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString Can you check the classpath ? HBaseZer

Re: Large number of column qualifiers

Please take a look at HBASE-11544 which is in hbase 1.1 Cheers On Wed, Sep 23, 2015 at 10:18 AM, Gaurav Agarwal wrote: > Hi All, > > I have Column Family with very large number of column qualifiers (> > 50,000). Each column qualifier is 8 bytes long. The problem is the when I > do a scan operat

Re: HBase Spark Streaming issue

to Hbase from spark developed by cloudera. > > > > Thanks > > > > On Mon, Sep 21, 2015 at 11:56 AM, Ted Yu wrote: > > > >> bq. spark-hbase-0.0.3-clabs-20150225.184251-1.jar > >> > >> The above jar is yours, right ? > >> > >>

Re: Hbase shell reports 2 live servers

Did you start region servers on all the datanodes ? If so, please check on the nodes where region server was not reported being alive. Cheers On Mon, Sep 21, 2015 at 2:22 PM, Christopher Chase wrote: > Hello, > > I currently have a cluster up and running (Name-node, Secondary name-node > and 6

Re: HBase Spark Streaming issue

s > > > On Mon, Sep 21, 2015 at 4:30 AM, Ted Yu wrote: > > > Dropping dev@ > > > > Looks like another version of hbase artifact was in the classpath. > > Can you double check ? > > > > Thanks > > > > > On Sep 21, 2015, at 12:45 AM,

Re: Multiwal performance with HBase 1.x

Thanks for sharing, Yu. Images didn't go through. Can you use third party site for sharing ? Cheers > On Sep 20, 2015, at 11:09 PM, Yu Li wrote: > > Hi Vlad, > > >> the existing write performance is more than adequate (avg load per RS > >> usually less than 1MB/sec) > We have some different

Re: HBase Spark Streaming issue

Dropping dev@ Looks like another version of hbase artifact was in the classpath. Can you double check ? Thanks > On Sep 21, 2015, at 12:45 AM, Siva wrote: > > Hi, > > I m seeing some strange error while inserting data from spark streaming to > hbase. > > I can able to write the data from sp

Re: JVM memory dump.

Pardon This one: https://confluence.atlassian.com/plugins/servlet/mobile#content/view/227416007 > On Sep 16, 2015, at 10:02 PM, Ted Yu wrote: > > Have you read this ? > http://spark.apache.org/community.html > > > >> On Sep 16, 2015, at 9:54 PM, James

Re: JVM memory dump.

Have you read this ? http://spark.apache.org/community.html > On Sep 16, 2015, at 9:54 PM, James Teng wrote: > > HI All, > > > first i have to say sorry, because this topic is not closely related to hbase > but jvm. Does jvm support or we can take other approaches to let the jvm dump > its

Re: [ANNOUNCE] Apache Gora 0.6.1 Release

Is there plan to support HBase 1.x releases ? Cheers On Mon, Sep 14, 2015 at 11:26 PM, lewis john mcgibbney wrote: > Hi All, > > The Apache Gora team are pleased to announce the immediate availability of > Apache Gora 0.6.1. > > What is Gora? > Gora is a framework which provides an in-memory da

Re: Multiwal performance with HBase 1.x

Since you have 8 SSDs, can you run the test with 8 groups of WAL ? Thanks On Tue, Sep 15, 2015 at 7:44 PM, Jingcheng Du wrote: > I did some tests on multiple wal, but with a much smaller data size, only > 100G. > I have 1 HMaster and 3 RegionServers. Each node has 8 SSD. > When I ran the test w

Re: HBase WebUI is not responding

connection: 192.168.0.54:56419: >> output error >> 2015-09-14 22:03:14,931 WARN [FifoRpcScheduler.handler1-thread-29] >> ipc.RpcServer: FifoRpcScheduler.handler1-thread-29: caught a >> ClosedChannelException, this means that the server was processing a request

Re: Defining WAL location within HDFS outside of rootdir

Anthony: bq. optimize the WAL location for the use case of a shared filesystem Can you tell us more about the nature of the shared filesystem ? Just want to understand your use case. If you have Hadoop system that supports tiered storage policies, this may be of interest to you: HBASE-12848 Chee

Re: HBase WebUI is not responding

nnected local=/192.168.0.54:33876 > remote=hbase-test-master2/192.168.0.54:6] > So there is some info in main page of the WebUI which isn’t responding, > any insights what it could be? > > Thanks. > > > > On 14 Sep 2015, at 15:09, Ted Yu wrote: > > > > C

Re: HBase WebUI is not responding

Can you check master log for the period when you accessed master web UI ? Does hbase shell function properly ? Thanks > On Sep 14, 2015, at 4:36 AM, Akmal Abbasov wrote: > > Hi all, > I’m having problems with accessing to HBase WebUI on active master node, > while I still can access to the W

Re: Why Hbase Master need also RegionServer on same host?

If I remember correctly, you posted the following : FAILED_OPEN hbase:namespace issue on RS with 1.1.2: Need table descriptor Do you mind continue debugging on that thread ? bq. if I decouple master from regionserver without the regionserver running on the same pod HDP 2.3 has Slider HBase whic

Re: HBase WebUI is not responding

Please check active master log and pastebin snippet when Web UI was accessed. Cheers On Fri, Sep 11, 2015 at 6:57 AM, Akmal Abbasov wrote: > Hi all, > I’m having problems with accessing to HBase WebUI on active master node, > while I still can access to the WebUI of the standby master. > I’ve c

Re: table comment

Do you use secure cluster ? Should the comment visibility be limited to certain users ? Cheers > On Sep 11, 2015, at 4:34 AM, Wojciech Indyk wrote: > > Hi! > I need to describe my HBase tables with some text. I try to find a > recommended solution, but I didn't. What I can propose is: > in hb

Re: FAILED_OPEN hbase:namespace issue on RS with 1.1.2: Need table descriptor

>From the snippet you posted, it is hard to tell whether DEBUG logging was turned on. If not, please turn on DEBUG logging and try to reproduce. Pastebinning hbase-site.xml would also help give us some clue. Cheers On Thu, Sep 10, 2015 at 9:10 PM, Ted Yu wrote: > htd is obtai

Re: FAILED_OPEN hbase:namespace issue on RS with 1.1.2: Need table descriptor

htd is obtained in RSRpcServices#openRegion(): htd = htds.get(region.getTable()); if (htd == null) { htd = regionServer.tableDescriptors.get(region.getTable()); htds.put(region.getTable(), htd); } Can you pastebin more of the region server log prior

Re: Wide table vs narrower table with blob

From write perf point of view, blobs are better, of course. > > -Vlad > > On Thu, Sep 10, 2015 at 9:33 AM, Ted Yu wrote: > > > You may have seen this: > http://hbase.apache.org/book.html#schema.smackdown > > > > bq. are part of one column family > > > &g

Re: Wide table vs narrower table with blob

You may have seen this: http://hbase.apache.org/book.html#schema.smackdown bq. are part of one column family Are the columns equally likely to be read ? I ask this because you may be able to utilize essential column family feature by separating columns which tend to be more frequently accessed in

Re: Balance to dead region server?

172.16.31.133 truncate ecitem:IVT_ItemInventory > > > - > > 2015-09-08 17:47 GMT-07:00 Ted Yu : > > > Can you pastebin more of the master log after 15:29:33,856 w.r.t. > > e3ecmrhdp24 ? > > > > I wonder how master thought e3ecmrhdp24 became live again. > >

Re: Balance to dead region server?

mercury.corp,60020,1441316616368 > 2015-09-03 15:29:36,399 INFO > org.apache.hadoop.hbase.io.hfile.LruBlockCache: totalSize=417.02 KB, > freeSize=395.54 MB, max=395.95 MB, blockCount=0, accesses=0, hits=0, > hitRatio=0, cachingAccesses=0, cachingHits=0, > cachingHitsRatio=0,evictions=269245

Re: Balance to dead region server?

Can you pastebin master log snippet with regard to the dead server ? > On Sep 8, 2015, at 5:16 PM, 伍照坤 wrote: > > Hi, Guys > > I encountered a serious problem in Production, the HMaster schedule lots of > balance jobs to a dead node. > > Environment: hbase-1.0.0-cdh.4.0, hadoop-2.6.0-cdh5.4

Re: regions stuck in transition

> On Mon, Sep 7, 2015 at 3:22 PM, Hbase Janitor > wrote: > >> looks like I have a corrupt hfile, probably related to the replication >> problems i'm having now. >> >> Thanks for the help! >> >>> On Mon, Sep 7, 2015 at 3:16 PM, Ted Yu wro

Re: regions stuck in transition

After timeout, the master would re-assign those regions. Can you check region server log to see why region open failed ? Was there any HFile which couldn't be opened ? Pastebinning log snippet if needed. Cheers On Mon, Sep 7, 2015 at 11:24 AM, Hbase Janitor wrote: > Hi, > > I have another pro

Re: strange replication problem

y morning. > > On Mon, Sep 7, 2015 at 1:47 PM, Ted Yu wrote: > > > Was there region movement prior to 11:24:00 (on the region server > > where WrongRegionException > > was observed) ? > > > > Cheers > > > > On Mon, Sep 7, 2015 at 9:59 AM, Hbase

Re: strange replication problem

Was there region movement prior to 11:24:00 (on the region server where WrongRegionException was observed) ? Cheers On Mon, Sep 7, 2015 at 9:59 AM, Hbase Janitor wrote: > Hi, > > We've recently upgraded to hbase 1.0 and we are seeing a strange error in > the region logs: > > 2015-09-07 11:24:00

Re: HBase table region size

For the 96 region table, region size is too small. In production, I have seen region size as high as 50GB. FYI > On Sep 7, 2015, at 2:55 AM, Akmal Abbasov wrote: > > Hi, > I would like to know about pros and cons against small region sizes. > Currently I have cluster with 5 nodes, which se

Re: Question about RPC queues

Kulkarni: Image didn't go through. Please use third party site for the image. Cheers On Fri, Sep 4, 2015 at 10:03 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Ah ok. So if I understand you right, irrespective of which queue type I > use, if a get comes when a chunk is b

Re: Multiwal performance with HBase 1.x

Do you have SSD's in your cluster ? If so, remember placing WAL files on SSD's Cheers On Thu, Sep 3, 2015 at 3:25 PM, milindshah wrote: > I agree that compaction is a separate discussion. What I am trying to do > here > is: > > 1) Load 2 TB of data with single WAL on an empty table. > 2) Load

Re: hbase thrift strange warning

You likely hit HBASE-14196 Workaround is to increase hbase.thrift.connection.max-idletime config parameter. Kudo to Vladimir. On Wed, Sep 2, 2015 at 5:17 PM, scratch28 wrote: > Trying to see if anybody knows why this is happening and how to fix > we are on hbase 1.1.1 > > We use javascript to

Re: How to detect whether hbase cluster is up and ready for accepting requests.

ons when the cluster is up. > > uknow. > ________ > From: Ted Yu > Sent: Tuesday, September 1, 2015 2:37 PM > To: user@hbase.apache.org > Subject: Re: How to detect whether hbase cluster is up and ready for > accepting requests. > > L

Re: Hbase Master error

eady > > Finally this command worked out > > bin/hadoop dfsadmin -safemode leave > > Now i able to see list tables and data's > > may i know why this sudden changes in hbase safemode > > > > On Tue, Sep 1, 2015 at 10:38 AM, Ted Yu wrote: > > >

Re: Hbase Master error

ation in hadoop set up > > beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps > 3287 SecondaryNameNode > 3599 NodeManager > 3478 ResourceManager > 3897 Jps > 3133 DataNode > 3014 NameNode > > > is that any way or command to check hdfs is working fine? > > On Tue, Sep 1

Re: How to detect whether hbase cluster is up and ready for accepting requests.

Looks like the link Samir shared is missing the following method: public Map getRegionsInTransition() { FYI On Tue, Sep 1, 2015 at 5:28 AM, Samir Ahmic wrote: > Hi, > Depending on your hbase version you can get ClusterStatus over api. > > https://hbase.apache.org/apidocs/org/apache/hadoop/hb

Re: reginoserver shutdown

聪聪: HBase 0.96 is quite old. Please consider upgrading to latest 0.98.14 or 1.1.2 release. Cheers On Tue, Sep 1, 2015 at 5:40 AM, Samir Ahmic wrote: > Hi, > Based on you logs: > 2015-09-01 15:35:58,047 INFO [JvmPauseMonitor] util.JvmPauseMonitor: > Detected pause in JVM or host machine *(eg G

Re: Error information when regionserver start

Did you attach image(s) ? They didn't go through. Please use third party site or paste text of the error. Cheers On Mon, Aug 31, 2015 at 7:15 PM, jackiehbaseuser wrote: > > Hi > > > Error information when regionserver start,howerver regionserver is normal > and avaliable .How can i resolve th

Re: Access cell tags from HBase shell

ell, > right? Cells are only interpreted server side and are not returned on the > client side... > > 2015-08-31 15:52 GMT-04:00 Ted Yu : > > > From the help message of put command, you can see the following: > > > > hbase> put 't1', 'r1'

Re: Access cell tags from HBase shell

>From the help message of put command, you can see the following: hbase> put 't1', 'r1', 'c1', 'value', ts1, {VISIBILITY=>'PRIVATE|SECRET'} Here is the group of related commands: 'visibility labels', :full_name => 'VISIBILITY LABEL TOOLS', :comment => "NOTE: Above commands are only appli

Re: Problem with HBase + Kerberos

> > > > >> I'm using HDP 2.2.4.2, with HBase 0.98.4.2.2. > > > >> I have unlimited strength JCE installed. > > > >> > > > >> I'll try to have more clues with this option. > > > >> > > > >> Loïc

Re: Using HBase with a shared filesystem (gluster, nfs, s3, etc)

ell without these nodes and a balanced cluster > (+- 3 regions per node), balancer ran very quickly, around 3 seconds. > > On Thu, Aug 27, 2015 at 9:50 AM, Ted Yu wrote: > > > How balanced are the table regions in your cluster ? > > > > Cheers > > > > On Thu

Re: Using HBase with a shared filesystem (gluster, nfs, s3, etc)

; > AFAIK, region movement does not moves the data of region on the > > (distributed)FileSystem. It should only, update metadata of HBase. > > Did you check diskio stats during region movement? > > > > On Tue, Aug 25, 2015 at 10:40 AM, Ted Yu wrote: > > > > >

Re: hbase pre-split

You can refer to: http://hbase.apache.org/book.html#arch.region.splits Cheers On Wed, Aug 26, 2015 at 6:38 PM, jackiehbaseuser wrote: > > Hi > > How many ways about hbase pre-split? > > thank u very much! > > Best regards! > > > Jackie

Re: Sporadic incorrect table directory structure when running restore_snapshot

exactly what's going on? > > On Wed, Aug 26, 2015 at 1:20 PM, donmai wrote: > > > DEBUG is on, trying to look through the logs again. Thanks! > > > > On Wed, Aug 26, 2015 at 12:59 PM, Ted Yu wrote: > > > >> Did you enable DEBUG logging ? > &g

Re: Sporadic incorrect table directory structure when running restore_snapshot

Did you enable DEBUG logging ? Can you find the logs for one such occurrence and pastebin relevant portion ? Thanks On Wed, Aug 26, 2015 at 9:58 AM, donmai wrote: > Hi, > > Occasionally when I run restore_snapshot on HBase 0.98.10, it appears that > the table directory structure created by the

Re: HBase event triggers

Have you looked at http://hbase.apache.org/book.html#cp ? Cheers > On Aug 26, 2015, at 12:30 AM, Buntu Dev wrote: > > I'm planning on ingesting web page events via Flume to HBase and wanted to > know if there are any ways HBase related projects to define rules to > trigger an action if given

Re: Using HBase with a shared filesystem (gluster, nfs, s3, etc)

movement from a region reassignment? > > On Tue, Aug 25, 2015 at 12:40 PM, Ted Yu wrote: > > > Can you give a bit more information: > > > > which filesystem you use > > which hbase release you use > > master log snippet for the long region assignment > &g

Re: Using HBase with a shared filesystem (gluster, nfs, s3, etc)

Can you give a bit more information: which filesystem you use which hbase release you use master log snippet for the long region assignment Thanks On Tue, Aug 25, 2015 at 9:30 AM, donmai wrote: > Hi, > > I'm curious about how exactly region movement works with regard to data > transfer. To my

Re: optimal size for Hbase.hregion.memstore.flush.size and its impact

Related please see HBASE-13408 HBase In-Memory Memstore Compaction FYI On Mon, Aug 24, 2015 at 10:32 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > The split policy also uses the flush size to estimate how to split > tables... > > It's sometime fine to upgrade thise number a bit. Li

Re: thrift.ProcessFunction: Internal error processing get

When I clicked on http://pastebin.com/embed.php?i=r9uqr8iN , I didn't see 'Internal error ' message. I tried the above operation both at home and at work. Can you double check your code, considering the 'Invalid method name' message ? Thanks On Mon, Aug 24, 2015 at 7:32 AM, Chandrashekhar Koteka

Re: Thrift node.js code not working

getting ' ERROR thrift.ProcessFunction: Internal error processing get' > error in Thrift server logs. Shall I write separate thread about this error? > > > Regards, > Chandrash3khar Kotekar > Mobile - +91 8600011455 > >> On Mon, Aug 24, 2015 at 6:45 PM, Ted Yu w

Re: Thrift node.js code not working

s, > Chandrash3khar Kotekar > Mobile - +91 8600011455 > > On Mon, Aug 24, 2015 at 6:15 PM, Ted Yu wrote: > > > Which hbase release are you using ? > > > > Which version of thrift do you use in your app ? > > > > Thanks > > > > > > > &

Re: Thrift node.js code not working

Which hbase release are you using ? Which version of thrift do you use in your app ? Thanks > On Aug 24, 2015, at 5:00 AM, Chandrashekhar Kotekar > wrote: > > Hi, > > I am trying to use following code to test HBase Thrift interface for > Node.js but it is not working. > > *var thrift = re

Re: hbase rowkey design ways

Have you read the following ? http://hbase.apache.org/book.html#rowkey.design Cheers On Sun, Aug 23, 2015 at 8:01 AM, jackiehbaseuser wrote: > > Hi > > How many ways when i design the hbase rowkey ,and give some examples. > > Thank u very much! > > Best regards! > > qiguo

Re: Please welcome new HBase committer Stephen Yuan Jiang

Congratulations Stephen. > On Aug 20, 2015, at 7:09 PM, Andrew Purtell wrote: > > On behalf of the Apache HBase PMC, I am pleased to announce that Stephen > Jiang has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Stephen's hard work and generous >

Re: HBase on HDFS: proper way to setup

Whether having HBase instance on each data node depends on the amount of data you have and access pattern you expect. bq. Is it any useful to have more HBase nodes than HDFS nodes? I have never seen the above setup. Do you have an hdfs cluster already ? Can you let us know your use case ? Cheer

Re: New Region Server failing to open region and subsequent cluster hang

Have you run hbck on testnamespace:testtable ? bq. major compaction was running for a table. Which table was being compacted ? Is it possible for you to share the region server log of the new server ? Cheers On Thu, Aug 20, 2015 at 4:58 AM, mukund murrali wrote: > Hi > > Recently we tried ad

Re: Problem with HBase + Kerberos

Which hbase / hadoop release are you using ? Running with -Dsun.security.krb5.debug=true will provide more clue. Do you have unlimited strength JCE installed ? Cheers On Thu, Aug 20, 2015 at 5:46 AM, Loïc Chanel wrote: > Hi all, > > Since I kerberized my cluster, it seems like I can't use HBa

Re: mornitor the hbase

You can use opentsdb / ganglia Cheers > On Aug 20, 2015, at 5:25 AM, jackiehbaseuser wrote: > > Hi > > I want to the mornitor the Hbase(based hbase 0.96.2),which tool can i choose > ! > > Thank u very much! > > Best regards! > > qiguo

Re: hbase doubts

come in increasing dates > and for dates>2015-08-06 only so will go to child2 and child1 wil always be > half filled. And child2 only will lead to new splits when reached split > size threshold. > > > > > > > On Wed, Aug 19, 2015 at 4:16 AM, Ted Yu wrote: >

Re: Which is the fastest way to dump the content of Hbase table?

bq. 'spilling map output' occupied most of whole time. Do you mind giving more detail on the above (percentage of job runtime) ? Which release of hadoop / hbase are you using ? Cheers On Tue, Aug 18, 2015 at 11:11 PM, dong.yajun wrote: > Hello, > > Which is the fastest way to dump the conten

Re: hbase doubts

18, 2015 at 9:41 PM, anil gupta wrote: > > > As per my experience, Phoenix is way superior than Hive-HBase integration > > for sql-like querying on HBase. It's because, Phoenix is built on top of > > HBase unlike Hive. > > > > On Tue, Aug 18, 2015 at 9:09 AM,

Re: hbase doubts

: > Thanks! > > Which one is better for sqlkind of queries over hbase (queries involve > filter , key range scan), aggregates by column values. > . > 1.Hive storage handlers > 2.or Phoenix > > On Tue, Aug 18, 2015 at 9:14 PM, Ted Yu wrote: > > > For #1, if you want

Re: hbase doubts

iles from hdfs to region directory - does regionserver localise the hfile > by downloading it to local and then uploading again in region directory? Or > it just moves to to region directory and wait for next compaction to get it > localise as in regionserver failure case? > > > > >

Re: difference between ClientScanner and ClientSmallScanner

ClientSmallScanner is used in cases where a single RPC would fetch scan results. It is instantiated when Scan.isSmall() indicates a small scan. Cheers On Tue, Aug 18, 2015 at 8:11 AM, whodarewin2006 wrote: > hi, > I was read the source code of hbase-client recently,and I have a > question,w

Re: hbase doubts

of size (5 of 20 bytes each )and 3 fields of size 200 bytes > each. > > On Mon, Aug 17, 2015 at 9:55 PM, Ted Yu wrote: > > > How many fields such as F1 are you considering for embedding in row key ? > > > > Suggested reading: > > http://hbase.apac

Re: hbase doubts

return the result just > by traversing keys no need to read columns? > > > On Mon, Aug 17, 2015 at 8:27 PM, Ted Yu wrote: > > > For #1, it is the limit on a single keyvalue, not row, not key. > > > > For #2, please see the following: > > > > http://hbas

Re: hbase doubts

ad of few if it would have been one large > table ? > > > On Mon, Aug 17, 2015 at 7:29 PM, Ted Yu wrote: > > > For #1, take a look at the following in hbase-default.xml : > > > > hbase.client.keyvalue.maxsize > > 10485760 > > > > For #2, it

Re: hbase doubts

For #1, take a look at the following in hbase-default.xml : hbase.client.keyvalue.maxsize 10485760 For #2, it would be easier to answer if you can outline access patterns in your app. For #3, adjustment according to current region boundaries is done client side. Take a look at the javado

Re: How to get the creation time of a HTable?

After predetermined number of days, would your table(s) not receive any read / write requests ? Have you considered using TTL for cleaning old data ? Cheers > On Aug 14, 2015, at 2:54 AM, ShaoFeng Shi wrote: > > Hello the community, > > In my case, I want to cleanup the HTables that older t

Re: In Windows, cannot capture HBase prompt('hbase(main):001:0>') from neither standard output nor standard error using process API

I think Dinesh was referring to: http://docs.oracle.com/javase/7/docs/api/java/lang/Process.html Cheers On Thu, Aug 13, 2015 at 3:23 PM, Nick Dimiduk wrote: > dev to bcc > > Hi Dinesh, > > I'm not sure what you mean by "process API". Are you launching the hbase > shell as an external process? W

Re: Major compaction skipping for older regions

t; ttl=9223372036854775807 and blockLocalityIndex is 1.0 (min 0.0) > > > Yes after manual triggering the deletes purged. But we don't want to have > it manual. Any other config to avoid such scenario? > > Thanks > > > > On Mon, Aug 10, 2015 at 8:01 PM, Ted Yu wrote: > >

Re: Major compaction skipping for older regions

What release of hbase are you using ? Can you pastebin region server log with DEBUG logging ? I guess you have tried issuing manual command. Did it work ? Thanks On Mon, Aug 10, 2015 at 7:02 AM, mukund murrali wrote: > Any one help us in this :( Are we missing somewhere in the use case? None

Re: dead loop small compact

I noticed the compaction was on this single file in qproxy_request_info2,\x00\x00\x01_\x00\xC8\x01g\xA26,1415980522820. fc5207e028a3f5e549bf79c089561793. Can you examine this file using http://hbase.apache.org/book.html#_hfile_tool ? BTW 0.96 is really old. Various 1.x releases have been made. Ch

Re: RegionServers shutdown randomly

it may be > able to cause. > > James > > > On Fri, Aug 7, 2015 at 11:05 AM, Ted Yu wrote: > > Some WAL related files were marked corrupt. > > > > Can you try repairing them ? > > > > Please check namenode log. > > Search HDFS JIRA for any pendin

Re: groupby(prefix(rowkey)) with multiple custom aggregated columns

Please take a look at hbase-client/src/main/java/org/apache/hadoop/hbase/client/coprocessor/AggregationClient.java which shows several other aggregations. BTW group by functionality would involve some more work since rows for the same group may span multiple regions. Cheers On Fri, Aug 7, 2015

Re: RegionServers shutdown randomly

MISSING SIZE: 360 B > > Corrupt blocks: 0 > Number of data-nodes: 4 > Number of racks: 1 > FSCK ended at Fri Aug 07 14:51:26 UTC 2015 in 4511 milliseconds > > The filesystem under path '/' is CORRUPT > - > > Thank you for y

Re: RegionServers shutdown randomly

Does 10.240.187.182 correspond with w-0 or m ? Looks like hdfs was intermittently unstable. Have you run fsck ? Cheers On Fri, Aug 7, 2015 at 12:59 AM, Adrià Vilà wrote: > Hello, > > HBase RegionServers fail once in a while: > - it can be any regionserver, no

Re: Flink & Hbase

Which release of hbase are you using ? Can you pastebin the log(s) from client / server side ? Table regions spreading across region servers is common scenario. You should be able to get this working. Thanks On Thu, Aug 6, 2015 at 1:43 PM, Lydia Ickler wrote: > Hi, > > I am using HBase in col

Re: Flushs and compactions

#x27;f1:c1', 'val1' > > > > flush 'testflush' > > > > put 'testflush', 'row1', 'f1:c1', 'val1' > > > > flush 'testflush' > > > > put 'testflush', 'row1&#

Re: Flushs and compactions

Can you provide some more detail please ? Release of hbase region server log (snippet) showing that compaction is skipped Thanks On Wed, Aug 5, 2015 at 10:15 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Quick question here. > > Compactions seems to be triggered when we flush auto

Re: Re: Re: Question for return size of PageFilter

t; > > > > > > At 2015-08-03 22:59:32, "Ted Yu" wrote: > >If you use PageFilter alone, that sounds Okay. What happens when > PageFilter > >is combined with other filters ? > > > >Cheers > > > >On Mon, Aug 3, 2015 at 7:53 AM, whoda

Re: OutOfOrderScannerNextException with 1.1.0.1

There have been some improvements to FuzzyRowFilter.java since 1.1.0.1 e.g. HBASE-13761 If you have a chance, please try out 1.1.1 release. Cheers On Tue, Aug 4, 2015 at 4:01 AM, Michal Haris wrote: > Hi all, I'm having the issue of OutOfOrderScannerNextException, which in > this case happens

Re: ERROR: Can't get master address from ZooKeeper; znode data == null

tter handling initial > > set up in this case. Presuming we can get things working for you, would > you > > mind making a short write up of getting started using Homebrew? I'm not > > sure yet where we'd publish it; perhaps it would be a good addition to > the > > HBase blog. > > > > On Tu

Re: ERROR: Can't get master address from ZooKeeper; znode data == null

Your hbase-site.xml is effectively empty. Have you followed this guide ? http://hbase.apache.org/book.html#quickstart > Cheers On Tue, Aug 4, 2015 at 7:23 AM, Daniel de Oliveira Mantovani < daniel.oliveira.mantov...@gmail.com> wrote: > Good morning,

Re: Get using `.addColumn()` and `.setFilter()`

get = new Get(row) > > .addFamily(FAMILY) > > .setFilter(new ColumnPrefixFilter(Bytes.toBytes("sess"))); > > > > should work. > > > > -Vlad > > > > On Mon, Aug 3, 2015 at 2:41 PM, Ted Yu > > > wrote: > > > >

Re: Get using `.addColumn()` and `.setFilter()`

Is there column with prefix 'name' whose column name is longer than 'name' (such as 'name0') ? If not, take a look at MultipleColumnPrefixFilter Cheers On Mon, Aug 3, 2015 at 1:39 PM, Dmitry Minkovsky wrote: > I'm trying to construct a `Get` the does two things: > > - Gets a cell by specific,

Re: scan column families with different time ranges

gt; > > What is "recent" for your data? More than 7 days? Or less? Don't you > have > > weekly major compactions? If so and if you are scanning for more than 7 > > days, then you will read the older files anyway, no? > > > > JM > > Le 2015-08-02 05

Re: Re: Question for return size of PageFilter

erver one by one,if we get enough records,we > can stop scan and return the records,is this OK? > > > > > > > > > At 2015-07-31 21:04:43, "Ted Yu" wrote: > >Coordination across different region servers is likely to reduce > efficiency > >

Re: Compaction queue size constantly increase.

Can you take jstack of the region server next time this happens ? Btw please consider upgrading. 0.96.x is too old. > On Aug 3, 2015, at 5:18 AM, Chang Chen wrote: > > Hi All > > We use HBase 0.96.1.1, and find a very strange issue which looks > like CompactSplitThread is waiting for somet

<    6   7   8   9   10   11   12   13   14   15   >