Re: DISCUSS: Strip xref from our site generation

2016-11-16 Thread Nick Dimiduk
Agree the value add is minimal. On Wed, Nov 16, 2016 at 9:41 PM Stack wrote: > The xref pages were useful once before grepcode and easy navigation in > apache git and github. Now, not so much. It is a long time since I've seen > anyone make a citation using xref pointers. Meantime the pages add

[jira] [Created] (HBASE-17119) Fix yetus hbase-personality so we don't try and generate protos in modules that have none

2016-11-16 Thread stack (JIRA)
stack created HBASE-17119: - Summary: Fix yetus hbase-personality so we don't try and generate protos in modules that have none Key: HBASE-17119 URL: https://issues.apache.org/jira/browse/HBASE-17119 Project:

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Stack
On Wed, Nov 16, 2016 at 10:44 PM, Stack wrote: > On Wed, Nov 16, 2016 at 10:57 AM, Gary Helmling > wrote: > >> >> Do you folks run the meta-carrying-master form G? > > Pardon me. I missed a paragraph. I see you folks do deploy this form. St.Ack > St.Ack > > > > > >> >> >> > > > >> > > Is th

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Stack
On Wed, Nov 16, 2016 at 10:57 AM, Gary Helmling wrote: > Only answer to the above observation is demonstration that ITBLL with meta > not on master is as robust as runs that have master carrying meta. > > > Agree that this is a prerequisite. Another useful measure might be the > delay before an

DISCUSS: Strip xref from our site generation

2016-11-16 Thread Stack
The xref pages were useful once before grepcode and easy navigation in apache git and github. Now, not so much. It is a long time since I've seen anyone make a citation using xref pointers. Meantime the pages add a bunch of bulk to our site. I suggest we undo their generation as part of site build

[jira] [Created] (HBASE-17118) StoreScanner leaked in KeyValueHeap

2016-11-16 Thread binlijin (JIRA)
binlijin created HBASE-17118: Summary: StoreScanner leaked in KeyValueHeap Key: HBASE-17118 URL: https://issues.apache.org/jira/browse/HBASE-17118 Project: HBase Issue Type: Bug Repor

[jira] [Resolved] (HBASE-17108) ZKConfig.getZKQuorumServersString does not return the correct client port number

2016-11-16 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-17108. Resolution: Fixed Assignee: Andrew Purtell Pushed to 0.98 > ZKConfig.getZKQuorumServ

[jira] [Resolved] (HBASE-16997) [Master] Collect table use information from RegionServers

2016-11-16 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-16997. Resolution: Invalid This is encapsulated in HBASE-17000 > [Master] Collect table use information f

[jira] [Created] (HBASE-17117) Reversed scan returns deleted versions and breaks RegionLocator

2016-11-16 Thread Ashu Pachauri (JIRA)
Ashu Pachauri created HBASE-17117: - Summary: Reversed scan returns deleted versions and breaks RegionLocator Key: HBASE-17117 URL: https://issues.apache.org/jira/browse/HBASE-17117 Project: HBase

[jira] [Resolved] (HBASE-6982) Tool or equivalent functionality to perform online region merges.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6982. -- Resolution: Duplicate Resolving as dupe of HBASE-1621 > Tool or equivalent functionality to perform online re

[jira] [Resolved] (HBASE-6968) Several HBase write perf improvement

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6968. -- Resolution: Not A Problem Resolving as not a problem anymore. "I look through trunk code, there's no change nee

[jira] [Resolved] (HBASE-6956) Do not return back to HTablePool closed connections

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6956. -- Resolution: Not A Problem No longer a problem. We don't do connections in the 0.90-way. > Do not return back to

[jira] [Resolved] (HBASE-6929) Publish Hbase 0.94 artifacts build against hadoop-2.0

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6929. -- Resolution: Not A Problem Resolving as not a problem any more. > Publish Hbase 0.94 artifacts build against had

[jira] [Resolved] (HBASE-9826) KeyValue should guard itself against corruptions

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9826. -- Resolution: Fixed in KeyValue.createByteArray() we check for the valid parameters used i

[jira] [Resolved] (HBASE-6773) Make the dfs replication factor configurable per table

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6773. -- Resolution: Invalid No longer valid. Can set by CF using the key HColumnDescriptor.DEFAULT_DFS_REPLICATION (It

[jira] [Resolved] (HBASE-9877) HFileOutputFormat creates partitions file with random name under /tmp

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9877. -- Resolution: Fixed Original issue was addressed by HBASE-13010. HBASE-15129 exposes hbas

[jira] [Resolved] (HBASE-6725) Check and Put can fail when using locks

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6725. -- Resolution: Cannot Reproduce Resolving because against 0.90 hbase. Also locking is different now in that we don

[jira] [Resolved] (HBASE-6722) fixHdfsOrphans won't work for first/end regions

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6722. -- Resolution: Later No one working on it. And this is all going to change in 2.0. Resolving as later. > fixHdfsO

[jira] [Resolved] (HBASE-6709) Refactoring QOS levels convention

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6709. -- Resolution: Invalid Internal stuff. Not user-level. Old. > Refactoring QOS levels convention > ---

[jira] [Resolved] (HBASE-6675) TestTableInputFormatScan takes too much time: 652.393s

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6675. -- Resolution: Won't Fix Old hbase resolving. > TestTableInputFormatScan takes too much time: 652.393s > -

[jira] [Resolved] (HBASE-6660) Meta assignment to a region server caused continuous NPE loop during postOpenDeployTasks

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6660. -- Resolution: Cannot Reproduce Old hbase. Reopen if can repro in new hbase. > Meta assignment to a region server

[jira] [Resolved] (HBASE-6465) Load balancer repeatedly close and open region in the same regionserver.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6465. -- Resolution: Won't Fix Issue w/ old load balancer. Reopen if can repro in newer balancer. > Load balancer repeat

[jira] [Resolved] (HBASE-6463) Support multiple memstore snapshots in order to support small/large flushes of cache.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6463. -- Resolution: Duplicate Resolving as a duplicate of the inmemory compaction effort (FYI [~anastas]) > Support mul

[jira] [Resolved] (HBASE-9913) weblogic deployment project implementation under the mapreduce hbase reported a NullPointerException

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9913. -- Resolution: Duplicate Fixed in HBASE-12491 > weblogic deployment project implementation

[jira] [Resolved] (HBASE-6461) Killing the HRegionServer and DataNode hosting ROOT can result in a malformed root table.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6461. -- Resolution: Cannot Reproduce No ROOT in modern hbases. Resolving as cannot repro. > Killing the HRegionServer a

[jira] [Resolved] (HBASE-6457) when use bulkload, hundreds of reduce write hfile, maybe create files of the same name, as a result some data loss

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6457. -- Resolution: Not A Problem Problem in 0.90 only. Resolving. > when use bulkload, hundreds of reduce write hfile,

[jira] [Resolved] (HBASE-9925) Don't close a file if doesn't EOF while replicating

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9925. -- Resolution: Later Resolving for later, we should better fix other replication bottleneck

[jira] [Resolved] (HBASE-6391) Master restart when enabling table will lead to region assignned twice

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6391. -- Resolution: Not A Problem Reopen if can repro in more modern hbase. > Master restart when enabling table will l

[jira] [Resolved] (HBASE-6343) After migrating from one cluster to another, new hmaster dies when reaching out to old nodes

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6343. -- Resolution: Won't Fix Seems like an old issue probably a problem in old hbase. Reopen if can repro in new conte

[jira] [Resolved] (HBASE-6338) Cache Method in RPC handler

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-6338. -- Resolution: Not A Problem We don't need this anymore [~aoxiang], right, in protobuf context and Service with al

[jira] [Resolved] (HBASE-9940) PerformanceEvaluation should have a test with many table options on (Bloom, compression, FAST_DIFF, etc.)

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9940. -- Resolution: Fixed Most of the features requested by [~jmspaggi] are already present in

[jira] [Created] (HBASE-17116) [PerformanceEvaluation] Add option to configure block size

2016-11-16 Thread Esteban Gutierrez (JIRA)
Esteban Gutierrez created HBASE-17116: - Summary: [PerformanceEvaluation] Add option to configure block size Key: HBASE-17116 URL: https://issues.apache.org/jira/browse/HBASE-17116 Project: HBase

[jira] [Resolved] (HBASE-9968) Cluster is non operative if the RS carrying -ROOT- is expiring after deleting -ROOT- region transition znode and before adding it to online regions.

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-9968. -- Resolution: Won't Fix We no longer have {{-ROOT-}} > Cluster is non operative if the RS

[jira] [Resolved] (HBASE-6205) Support an option to keep data of dropped table for some time

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-6205. -- Resolution: Later Resolving for later, We already have the archive and snapshots and we

[jira] [Resolved] (HBASE-3991) Add Util folder for Utility Scripts

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3991. -- Resolution: Won't Fix No progress on this in 5 years. We tend to unify things on the mai

[jira] [Resolved] (HBASE-3975) NoServerForRegionException stalls write pipeline

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3975. -- Resolution: Fixed The new async client is taking care of this. > NoServerForRegionExcep

[jira] [Resolved] (HBASE-5977) Usage of modules

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5977. -- Resolution: Fixed Assignee: Jesse Yates Resolving as done. When this issue was being worked on, we were ca

[jira] [Resolved] (HBASE-3854) [thrift] broken thrift examples

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3854. -- Resolution: Later Resolving as later for now. We should fix coverage on the hbase-exampl

[jira] [Resolved] (HBASE-5921) Add support remaining admin functionality on a table reference in shell

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5921. -- Resolution: Later Not being worked on. > Add support remaining admin functionality on a table reference in shel

[jira] [Resolved] (HBASE-5686) Should add backup masters to AvroUtil.csToACS()

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5686. -- Resolution: Invalid No more avro in hbase. > Should add backup masters to AvroUtil.csToACS() >

[jira] [Resolved] (HBASE-5505) if max file size set to 256M, Per table hbase.hregion.max.filesize setting(at htable creation) overwritten by value set in hbase-site.conf(which might not be 256MB)

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5505. -- Resolution: Later Resolving at Steven's suggestion: "after a try, I think its too expensive to fix this minor b

[jira] [Resolved] (HBASE-5578) NPE when regionserver reported server load, caused rs stop.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5578. -- Resolution: Cannot Reproduce > NPE when regionserver reported server load, caused rs stop. > ---

[jira] [Resolved] (HBASE-3792) TableInputFormat leaks ZK connections

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3792. -- Resolution: Won't Fix > TableInputFormat leaks ZK connections >

[jira] [Resolved] (HBASE-5461) Set hbase.hstore.compaction.min.size way down to 4MB

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5461. -- Resolution: Invalid Compaction has moved on from the context where this issue made sense. Resolving. > Set hbas

[jira] [Resolved] (HBASE-5324) interactive hbck: fix something after confirmed from user

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5324. -- Resolution: Later Nice to have but no one working on it and hbck is about to change radically. > interactive hb

[jira] [Resolved] (HBASE-5148) Compaction property at the server level are not propagated at the table level.

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5148. -- Resolution: Invalid Resolving as per [~anoop.hbase] "I think this is not a valid bug and can be closed." > Com

[jira] [Resolved] (HBASE-5146) Hbase Shell - allow setting config properties

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5146. -- Resolution: Duplicate Overlap with issues about online config including HBASE-7236 > Hbase Shell - allow settin

[jira] [Resolved] (HBASE-5075) regionserver crashed and failover

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5075. -- Resolution: Won't Fix The summary and description describe an issue we still have. The patch though is for some

[jira] [Resolved] (HBASE-3791) Display total number of zookeeper connections on master.jsp

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3791. -- Resolution: Fixed zk.jsp (ZKUtil.dump() see HBASE-2692) from the Master UI already provi

[jira] [Resolved] (HBASE-5024) A thread named LruBlockCache.EvictionThread remains after the shutdown of a cluster

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-5024. -- Resolution: Cannot Reproduce Don't seem to see this in more modern hbase's. Resolving (Matteo traced code and w

[jira] [Resolved] (HBASE-4988) MetaServer crash cause all splitting regionserver abort

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4988. -- Resolution: Won't Fix Patch for 0.90. Won't have this issue in 2.0. Reopen if issue in more modern hbase. > Met

[jira] [Resolved] (HBASE-3786) Enhance MasterCoprocessorHost to include notification of balancing of each region

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3786. -- Resolution: Won't Fix HBASE-4552 was closed and as [~apurtell] stated in HBASE-3529 with

[jira] [Resolved] (HBASE-4947) CopyTable warns about being unable to find table from wrong instance of HBase

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4947. -- Resolution: Cannot Reproduce Reopen if can be repro'd on more modern hbase. > CopyTable warns about being unabl

[jira] [Resolved] (HBASE-4633) Potential memory leak in client RPC timeout mechanism

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4633. -- Resolution: Cannot Reproduce RPC is very different now. Resolving as cannot repro. > Potential memory leak in c

[jira] [Resolved] (HBASE-4921) HTable initialization looks for EMPTY_START_ROW

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4921. -- Resolution: Cannot Reproduce Resolving as no longer relevant. > HTable initialization looks for EMPTY_START_ROW

[jira] [Resolved] (HBASE-3782) Multi-Family support for bulk upload tools causes File Not Found Exception

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3782. -- Resolution: Won't Fix Should be fixed by atomic bulk loading from HBASE-4552 > Multi-Fa

[jira] [Resolved] (HBASE-4631) Cleanup and optimize embedded HRegionThriftServer

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4631. -- Resolution: Won't Fix Not an issue any more There is no embedded thrift server any more. > Cleanup and optimize

[jira] [Resolved] (HBASE-4587) HBase MR support for multiple tables as input

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4587. -- Resolution: Duplicate Implemented elsewhere. See MultiTableInputFormat and MultiTableOutputFormat. > HBase MR s

[jira] [Resolved] (HBASE-3778) HBaseAdmin.create doesn't create empty boundary keys

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3778. -- Resolution: Duplicate > HBaseAdmin.create doesn't create empty boundary keys > -

[jira] [Resolved] (HBASE-4324) Single unassigned directory is very slow when there are many unassigned nodes

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4324. -- Resolution: Won't Fix No longer pertinent (don't keep list of unassigneds in zk now). Could have this issue whe

[jira] [Resolved] (HBASE-4274) RS should periodically ping its HLog pipeline even if no writes are arriving

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4274. -- Resolution: Won't Fix Rather than ping so we can crash closer to the removal of HDFS, instead try and ride over

[jira] [Resolved] (HBASE-4246) Cluster with too many regions cannot withstand some master failover scenarios

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4246. -- Resolution: Won't Fix Resolving as stale, no-longer-pertinent. Reopen if still issue in more modern hbase. > C

[jira] [Resolved] (HBASE-3725) HBase increments from old value after delete and write to disk

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3725. -- Resolution: Resolved Resolving per last comment from [~larsh] > HBase increments from o

[jira] [Resolved] (HBASE-4216) IllegalArgumentException prefetching from META

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4216. -- Resolution: Won't Fix Prefetch has been purged Resolving as no-longer-relevant, won't fix. > IllegalArgumentExc

[jira] [Resolved] (HBASE-4198) Harmonize HBA flush, compact and majorCompact

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4198. -- Resolution: Won't Fix Stale. Context long gone. Resolving. Open if problem in more recent hbase. > Harmonize HB

[jira] [Resolved] (HBASE-4134) The total number of regions was more than the actual region count after the hbck fix

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-4134. -- Resolution: Invalid Stale. Reopen if can repro in more modern hbase. > The total number of regions was more tha

[jira] [Resolved] (HBASE-3432) [hbck] Add "remove table" switch

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3432. -- Resolution: Won't Fix closing as stale. Not seen in a long time. > [hbck] Add "remove t

[jira] [Resolved] (HBASE-3307) Add checkAndPut to the Thrift API

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-3307. -- Resolution: Duplicate dup of HBASE-10960 > Add checkAndPut to the Thrift API >

[jira] [Resolved] (HBASE-2535) split hostname format should be consistent with tasktracker for locality

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-2535. -- Resolution: Duplicate resolved by HBASE-7693 > split hostname format should be consiste

[jira] [Resolved] (HBASE-74) [performance] When a get or scan request spans multiple columns, execute the reads in parallel

2016-11-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-74. Resolution: Duplicate Resolving as superceded by HBASE-1935 > [performance] When a get or scan request spans multiple

[jira] [Resolved] (HBASE-2434) Add scanner caching option to Export and write buffer option for Import

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-2434. -- Resolution: Won't Fix No longer relevant, superseded by the buffered mutator and [~yangz

[jira] [Resolved] (HBASE-2376) Add special SnapshotScanner which presents view of all data at some time in the past

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-2376. -- Resolution: Later Equivalent functionality can be achieved by using HBASE-4536, HBASE-40

[jira] [Resolved] (HBASE-2213) HCD should only have those fields explicitly set by user while creating tables

2016-11-16 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HBASE-2213. -- Resolution: Won't Fix Stale, re-open if you consider this needs to be implemented. > HC

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Gary Helmling
On Wed, Nov 16, 2016 at 11:36 AM Ted Yu wrote: > HBASE-16025 is currently marked Critical. > > I think it should be a blocker. > > Done.

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Ted Yu
HBASE-16025 is currently marked Critical. I think it should be a blocker. Cheers On Nov 16, 2016, at 11:10 AM, Gary Helmling wrote: >> >> Gary has a JIRA HBASE-16025 which would reduce the load on server hosting >> hbase:meta. > Thanks for bringing this issue up, Ted. It still needs to be

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Gary Helmling
> > Gary has a JIRA HBASE-16025 which would reduce the load on server hosting > hbase:meta. > > Thanks for bringing this issue up, Ted. It still needs to be fixed. Due to the shift of table state into meta, the git master branch will currently trigger calls to meta for every call retry. This is e

Re: Merge and HMerge

2016-11-16 Thread Enis Söztutar
@Appy what is not clear from above? I think we should get rid of both Merge and HMerge. We should not have any tool which will work in offline mode by going over the HDFS data. Seems very brittle to be broken when things get changed. Only use case I can think of is that somehow you end up with a

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Gary Helmling
On Tue, Nov 15, 2016 at 11:44 AM wrote: > > In the absence of more information, intuition says master carries meta > to avoid a whole class of problems. > Off-hand I think the class of problems we'll eliminate are problems that > are well understood and being constantly dealt with and hardened to

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Gary Helmling
Only answer to the above observation is demonstration that ITBLL with meta not on master is as robust as runs that have master carrying meta. Agree that this is a prerequisite. Another useful measure might be the delay before an assignment under load is visible to clients. > > But making RPC

[DISCUSS] hbase-spark module in branch-1 and branch-2

2016-11-16 Thread Sean Busbey
Hi folks! With 2.0 releases coming up, I'd like to revive our prior discussion on the readiness of the hbase-spark module for downstream users. We've had a ticket for tracking the milestones set up for inclusion in branch-1 releases for about 1.5 years: https://issues.apache.org/jira/browse/HBAS

[jira] [Created] (HBASE-17115) HMaster/HRegion Info Server does not honour admin.acl

2016-11-16 Thread Arshad Mohammad (JIRA)
Arshad Mohammad created HBASE-17115: --- Summary: HMaster/HRegion Info Server does not honour admin.acl Key: HBASE-17115 URL: https://issues.apache.org/jira/browse/HBASE-17115 Project: HBase I

[jira] [Created] (HBASE-17114) Add an option to set special retry pause when encountering CallQueueTooBigException

2016-11-16 Thread Yu Li (JIRA)
Yu Li created HBASE-17114: - Summary: Add an option to set special retry pause when encountering CallQueueTooBigException Key: HBASE-17114 URL: https://issues.apache.org/jira/browse/HBASE-17114 Project: HBase

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Yu Li
@Mikhail: Thank you sir for the reference to HBASE-15654 and good to know the efforts on optimizing meta cache. But in our case there might be plenty of new process launched and accessing hbase at the same time, like at the very beginning of some big yarn batch job or during the failover of streami

[jira] [Created] (HBASE-17113) finding middle key in HFileV2 is always wrong and can cause IndexOutOfBoundsException

2016-11-16 Thread Allan Yang (JIRA)
Allan Yang created HBASE-17113: -- Summary: finding middle key in HFileV2 is always wrong and can cause IndexOutOfBoundsException Key: HBASE-17113 URL: https://issues.apache.org/jira/browse/HBASE-17113 Pr

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Bryan Beaudreault
I'd like to echo Yu Li. As an operator/user, it is very helpful to be able to run the masters separately. This allows for hot fixes, but also simplifies operations in times of crisis: if there's any real issue, we can restart the masters at will without any fear of impact. If the plan is to coloca

[jira] [Created] (HBASE-17112) Prevent setting timestamp of delta operations being same as previous value's

2016-11-16 Thread Phil Yang (JIRA)
Phil Yang created HBASE-17112: - Summary: Prevent setting timestamp of delta operations being same as previous value's Key: HBASE-17112 URL: https://issues.apache.org/jira/browse/HBASE-17112 Project: HBase

Successful: HBase Generate Website

2016-11-16 Thread Apache Jenkins Server
Build status: Successful If successful, the website and docs have been generated. To update the live site, follow the instructions below. If failed, skip to the bottom of this email. Use the following commands to download the patch and apply it to a clean branch based on origin/asf-site. If yo

Re: Time for 1.1.8

2016-11-16 Thread Ted Yu
Nick: Next week is a short week in US due to the holiday. Please consider making the RC either later this week before the weekend or after Thanksgiving. > On Nov 15, 2016, at 10:49 PM, Nick Dimiduk wrote: > > Heads up: it's about that time again. There's some nice fixes landed since > 1.1.7,

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Ted Yu
Gary has a JIRA HBASE-16025 which would reduce the load on server hosting hbase:meta. FYI > On Nov 16, 2016, at 2:13 AM, Yu Li wrote: > > Very late to the party +1 (Smile) > > We also offline discussed standalone meta server here in Alibaba since > we've observed crazily high QPS on meta cau

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Jean-Marc Spaggiari
Hi all, I'm not a commiter, but I really love this dicsussion and I want to chime in. I saw 2 very interesting ideas I'm reading between the lines. The first one was to not have any master, but get on RS making master decisions and therefore not hosting any region (or why not just the META). The

[jira] [Created] (HBASE-17111) Use Apache CLI in SnapshotInfo tool

2016-11-16 Thread Appy (JIRA)
Appy created HBASE-17111: Summary: Use Apache CLI in SnapshotInfo tool Key: HBASE-17111 URL: https://issues.apache.org/jira/browse/HBASE-17111 Project: HBase Issue Type: Bug Reporter: App

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread 宾莉金 or binlijin
Hosting meta on the machine that doesn't serve user regions would help to ensure that updates to meta have higher chance to succeed. But if that machine isn't Master, then we'd introduce yet one more service role to the deployment. And I'd say that different machine roles/service types required for

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Mikhail Antonov
(side note @Yu - FYI there has been a number of fixes/optimizations to the way we cache and invalidate caches of region locations on the client side in 1.3, see for example HBASE-15658, HBASE-15654). On the topic - Hosting meta on the machine that doesn't serve user regions would help to ensure t

Re: [DISCUSS] No regions on Master node in 2.0

2016-11-16 Thread Yu Li
Very late to the party +1 (Smile) We also offline discussed standalone meta server here in Alibaba since we've observed crazily high QPS on meta caused by online machine learning workload, and in the discussion we also mentioned pros. and cons. of serving meta on HMaster. Since quite some pros. al

Re: Merge and HMerge

2016-11-16 Thread Apekshit Sharma
bq. HMerge can merge multiple regions by going over the list of regions and checking their sizes. bq. But both of these tools (Merge and HMerge) are very dangerous I came across HMerge and it looks like dead code. Isn't referenced from anywhere except one test. (This is what lars also pointed out

Re: HBASE 2.0 release progress

2016-11-16 Thread ramkrishna vasudevan
For the offheap write path related things, The parent JIRA https://issues.apache.org/jira/browse/HBASE-15179 We have raised subtasks under that. Many of them are closed and there are 3 main sub-jiras now. All the 3 are now patch available. Subtasks include -> Reading the requests in to a ByteBuff

[jira] [Created] (HBASE-17110) Add an "Overall Strategy" option(balanced both on table level and server level) to SimpleLoadBalancer

2016-11-16 Thread Charlie Qiangeng Xu (JIRA)
Charlie Qiangeng Xu created HBASE-17110: --- Summary: Add an "Overall Strategy" option(balanced both on table level and server level) to SimpleLoadBalancer Key: HBASE-17110 URL: https://issues.apache.org/jira/b