[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650167#comment-14650167 ] Hudson commented on HBASE-14154: FAILURE: Integrated in HBase-TRUNK #6692 (See [https://builds.apache.org/job/HBase-TRUNK/6692/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev f504e4b4ed1a8173d1e8420207f608b8572436e2) * hbase-shell/src/main/ruby/shell/commands/create.rb * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterImpl.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHTableDescriptor.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650186#comment-14650186 ] Hudson commented on HBASE-14154: FAILURE: Integrated in HBase-1.2-IT #72 (See [https://builds.apache.org/job/HBase-1.2-IT/72/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev 92c7bbf310fce99cc0f37806a8b63ec751d31f6f) * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHTableDescriptor.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileWriter.java * hbase-shell/src/main/ruby/shell/commands/create.rb DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey updated HBASE-14085:
Status: Open (was: Patch Available)
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey updated HBASE-14085:
Attachment: HBASE-14085.2.patch
-02
* fix long lines
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey updated HBASE-14085:
Status: Patch Available (was: Open)
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13212) Procedure V2 - master Create/Modify/Delete namespace
[ https://issues.apache.org/jira/browse/HBASE-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650179#comment-14650179 ] Stephen Yuan Jiang commented on HBASE-13212: Attached the V2 patch to address javadoc warnings and checkstyle errors introduced by V1 patch. Procedure V2 - master Create/Modify/Delete namespace Key: HBASE-13212 URL: https://issues.apache.org/jira/browse/HBASE-13212 Project: HBase Issue Type: Sub-task Components: master Affects Versions: 2.0.0 Reporter: Stephen Yuan Jiang Assignee: Stephen Yuan Jiang Labels: reliability Attachments: HBASE-13212.v1-master.patch, HBASE-13212.v2-master.patch Original Estimate: 168h Remaining Estimate: 168h master side, part of HBASE-12439 starts up the procedure executor on the master and replaces the create/modify/delete namespace handlers with the procedure version. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13212) Procedure V2 - master Create/Modify/Delete namespace
[ https://issues.apache.org/jira/browse/HBASE-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Yuan Jiang updated HBASE-13212: --- Attachment: HBASE-13212.v2-master.patch Procedure V2 - master Create/Modify/Delete namespace Key: HBASE-13212 URL: https://issues.apache.org/jira/browse/HBASE-13212 Project: HBase Issue Type: Sub-task Components: master Affects Versions: 2.0.0 Reporter: Stephen Yuan Jiang Assignee: Stephen Yuan Jiang Labels: reliability Attachments: HBASE-13212.v1-master.patch, HBASE-13212.v2-master.patch Original Estimate: 168h Remaining Estimate: 168h master side, part of HBASE-12439 starts up the procedure executor on the master and replaces the create/modify/delete namespace handlers with the procedure version. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650181#comment-14650181 ] Hudson commented on HBASE-14154: SUCCESS: Integrated in HBase-1.3-IT #66 (See [https://builds.apache.org/job/HBase-1.3-IT/66/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev f2747969411737f65f5522ee867cc02a74cf310e) * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java * hbase-shell/src/main/ruby/shell/commands/create.rb * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHTableDescriptor.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileWriter.java DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650188#comment-14650188 ] Hudson commented on HBASE-14154: SUCCESS: Integrated in HBase-1.2 #89 (See [https://builds.apache.org/job/HBase-1.2/89/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev 92c7bbf310fce99cc0f37806a8b63ec751d31f6f) * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-shell/src/main/ruby/shell/commands/create.rb * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileWriter.java * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHTableDescriptor.java DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13988) Add exception handler for lease thread
[
https://issues.apache.org/jira/browse/HBASE-13988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-13988:
---
Fix Version/s: (was: 0.98.15)
0.98.14
Add exception handler for lease thread
--
Key: HBASE-13988
URL: https://issues.apache.org/jira/browse/HBASE-13988
Project: HBase
Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Liu Shaohui
Assignee: Liu Shaohui
Priority: Minor
Fix For: 2.0.0, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Attachments: HBASE-13988-addendum.diff, HBASE-13988-v001.diff,
HBASE-13988-v002.diff
In a prod cluster, a region server exited for some important
threads were not alive. After excluding other threads from the log, we
doubted the lease thread was the root.
So we need to add an exception handler to the lease thread to debug why it
exited in future.
{quote}
2015-06-29,12:46:09,222 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED: One or more
threads are no longer alive -- stop
2015-06-29,12:46:09,223 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
server on 21600
...
2015-06-29,12:46:09,330 INFO org.apache.hadoop.hbase.regionserver.LogRoller:
LogRoller exiting.
2015-06-29,12:46:09,330 INFO
org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Thread-37 exiting
2015-06-29,12:46:09,330 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer$CompactionChecker:
regionserver21600.compactionChecker exiting
2015-06-29,12:46:12,403 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer$PeriodicMemstoreFlusher:
regionserver21600.periodicFlusher exiting
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13714) Add tracking of the total response queue size
[ https://issues.apache.org/jira/browse/HBASE-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650470#comment-14650470 ] Esteban Gutierrez commented on HBASE-13714: --- Correct, the call was returning a result of that size and no BoundedByteBufferPool involved here since this is an ancient HBase 0.92 cluster. Add tracking of the total response queue size - Key: HBASE-13714 URL: https://issues.apache.org/jira/browse/HBASE-13714 Project: HBase Issue Type: Improvement Components: master, metrics, regionserver, rpc Affects Versions: 2.0.0, 1.0.2, 1.2.0 Reporter: Esteban Gutierrez I noticed this behavior while working on HBASE-13694: Once we are done processing a request, we decrement the call queue size on the RPC server. However, responses can be very large and sometimes sending them can take a long time. Since we don't keep track the response queue via metrics it is hard to spot when the responses are using too much resources on the RS. Ideally we should be tracking on the RS how much data we have in-flight in the response queue via metrics and not just in the logs if the size of the response exceeds a threshold (e.g hbase.ipc.warn.response.size or hbase.ipc.warn.response.time) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14122) Client API for determining if server side supports cell level security
[
https://issues.apache.org/jira/browse/HBASE-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650414#comment-14650414
]
Andrew Purtell commented on HBASE-14122:
The line length warning comes from the file autogenerated by the protobuf
compiler, I think we're good.
Client API for determining if server side supports cell level security
--
Key: HBASE-14122
URL: https://issues.apache.org/jira/browse/HBASE-14122
Project: HBase
Issue Type: Improvement
Reporter: Andrew Purtell
Assignee: Andrew Purtell
Priority: Minor
Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0
Attachments: HBASE-14122-0.98.patch, HBASE-14122-branch-1.patch,
HBASE-14122.patch, HBASE-14122.patch
Add a client API for determining if the server side supports cell level
security.
Ask the master, assuming as we do in many other instances that the master and
regionservers all have a consistent view of site configuration.
Return {{true}} if all features required for cell level security are present,
{{false}} otherwise, or throw {{UnsupportedOperationException}} if the master
does not have support for the RPC call.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12890) Provide a way to throttle the number of regions moved by the balancer
[ https://issues.apache.org/jira/browse/HBASE-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650424#comment-14650424 ] Andrew Purtell commented on HBASE-12890: +1 Provide a way to throttle the number of regions moved by the balancer - Key: HBASE-12890 URL: https://issues.apache.org/jira/browse/HBASE-12890 Project: HBase Issue Type: Improvement Affects Versions: 0.98.10 Reporter: churro morales Assignee: churro morales Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-12890.patch We have a very large cluster and we frequently add remove quite a few regionservers from our cluster. Whenever we do this the balancer moves thousands of regions at once. Instead we provide a configuration parameter: hbase.balancer.max.regions. This limits the number of regions that are balanced per iteration. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14165) The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues)
[
https://issues.apache.org/jira/browse/HBASE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650460#comment-14650460
]
Anoop Sam John commented on HBASE-14165:
make sense. +1
The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues +
numReadQueues + numScanQueues)
-
Key: HBASE-14165
URL: https://issues.apache.org/jira/browse/HBASE-14165
Project: HBase
Issue Type: Improvement
Components: rpc
Affects Versions: 0.99.2
Reporter: cuijianwei
Priority: Minor
Attachments: HBASE-14165-trunk.patch
The RWQueueRpcExecutor.queues will be initialized as:
{code}
queues = new ArrayListBlockingQueueCallRunner(writeHandlersCount +
readHandlersCount);
{code}
It seems this could be improved as:
{code}
queues = new ArrayListBlockingQueueCallRunner(numWriteQueues +
numReadQueues + numScanQueues);
{code}
Suggestions are welcomed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12890) Provide a way to throttle the number of regions moved by the balancer
[ https://issues.apache.org/jira/browse/HBASE-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650374#comment-14650374 ] Ted Yu commented on HBASE-12890: lgtm Provide a way to throttle the number of regions moved by the balancer - Key: HBASE-12890 URL: https://issues.apache.org/jira/browse/HBASE-12890 Project: HBase Issue Type: Improvement Affects Versions: 0.98.10 Reporter: churro morales Assignee: churro morales Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: HBASE-12890.patch We have a very large cluster and we frequently add remove quite a few regionservers from our cluster. Whenever we do this the balancer moves thousands of regions at once. Instead we provide a configuration parameter: hbase.balancer.max.regions. This limits the number of regions that are balanced per iteration. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650440#comment-14650440 ] Andrew Purtell edited comment on HBASE-6721 at 8/1/15 4:37 PM: --- Thanks [~toffer]. I applied your latest patch to master and pushed the result as new branch hbase-6721. I checked that it compiled before pushing but didn't run tests. Do you need this for 0.98? If so, we can do another branch hbase-6721-0.98 with a backport and rebase it at every RC. Or one of the 1.x-es was (Author: apurtell): Thanks [~toffer]. I applied your latest patch to master and pushed the result as new branch hbase-6721. I checked that it compiled before pushing but didn't run tests. Do you need this for 0.98? If so, we can do another branch hbase-6721-0.98 with a backport and rebase it at every RC. RegionServer Group based Assignment --- Key: HBASE-6721 URL: https://issues.apache.org/jira/browse/HBASE-6721 Project: HBase Issue Type: New Feature Reporter: Francis Liu Assignee: Francis Liu Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation. The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well. This is essentially a simplification of the approach taken in HBASE-4120. See attached document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650440#comment-14650440 ] Andrew Purtell commented on HBASE-6721: --- Thanks [~toffer]. I applied your latest patch to master and pushed the result as new branch hbase-6721. I checked that it compiled before pushing but didn't run tests. Do you need this for 0.98? If so, we can do another branch hbase-6721-0.98 with a backport and rebase it at every RC. RegionServer Group based Assignment --- Key: HBASE-6721 URL: https://issues.apache.org/jira/browse/HBASE-6721 Project: HBase Issue Type: New Feature Reporter: Francis Liu Assignee: Francis Liu Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation. The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well. This is essentially a simplification of the approach taken in HBASE-4120. See attached document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14122) Client API for determining if server side supports cell level security
[
https://issues.apache.org/jira/browse/HBASE-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650475#comment-14650475
]
Ashish Singhi commented on HBASE-14122:
---
lgtm
Client API for determining if server side supports cell level security
--
Key: HBASE-14122
URL: https://issues.apache.org/jira/browse/HBASE-14122
Project: HBase
Issue Type: Improvement
Reporter: Andrew Purtell
Assignee: Andrew Purtell
Priority: Minor
Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0
Attachments: HBASE-14122-0.98.patch, HBASE-14122-branch-1.patch,
HBASE-14122.patch, HBASE-14122.patch
Add a client API for determining if the server side supports cell level
security.
Ask the master, assuming as we do in many other instances that the master and
regionservers all have a consistent view of site configuration.
Return {{true}} if all features required for cell level security are present,
{{false}} otherwise, or throw {{UnsupportedOperationException}} if the master
does not have support for the RPC call.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HBASE-14148: - Attachment: HBASE-14148-cleanroom.1.patch Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Apekshit Sharma Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650271#comment-14650271 ] Gabor Liptak commented on HBASE-14148: -- [~busbey] Thank you for the pointers. They help to be in the right ballpark :) Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Apekshit Sharma Attachments: HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13714) Add tracking of the total response queue size
[ https://issues.apache.org/jira/browse/HBASE-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650463#comment-14650463 ] Anoop Sam John commented on HBASE-13714: bq.the byte buffer used for the respohnse in some calls was close to 1MB This call was actually returning result of this size? Or much lesser? Any idea u have? We had an issue with the buffer (for cell block creation) size calculation in BoundedByteBufferPool Add tracking of the total response queue size - Key: HBASE-13714 URL: https://issues.apache.org/jira/browse/HBASE-13714 Project: HBase Issue Type: Improvement Components: master, metrics, regionserver, rpc Affects Versions: 2.0.0, 1.0.2, 1.2.0 Reporter: Esteban Gutierrez I noticed this behavior while working on HBASE-13694: Once we are done processing a request, we decrement the call queue size on the RPC server. However, responses can be very large and sometimes sending them can take a long time. Since we don't keep track the response queue via metrics it is hard to spot when the responses are using too much resources on the RS. Ideally we should be tracking on the RS how much data we have in-flight in the response queue via metrics and not just in the logs if the size of the response exceeds a threshold (e.g hbase.ipc.warn.response.size or hbase.ipc.warn.response.time) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650410#comment-14650410
]
Andrew Purtell commented on HBASE-14085:
lgtm. Left minor comments up on RB
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650440#comment-14650440 ] Andrew Purtell edited comment on HBASE-6721 at 8/1/15 4:37 PM: --- Thanks [~toffer]. I applied your latest patch to master and pushed the result as new branch hbase-6721. I checked that it compiled before pushing but didn't run tests. Do you need this for 0.98? If so, we can do another branch hbase-6721-0.98 with a backport and rebase it at every RC. Or branch-1. was (Author: apurtell): Thanks [~toffer]. I applied your latest patch to master and pushed the result as new branch hbase-6721. I checked that it compiled before pushing but didn't run tests. Do you need this for 0.98? If so, we can do another branch hbase-6721-0.98 with a backport and rebase it at every RC. Or one of the 1.x-es RegionServer Group based Assignment --- Key: HBASE-6721 URL: https://issues.apache.org/jira/browse/HBASE-6721 Project: HBase Issue Type: New Feature Reporter: Francis Liu Assignee: Francis Liu Attachments: 6721-master-webUI.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_8.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation. The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well. This is essentially a simplification of the approach taken in HBASE-4120. See attached document. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13373) Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.
[ https://issues.apache.org/jira/browse/HBASE-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650464#comment-14650464 ] Anoop Sam John commented on HBASE-13373: For newly created HFiles, we should stick with the max major version which is the newest. Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. -- Key: HBASE-13373 URL: https://issues.apache.org/jira/browse/HBASE-13373 Project: HBase Issue Type: Task Reporter: stack Assignee: stack Fix For: 2.0.0 Attachments: 0001-HBASE-13373-Squash-HFileReaderV3-together-with-HFile.patch, 13373.txt, 13373.v3.txt, 13373.v3.txt, 13373.v5.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.wip.txt Profiling I actually ran into case where complaint that could not inline because: MaxInlineLevel maximum number of nested calls that are inlined 9 intx i.e. method was more than 9 levels deep. The HFileReaderV? with Abstracts is not needed anymore now we are into the clear with V3 enabled since hbase 1.0.0; we can have just an Interface and an implementation. If we need to support a new hfile type, can hopefully do it in a backward compatible way now we have Cell Interface, etc. Squashing all this stuff together actually makes it easier figuring what is going on when reading code. I can also get rid of a bunch of duplication too. Attached is a WIP. Doesn't fully compile yet but you get the idea. I'll keep on unless objection. Will try it against data written with old classes as soon as I have something working. I don't believe we write classnames into our data. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for TTL
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650303#comment-14650303 ] Hudson commented on HBASE-13864: FAILURE: Integrated in HBase-TRUNK #6693 (See [https://builds.apache.org/job/HBase-TRUNK/6693/]) HBASE-13864 HColumnDescriptor should parse the output from master and from describe for TTL (Ashu Pachauri) (tedyu: rev 4b6598e394bae67b54d6f741dd262afe03b2c133) * hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-common/src/main/java/org/apache/hadoop/hbase/util/PrettyPrinter.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-shell/src/main/ruby/hbase/admin.rb HColumnDescriptor should parse the output from master and from describe for TTL --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0 Attachments: 13864-branch-1.txt, HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HBASE-13373) Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.
[ https://issues.apache.org/jira/browse/HBASE-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650464#comment-14650464 ] Anoop Sam John edited comment on HBASE-13373 at 8/1/15 5:13 PM: For newly created HFiles, we should stick with the max major version which is the newest. Any specific reason for using V2 for new HFiles? was (Author: anoop.hbase): For newly created HFiles, we should stick with the max major version which is the newest. Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. -- Key: HBASE-13373 URL: https://issues.apache.org/jira/browse/HBASE-13373 Project: HBase Issue Type: Task Reporter: stack Assignee: stack Fix For: 2.0.0 Attachments: 0001-HBASE-13373-Squash-HFileReaderV3-together-with-HFile.patch, 13373.txt, 13373.v3.txt, 13373.v3.txt, 13373.v5.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.v6.txt, 13373.wip.txt Profiling I actually ran into case where complaint that could not inline because: MaxInlineLevel maximum number of nested calls that are inlined 9 intx i.e. method was more than 9 levels deep. The HFileReaderV? with Abstracts is not needed anymore now we are into the clear with V3 enabled since hbase 1.0.0; we can have just an Interface and an implementation. If we need to support a new hfile type, can hopefully do it in a backward compatible way now we have Cell Interface, etc. Squashing all this stuff together actually makes it easier figuring what is going on when reading code. I can also get rid of a bunch of duplication too. Attached is a WIP. Doesn't fully compile yet but you get the idea. I'll keep on unless objection. Will try it against data written with old classes as soon as I have something working. I don't believe we write classnames into our data. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650495#comment-14650495 ] Sean Busbey commented on HBASE-14148: - cleanroom patch looks good. could you add a test that verifies setting it to something other than DENY ends up in the header? Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HBASE-14148: Assignee: Gabor Liptak (was: Apekshit Sharma) Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14165) The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues)
[
https://issues.apache.org/jira/browse/HBASE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650425#comment-14650425
]
Andrew Purtell commented on HBASE-14165:
+1
The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues +
numReadQueues + numScanQueues)
-
Key: HBASE-14165
URL: https://issues.apache.org/jira/browse/HBASE-14165
Project: HBase
Issue Type: Improvement
Components: rpc
Affects Versions: 0.99.2
Reporter: cuijianwei
Priority: Minor
Attachments: HBASE-14165-trunk.patch
The RWQueueRpcExecutor.queues will be initialized as:
{code}
queues = new ArrayListBlockingQueueCallRunner(writeHandlersCount +
readHandlersCount);
{code}
It seems this could be improved as:
{code}
queues = new ArrayListBlockingQueueCallRunner(numWriteQueues +
numReadQueues + numScanQueues);
{code}
Suggestions are welcomed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12853) distributed write pattern to replace ad hoc 'salting'
[ https://issues.apache.org/jira/browse/HBASE-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650544#comment-14650544 ] Ian Michael Gumby commented on HBASE-12853: --- Wow, Rather than try to stay focused on the issue of the Jira, you talk about contributing to open source. I can tell you the answer, I can even explain it to you, but you still wouldn't get it. distributed write pattern to replace ad hoc 'salting' - Key: HBASE-12853 URL: https://issues.apache.org/jira/browse/HBASE-12853 Project: HBase Issue Type: New Feature Reporter: Michael Segel Fix For: 2.0.0 In reviewing HBASE-11682 (Description of Hot Spotting), one of the issues is that while 'salting' alleviated regional hot spotting, it increased the complexity required to utilize the data. Through the use of coprocessors, it should be possible to offer a method which distributes the data on write across the cluster and then manages reading the data returning a sort ordered result set, abstracting the underlying process. On table creation, a flag is set to indicate that this is a parallel table. On insert in to the table, if the flag is set to true then a prefix is added to the key. e.g. region server#- or region server #|| where the region server # is an integer between 1 and the number of region servers defined. On read (scan) for each region server defined, a separate scan is created adding the prefix. Since each scan will be in sort order, its possible to strip the prefix and return the lowest value key from each of the subsets. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HBASE-14148: - Attachment: HBASE-14148-cleanroom.2.patch Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-cleanroom.2.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[
https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650581#comment-14650581
]
Hadoop QA commented on HBASE-14148:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12748335/HBASE-14148-cleanroom.3.patch
against master branch at commit 4b6598e394bae67b54d6f741dd262afe03b2c133.
ATTACHMENT ID: 12748335
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14953//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14953//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14953//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14953//console
This message is automatically generated.
Web UI Framable Page
Key: HBASE-14148
URL: https://issues.apache.org/jira/browse/HBASE-14148
Project: HBase
Issue Type: Bug
Reporter: Apekshit Sharma
Assignee: Gabor Liptak
Attachments: HBASE-14148-cleanroom.1.patch,
HBASE-14148-cleanroom.2.patch, HBASE-14148-cleanroom.3.patch,
HBASE-14148-master.patch, HBASE-14148-v2-master.patch,
HBASE-14148-v3-master.patch
The web UIs do not include the X-Frame-Options header to prevent the pages
from being framed from another site.
Reference:
https://www.owasp.org/index.php/Clickjacking
https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet
https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14165) The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues)
[
https://issues.apache.org/jira/browse/HBASE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650599#comment-14650599
]
Hadoop QA commented on HBASE-14165:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12747781/HBASE-14165-trunk.patch
against master branch at commit 4b6598e394bae67b54d6f741dd262afe03b2c133.
ATTACHMENT ID: 12747781
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:red}-1 checkstyle{color}. The applied patch generated
1865 checkstyle errors (more than the master's current 1864 errors).
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14954//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14954//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14954//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14954//console
This message is automatically generated.
The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues +
numReadQueues + numScanQueues)
-
Key: HBASE-14165
URL: https://issues.apache.org/jira/browse/HBASE-14165
Project: HBase
Issue Type: Improvement
Components: rpc
Affects Versions: 0.99.2
Reporter: cuijianwei
Priority: Minor
Attachments: HBASE-14165-trunk.patch
The RWQueueRpcExecutor.queues will be initialized as:
{code}
queues = new ArrayListBlockingQueueCallRunner(writeHandlersCount +
readHandlersCount);
{code}
It seems this could be improved as:
{code}
queues = new ArrayListBlockingQueueCallRunner(numWriteQueues +
numReadQueues + numScanQueues);
{code}
Suggestions are welcomed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13408) HBase In-Memory Memstore Compaction
[ https://issues.apache.org/jira/browse/HBASE-13408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650518#comment-14650518 ] Eshcar Hillel commented on HBASE-13408: --- Then how about we’ll make use of the FlushPolicy abstraction that is written so nicely and is easy to extend ;-). We can add to it a method selectStoresToCompact(), so that a flush process manages 2 sets to reduce memory usage (1) stores to flush (2) stores to be compacted. A store is in either of the two sets or in none, but not in both of them. The decision whether reducing the memory usage is done by a flush or a compaction depends on the store type and state. In addition, we’ll add a method to the MemStore interface doInmemoryCompaction(). In compacted memstore the implementation of this method would be to push the active set into the compaction pipeline and invoke a compaction. With this solution the semantics of prepare-to-flush remains the same. HBase In-Memory Memstore Compaction --- Key: HBASE-13408 URL: https://issues.apache.org/jira/browse/HBASE-13408 Project: HBase Issue Type: New Feature Reporter: Eshcar Hillel Attachments: HBaseIn-MemoryMemstoreCompactionDesignDocument-ver02.pdf, HBaseIn-MemoryMemstoreCompactionDesignDocument.pdf, InMemoryMemstoreCompactionEvaluationResults.pdf A store unit holds a column family in a region, where the memstore is its in-memory component. The memstore absorbs all updates to the store; from time to time these updates are flushed to a file on disk, where they are compacted. Unlike disk components, the memstore is not compacted until it is written to the filesystem and optionally to block-cache. This may result in underutilization of the memory due to duplicate entries per row, for example, when hot data is continuously updated. Generally, the faster the data is accumulated in memory, more flushes are triggered, the data sinks to disk more frequently, slowing down retrieval of data, even if very recent. In high-churn workloads, compacting the memstore can help maintain the data in memory, and thereby speed up data retrieval. We suggest a new compacted memstore with the following principles: 1.The data is kept in memory for as long as possible 2.Memstore data is either compacted or in process of being compacted 3.Allow a panic mode, which may interrupt an in-progress compaction and force a flush of part of the memstore. We suggest applying this optimization only to in-memory column families. A design document is attached. This feature was previously discussed in HBASE-5311. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[
https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650524#comment-14650524
]
Hadoop QA commented on HBASE-14148:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12748324/HBASE-14148-cleanroom.1.patch
against master branch at commit 4b6598e394bae67b54d6f741dd262afe03b2c133.
ATTACHMENT ID: 12748324
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
{color:red}-1 core zombie tests{color}. There are 4 zombie test(s):
at
org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot.testExportFileSystemState(TestMobExportSnapshot.java:285)
at
org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot.testExportFileSystemState(TestMobExportSnapshot.java:259)
at
org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot.testExportWithTargetName(TestMobExportSnapshot.java:217)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFileSystemState(TestExportSnapshot.java:288)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testConsecutiveExports(TestExportSnapshot.java:213)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFileSystemState(TestExportSnapshot.java:288)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFileSystemState(TestExportSnapshot.java:262)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testEmptyExportFileSystemState(TestExportSnapshot.java:206)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14951//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14951//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14951//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14951//console
This message is automatically generated.
Web UI Framable Page
Key: HBASE-14148
URL: https://issues.apache.org/jira/browse/HBASE-14148
Project: HBase
Issue Type: Bug
Reporter: Apekshit Sharma
Assignee: Gabor Liptak
Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch,
HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch
The web UIs do not include the X-Frame-Options header to prevent the pages
from being framed from another site.
Reference:
https://www.owasp.org/index.php/Clickjacking
https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet
https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650341#comment-14650341
]
Sean Busbey commented on HBASE-14085:
-
Ugh. Does our version of QABot only show 10 long lines without saying it's
not show everything? Looks like it.
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact NOTICE file does not appear to propagate appropriate info
from the NOTICE files from bundled dependencies
* checked NOTICE on source
** source artifact NOTICE file does not include a copyright line
** source NOTICE file includes notices for third party dependencies not
included in the artifact
* checked NOTICE files shipped in maven jars
** copyright line only says 2015 when it's very likely the contents are under
copyright prior to this year
* nit: NOTICE file on jars in maven say HBase - ${module} rather than
Apache HBase - ${module} as required
refs:
http://www.apache.org/dev/licensing-howto.html#bundled-vs-non-bundled
http://www.apache.org/dev/licensing-howto.html#binary
http://www.apache.org/dev/licensing-howto.html#simple
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650509#comment-14650509 ] Sean Busbey commented on HBASE-14148: - They can't look at the earlier patch. If you think we can reuse it, pull out that part as an addendum on Gabor's patch and I'll push the lot. -- Sean Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650521#comment-14650521 ] Gabor Liptak commented on HBASE-14148: -- [~appy] If you upload tests only as a separate Java or patch file, I can pull it in for review and incorporate. Thanks Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-14165) The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues)
[
https://issues.apache.org/jira/browse/HBASE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated HBASE-14165:
---
Status: Patch Available (was: Open)
The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues +
numReadQueues + numScanQueues)
-
Key: HBASE-14165
URL: https://issues.apache.org/jira/browse/HBASE-14165
Project: HBase
Issue Type: Improvement
Components: rpc
Affects Versions: 0.99.2
Reporter: cuijianwei
Priority: Minor
Attachments: HBASE-14165-trunk.patch
The RWQueueRpcExecutor.queues will be initialized as:
{code}
queues = new ArrayListBlockingQueueCallRunner(writeHandlersCount +
readHandlersCount);
{code}
It seems this could be improved as:
{code}
queues = new ArrayListBlockingQueueCallRunner(numWriteQueues +
numReadQueues + numScanQueues);
{code}
Suggestions are welcomed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650503#comment-14650503 ] Apekshit Sharma commented on HBASE-14148: - [~busbey] Should be cool to use the test from earlier patch because it was purely my contribution. I don't believe we need to cleanroom it. [~gliptak] If sean agrees, feel free to copy the tests. Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13212) Procedure V2 - master Create/Modify/Delete namespace
[ https://issues.apache.org/jira/browse/HBASE-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650526#comment-14650526 ] Stephen Yuan Jiang commented on HBASE-13212: The patch has nothing to do with the failed and zombie tests Procedure V2 - master Create/Modify/Delete namespace Key: HBASE-13212 URL: https://issues.apache.org/jira/browse/HBASE-13212 Project: HBase Issue Type: Sub-task Components: master Affects Versions: 2.0.0 Reporter: Stephen Yuan Jiang Assignee: Stephen Yuan Jiang Labels: reliability Attachments: HBASE-13212.v1-master.patch, HBASE-13212.v2-master.patch Original Estimate: 168h Remaining Estimate: 168h master side, part of HBASE-12439 starts up the procedure executor on the master and replaces the create/modify/delete namespace handlers with the procedure version. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14148) Web UI Framable Page
[
https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650552#comment-14650552
]
Hadoop QA commented on HBASE-14148:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12748333/HBASE-14148-cleanroom.2.patch
against master branch at commit 4b6598e394bae67b54d6f741dd262afe03b2c133.
ATTACHMENT ID: 12748333
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.http.TestHttpServer
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14952//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14952//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14952//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14952//console
This message is automatically generated.
Web UI Framable Page
Key: HBASE-14148
URL: https://issues.apache.org/jira/browse/HBASE-14148
Project: HBase
Issue Type: Bug
Reporter: Apekshit Sharma
Assignee: Gabor Liptak
Attachments: HBASE-14148-cleanroom.1.patch,
HBASE-14148-cleanroom.2.patch, HBASE-14148-master.patch,
HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch
The web UIs do not include the X-Frame-Options header to prevent the pages
from being framed from another site.
Reference:
https://www.owasp.org/index.php/Clickjacking
https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet
https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HBASE-14148) Web UI Framable Page
[ https://issues.apache.org/jira/browse/HBASE-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HBASE-14148: - Attachment: HBASE-14148-cleanroom.3.patch Web UI Framable Page Key: HBASE-14148 URL: https://issues.apache.org/jira/browse/HBASE-14148 Project: HBase Issue Type: Bug Reporter: Apekshit Sharma Assignee: Gabor Liptak Attachments: HBASE-14148-cleanroom.1.patch, HBASE-14148-cleanroom.2.patch, HBASE-14148-cleanroom.3.patch, HBASE-14148-master.patch, HBASE-14148-v2-master.patch, HBASE-14148-v3-master.patch The web UIs do not include the X-Frame-Options header to prevent the pages from being framed from another site. Reference: https://www.owasp.org/index.php/Clickjacking https://www.owasp.org/index.php/Clickjacking_Defense_Cheat_Sheet https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650198#comment-14650198 ] Hudson commented on HBASE-14154: FAILURE: Integrated in HBase-0.98 #1065 (See [https://builds.apache.org/job/HBase-0.98/1065/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev 34a1f81eda9c944d519bbae2bf3df84c3adeb36c) * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileWriter.java * hbase-shell/src/main/ruby/shell/commands/create.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650208#comment-14650208 ] Hudson commented on HBASE-14154: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1018 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1018/]) HBASE-14154 DFS Replication should be configurable at column family level (apurtell: rev 34a1f81eda9c944d519bbae2bf3df84c3adeb36c) * hbase-shell/src/main/ruby/hbase/admin.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileWriter.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java * hbase-shell/src/main/ruby/shell/commands/create.rb * hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java * hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for ttl
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13864: --- Hadoop Flags: Reviewed Fix Version/s: 1.3.0 1.2.0 2.0.0 HColumnDescriptor should parse the output from master and from describe for ttl --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for TTL
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13864: --- Summary: HColumnDescriptor should parse the output from master and from describe for TTL (was: HColumnDescriptor should parse the output from master and from describe for ttl) HColumnDescriptor should parse the output from master and from describe for TTL --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for TTL
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13864: --- Status: Open (was: Patch Available) HColumnDescriptor should parse the output from master and from describe for TTL --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0, 1.2.0, 1.3.0 Attachments: HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for TTL
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13864: --- Fix Version/s: (was: 1.3.0) (was: 1.2.0) HColumnDescriptor should parse the output from master and from describe for TTL --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0 Attachments: 13864-branch-1.txt, HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-13864) HColumnDescriptor should parse the output from master and from describe for TTL
[ https://issues.apache.org/jira/browse/HBASE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13864: --- Attachment: 13864-branch-1.txt Patch backported to branch-1 However, it doesn't compile. HBaseException is in hbase-client module while PrettyPrinter is in hbase-common module. HColumnDescriptor should parse the output from master and from describe for TTL --- Key: HBASE-13864 URL: https://issues.apache.org/jira/browse/HBASE-13864 Project: HBase Issue Type: Bug Components: shell Reporter: Elliott Clark Assignee: Ashu Pachauri Fix For: 2.0.0 Attachments: 13864-branch-1.txt, HBASE-13864-1.patch, HBASE-13864-2.patch, HBASE-13864-3.patch, HBASE-13864-4.patch, HBASE-13864.patch The TTL printing on HColumnDescriptor adds a human readable time. When using that string for the create command it throws an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13212) Procedure V2 - master Create/Modify/Delete namespace
[
https://issues.apache.org/jira/browse/HBASE-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650239#comment-14650239
]
Hadoop QA commented on HBASE-13212:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12748297/HBASE-13212.v2-master.patch
against master branch at commit f504e4b4ed1a8173d1e8420207f608b8572436e2.
ATTACHMENT ID: 12748297
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 12 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.master.TestDistributedLogSplitting
{color:red}-1 core zombie tests{color}. There are 3 zombie test(s):
at
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWriteInternals(TestCacheOnWrite.java:274)
at
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWrite(TestCacheOnWrite.java:502)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14949//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14949//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14949//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14949//console
This message is automatically generated.
Procedure V2 - master Create/Modify/Delete namespace
Key: HBASE-13212
URL: https://issues.apache.org/jira/browse/HBASE-13212
Project: HBase
Issue Type: Sub-task
Components: master
Affects Versions: 2.0.0
Reporter: Stephen Yuan Jiang
Assignee: Stephen Yuan Jiang
Labels: reliability
Attachments: HBASE-13212.v1-master.patch, HBASE-13212.v2-master.patch
Original Estimate: 168h
Remaining Estimate: 168h
master side, part of HBASE-12439
starts up the procedure executor on the master
and replaces the create/modify/delete namespace handlers with the procedure
version.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-14085) Correct LICENSE and NOTICE files in artifacts
[
https://issues.apache.org/jira/browse/HBASE-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650248#comment-14650248
]
Hadoop QA commented on HBASE-14085:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12748295/HBASE-14085.2.patch
against master branch at commit f504e4b4ed1a8173d1e8420207f608b8572436e2.
ATTACHMENT ID: 12748295
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 30 new
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 lineLengths{color}. The patch introduces the following lines
longer than 100:
+ Build an aggregation of our templated NOTICE file and the
NOTICE files in our dependencies.
+1.1. Contributor means each individual or entity that creates or contributes
to the creation of Modifications.
+1.2. Contributor Version means the combination of the Original Software, prior
Modifications used by a Contributor (if any), and the Modifications made by
that particular Contributor.
+1.3. Covered Software means (a) the Original Software, or (b) Modifications,
or (c) the combination of files containing Original Software with files
containing Modifications, in each case including portions thereof.
+1.5. Initial Developer means the individual or entity that first makes
Original Software available under this License.
+1.6. Larger Work means a work which combines Covered Software or portions
thereof with code not governed by the terms of this License.
+1.8. Licensable means having the right to grant, to the maximum extent
possible, whether at the time of the initial grant or subsequently acquired,
any and all of the rights conveyed herein.
+1.9. Modifications means the Source Code and Executable form of any of the
following: A. Any file that results from an addition to, deletion from or
modification of the contents of a file containing Original Software or previous
Modifications; B. Any new file that contains any part of the Original Software
or previous Modification; or C. Any new file that is contributed or otherwise
made available under the terms of this License.
+1.10. Original Software means the Source Code and Executable form of computer
software code that is originally released under this License.
+1.11. Patent Claims means any patent claim(s), now owned or hereafter
acquired, including without limitation, method, process, and apparatus claims,
in any patent Licensable by grantor.
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14950//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14950//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14950//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14950//console
This message is automatically generated.
Correct LICENSE and NOTICE files in artifacts
-
Key: HBASE-14085
URL: https://issues.apache.org/jira/browse/HBASE-14085
Project: HBase
Issue Type: Task
Components: build
Affects Versions: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
Fix For: 2.0.0, 0.94.28, 0.98.14, 1.0.2, 1.2.0, 1.1.2
Attachments: HBASE-14085.1.patch, HBASE-14085.2.patch
+Problems:
* checked LICENSE/NOTICE on binary
** binary artifact LICENSE file has not been updated to include the
additional license terms for contained third party dependencies
** binary artifact NOTICE file does not include a copyright line
** binary artifact
[jira] [Commented] (HBASE-14154) DFS Replication should be configurable at column family level
[ https://issues.apache.org/jira/browse/HBASE-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650259#comment-14650259 ] Ashish Singhi commented on HBASE-14154: --- ya, mistake. Thanks. DFS Replication should be configurable at column family level - Key: HBASE-14154 URL: https://issues.apache.org/jira/browse/HBASE-14154 Project: HBase Issue Type: New Feature Reporter: Ashish Singhi Assignee: Ashish Singhi Priority: Minor Fix For: 2.0.0, 0.98.14, 1.2.0, 1.3.0 Attachments: HBASE-14154-0.98-v1.patch, HBASE-14154-0.98.patch, HBASE-14154-branch-1-v1.patch, HBASE-14154-branch-1.patch, HBASE-14154-v1.patch, HBASE-14154-v2.patch, HBASE-14154-v3.patch, HBASE-14154-v4.patch, HBASE-14154.patch There are cases where a user wants to have a control on the number of hfile copies he/she can have in the cluster. For eg: For a test table user would like to have only one copy instead of three(default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
