[jira] [Created] (HBASE-19861) Avoid using RPCs when querying table infos for master status pages
Xiaolin Ha created HBASE-19861:
--
Summary: Avoid using RPCs when querying table infos for master
status pages
Key: HBASE-19861
URL: https://issues.apache.org/jira/browse/HBASE-19861
Project: HBase
Issue Type: Improvement
Components: monitoring
Reporter: Xiaolin Ha
When querying table information for master status pages, currently method is
using admin interfaces. For example, when list user tables, codes are as
follows.
Connection connection = master.getConnection();
Admin admin = connection.getAdmin();
try {
tables = admin.listTables();
} finally {
admin.close();
}
But actually, we can get all user tables from master's memory.
Using admin interfaces means using RPCs, which has a low efficiency.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (HBASE-19860) Run branch-2 nightly job more frequently
[ https://issues.apache.org/jira/browse/HBASE-19860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Appy resolved HBASE-19860. -- Resolution: Fixed > Run branch-2 nightly job more frequently > > > Key: HBASE-19860 > URL: https://issues.apache.org/jira/browse/HBASE-19860 > Project: HBase > Issue Type: Improvement >Reporter: Appy >Assignee: Appy >Priority: Minor > Attachments: HBASE-19860.branch-2.001.patch > > > For time being, running the job more frequently will give us more data faster > to debug flaky tests . -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HBASE-19860) Run branch-2 nightly job more frequently
Appy created HBASE-19860: Summary: Run branch-2 nightly job more frequently Key: HBASE-19860 URL: https://issues.apache.org/jira/browse/HBASE-19860 Project: HBase Issue Type: Improvement Reporter: Appy Assignee: Appy For time being, running the job more frequently will give us more data faster to debug flaky tests . -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[VOTE] The first HBase 1.4.1 release candidate (RC0) is available
The first HBase 1.4.1 release candidate (RC0) is available for download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.1RC0/ and Maven artifacts are available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1194 . The git tag corresponding to the candidate is '1.4.1RC0' (4b25debc83). A detailed source and binary compatibility report for this release is available for your review at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.1RC0/compat-check-report.html . A list of the 38 issues resolved in this release can be found at https://s.apache.org/tx1w . Please try out the candidate and vote +1/0/-1. This vote will be open for at least 72 hours. Unless objection I will try to close it Friday February 2, 2018 if we have sufficient votes. Prior to making this announcement I made the following preflight checks: - RAT check passes (7u80) - Unit test suite passes 10 of 10 iterations (8u131) - LTT load 1M rows with 100% verification and 20% updates (8u131) - PE sequentialWrite, sequentialRead, randomWrite, randomRead, scanRange100 (8u131) -- Best regards, Andrew Words like orphans lost among the crosstalk, meaning torn from truth's decrepit hands - A23, Crosstalk
[jira] [Resolved] (HBASE-17883) release 1.4.0
[ https://issues.apache.org/jira/browse/HBASE-17883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-17883. Resolution: Fixed > release 1.4.0 > - > > Key: HBASE-17883 > URL: https://issues.apache.org/jira/browse/HBASE-17883 > Project: HBase > Issue Type: Task > Components: community >Affects Versions: 1.4.0 >Reporter: Sean Busbey >Assignee: Andrew Purtell >Priority: Critical > > Let's start working through doing the needful; it's been almost 3 months sine > 1.3.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HBASE-19859) Update download page header for 1.1 EOL
Mike Drob created HBASE-19859: - Summary: Update download page header for 1.1 EOL Key: HBASE-19859 URL: https://issues.apache.org/jira/browse/HBASE-19859 Project: HBase Issue Type: Task Reporter: Mike Drob See example mirror: http://mirrors.ocf.berkeley.edu/apache/hbase/ They still claim that 1.1 is under active development. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HBASE-19466) Rare failure in TestScannerCursor
[ https://issues.apache.org/jira/browse/HBASE-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-19466. Resolution: Cannot Reproduce > Rare failure in TestScannerCursor > - > > Key: HBASE-19466 > URL: https://issues.apache.org/jira/browse/HBASE-19466 > Project: HBase > Issue Type: Bug >Affects Versions: 1.4.0 >Reporter: Andrew Purtell >Priority: Minor > > I think we just need to increase the timeout interval to deal with occasional > slowdowns on test executors. 1998 ms is a pretty short timeout. > By the way "rpcTimetout" in the exception message is a misspelling. > [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > 37.412 s <<< FAILURE! - in > org.apache.hadoop.hbase.regionserver.TestScannerCursor > [ERROR] > testHeartbeatWithSparseFilter(org.apache.hadoop.hbase.regionserver.TestScannerCursor) > Time elapsed: 35.604 s <<< ERROR! > org.apache.hadoop.hbase.client.RetriesExhaustedException: > Failed after attempts=36, exceptions: > Thu Dec 07 22:27:16 UTC 2017, null, java.net.SocketTimeoutException: > callTimeout=4000, callDuration=4108: Call to > ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local > exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, > waitTime=2002, rpcTimetout=1998 row '' on table 'TestScannerCursor' at > region=TestScannerCursor,,1512685598567.1d4e59215a881d6ccbd0b5b5bdec5587., > hostname=ip-172-31-47-35.us-west-2.compute.internal,35690,1512685593244, > seqNum=2 > at > org.apache.hadoop.hbase.regionserver.TestScannerCursor.testHeartbeatWithSparseFilter(TestScannerCursor.java:154) > Caused by: java.net.SocketTimeoutException: callTimeout=4000, > callDuration=4108: Call to > ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local > exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, > waitTime=2002, rpcTimetout=1998 row '' on table 'TestScannerCursor' at > region=TestScannerCursor,,1512685598567.1d4e59215a881d6ccbd0b5b5bdec5587., > hostname=ip-172-31-47-35.us-west-2.compute.internal,35690,1512685593244, > seqNum=2 > Caused by: java.io.IOException: Call to > ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local > exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, > waitTime=2002, rpcTimetout=1998 > Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, > waitTime=2002, rpcTimetout=1998 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HBASE-19858) Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
Andrew Purtell created HBASE-19858: -- Summary: Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1 Key: HBASE-19858 URL: https://issues.apache.org/jira/browse/HBASE-19858 Project: HBase Issue Type: Task Reporter: Andrew Purtell Assignee: Andrew Purtell Fix For: 1.5.0 Backport the following commits to branch-1: * HBASE-14061 Support CF-level Storage Policy * HBASE-14061 Support CF-level Storage Policy (addendum) * HBASE-14061 Support CF-level Storage Policy (addendum2) * HBASE-15172 Support setting storage policy in bulkload * HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs * HBASE-18015 Storage class aware block placement for procedure v2 WALs * HBASE-18017 Reduce frequency of setStoragePolicy failure warnings * HBASE-19016 Coordinate storage policy property name for table schema and bulkload Fix * Default storage policy if not configured cannot be "NONE" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HBASE-19857) Complete the procedure for adding a sync replication peer
Duo Zhang created HBASE-19857: - Summary: Complete the procedure for adding a sync replication peer Key: HBASE-19857 URL: https://issues.apache.org/jira/browse/HBASE-19857 Project: HBase Issue Type: Sub-task Reporter: Duo Zhang Now it is only a fake procedure which does not change anything at RS side. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HBASE-19856) Missing org/apache/spark/Logging with Spark
kent created HBASE-19856:
Summary: Missing org/apache/spark/Logging with Spark
Key: HBASE-19856
URL: https://issues.apache.org/jira/browse/HBASE-19856
Project: HBase
Issue Type: Bug
Reporter: kent
dependencies:
spark-streaming_2.11 2.2.1
spark-streaming-kafka-0-8-2.11 2.2.1
hbase-spark 2.0.0-alpha4
Submit app in spark 2.2 will get this error
{code:java}
2018-01-24 17:18:13,436 ERROR yarn.ApplicationMaster: User class threw
exception: java.lang.NoClassDefFoundError: org/apache/spark/Logging
java.lang.NoClassDefFoundError: org/apache/spark/Logging at
java.lang.ClassLoader.defineClass1(Native Method) at
java.lang.ClassLoader.defineClass(ClassLoader.java:763) at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at
java.net.URLClassLoader.defineClass(URLClassLoader.java:467) at
java.net.URLClassLoader.access$100(URLClassLoader.java:73) at
java.net.URLClassLoader$1.run(URLClassLoader.java:368) at
java.net.URLClassLoader$1.run(URLClassLoader.java:362) at
java.security.AccessController.doPrivileged(Native Method) at
java.net.URLClassLoader.findClass(URLClassLoader.java:361) at
java.lang.ClassLoader.loadClass(ClassLoader.java:424) at
java.lang.ClassLoader.loadClass(ClassLoader.java:357) at
org.apache.hadoop.hbase.spark.JavaHBaseContext.(JavaHBaseContext.scala:46)
at com.clongame.spark.StoreApp.main(StoreApp.java:53) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:635)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.Logging at
java.net.URLClassLoader.findClass(URLClassLoader.java:381) at
java.lang.ClassLoader.loadClass(ClassLoader.java:424) at
java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 18 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HBASE-19855) Refactor RegionScannerImpl.nextInternal method
Guanghao Zhang created HBASE-19855: -- Summary: Refactor RegionScannerImpl.nextInternal method Key: HBASE-19855 URL: https://issues.apache.org/jira/browse/HBASE-19855 Project: HBase Issue Type: Bug Reporter: Guanghao Zhang Now this method is too complicated and confusing... https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java -- This message was sent by Atlassian JIRA (v7.6.3#76005)
