date:20160905

[jira] [Created] (HBASE-16563) hbase-assembly can only deal with the first license of dependency

2016-09-05 Thread Colin Ma (JIRA)

Colin Ma created HBASE-16563:


 Summary: hbase-assembly can only deal with the first license of 
dependency
 Key: HBASE-16563
 URL: https://issues.apache.org/jira/browse/HBASE-16563
 Project: HBase
  Issue Type: Bug
  Components: build
Reporter: Colin Ma
Assignee: Colin Ma


Currently, only the first  in  will be validated in 
LICENSE.vm. The hbase-assembly will be failed to validate the following 
information,because Apache License v2.0 is not the first one :
{code}

  
  LGPL, version 2.1
  http://www.gnu.org/licenses/licenses.html
  repo
  
  
  Apache License v2.0
  http://www.apache.org/licenses/LICENSE-2.0.txt
  repo
  
  
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[RESULT][VOTE] Third release candidate for HBase 1.1.6 (RC2) is available

2016-09-05 Thread Nick Dimiduk

With 4 binding +1 votes and no 0 or -1 votes, the vote passes. I will send
out the release announcement shortly.

Thanks to all who voted on the release candidate!

On Sun, Aug 28, 2016 at 11:30 AM, Nick Dimiduk  wrote:

> I'm happy to announce the third release candidate of HBase 1.1.6 (HBase-
> 1.1.6RC2) is available for download at https://dist.apache.org/
> repos/dist/dev/hbase/hbase-1.1.6RC2/
>
> Maven artifacts are also available in the staging repository
> https://repository.apache.org/content/repositories/orgapachehbase-1148
>
> Artifacts are signed with my code signing subkey 0xAD9039071C3489BD,
> available in the Apache keys directory https://people.
> apache.org/keys/committer/ndimiduk.asc and in our KEYS file
> https://www-us.apache.org/dist/hbase/KEYS.
>
> There's also a signed tag for this release at https://git-wip-us.apache.
> org/repos/asf?p=hbase.git;a=tag;h=dea3b9ed8239748136ee3e8010a16039a9c29410
>
> The detailed source and binary compatibility report vs 1.1.5 has been
> published for your review, at http://home.apache.org/~
> ndimiduk/1.1.5_1.1.6RC2_compat_report.html
>
> HBase 1.1.6 is the sixth patch release in the HBase 1.1 line, continuing
> on the theme of bringing a stable, reliable database to the Hadoop and
> NoSQL communities. This release includes over 70 bug fixes since the 1.1.5
> release. Notable correctness fixes include HBASE-15698, HBASE-15856,
> HBASE-15878, HBASE-16012, HBASE-16056, HBASE-16093, HBASE-16132,
> HBASE-16237, HBASE-16288, HBASE-16420, HBASE-16429, and HBASE-16464.
>
> The full list of fixes included in this release is available at
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> projectId=12310753=12335679 and and in the CHANGES.txt file
> included in the distribution.
>
> Please try out this candidate and vote +/-1 by 23:59 Pacific time on
> Sunday, 2016-09-04 as to whether we should release these artifacts as HBase
> 1.1.6.
>
> Thanks,
> Nick
>

Re: [VOTE] Third release candidate for HBase 1.1.6 (RC2) is available

2016-09-05 Thread Nick Dimiduk

- verified tarballs vs public key in KEYS file.
- extracted bin tgz:
  - inspect structure. look good.
  - with both jdk1.7.0_80, jdk1.8.0_65:
- run LoadTestTool against standalone bin tgz with FAST_DIFF block
encoder and ROWCOL blooms. No issues, logs look good.
- poked around webUI. looks good.
  - verified version in MasterUI matches git tag sha
  - load the site, browsed book and API docs.
- extracted src tgz:
  - inspect structure. look good.
  - run LoadTestTool against standalone built from src tgz with ROW blooms.
No issues, logs look good.
  - poked around webUI. looks good.
- inspected compatibility report. Noting the expected changes from
HBASE-16420.

+1

On Sun, Aug 28, 2016 at 11:30 AM, Nick Dimiduk  wrote:

> I'm happy to announce the third release candidate of HBase 1.1.6 (HBase-
> 1.1.6RC2) is available for download at https://dist.apache.org/
> repos/dist/dev/hbase/hbase-1.1.6RC2/
>
> Maven artifacts are also available in the staging repository
> https://repository.apache.org/content/repositories/orgapachehbase-1148
>
> Artifacts are signed with my code signing subkey 0xAD9039071C3489BD,
> available in the Apache keys directory https://people.
> apache.org/keys/committer/ndimiduk.asc and in our KEYS file
> https://www-us.apache.org/dist/hbase/KEYS.
>
> There's also a signed tag for this release at https://git-wip-us.apache.
> org/repos/asf?p=hbase.git;a=tag;h=dea3b9ed8239748136ee3e8010a16039a9c29410
>
> The detailed source and binary compatibility report vs 1.1.5 has been
> published for your review, at http://home.apache.org/~
> ndimiduk/1.1.5_1.1.6RC2_compat_report.html
>
> HBase 1.1.6 is the sixth patch release in the HBase 1.1 line, continuing
> on the theme of bringing a stable, reliable database to the Hadoop and
> NoSQL communities. This release includes over 70 bug fixes since the 1.1.5
> release. Notable correctness fixes include HBASE-15698, HBASE-15856,
> HBASE-15878, HBASE-16012, HBASE-16056, HBASE-16093, HBASE-16132,
> HBASE-16237, HBASE-16288, HBASE-16420, HBASE-16429, and HBASE-16464.
>
> The full list of fixes included in this release is available at
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> projectId=12310753=12335679 and and in the CHANGES.txt file
> included in the distribution.
>
> Please try out this candidate and vote +/-1 by 23:59 Pacific time on
> Sunday, 2016-09-04 as to whether we should release these artifacts as HBase
> 1.1.6.
>
> Thanks,
> Nick
>

Successful: hbase.apache.org HTML Checker

2016-09-05 Thread Apache Jenkins Server

Successful

If successful, the HTML and link-checking report for http://hbase.apache.org is 
available at 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/59/artifact/link_report/index.html.

If failed, see 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/59/console.

Re: There are some errors with hbase java example

2016-09-05 Thread Ted Yu

Xi:
Thanks for spotting these.

snappy requires some setup - setting compression type to others would be
easier for first time users.

Please open a JIRA to modify refguide.

Cheers


On Mon, Sep 5, 2016 at 12:31 PM, Xi Yang  wrote:

> Hi ,
>
> There are some errors with hbase java example:
> https://hbase.apache.org/book.html#_examples
>
> 1. if (admin.tableExists(tableName)) {
>
> System.out.println("Table does not exist.");
> System.exit(-1);
>   }
>
> If you write code like this, you will find that the code will always go
> into this block.
> [image: 内嵌图片 1]
>
> So we should change it into
>
> if ( *!*admin.tableExists(tableName)) {}
>
>
>
> 2. table.addFamily(new HColumnDescriptor(CF_DEFAULT).
> setCompressionType(Algorithm.SNAPPY));
>
> Some people may occur the example like me:
>
> Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.
> apache.hadoop.hbase.DoNotRetryIOException): 
> org.apache.hadoop.hbase.DoNotRetryIOException:
> Compression algorithm 'snappy' previously failed test. Set
> hbase.table.sanity.checks to false at conf or table descriptor if you want
> to bypass sanity checks
> at org.apache.hadoop.hbase.master.HMaster.warnOrThrowExceptionForFailure
> (HMaster.java:1701)
> at org.apache.hadoop.hbase.master.HMaster.sanityCheckTableDescriptor(
> HMaster.java:1569)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1491)
> at org.apache.hadoop.hbase.master.MasterRpcServices.
> createTable(MasterRpcServices.java:462)
> at org.apache.hadoop.hbase.protobuf.generated.
> MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55682)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2178)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(
> RpcExecutor.java:133)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
> at java.lang.Thread.run(Thread.java:745)
>
> So I think we should change this line into
> table.addFamily(new HColumnDescriptor(CF_DEFAULT).
> setCompressionType(Algorithm.*NONE*));
>
> 3. // Update existing column family
>
>   HColumnDescriptor existingColumn = new HColumnDescriptor(CF_DEFAULT);
>   existingColumn.setCompactionCompressionType(Algorithm.GZ);
>   existingColumn.setMaxVersions(HConstants.ALL_VERSIONS);
>   table.modifyFamily(existingColumn);
>   admin.modifyTable(tableName, table);
>
> You will get this exception
>
> Exception in thread "main" java.lang.IllegalArgumentException: Column
> family 'DEFAULT_COLUMN_FAMILY' does not exist
> at org.apache.hadoop.hbase.HTableDescriptor.modifyFamily(
> HTableDescriptor.java:893)
> at org.alex.hbasetest.Example.modifySchema(Example.java:66)
> at org.alex.hbasetest.Example.main(Example.java:88)
>
> Because we should get the HTableDescriptor via Admin first. Like this:
> Change
> HTableDescriptor table = new HTableDescriptor(tableName);
> into
> HTableDescriptor table = *admin.getTableDescriptor(tableName)*;
>
> 4. Some other places but not error:
> There are some other places need to be improve;
>
> try *(*Connection connection = ConnectionFactory.createConnection(config);
>  Admin admin = connection.getAdmin()*)* *{*
>
>   HTableDescriptor table = new 
> HTableDescriptor(TableName.valueOf(TABLE_NAME));
>   table.addFamily(new 
> HColumnDescriptor(CF_DEFAULT).setCompressionType(Algorithm.SNAPPY));
>
>   System.out.print("Creating table. ");
>   createOrOverwrite(admin, table);
>   System.out.println(" Done.");
> *}*
>
> I'm confused with that code and keep thinking why write code like this?
>
>
> Thanks,
> Alex
>
>
>
>
>
>
>

Re: Successful: HBase Generate Website

2016-09-05 Thread Dima Spivak

Pushed.

-Dima

On Mon, Sep 5, 2016 at 7:57 AM, Apache Jenkins Server <
jenk...@builds.apache.org> wrote:

> Build status: Successful
>
> If successful, the website and docs have been generated. To update the
> live site, follow the instructions below. If failed, skip to the bottom of
> this email.
>
> Use the following commands to download the patch and apply it to a clean
> branch based on origin/asf-site. If you prefer to keep the hbase-site repo
> around permanently, you can skip the clone step.
>
>   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git
>
>   cd hbase-site
>   wget -O- https://builds.apache.org/job/hbase_generate_website/333/
> artifact/website.patch.zip | funzip > b6ba13c37715422710a142f6f82ba4
> 817129c3d6.patch
>   git fetch
>   git checkout -b asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6
> origin/asf-site
>   git am --whitespace=fix b6ba13c37715422710a142f6f82ba4817129c3d6.patch
>
> At this point, you can preview the changes by opening index.html or any of
> the other HTML pages in your local 
> asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6
> branch.
>
> There are lots of spurious changes, such as timestamps and CSS styles in
> tables, so a generic git diff is not very useful. To see a list of files
> that have been added, deleted, renamed, changed type, or are otherwise
> interesting, use the following command:
>
>   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site
>
> To see only files that had 100 or more lines changed:
>
>   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'
>
> When you are satisfied, publish your changes to origin/asf-site using
> these commands:
>
>   git commit --allow-empty -m "Empty commit" # to work around a current
> ASF INFRA bug
>   git push origin asf-site-b6ba13c37715422710a142f6f82ba4
> 817129c3d6:asf-site
>   git checkout asf-site
>   git branch -D asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6
>
> Changes take a couple of minutes to be propagated. You can verify whether
> they have been propagated by looking at the Last Published date at the
> bottom of http://hbase.apache.org/. It should match the date in the
> index.html on the asf-site branch in Git.
>
> As a courtesy- reply-all to this email to let other committers know you
> pushed the site.
>
>
>
> If failed, see https://builds.apache.org/job/hbase_generate_website/333/
> console

[jira] [Created] (HBASE-16562) ITBLL should fail to start if misconfigured

2016-09-05 Thread Andrew Purtell (JIRA)

Andrew Purtell created HBASE-16562:
--

 Summary: ITBLL should fail to start if misconfigured
 Key: HBASE-16562
 URL: https://issues.apache.org/jira/browse/HBASE-16562
 Project: HBase
  Issue Type: Improvement
  Components: integration tests
Reporter: Andrew Purtell


The number of nodes in ITBLL must a multiple of width*wrap (defaults to 25M, 
but can be configured by adding two more args to the test invocation) or else 
verification will fail. This can be very expensive in terms of time or hourly 
billing for on demand test resources. Check the sanity of test parameters 
before launching any MR jobs and fail fast if invariants aren't met with an 
indication what parameter(s) need fixing. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Successful: HBase Generate Website

2016-09-05 Thread Apache Jenkins Server

Build status: Successful

If successful, the website and docs have been generated. To update the live 
site, follow the instructions below. If failed, skip to the bottom of this 
email.

Use the following commands to download the patch and apply it to a clean branch 
based on origin/asf-site. If you prefer to keep the hbase-site repo around 
permanently, you can skip the clone step.

  git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git

  cd hbase-site
  wget -O- 
https://builds.apache.org/job/hbase_generate_website/333/artifact/website.patch.zip
 | funzip > b6ba13c37715422710a142f6f82ba4817129c3d6.patch
  git fetch
  git checkout -b asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6 
origin/asf-site
  git am --whitespace=fix b6ba13c37715422710a142f6f82ba4817129c3d6.patch

At this point, you can preview the changes by opening index.html or any of the 
other HTML pages in your local 
asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6 branch.

There are lots of spurious changes, such as timestamps and CSS styles in 
tables, so a generic git diff is not very useful. To see a list of files that 
have been added, deleted, renamed, changed type, or are otherwise interesting, 
use the following command:

  git diff --name-status --diff-filter=ADCRTXUB origin/asf-site

To see only files that had 100 or more lines changed:

  git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'

When you are satisfied, publish your changes to origin/asf-site using these 
commands:

  git commit --allow-empty -m "Empty commit" # to work around a current ASF 
INFRA bug
  git push origin asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6:asf-site
  git checkout asf-site
  git branch -D asf-site-b6ba13c37715422710a142f6f82ba4817129c3d6

Changes take a couple of minutes to be propagated. You can verify whether they 
have been propagated by looking at the Last Published date at the bottom of 
http://hbase.apache.org/. It should match the date in the index.html on the 
asf-site branch in Git.

As a courtesy- reply-all to this email to let other committers know you pushed 
the site.



If failed, see https://builds.apache.org/job/hbase_generate_website/333/console

[jira] [Created] (HBASE-16561) Add metrics about read/write/scan queue length and active handler count

2016-09-05 Thread Guanghao Zhang (JIRA)

Guanghao Zhang created HBASE-16561:
--

 Summary: Add metrics about read/write/scan queue length and active 
handler count
 Key: HBASE-16561
 URL: https://issues.apache.org/jira/browse/HBASE-16561
 Project: HBase
  Issue Type: Improvement
  Components: IPC/RPC, metrics
Reporter: Guanghao Zhang
Priority: Minor


Now there are only metrics about total queue length and active rpc handler 
count. But for the RWQueueRpcExecutor, we can have different queues and 
handlers for read/write/scan request. I thought it is necessary to add more 
metrics for RWQueueRpcExecutor. When use it in production cluster, we can 
adjust the config of queues and handlers according to the metrics.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

2016-09-05 Thread Heng Chen

Thanks Dima!  I rerun test with you suggestion, and it passed! (hbase
--config ~/hadoop/hbase/f04_conf/
org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 3 250
/tmp/itbll 3 10 25 -m serverKilling)

So +1 for me

2016-09-05 21:33 GMT+08:00 Dima Spivak :

> Hey Heng,
>
> You need to ensure that the number of nodes in ITBLL is a multiple of
> width*wrap (defaults to 25M, but can be configured by adding two more args
> to the test invocation). See: the 0.98.22 RC0 thread, where I forgot this
> :).
>
> On Monday, September 5, 2016, Heng Chen  wrote:
>
> > I will test it with 1.2.2 again.  Not sure about it now.
> >
> > 2016-09-05 20:26 GMT+08:00 Stack >:
> >
> > > Thanks Heng. Do you know if 1.2.2 or earlier versions of 1.2 failed in
> > > similar way or is this new phenomenon?
> > > Thanks,
> > > St.Ack
> > >
> > > On Mon, Sep 5, 2016 at 1:26 AM, Heng Chen  > >
> > > wrote:
> > >
> > > > - Unpacked source and binary tarballs: layout looks good
> > > > - Started up a 3-node cluster (Hadoop 2.7.2, Oracle JDK 8u20, 2
> > master, 2
> > > > rs) from binary tarballs.
> > > > - Verified that the web UI works and shell works
> > > > - build from source and run test case (JDK 8u20),  passed.
> > > > - Run LTT with 1M rows (100 writers,  30 readers (100%),  10 updaters
> > > > (20%))  all keys verified,  no warns, no errors,  no failed,
> latencies
> > > >  lgtm
> > > > - Run ITBLL with 2M rows (slowDeterministic), passed.
> > > >
> > > > Run ITBLL with 2M rows (serverKilling) has some issues.  I run two
> > times,
> > > > all failed ( hbase --config ~/hadoop/hbase/f04_conf/
> > > > org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 1
> > > > 200 /tmp/it_16224_v0 1 -m serverKilling)
> > > >
> > > > The first time,  after kill components in cluster serval times (1
> > active
> > > > master, 1 backup master, 1 active RS, 1 dead RS), some regions fall
> in
> > > > Failed_open state on active RS,  so balance could not run, and ITBLL
> > > hang.
> > > >   Then i start the dead RS manually,   and stop the active RS,  ITBLL
> > > could
> > > > go on.  But after some time,  ITBLL hang again due to backup master
> > could
> > > > not be startup,  so i do manually again,  and ITBLL go on ,  and at
> > least
> > > > verified failed.
> > > >
> > > >
> > > > The second time,  there is no abnormal issues during ITBLL,  but
> > verified
> > > > failed.
> > > >
> > > > Upload the logs
> > > >
> > > >
> > > >
> > > > 2016-09-03 0:33 GMT+08:00 Misty Stanley-Jones  > >:
> > > >
> > > >> +1 based on OSX 10.11.6
> > > >>
> > > >> Steps taken:
> > > >>
> > > >> Binary tar.gz:
> > > >> - Download the tarball
> > > >> - Test the MD5sum, it matched
> > > >> - Extract the tarball
> > > >> - Start  HBase in standalone mode
> > > >> - Start the CLI
> > > >> - Access the master and regionServer web UIs
> > > >> - Stop HBase
> > > >>
> > > >> Source tar.gz:
> > > >> - Download the tarball
> > > >> - Test the MD5sum, it matched
> > > >> - Extract the tarball
> > > >> - Build using Maven 3.39 and JDK 1.8.0_102 on OSX and 'mvn clean
> > install
> > > >> --fail-at-end' and let the full test suite run
> > > >> -- A few failed tests but each passed when I ran it separately. Not
> > > >> surprising since I was running all this on a Macbook.
> > > >> - Start HBase in standalone mode
> > > >> - Start the CLI
> > > >> - Access the master and regionServer web UIs
> > > >> - Stop HBase
> > > >>
> > > >>
> > > >> On Tue, Aug 30, 2016, at 11:14 AM, Stack wrote:
> > > >> > The first release candidate for HBase 1.2.3 (hbase-1.2.3RC0) is
> > > >> > available for download at:
> > > >> >
> > > >> >  https://dist.apache.org/repos/dist/dev/hbase/hbase-1.2.3RC0/
> > > >> >
> > > >> > Maven artifacts are also available in a staging repository at:
> > > >> >
> > > >> >  https://repository.apache.org/content/repositories/orgapache
> > > >> hbase-1149/
> > > >> >
> > > >> > Artifacts are signed with my key (30CD0996) published up in our
> KEYS
> > > >> > file at https://www-us.apache.org/dist/hbase/KEYS.
> > > >> >
> > > >> > The RC is tagged 1.2.3RC0 (I'll sign the tag the next time
> > through...)
> > > >> >
> > > >> > The detailed source and binary compatibility report vs 1.2.2 has
> > been
> > > >> > published for your review, at:
> > > >> >
> > > >> >  http://people.apache.org/~stack/1.2.2_1.2.3RC0_compat_
> report.html
> > > >> >
> > > >> > HBase 1.2.3 is the third patch release in the HBase 1.2 line,
> > > continuing
> > > >> > on
> > > >> > the theme of bringing a stable, reliable database to the Hadoop
> and
> > > >> NoSQL
> > > >> > communities. This release includes over 48 bug fixes since 1.2.2.
> In
> > > >> > particular it addresses an API incompatibility uncovered by our
> > Apache
> > > >> > Phoenix bothers and sisters in our Table Interface: HBASE-16420.
> > > >> >

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

2016-09-05 Thread Dima Spivak

Hey Heng,

You need to ensure that the number of nodes in ITBLL is a multiple of
width*wrap (defaults to 25M, but can be configured by adding two more args
to the test invocation). See: the 0.98.22 RC0 thread, where I forgot this
:).

On Monday, September 5, 2016, Heng Chen  wrote:

> I will test it with 1.2.2 again.  Not sure about it now.
>
> 2016-09-05 20:26 GMT+08:00 Stack >:
>
> > Thanks Heng. Do you know if 1.2.2 or earlier versions of 1.2 failed in
> > similar way or is this new phenomenon?
> > Thanks,
> > St.Ack
> >
> > On Mon, Sep 5, 2016 at 1:26 AM, Heng Chen  >
> > wrote:
> >
> > > - Unpacked source and binary tarballs: layout looks good
> > > - Started up a 3-node cluster (Hadoop 2.7.2, Oracle JDK 8u20, 2
> master, 2
> > > rs) from binary tarballs.
> > > - Verified that the web UI works and shell works
> > > - build from source and run test case (JDK 8u20),  passed.
> > > - Run LTT with 1M rows (100 writers,  30 readers (100%),  10 updaters
> > > (20%))  all keys verified,  no warns, no errors,  no failed, latencies
> > >  lgtm
> > > - Run ITBLL with 2M rows (slowDeterministic), passed.
> > >
> > > Run ITBLL with 2M rows (serverKilling) has some issues.  I run two
> times,
> > > all failed ( hbase --config ~/hadoop/hbase/f04_conf/
> > > org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 1
> > > 200 /tmp/it_16224_v0 1 -m serverKilling)
> > >
> > > The first time,  after kill components in cluster serval times (1
> active
> > > master, 1 backup master, 1 active RS, 1 dead RS), some regions fall in
> > > Failed_open state on active RS,  so balance could not run, and ITBLL
> > hang.
> > >   Then i start the dead RS manually,   and stop the active RS,  ITBLL
> > could
> > > go on.  But after some time,  ITBLL hang again due to backup master
> could
> > > not be startup,  so i do manually again,  and ITBLL go on ,  and at
> least
> > > verified failed.
> > >
> > >
> > > The second time,  there is no abnormal issues during ITBLL,  but
> verified
> > > failed.
> > >
> > > Upload the logs
> > >
> > >
> > >
> > > 2016-09-03 0:33 GMT+08:00 Misty Stanley-Jones  >:
> > >
> > >> +1 based on OSX 10.11.6
> > >>
> > >> Steps taken:
> > >>
> > >> Binary tar.gz:
> > >> - Download the tarball
> > >> - Test the MD5sum, it matched
> > >> - Extract the tarball
> > >> - Start  HBase in standalone mode
> > >> - Start the CLI
> > >> - Access the master and regionServer web UIs
> > >> - Stop HBase
> > >>
> > >> Source tar.gz:
> > >> - Download the tarball
> > >> - Test the MD5sum, it matched
> > >> - Extract the tarball
> > >> - Build using Maven 3.39 and JDK 1.8.0_102 on OSX and 'mvn clean
> install
> > >> --fail-at-end' and let the full test suite run
> > >> -- A few failed tests but each passed when I ran it separately. Not
> > >> surprising since I was running all this on a Macbook.
> > >> - Start HBase in standalone mode
> > >> - Start the CLI
> > >> - Access the master and regionServer web UIs
> > >> - Stop HBase
> > >>
> > >>
> > >> On Tue, Aug 30, 2016, at 11:14 AM, Stack wrote:
> > >> > The first release candidate for HBase 1.2.3 (hbase-1.2.3RC0) is
> > >> > available for download at:
> > >> >
> > >> >  https://dist.apache.org/repos/dist/dev/hbase/hbase-1.2.3RC0/
> > >> >
> > >> > Maven artifacts are also available in a staging repository at:
> > >> >
> > >> >  https://repository.apache.org/content/repositories/orgapache
> > >> hbase-1149/
> > >> >
> > >> > Artifacts are signed with my key (30CD0996) published up in our KEYS
> > >> > file at https://www-us.apache.org/dist/hbase/KEYS.
> > >> >
> > >> > The RC is tagged 1.2.3RC0 (I'll sign the tag the next time
> through...)
> > >> >
> > >> > The detailed source and binary compatibility report vs 1.2.2 has
> been
> > >> > published for your review, at:
> > >> >
> > >> >  http://people.apache.org/~stack/1.2.2_1.2.3RC0_compat_report.html
> > >> >
> > >> > HBase 1.2.3 is the third patch release in the HBase 1.2 line,
> > continuing
> > >> > on
> > >> > the theme of bringing a stable, reliable database to the Hadoop and
> > >> NoSQL
> > >> > communities. This release includes over 48 bug fixes since 1.2.2. In
> > >> > particular it addresses an API incompatibility uncovered by our
> Apache
> > >> > Phoenix bothers and sisters in our Table Interface: HBASE-16420.
> > >> >
> > >> > The full list of fixes included in this release is available at:
> > >> >
> > >> >
> > >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?proje
> > >> ctId=12310753=12336053
> > >> >
> > >> > and in the CHANGES.txt file included in the distribution.
> > >> >
> > >> > Please try out this candidate and vote +/-1 by 23:59 Pacific time on
> > >> > Monday, 2016-09-05 as to whether we should release these artifacts
> as
> > >> > HBase
> > >> > 1.2.3.
> > >> >
> > >> > Thanks,
> > >> > St.Ack
> > >>
> > >
> > >
> >
>


-- 
-Dima

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

2016-09-05 Thread Heng Chen

I will test it with 1.2.2 again.  Not sure about it now.

2016-09-05 20:26 GMT+08:00 Stack :

> Thanks Heng. Do you know if 1.2.2 or earlier versions of 1.2 failed in
> similar way or is this new phenomenon?
> Thanks,
> St.Ack
>
> On Mon, Sep 5, 2016 at 1:26 AM, Heng Chen 
> wrote:
>
> > - Unpacked source and binary tarballs: layout looks good
> > - Started up a 3-node cluster (Hadoop 2.7.2, Oracle JDK 8u20, 2 master, 2
> > rs) from binary tarballs.
> > - Verified that the web UI works and shell works
> > - build from source and run test case (JDK 8u20),  passed.
> > - Run LTT with 1M rows (100 writers,  30 readers (100%),  10 updaters
> > (20%))  all keys verified,  no warns, no errors,  no failed, latencies
> >  lgtm
> > - Run ITBLL with 2M rows (slowDeterministic), passed.
> >
> > Run ITBLL with 2M rows (serverKilling) has some issues.  I run two times,
> > all failed ( hbase --config ~/hadoop/hbase/f04_conf/
> > org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 1
> > 200 /tmp/it_16224_v0 1 -m serverKilling)
> >
> > The first time,  after kill components in cluster serval times (1 active
> > master, 1 backup master, 1 active RS, 1 dead RS), some regions fall in
> > Failed_open state on active RS,  so balance could not run, and ITBLL
> hang.
> >   Then i start the dead RS manually,   and stop the active RS,  ITBLL
> could
> > go on.  But after some time,  ITBLL hang again due to backup master could
> > not be startup,  so i do manually again,  and ITBLL go on ,  and at least
> > verified failed.
> >
> >
> > The second time,  there is no abnormal issues during ITBLL,  but verified
> > failed.
> >
> > Upload the logs
> >
> >
> >
> > 2016-09-03 0:33 GMT+08:00 Misty Stanley-Jones :
> >
> >> +1 based on OSX 10.11.6
> >>
> >> Steps taken:
> >>
> >> Binary tar.gz:
> >> - Download the tarball
> >> - Test the MD5sum, it matched
> >> - Extract the tarball
> >> - Start  HBase in standalone mode
> >> - Start the CLI
> >> - Access the master and regionServer web UIs
> >> - Stop HBase
> >>
> >> Source tar.gz:
> >> - Download the tarball
> >> - Test the MD5sum, it matched
> >> - Extract the tarball
> >> - Build using Maven 3.39 and JDK 1.8.0_102 on OSX and 'mvn clean install
> >> --fail-at-end' and let the full test suite run
> >> -- A few failed tests but each passed when I ran it separately. Not
> >> surprising since I was running all this on a Macbook.
> >> - Start HBase in standalone mode
> >> - Start the CLI
> >> - Access the master and regionServer web UIs
> >> - Stop HBase
> >>
> >>
> >> On Tue, Aug 30, 2016, at 11:14 AM, Stack wrote:
> >> > The first release candidate for HBase 1.2.3 (hbase-1.2.3RC0) is
> >> > available for download at:
> >> >
> >> >  https://dist.apache.org/repos/dist/dev/hbase/hbase-1.2.3RC0/
> >> >
> >> > Maven artifacts are also available in a staging repository at:
> >> >
> >> >  https://repository.apache.org/content/repositories/orgapache
> >> hbase-1149/
> >> >
> >> > Artifacts are signed with my key (30CD0996) published up in our KEYS
> >> > file at https://www-us.apache.org/dist/hbase/KEYS.
> >> >
> >> > The RC is tagged 1.2.3RC0 (I'll sign the tag the next time through...)
> >> >
> >> > The detailed source and binary compatibility report vs 1.2.2 has been
> >> > published for your review, at:
> >> >
> >> >  http://people.apache.org/~stack/1.2.2_1.2.3RC0_compat_report.html
> >> >
> >> > HBase 1.2.3 is the third patch release in the HBase 1.2 line,
> continuing
> >> > on
> >> > the theme of bringing a stable, reliable database to the Hadoop and
> >> NoSQL
> >> > communities. This release includes over 48 bug fixes since 1.2.2. In
> >> > particular it addresses an API incompatibility uncovered by our Apache
> >> > Phoenix bothers and sisters in our Table Interface: HBASE-16420.
> >> >
> >> > The full list of fixes included in this release is available at:
> >> >
> >> >
> >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?proje
> >> ctId=12310753=12336053
> >> >
> >> > and in the CHANGES.txt file included in the distribution.
> >> >
> >> > Please try out this candidate and vote +/-1 by 23:59 Pacific time on
> >> > Monday, 2016-09-05 as to whether we should release these artifacts as
> >> > HBase
> >> > 1.2.3.
> >> >
> >> > Thanks,
> >> > St.Ack
> >>
> >
> >
>

RE: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC

2016-09-05 Thread Pankaj kr

Congratulations Dima...!! 

> -Original Message-
> From: Andrew Purtell [mailto:apurt...@apache.org] 
> Sent: 01 September 2016 01:08
> To: dev@hbase.apache.org; u...@hbase.apache.org
> Subject: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC
> 
> On behalf of the Apache HBase PMC I am pleased to announce that Dima Spivak 
> has accepted our invitation to become a committer and PMC member on the 
> Apache HBase project. Dima has been an active contributor for some time, 
> particularly in development and contribution of release tooling that all of 
> our RMs now use, such as the API compatibility checker. Dima has also been 
> active in testing and voting on release candidates. Release voting is 
> important to project health and momentum and demonstrates interest and 
> capability above and beyond just committing. We wish to recognize this and 
> make those release votes binding. Please join me in thanking Dima for his 
> contributions to date and anticipation of many more contributions.
> 
> Welcome to the HBase project, Dima!
> 
> --
> Best regards,
> 
>   - Andy
> 
> Problems worthy of attack prove their worth by hitting back. - Piet Hein (via 
> Tom White)

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

2016-09-05 Thread Stack

Thanks Heng. Do you know if 1.2.2 or earlier versions of 1.2 failed in
similar way or is this new phenomenon?
Thanks,
St.Ack

On Mon, Sep 5, 2016 at 1:26 AM, Heng Chen  wrote:

> - Unpacked source and binary tarballs: layout looks good
> - Started up a 3-node cluster (Hadoop 2.7.2, Oracle JDK 8u20, 2 master, 2
> rs) from binary tarballs.
> - Verified that the web UI works and shell works
> - build from source and run test case (JDK 8u20),  passed.
> - Run LTT with 1M rows (100 writers,  30 readers (100%),  10 updaters
> (20%))  all keys verified,  no warns, no errors,  no failed, latencies
>  lgtm
> - Run ITBLL with 2M rows (slowDeterministic), passed.
>
> Run ITBLL with 2M rows (serverKilling) has some issues.  I run two times,
> all failed ( hbase --config ~/hadoop/hbase/f04_conf/
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 1
> 200 /tmp/it_16224_v0 1 -m serverKilling)
>
> The first time,  after kill components in cluster serval times (1 active
> master, 1 backup master, 1 active RS, 1 dead RS), some regions fall in
> Failed_open state on active RS,  so balance could not run, and ITBLL hang.
>   Then i start the dead RS manually,   and stop the active RS,  ITBLL could
> go on.  But after some time,  ITBLL hang again due to backup master could
> not be startup,  so i do manually again,  and ITBLL go on ,  and at least
> verified failed.
>
>
> The second time,  there is no abnormal issues during ITBLL,  but verified
> failed.
>
> Upload the logs
>
>
>
> 2016-09-03 0:33 GMT+08:00 Misty Stanley-Jones :
>
>> +1 based on OSX 10.11.6
>>
>> Steps taken:
>>
>> Binary tar.gz:
>> - Download the tarball
>> - Test the MD5sum, it matched
>> - Extract the tarball
>> - Start  HBase in standalone mode
>> - Start the CLI
>> - Access the master and regionServer web UIs
>> - Stop HBase
>>
>> Source tar.gz:
>> - Download the tarball
>> - Test the MD5sum, it matched
>> - Extract the tarball
>> - Build using Maven 3.39 and JDK 1.8.0_102 on OSX and 'mvn clean install
>> --fail-at-end' and let the full test suite run
>> -- A few failed tests but each passed when I ran it separately. Not
>> surprising since I was running all this on a Macbook.
>> - Start HBase in standalone mode
>> - Start the CLI
>> - Access the master and regionServer web UIs
>> - Stop HBase
>>
>>
>> On Tue, Aug 30, 2016, at 11:14 AM, Stack wrote:
>> > The first release candidate for HBase 1.2.3 (hbase-1.2.3RC0) is
>> > available for download at:
>> >
>> >  https://dist.apache.org/repos/dist/dev/hbase/hbase-1.2.3RC0/
>> >
>> > Maven artifacts are also available in a staging repository at:
>> >
>> >  https://repository.apache.org/content/repositories/orgapache
>> hbase-1149/
>> >
>> > Artifacts are signed with my key (30CD0996) published up in our KEYS
>> > file at https://www-us.apache.org/dist/hbase/KEYS.
>> >
>> > The RC is tagged 1.2.3RC0 (I'll sign the tag the next time through...)
>> >
>> > The detailed source and binary compatibility report vs 1.2.2 has been
>> > published for your review, at:
>> >
>> >  http://people.apache.org/~stack/1.2.2_1.2.3RC0_compat_report.html
>> >
>> > HBase 1.2.3 is the third patch release in the HBase 1.2 line, continuing
>> > on
>> > the theme of bringing a stable, reliable database to the Hadoop and
>> NoSQL
>> > communities. This release includes over 48 bug fixes since 1.2.2. In
>> > particular it addresses an API incompatibility uncovered by our Apache
>> > Phoenix bothers and sisters in our Table Interface: HBASE-16420.
>> >
>> > The full list of fixes included in this release is available at:
>> >
>> >
>> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?proje
>> ctId=12310753=12336053
>> >
>> > and in the CHANGES.txt file included in the distribution.
>> >
>> > Please try out this candidate and vote +/-1 by 23:59 Pacific time on
>> > Monday, 2016-09-05 as to whether we should release these artifacts as
>> > HBase
>> > 1.2.3.
>> >
>> > Thanks,
>> > St.Ack
>>
>
>

[jira] [Created] (HBASE-16563) hbase-assembly can only deal with the first license of dependency

[RESULT][VOTE] Third release candidate for HBase 1.1.6 (RC2) is available

Re: [VOTE] Third release candidate for HBase 1.1.6 (RC2) is available

Successful: hbase.apache.org HTML Checker

Re: There are some errors with hbase java example

Re: Successful: HBase Generate Website

[jira] [Created] (HBASE-16562) ITBLL should fail to start if misconfigured

Successful: HBase Generate Website

[jira] [Created] (HBASE-16561) Add metrics about read/write/scan queue length and active handler count

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

RE: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC

Re: [VOTE] First release candidate for hbase-1.2.3 (RC0) is available

14 matches

Site Navigation

Mail list logo

Footer information