Thanks for everybody who tested the release and voted. The vote passes with 7 +1's (6 binding). I'll push out the artifacts now and the send a release notes Sunday.
Enis On Fri, Feb 20, 2015 at 11:05 PM, Jeffrey Zhong <jzh...@hortonworks.com> wrote: > > +1. I have compiled & run Phoenix master branch code(with some code > changes) on top of Hbase 1.0.0. All Phoenix tests are passed and one issue > is found(https://issues.apache.org/jira/browse/HBASE-13077) > > Thanks, > -Jeffrey > > On 2/20/15, 12:38 AM, "Enis Söztutar" <e...@apache.org> wrote: > > >Thanks for tests and votes so far. > > > >Here is my official +1 (see above for my tests). > > > >I was inspecting a similar issue today in the cluster with > >IntegrationTestLoadAndVerify with destructive CM, and the log splitting > >did > >not finish in 3 attempts. I think the issue is a not that critical though, > >I think it is due to a race between timeout monitor and some slowness in > >task heartbeat due to a loaded master (will open a jira if I nail down the > >exact reason). > > > >We need at least one more vote. I'll extend the voting for this RC (RC5) > >until 20th midnight PST. Please let me know if you intend to spend some > >more time on testing. We can extend the deadline. > > > >Cheers, > >Enis > > > >On Thu, Feb 19, 2015 at 6:12 PM, Andrew Purtell <apurt...@apache.org> > >wrote: > > > >> Maybe its just me > >> > >> > >> On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <enis....@gmail.com> > >> wrote: > >> > >> > I did not run the unit tests locally. I was relying on the following > >> build > >> > which is 100% pass: > >> > > >> > https://builds.apache.org/view/All/job/HBase-1.0/746/ > >> > > >> > It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81). > >>Let > >> > me kick a local UT run just in case. > >> > > >> > Enis > >> > > >> > On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <apurt...@apache.org> > >> > wrote: > >> > > >> > > That list is missing unit testing. Did you happen to do that when > >> > building > >> > > but not mention it Enis? If so did they all pass for you? > >> > > > >> > > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <enis....@gmail.com> > >> > wrote: > >> > > > >> > > > Here is my RC5 testing so far: > >> > > > > >> > > > - checked checksums, sigs > >> > > > - checked the bin and src artifacts > >> > > > - checked layouts > >> > > > - checked java files in src tarball, and jar files in bin tarball > >> > > > - checked the book and the site (they are new style) > >> > > > - checked javadocs for both devapi and userapi > >> > > > - checked reported version, build time, revision > >> > > > - run some smoke tests using shell > >> > > > - started local mode > >> > > > - run LTT local mode > >> > > > - checked the webUIs of master and region servers > >> > > > - checked JMX dump and debug dump > >> > > > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 > >> 2.5.1 > >> > > > 2.5.2 2.6.0 > >> > > > - Deployed at a 6 node cluster with Hadoop-2.6.0 > >> > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX > >>encoding > >> > > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY > >>compression > >> > > > - Tested with Bucket cache with 500M off heap > >> > > > > >> > > > I am still running larger scale tests, and some CM tests on the > >> > cluster. > >> > > > Will report back tomorrow and cast my vote. > >> > > > > >> > > > Enis > >> > > > > >> > > > > >> > > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <palomino...@gmail.com> > wrote: > >> > > > > >> > > > > TestCacheOnWrite itself has some problems. It > >> > > > > uses TestHFileWriterV2.randomOrderedKey to generate a random > >>byte > >> > > array, > >> > > > > then use first 32 bytes as row and other parts as family and > >> > qualifier, > >> > > > but > >> > > > > TestHFileWriterV2.randomOrderedKey may return a byte array only > >> > > contains > >> > > > 32 > >> > > > > bytes, so there will be family and qualifier with zero length. > >> > > > > > >> > > > > I do not know if this is the reason why this test is flaky > >>since it > >> > > use a > >> > > > > Random with pre-defined seed so the random sequence should be > >> > stable. I > >> > > > can > >> > > > > modify the KeyValue generation part to see if it helps. > >> > > > > > >> > > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to ' > >> > > > > randomOrderedRow'? > >> > > > > > >> > > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <apurt...@apache.org>: > >> > > > > > >> > > > > > I'm not able to get a clean unit test run when building from > >> source > >> > > > using > >> > > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, > >>maybe > >> > > more > >> > > > > but > >> > > > > > the build doesn't get past hbase-server. Maybe these are known > >> > > issues? > >> > > > If > >> > > > > > not I'll dig in when I get some time. > >> > > > > > > >> > > > > > > >> > > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar > >><e...@apache.org> > >> > > > wrote: > >> > > > > > > >> > > > > > > It gives me great pleasure to announce that the sixth > >>release > >> > > > candidate > >> > > > > > for > >> > > > > > > the release > >> > > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at > >> > > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/ > >> > > > > > > > >> > > > > > > Maven artifacts are also available in the temporary > >>repository > >> > > > > > > > >> > > > > >> https://repository.apache.org/content/repositories/orgapachehbase-1065 > >> > > > > > > > >> > > > > > > Signed with my code signing key E964B5FF. Can be found here: > >> > > > > > > https://people.apache.org/keys/committer/enis.asc > >> > > > > > > > >> > > > > > > Signed tag in the repository can be found here: > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> > https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46 > >>c917a9aba2106be4bf74182a764 > >> > > > > > > > >> > > > > > > HBase 1.0.0 is the next stable release, and the start of > >> > "semantic > >> > > > > > > versioned" > >> > > > > > > releases (See [1]). > >> > > > > > > > >> > > > > > > The theme of 1.0.0 release is to become a stable base for > >> future > >> > > 1.x > >> > > > > > series > >> > > > > > > of releases. We aim to achieve at least the same level of > >> > stability > >> > > > of > >> > > > > > 0.98 > >> > > > > > > releases. > >> > > > > > > > >> > > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release. > >> > Together > >> > > > > with > >> > > > > > > the > >> > > > > > > previous 0.99.x releases, major changes in 1.0.0 are listed > >> (but > >> > > not > >> > > > > > > limited to) > >> > > > > > > below. Note that all previous 0.99.x releases are developer > >> > preview > >> > > > > > > releases, and will > >> > > > > > > NOT be supported in any form. > >> > > > > > > > >> > > > > > > API Cleanup and changes > >> > > > > > > 1.0.0 introduces new APIs, and deprecates some of > >> commonly-used > >> > > > > > > client side APIs (HTableInterface, HTable and HBaseAdmin). > >> > > > > > > We advise to update your application to use the new style > >>of > >> > > APIs, > >> > > > > > since > >> > > > > > > deprecated APIs might be removed in future releases (2.x). > >> See > >> > > [2] > >> > > > > and > >> > > > > > > [3] > >> > > > > > > for an overview of changes. All Client side API's are > >>marked > >> > with > >> > > > > > > InterfaceAudience.Public class, indicating that the > >> > class/method > >> > > is > >> > > > > an > >> > > > > > > official "client API" for HBase. All 1.x releases are > >>planned > >> > to > >> > > be > >> > > > > API > >> > > > > > > compatible for these classes. See [1] for an overview. > >> > > > > > > > >> > > > > > > Master runs a Region Server as well > >> > > > > > > Starting with 1.0.0, the HBase master server and backup > >> master > >> > > > > servers > >> > > > > > > will > >> > > > > > > also act as a region server. RPC port and info port for > >>web > >> UI > >> > is > >> > > > > > shared > >> > > > > > > for > >> > > > > > > the master and region server roles. Active master can host > >> > > regions > >> > > > of > >> > > > > > > defined tables if configured (disabled by default). Backup > >> > > masters > >> > > > > will > >> > > > > > > not > >> > > > > > > host regions. > >> > > > > > > > >> > > > > > > Read availability using timeline consistent region replicas > >> > > > > > > This release contains Phase 1 items for experimental "Read > >> > > > > availability > >> > > > > > > using > >> > > > > > > timeline consistent region replicas" feature. A region > >>can be > >> > > > hosted > >> > > > > in > >> > > > > > > multiple region servers in read-only mode. One of the > >> replicas > >> > > for > >> > > > > the > >> > > > > > > region > >> > > > > > > will be primary, accepting writes, and other replicas > >>will be > >> > > > sharing > >> > > > > > the > >> > > > > > > same > >> > > > > > > data files. Read requests can be done against any replica > >>for > >> > the > >> > > > > > region > >> > > > > > > with > >> > > > > > > backup RPCs for high availability with timeline > >>consistency > >> > > > > guarantees. > >> > > > > > > More > >> > > > > > > information can be found at HBASE-10070. > >> > > > > > > > >> > > > > > > Online config change and other forward ports from 0.89-fb > >> branch > >> > > > > > > HBASE-12147 forward ported online config change which > >>enables > >> > > some > >> > > > of > >> > > > > > the > >> > > > > > > configuration from the server to be reloaded without > >> restarting > >> > > the > >> > > > > > > region > >> > > > > > > servers. > >> > > > > > > > >> > > > > > > Other notable improvements in 1.0.0 (including previous > >>0.99.x) > >> > are > >> > > > > > > - A new web skin in time for 1.0 (http://hbase.apache.org) > >> > > > > > > - Automatic tuning of global memstore and block cache sizes > >> > > > > > > - Various security, tags and visibility labels improvements > >> > > > > > > - Bucket cache improvements (usability and compressed data > >> > blocks) > >> > > > > > > - A new pluggable replication endpoint to plug in to > >>HBase's > >> > > > > > inter-cluster > >> > > > > > > replication to replicate to a custom data store > >> > > > > > > - A Dockerfile to easily build and run HBase from source > >> > > > > > > - Truncate table command > >> > > > > > > - Region assignment to use hbase:meta table instead of > >> zookeeper > >> > > for > >> > > > > > > faster > >> > > > > > > region assignment (disabled by default) > >> > > > > > > - Extensive documentation improvements > >> > > > > > > - [HBASE-12511] - namespace permissions - add support from > >> table > >> > > > > > creation > >> > > > > > > privilege in a namespace 'C' > >> > > > > > > - [HBASE-12568] - Adopt Semantic Versioning and document > >>it in > >> > the > >> > > > > book > >> > > > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support > >>for > >> > > Thrift > >> > > > > > Server > >> > > > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide > >>LoadBalancer > >> > with > >> > > > > online > >> > > > > > > configuration capability' to branch-1 > >> > > > > > > - [HBASE-10560] - Per cell TTLs > >> > > > > > > - [HBASE-11997] - CopyTable with bulkload > >> > > > > > > - [HBASE-11990] - Make setting the start and stop row for a > >> > > specific > >> > > > > > > prefix easier > >> > > > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins > >>metrics > >> > > > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster > >> > > > > > > - [HBASE-12032] - Script to stop regionservers via RPC > >> > > > > > > - [HBASE-11907] - Use the joni byte[] regex engine in > >>place of > >> > > > > j.u.regex > >> > > > > > > in RegexStringComparator > >> > > > > > > - [HBASE-11796] - Add client support for atomic > >>checkAndMutate > >> > > > > > > - [HBASE-11804] - Raise default heap size if unspecified > >> > > > > > > - [HBASE-11890] - HBase REST Client is hard coded to http > >> > protocol > >> > > > > > > - [HBASE-12126] - Region server coprocessor endpoint > >> > > > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse > >>scans > >> > > > > > > - [HBASE-12075] - Preemptive Fast Fail > >> > > > > > > - [HBASE-12354] - Update dependencies in time for 1.0 > >>release > >> > > > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with > >> > > > > MIN_VERSIONS > >> > > > > > > - [HBASE-12434] - Add a command to compact all the regions > >>in > >> a > >> > > > > > > regionserver > >> > > > > > > - [HBASE-8707] - Add LongComparator for filter > >> > > > > > > - [HBASE-12286] - [shell] Add server/cluster online load of > >> > > > > > configuration > >> > > > > > > changes > >> > > > > > > - [HBASE-12361] - Show data locality of region in table > >>page > >> > > > > > > - [HBASE-12496] - A blockedRequestsCount metric > >> > > > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client > >>pushback > >> > > > > mechanism) > >> > > > > > to > >> > > > > > > branch-1 > >> > > > > > > - [HBASE-12731] - Heap occupancy based client pushback > >> > > > > > > - [HBASE-12728] - buffered writes substantially less useful > >> > after > >> > > > > > removal > >> > > > > > > of HTablePool > >> > > > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer > >> > > > > > > - Various fixes to REST server > >> > > > > > > - Internal refactoring for abstracting away zookeeper usage > >> > > > > > > - Better support for Cell interface internally in read and > >> write > >> > > > paths > >> > > > > > for > >> > > > > > > better performance and flexibility > >> > > > > > > - Combining internal mvcc and seqId infrastructure > >> > > > > > > - Ring buffer based WAL improvements > >> > > > > > > - Switch to using new style of client APIs internally (in a > >> lot > >> > of > >> > > > > > places) > >> > > > > > > - Improvements in visibility labels > >> > > > > > > - Perf improvements > >> > > > > > > - Numerous improvements in other areas and bug fixes. > >> > > > > > > > >> > > > > > > 1.0.0 release has these changes in default behavior (see > >>[4]) > >> > > > > > > - Zookeeper 3.4.x is required > >> > > > > > > - Hadoop-2.x is required > >> > > > > > > - JDK-1.7 is required > >> > > > > > > - Default ports have changed from 600XX range into out of > >> > > ephemeral > >> > > > > > 160XX > >> > > > > > > range. > >> > > > > > > - Hfile version 3 has been enabled by default. > >> > > > > > > - Slab cache has been removed (use bucket cache instead) > >> > > > > > > - Default heap for region servers (and master) is changed > >>from > >> > 1GB > >> > > > to > >> > > > > > > the jdk's default. On most platforms, it will default to > >>1/4 > >> > of > >> > > > > > physical > >> > > > > > > memory > >> > > > > > > - Some client facing APIs (HTableInterface, etc) has been > >> > > deprecated > >> > > > > and > >> > > > > > > replaced. > >> > > > > > > - Custom Filter implementations should switch to using the > >>new > >> > > > > > recommended > >> > > > > > > APIs. > >> > > > > > > - Some authorization permissions (especially regarding > >> > namespaces) > >> > > > > have > >> > > > > > > been > >> > > > > > > changed (HBASE-12511, HBASE-8015) > >> > > > > > > - Mapred package and classes under there has been > >> un-deprecated. > >> > > > > > > - Two new modules (jar files): hbase-annotations and > >> > hbase-rest. > >> > > > > > > - HTrace dependency is moved to the Apache artifacts ( > >> > > > > > > https://htrace.incubator.apache.org/) > >> > > > > > > - Various updates to dependency versions > >> > > > > > > > >> > > > > > > Full list of the issues can be found at: > >> > > > > > > - 1.0.0 issues : > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753 > >>&version=12325852 > >> > > > > > > - 0.99.2 issues : > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753 > >>&version=12325675 > >> > > > > > > - 0.99.1 issues : > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753 > >>&version=12328551 > >> > > > > > > - 0.99.0 issues : > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753 > >>&version=12328822 > >> > > > > > > > >> > > > > > > Compatibility > >> > > > > > > ------------- > >> > > > > > > Source Compatibility: > >> > > > > > > Client side code in HBase-1.0.0 is (mostly) source > >>compatible > >> > with > >> > > > > > earlier > >> > > > > > > versions. Some minor API changes might be needed from the > >> client > >> > > > side. > >> > > > > > > > >> > > > > > > > >> > > > > > > Wire Compatibility: > >> > > > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases. > >> > > Clients > >> > > > > and > >> > > > > > > servers running in different versions as long as new > >>features > >> are > >> > > not > >> > > > > > used > >> > > > > > > should be possible. > >> > > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is > >>supported as > >> > > well. > >> > > > > > 1.0.0 > >> > > > > > > introduces a new file format (hfile v3) that is enabled by > >> > default > >> > > > that > >> > > > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 > >> directly > >> > > to > >> > > > > > 1.0.0 > >> > > > > > > is > >> > > > > > > not supported. > >> > > > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, > >>etc). > >> > > > > > > > >> > > > > > > Binary Compatibility: > >> > > > > > > Binary compatibility at the Java API layer with earlier > >> versions > >> > > > > (0.98.x, > >> > > > > > > 0.96.x and 0.94.x) is not supported. You may have to > >>recompile > >> > your > >> > > > > > client > >> > > > > > > code and any server side code (coprocessors, filters etc) > >> > referring > >> > > > to > >> > > > > > > hbase jars. > >> > > > > > > > >> > > > > > > Upgrading > >> > > > > > > --------- > >> > > > > > > See [4] for upgrade instructions and extended discussion on > >>the > >> > > > > changes. > >> > > > > > > > >> > > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or > >>rolling > >> > > > upgrade > >> > > > > > > fashion > >> > > > > > > is supported. > >> > > > > > > > >> > > > > > > From 0.96.x : Upgrade from 0.96.x is supported with a > >>shutdown > >> > and > >> > > > > > restart > >> > > > > > > of > >> > > > > > > the cluster. > >> > > > > > > > >> > > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to > >> upgrade > >> > > > from > >> > > > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite > >> cluster > >> > > > level > >> > > > > > > metadata. > >> > > > > > > See [5] for details. > >> > > > > > > > >> > > > > > > > >> > > > > > > Supported Hadoop versions > >> > > > > > > ------------------------- > >> > > > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only > >> > > Hadoop-2.x > >> > > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and > >> > Hadoop-2.6.x > >> > > > > > > releases > >> > > > > > > are the most tested hadoop releases and we recommend running > >> with > >> > > > those > >> > > > > > > versions > >> > > > > > > (or later versions). Earlier Hadoop-2 based releases > >> > (hadoop-2.2.x > >> > > > and > >> > > > > > > 2.3.x) > >> > > > > > > are not tested to the full extend. More information can be > >> found > >> > > > here: > >> > > > > > > https://hbase.apache.org/book/configuration.html#hadoop > >> > > > > > > > >> > > > > > > > >> > > > > > > Supported Java versions > >> > > > > > > ------------------------- > >> > > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is > >>supported. > >> > JDK8 > >> > > > > > support > >> > > > > > > is experimental. More information can be found here: > >> > > > > > > https://hbase.apache.org/book/configuration.html#java > >> > > > > > > > >> > > > > > > > >> > > > > > > Voting > >> > > > > > > ------ > >> > > > > > > Please try to test and vote on this release by Feb 19 2015 > >> > 11:59PM > >> > > > PDT. > >> > > > > > > We will have a 5 day voting period because this is the sixth > >> RC. > >> > > > Please > >> > > > > > try > >> > > > > > > to > >> > > > > > > spend some time for testing this important release. > >> > > > > > > > >> > > > > > > [] +1 Release the artifacts as 1.0.0 > >> > > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because... > >> > > > > > > > >> > > > > > > Gratitute > >> > > > > > > --------- > >> > > > > > > Last but not least, 1.0.0 release has been in a long time > >> making > >> > > with > >> > > > > > > contributions from a very large group of awesome people and > >> hard > >> > > work > >> > > > > > from > >> > > > > > > committers and contributors. We would like to extend our > >>thanks > >> > to > >> > > > > > > everybody > >> > > > > > > who worked on this release or contributed to HBase over the > >> > years. > >> > > > > > > > >> > > > > > > > >> > > > > > > References > >> > > > > > > ---------- > >> > > > > > > [1] > >> > https://hbase.apache.org/book/upgrading.html#hbase.versioning > >> > > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release > >> > > > > > > [3] http://s.apache.org/hbase-1.0-api > >> > > > > > > [4] > >> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes > >> > > > > > > [5] > >> > > > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94 > >> > > > > > > > >> > > > > > > Enis > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > -- > >> > > > > > Best regards, > >> > > > > > > >> > > > > > - Andy > >> > > > > > > >> > > > > > Problems worthy of attack prove their worth by hitting back. - > >> Piet > >> > > > Hein > >> > > > > > (via Tom White) > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > > -- > >> > > Best regards, > >> > > > >> > > - Andy > >> > > > >> > > Problems worthy of attack prove their worth by hitting back. - Piet > >> Hein > >> > > (via Tom White) > >> > > > >> > > >> > >> > >> > >> -- > >> Best regards, > >> > >> - Andy > >> > >> Problems worthy of attack prove their worth by hitting back. - Piet Hein > >> (via Tom White) > >> > >