Failure: hbase.apache.org HTML Checker

[Apache Jenkins Server]

Failure

If successful, the HTML and link-checking report for http://hbase.apache.org is 
available at 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/2/artifact/link_report/index.html.

If failed, see 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/2/console.

Fixed: hbase.apache.org HTML Checker

[Apache Jenkins Server]

Fixed

If successful, the HTML and link-checking report for http://hbase.apache.org is 
available at 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/3/artifact/link_report/index.html.

If failed, see 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/3/console.

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

[Stack]

I just did an edit of all of our jenkins configuration. I changed the
post-build zombie section. The surefire-killer was hanging out here it
seems (For detail, see HBASE-14589 Looking for the surefire-killer; builds
being killed...). I may have messed up builds. Will fix in morning if so
(currently builds seem a bit backed up so won't wait around).

St.Ack

On Fri, Oct 30, 2015 at 9:18 AM, Sean Busbey  wrote:

> Hi Folks,
>
> Brief summary of cleanup/changes in our builds. ref thread '[DISCUSS]
> reducing our load on builds.a.o' on reasoning or if you have concerns.
>
> Our project job view now has a brief summary of what's going on:
>
> https://builds.apache.org/view/H-L/view/HBase/
>
> * Where we had matrix builds, I confirmed they're doing the same thing
> (in at least one test-configuration) as the non-matrix version
> * I disabled jobs that were duplicating work done in matrix jobs, or
> that only worked on a tag
> * Made sure all non-disabled 0.98+ jobs are set to notify jira +
> builds mailing list
> * I updated pre-1.1 jobs to look for changes 1/day
> * I updated 1.1 jobs to look for changes every 8 hours
> * I updated 1.2, 1.3, and trunk to look for changes every 4 hours
>
> There's still some non-pressing clean up work to do, so I'll file a
> jira later today just to make sure it's all recorded somewhere.
>
> On Mon, Jun 15, 2015 at 11:55 PM, Sean Busbey  wrote:
> > Added new HBase-1.3 build or branch-1 and changed the existing 1.2
> builds to
> > use branch-1.2. (ref HBASE-13912)
> >
> > On Sun, Jun 14, 2015 at 1:11 AM, Sean Busbey 
> wrote:
> >>
> >> I've add a new build test to run the ITs under sunny day conditions
> using
> >> minicluster for both java 7 and java 8 on the 1.2 line.
> >>
> >> https://builds.apache.org/job/HBase-1.2-IT/
> >>
> >> I haven't turned on notifications yet, because BulkIngest and TestIngest
> >> are read. details on HBASE-13750
> >>
> >> On Sat, Jun 13, 2015 at 8:28 PM, Sean Busbey 
> wrote:
> >>>
> >>> sigh. that should have been "is now a matrix build".
> >>>
> >>> On Sat, Jun 13, 2015 at 7:31 PM, Sean Busbey 
> wrote:
> 
>  The HBase-1.2 build[1] is not a matrix build that runs JDK7 and JDK8
> in
>  parallel.
> 
>  I saved the old job for now and left it disabled[2].
> 
> 
>  [1]: https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2/
>  [2]:
> 
> https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2%20non-matrix/
> 
>  On Fri, Apr 10, 2015 at 3:42 PM, Sean Busbey 
>  wrote:
> >
> > Sorry for the noise. I also updated the checkstyle step on
> HBase-TRUNK
> >
> > from
> > mvn checkstyle:checkstyle
> > to
> > mvn -DskipTests package checkstyle:checkstyle
> >
> > to deal with the same issue. Looks all clear now.
> >
> > On Fri, Apr 10, 2015 at 3:03 PM, Sean Busbey 
> > wrote:
> >>
> >> Updated the following builds:
> >>
> >> * HBase-TRUNK
> >>
> >> moved from
> >>
> >> mvn clean compile findbugs:findbugs
> >>
> >> to
> >>
> >>mvn clean -DskipTests package findbugs:findbugs
> >>
> >> To work around the known issue where we can't do a bootstrap compile
> >> without previous install or remote SNAPSHOT artifacts. (recently
> triggered
> >> by the addition of the procedure module on master)
> >>
> >> On Mon, Mar 30, 2015 at 8:49 PM, 张铎  wrote:
> >>>
> >>> Make findbugs and checkstyle plugins always run.
> >>> The default behavior only publishes result for stable builds, but
> >>> master is
> >>> not always stable and sometimes we introduce new warnings in
> unstable
> >>> builds(see builds 6310-6314).
> >>> And findbugs and checkstyle will not fail unless we abort the
> >>> building
> >>> process I think, so it is safe to turn it on every time.
> >>>
> >>> Thanks.
> >>>
> >>> 2015-03-22 22:44 GMT+08:00 Ted Yu :
> >>>
> >>> > +1 on letting HBase-TRUNK jenkins show coverage report.
> >>> >
> >>> > Cheers
> >>> >
> >>> > On Sun, Mar 22, 2015 at 5:51 AM, 张铎 
> wrote:
> >>> >
> >>> > > Going to change the config of HBase-TRUNK jenkins to show
> >>> > > findbugs,
> >>> > > checkstyle and jacoco coverage report.
> >>> > > The config has been tested on
> >>> > > https://builds.apache.org/job/HBase-TRUNK-jacoco for nearly 30
> >>> > > times.
> >>> > Not
> >>> > > much different from HBase-TRUNK unless it runs ~30% slower(the
> >>> > > overhead
> >>> > of
> >>> > > collecting information for code coverage).
> >>> > > Thanks.
> >>> > >
> >>> > > 2015-03-12 5:08 GMT+08:00 Andrew Purtell  >:
> >>> > >
> >>> > > > 

[jira] [Created] (HBASE-14744) BulkDelete in Hbase Table

[Marimuthu (JIRA)]

Marimuthu created HBASE-14744:
-

 Summary: BulkDelete in Hbase Table
 Key: HBASE-14744
 URL: https://issues.apache.org/jira/browse/HBASE-14744
 Project: HBase
  Issue Type: Bug
  Components: Deletes
Affects Versions: 0.98.7
 Environment: OS : Unix
Java Version : java version "1.8.0_25"
Hbase Version: Version 0.98.7.12.1509250618_h2
Reporter: Marimuthu


Hi Anoop/Ted,
I need to delete bulk records in Hbase table based on certain criteria.
I copied one piece of code from similar thread and it throws "can not find  
symbol" error for most of the code.

Can you please provide me right code which would be used to delete bulk records

Here are the errors
DeleteRowsTest.java:75: error: cannot find symbol
   HTable tableName = new HTable(conf, "salestoolsdata:account");
 ^
  symbol:   variable conf
  location: class DeleteRowsTest
DeleteRowsTest.java:79: error: no suitable constructor found for 
SingleColumnValueFilter(char,String,CompareOp,byte[])
SingleColumnValueFilter scvf = new 
SingleColumnValueFilter('d',"ISDELETED",CompareOp.EQUAL, Bytes.toBytes("true"));
   ^
constructor 
SingleColumnValueFilter.SingleColumnValueFilter(byte[],byte[],CompareOp,byte[]) 
is not applicable
  (argument mismatch; char cannot be converted to byte[])
constructor 
SingleColumnValueFilter.SingleColumnValueFilter(byte[],byte[],CompareOp,ByteArrayComparable)
 is not applicable
  (argument mismatch; char cannot be converted to byte[])
DeleteRowsTest.java:85: error: cannot find symbol
long noOfRowsDeleted = invokeBulkDeleteProtocol(tableName, scan, 500, 
DeleteType.ROW, null);
  ^
  symbol:   variable DeleteType
  location: class DeleteRowsTest
DeleteRowsTest.java:89: error: cannot find symbol
for (Result result : ht.getScanner(new Scan())) {
 ^
  symbol:   variable ht
  location: class DeleteRowsTest
DeleteRowsTest.java:98: error: cannot find symbol
HTable ht = new HTable(conf, tableName);
   ^
  symbol:   variable conf
  location: class DeleteRowsTest
DeleteRowsTest.java:100: error: cannot find symbol
Batch.Call callable = 
   ^
  symbol:   class BulkDeleteProtocol
  location: class DeleteRowsTest
DeleteRowsTest.java:100: error: cannot find symbol
Batch.Call callable = 
   ^
  symbol:   class BulkDeleteResponse
  location: class DeleteRowsTest
DeleteRowsTest.java:101: error: cannot find symbol
new Batch.Call() {
   ^
  symbol:   class BulkDeleteProtocol
  location: class DeleteRowsTest
DeleteRowsTest.java:101: error: cannot find symbol
new Batch.Call() {
   ^
  symbol:   class BulkDeleteResponse
  location: class DeleteRowsTest
DeleteRowsTest.java:102: error: cannot find symbol
  public BulkDeleteResponse call(BulkDeleteProtocol instance) throws 
IOException {
 ^
  symbol: class BulkDeleteProtocol
DeleteRowsTest.java:102: error: cannot find symbol
  public BulkDeleteResponse call(BulkDeleteProtocol instance) throws 
IOException {
 ^
  symbol: class BulkDeleteResponse
DeleteRowsTest.java:106: error: cannot find symbol
Map result = 
ht.coprocessorExec(BulkDeleteProtocol.class,
^
  symbol:   class BulkDeleteResponse
  location: class DeleteRowsTest
DeleteRowsTest.java:106: error: cannot find symbol
Map result = 
ht.coprocessorExec(BulkDeleteProtocol.class,
^
  symbol:   class BulkDeleteProtocol
  location: class DeleteRowsTest
DeleteRowsTest.java:108: error: cannot find symbol
for (BulkDeleteResponse response : result.values()) {
 ^
  symbol:   class BulkDeleteResponse
  location: class DeleteRowsTest
Note: Some messages have been simplified; recompile with -Xdiags:verbose to get 
full output
18 errors



Thanks
Marimuthu





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-14743) Add metrics around HeapMemoryManager

[Elliott Clark (JIRA)]

Elliott Clark created HBASE-14743:
-

 Summary: Add metrics around HeapMemoryManager
 Key: HBASE-14743
 URL: https://issues.apache.org/jira/browse/HBASE-14743
 Project: HBase
  Issue Type: Bug
Reporter: Elliott Clark


it would be good to know how many invocations there have been.
How many decided to expand memstore.
How many decided to expand block cache.
How many decided to do nothing.
etc.

When that's done use those metrics to clean up the tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HBASE-13742) buildbot should run link checker over book

[Misty Stanley-Jones (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-13742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones resolved HBASE-13742.
-
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 2.0.0

Fix version doesn't really make sense here, but I've put it in case it is 
needed. It's just a Jenkins job.

> buildbot should run link checker over book
> --
>
> Key: HBASE-13742
> URL: https://issues.apache.org/jira/browse/HBASE-13742
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Reporter: Nick Dimiduk
>Assignee: Misty Stanley-Jones
>  Labels: test-patch
> Fix For: 2.0.0
>
>
> I noticed when digging around for info on ImportTsv that we have a broken 
> link in "66.4 See Also". Links to \#importtsv but the real anchor on "117.11. 
> ImportTsv" is \#_importtsv.
> Instead of continuing to fix broken links one-by-one, we should run a link 
> checker over all the docs and ensure these anchors are correct. Similarly, we 
> should be looking for references that need to be relative and fix them, a la 
> HBASE-13669.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HBASE-11720) Set up jenkins job to build site documentation

[Misty Stanley-Jones (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Misty Stanley-Jones resolved HBASE-11720.
-
   Resolution: Fixed
Fix Version/s: 2.0.0

This is a Jenkins-only fix, nothing to do with the source.

> Set up jenkins job to build site documentation
> --
>
> Key: HBASE-11720
> URL: https://issues.apache.org/jira/browse/HBASE-11720
> Project: HBase
>  Issue Type: Task
>  Components: build, documentation
>Reporter: Sean Busbey
>Assignee: Misty Stanley-Jones
>Priority: Minor
>  Labels: jenkins
> Fix For: 2.0.0
>
>
> We should add a jenkins job that builds the website with all docs (nightly? 
> on change?) so that we can get early warning of breakage (e.g. [tag 
> typos|https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=commit;h=bdf9c35d0001e030dff1161fa3a4da87fbc84760])
>  as well as an easy place to review the not-yet-published rendered form.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Successful: HBase Generate Website

[Apache Jenkins Server]

Successful

If successful, AND you have SVN commit access, paste the following into a 
command prompt to publish the website:

wget 
https://builds.apache.org/job/HBase%20Generate%20Website/9/artifact/trunk.tar.gz
tar xzvf trunk.tar.gz
cd trunk
svn commit -F ./commit_msg.txt

If failed, see 
https://builds.apache.org/job/HBase%20Generate%20Website/9/console

Fwd: Successful: HBase Generate Website

[Misty Stanley-Jones]

I set up a Jenkins job to do the heavy lifting of building and publishing
the website. All you need to do is paste the commands from the email from
Jenkins. You don't even need to worry about keeping the SVN repo up to
date. Hope this is helpful!

Right now, this will run daily. We can tune it down if it's too often.

-- Forwarded message --
From: Apache Jenkins Server 
Date: Tue, Nov 3, 2015 at 3:48 PM
Subject: Successful: HBase Generate Website
To: dev@hbase.apache.org


Successful

If successful, AND you have SVN commit access, paste the following into a
command prompt to publish the website:

wget
https://builds.apache.org/job/HBase%20Generate%20Website/9/artifact/trunk.tar.gz
tar xzvf trunk.tar.gz
cd trunk
svn commit -F ./commit_msg.txt

If failed, see
https://builds.apache.org/job/HBase%20Generate%20Website/9/console

[jira] [Created] (HBASE-14742) TestHeapMemoryManager is flakey

[Elliott Clark (JIRA)]

Elliott Clark created HBASE-14742:
-

 Summary: TestHeapMemoryManager is flakey
 Key: HBASE-14742
 URL: https://issues.apache.org/jira/browse/HBASE-14742
 Project: HBase
  Issue Type: Bug
  Components: test
Reporter: Elliott Clark
Assignee: Elliott Clark


On our internal build system we've seen TestHeapMemoryManager fail twice.

{code}
Failed tests: 
  
TestHeapMemoryManager.testWhenClusterIsReadHeavy:174->assertHeapSpaceDelta:317 
null
  
TestHeapMemoryManager.testWhenClusterIsWriteHeavy:136->assertHeapSpaceDelta:317 
null
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (HBASE-14725) Vet categorization of tests so they for sure go into the right small/medium/large buckets

[stack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack reopened HBASE-14725:
---

Reverted from all branches. It looks to have destabilized the build -- the MR 
jobs are failing.

> Vet categorization of tests so they for sure go into the right 
> small/medium/large buckets
> -
>
> Key: HBASE-14725
> URL: https://issues.apache.org/jira/browse/HBASE-14725
> Project: HBase
>  Issue Type: Sub-task
>  Components: test
>Reporter: stack
>Assignee: stack
> Fix For: 2.0.0, 1.2.0, 1.3.0
>
> Attachments: 14725v2 (1).txt, 14725v2 (1).txt, 14725v2.txt, 
> 14725v2.txt, 14725v4.txt, 14725v4.txt, categorization.patch
>
>
> I tried doing runSmallTests, runMediumTests, etc., and I noticed that some 
> tests are larger than our categorization. At least for small tests it means 
> they area all running in the one JVM. I also noticed that the categorization 
> only takes effect in hbase-server.
> This patch makes it so runSmallTests runs all the small tests only in each 
> category.  Also moves tests that were larger than small out to medium so they 
> don't run in the one JVM anymore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-14745) Shade the last few dependencies in hbase-shaded-client

[Elliott Clark (JIRA)]

Elliott Clark created HBASE-14745:
-

 Summary: Shade the last few dependencies in hbase-shaded-client
 Key: HBASE-14745
 URL: https://issues.apache.org/jira/browse/HBASE-14745
 Project: HBase
  Issue Type: Bug
Reporter: Elliott Clark
Assignee: Elliott Clark


* junit
* hadoop common



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Successful: hbase.apache.org HTML Checker

[Apache Jenkins Server]

Successful

If successful, the HTML and link-checking report for http://hbase.apache.org is 
available at 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/1/artifact/link_report/index.html.

If failed, see 
https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/1/console.

[jira] [Created] (HBASE-14748) Update 0.94 apidocs and xref on website

[Misty Stanley-Jones (JIRA)]

Misty Stanley-Jones created HBASE-14748:
---

 Summary: Update 0.94 apidocs and xref on website
 Key: HBASE-14748
 URL: https://issues.apache.org/jira/browse/HBASE-14748
 Project: HBase
  Issue Type: Sub-task
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones


When HBASE-14747 has been merged, update the subdirectories of 0.94/ in SVN. 
There are lots of broken links there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-14746) Run less client threads in tests

[stack (JIRA)]

stack created HBASE-14746:
-

 Summary: Run less client threads in tests
 Key: HBASE-14746
 URL: https://issues.apache.org/jira/browse/HBASE-14746
 Project: HBase
  Issue Type: Sub-task
Reporter: stack


Looking at thread counts reported by the nice 'after:' log message, I see the 
likes of TestReplicationKillSlaveRS and all of its derivatives reporting 
hundreds of threads (shows as over 1000 in one run here).

Running the test standalone, I see the above run up the threads to 700 (only!). 
Need to figure why the discrepancy.

The attached patch makes some difference -- cutting down the client thread 
count -- but not enough. Let me look more.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HBASE-14715) Add javadocs to DelegatingRetryingCallable

[Jesse Yates (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesse Yates resolved HBASE-14715.
-
   Resolution: Fixed
Fix Version/s: 2.0.0

Committed to trunk. Thanks for the reviews fellas.

> Add javadocs to DelegatingRetryingCallable
> --
>
> Key: HBASE-14715
> URL: https://issues.apache.org/jira/browse/HBASE-14715
> Project: HBase
>  Issue Type: Improvement
>  Components: Client
>Reporter: Jesse Yates
>Assignee: Jesse Yates
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: hbase-14715-trunk-v0.patch
>
>
> Follow up cleanup from HBASE-9049



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-14747) Make it possible to build Javadoc and xref reports for 0.94 again

[Misty Stanley-Jones (JIRA)]

Misty Stanley-Jones created HBASE-14747:
---

 Summary: Make it possible to build Javadoc and xref reports for 
0.94 again
 Key: HBASE-14747
 URL: https://issues.apache.org/jira/browse/HBASE-14747
 Project: HBase
  Issue Type: Task
  Components: build
Affects Versions: 0.94.27
Reporter: Misty Stanley-Jones
Assignee: Misty Stanley-Jones
 Fix For: 0.94.28






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Successful: hbase.apache.org HTML Checker

[Stack]

This is great. Thanks Misty. The mail to the list will always have this
text w/ links on what to do if failed?
St.Ack

On Mon, Nov 2, 2015 at 4:29 PM, Misty Stanley-Jones <
mstanleyjo...@cloudera.com> wrote:

> FYI, this report will run weekly and let us know if we have broken links,
> missing files, etc.
>
> On Tue, Nov 3, 2015 at 10:02 AM, Apache Jenkins Server <
> jenk...@builds.apache.org> wrote:
>
> > Successful
> >
> > If successful, the HTML and link-checking report for
> > http://hbase.apache.org is available at
> >
> https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/1/artifact/link_report/index.html
> > .
> >
> > If failed, see
> > https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/1/console
> .
>