[jira] [Created] (HBASE-17109) LoadTestTool needs differentiation and help/usage/options/cleanup and examples; else lets drop it: we have enough loading options already

2016-11-15 Thread stack (JIRA)
stack created HBASE-17109:
-

 Summary: LoadTestTool needs differentiation and 
help/usage/options/cleanup and examples; else lets drop it: we have enough 
loading options already
 Key: HBASE-17109
 URL: https://issues.apache.org/jira/browse/HBASE-17109
 Project: HBase
  Issue Type: Task
Reporter: stack
Priority: Critical
 Fix For: 2.0.0


LTT needs better differentiation from PE (and YCSB). When would I use it 
instead?

If we can't make a case for it, lets drop it. Having so many loading options is 
only confusing 

It could be easier to use and get going doing some mildly interesting loadings 
but the options presented confuse. They are not sorted. There are no examples. 
If you type nothing you get an exception instead of help. A little cleanup and 
LTT could be easy to get going loading tool. For heavier loading PE or YCSB... 
though again, the less options the better.

One thing LTT is nice at is the way it can make many tables with many regions 
easily. What else differentiates it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17108) ZKConfig.getZKQuorumServersString does not return the correct client port number

2016-11-15 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-17108:
--

 Summary: ZKConfig.getZKQuorumServersString does not return the 
correct client port number
 Key: HBASE-17108
 URL: https://issues.apache.org/jira/browse/HBASE-17108
 Project: HBase
  Issue Type: Bug
Affects Versions: 0.98.17
Reporter: Andrew Purtell
 Fix For: 0.98.24


ZKConfig.getZKQuorumServersString may not return the correct client port 
number, at least on 0.98 branch. See PHOENIX-3485. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17107) FN info should be cleaned up on region/table cleanup

2016-11-15 Thread Thiruvel Thirumoolan (JIRA)
Thiruvel Thirumoolan created HBASE-17107:


 Summary: FN info should be cleaned up on region/table cleanup
 Key: HBASE-17107
 URL: https://issues.apache.org/jira/browse/HBASE-17107
 Project: HBase
  Issue Type: Sub-task
Reporter: Thiruvel Thirumoolan
Assignee: Thiruvel Thirumoolan


FN info should be cleaned up when table is deleted and when regions are GCed 
(i.e. CatalogJanitor).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17106) Wrap arguments to Coprocessor method invocations in Context objects

2016-11-15 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-17106:
-

 Summary: Wrap arguments to Coprocessor method invocations in 
Context objects
 Key: HBASE-17106
 URL: https://issues.apache.org/jira/browse/HBASE-17106
 Project: HBase
  Issue Type: New Feature
Reporter: Enis Soztutar
 Fix For: 2.0.0


As discussed in various contexts (and recently in 
https://issues.apache.org/jira/browse/HBASE-16962?focusedCommentId=15648512=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15648512)
 we have a very large number of deprecated methods in RegionObserver (and 
possibly others) which are due to the fact that the method signatures like: 
{code}
  @Deprecated
  InternalScanner preFlushScannerOpen(final 
ObserverContext c,
  final Store store, final KeyValueScanner memstoreScanner, final 
InternalScanner s)
  throws IOException;
{code}
depend inherently on the internal method signatures which gets changed 
frequently. 

We should look into wrapping the method arguments for such declerations in the 
RegionObserver interface so that we can evolve and add new arguments without 
breaking existing coprocessors between minor versions. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17105) Annotate RegionServerObserver

2016-11-15 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-17105:
-

 Summary: Annotate RegionServerObserver
 Key: HBASE-17105
 URL: https://issues.apache.org/jira/browse/HBASE-17105
 Project: HBase
  Issue Type: Bug
Reporter: Enis Soztutar
Assignee: Enis Soztutar
 Fix For: 2.0.0, 1.4.0


Seems that we have forgotten to annotate RegionServerObserver with 
InterfaceAudience. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (HBASE-16825) Backup mega patch: Review 52748 work

2016-11-15 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov reopened HBASE-16825:
---

> Backup mega patch: Review 52748 work
> 
>
> Key: HBASE-16825
> URL: https://issues.apache.org/jira/browse/HBASE-16825
> Project: HBase
>  Issue Type: Task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: HBASE-7912
>
>
> This ticket to address comments/issues raised in RB:
> https://reviews.apache.org/r/52748



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (HBASE-16940) Address review of "Backup/Restore (HBASE-7912, HBASE-14030, HBASE-14123) mega patch" posted on RB

2016-11-15 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov reopened HBASE-16940:
---

Reopening the issue to address the most recent comments.

> Address review of "Backup/Restore (HBASE-7912, HBASE-14030, HBASE-14123) mega 
> patch" posted on RB 
> --
>
> Key: HBASE-16940
> URL: https://issues.apache.org/jira/browse/HBASE-16940
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0
>
> Attachments: HBASE-16940-v1.patch, HBASE-16940-v2.patch
>
>
> Review 52748 remaining issues.
> https://reviews.apache.org/r/52748



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17104) Improve cryptic error message "Memstore size is" on region close

2016-11-15 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-17104:
---

 Summary: Improve cryptic error message "Memstore size is" on 
region close
 Key: HBASE-17104
 URL: https://issues.apache.org/jira/browse/HBASE-17104
 Project: HBase
  Issue Type: Bug
  Components: regionserver
Reporter: Matteo Bertozzi
Priority: Trivial
 Fix For: 2.0.0


while grepping my RS log for ERROR I found a cryptic
{noformat}
ERROR [RS_CLOSE_REGION-u1604vm:35021-1] regionserver.HRegion(1601): Memstore 
size is 33744
{noformat}

from the code looks like we seems to want to notify the user about the fact 
that on close the rs was not able to flush and there were things in the RS. 
https://github.com/apache/hbase/blob/c3685760f004450667920144f926383eb307de53/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java#L1601
{code}
if (!canFlush) {
  this.decrMemstoreSize(new MemstoreSize(memstoreDataSize.get(), 
getMemstoreHeapOverhead()));
} else if (memstoreDataSize.get() != 0) {
  LOG.error("Memstore size is " + memstoreDataSize.get());
}
{code}
this should probably not even be an error but a warn or even info, unless we 
have puts that specifically asked to not be written to the wal,  otherwise the 
data in the memstore should be safe in the wals. 
In any case it will be nice to have a message describing what is going on and 
why we are notifying about the memstore size.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Please update your jenkins job configs ASAP

2016-11-15 Thread Gav
fwiw I too had seen the 'disappearance'  of the 'slave' configuration of
the matrix jobs.
Nothing to do with what I have been working on, this stopped working a
while ago.

I have commented on a Jenkins jira ticket about it, no response so far.

Gav...


On Wed, Nov 16, 2016 at 6:24 AM, Jonathan Hsieh  wrote:

> I see.  I had assumed that setting the label expression constraint in the
> "advance project options" would take care of that but when I looked they do
> not.
>
> The problem actually was that they were using "slave" instead of "Label
> Expression".  After correcting that,  the matrix jobs seems to be building
> on the proper machines now.
>
> I've updated 0.98, 1.4 and master matrix jobs.  Hopefully this will get our
> jobs back in business.  Will check again later today.
>
> Jon.
>
> On Tue, Nov 15, 2016 at 11:01 AM, Sean Busbey  wrote:
>
> > without the configuration matrix item of where to run, we run on
> arbitrary
> > nodes rather than the H* nodes. That's fine if what we intend.
> Historically
> > the arbitrary nodes have not had enough resources to run our test suite.
> >
> >
> > (Also the image did not come through)
> >
> > On Tue, Nov 15, 2016 at 11:49 AM, Jonathan Hsieh 
> wrote:
> >
> > > Ok, I've fixed the matrix jobs for 0.98, 1.4, and trunk builds are
> fixed
> > > and running against appropriate JDKs now.
> > >
> > > The fix was to removed the "Slave" Configuration matrix item (that was
> > > configured in the advanced options), and only have the JDK
> configuration
> > > matrix items. I've set them up so the look like this now (image is from
> > > trunk [1])
> > >
> > > Jon.
> > >
> > > [1] [image: Inline image 1]
> > >
> > > On Tue, Nov 15, 2016 at 9:13 AM, Jonathan Hsieh 
> > wrote:
> > >
> > >> Looks like the matrix jobs -- trunk and 1.4 aren't actually running
> > >> anything as well as the updated 0.98 jobs.   This may have something
> to
> > do
> > >> with the JDK labels that were also updated recently[1].  Maybe this is
> > >> related to the "space in a matrix label name" problem that caused us
> to
> > >> change 1.2, and 1.3 into separate jobs?  (we have one good run in our
> > >> history of 0.98 using the now removed latest1.6, latest1.7 labels. [2]
> > >>
> > >> Jon
> > >>
> > >> [1] https://cwiki.apache.org/confluence/display/INFRA/JDK+Instal
> > >> lation+Matrix
> > >> [2] https://builds.apache.org/view/H-L/view/HBase/job/HBase-
> > >> 0.98-matrix/369/
> > >>
> > >> On Tue, Nov 15, 2016 at 12:48 AM, Michael Dürig 
> > >> wrote:
> > >>
> > >>>
> > >>> Hi,
> > >>>
> > >>> On 15.11.16 5:05 , Ted Yu wrote:
> > >>>
> >  Looking at a reportedly successful build:
> >  https://builds.apache.org/job/HBase-1.4/533/console
> > 
> >  I don't see the JDK 1.7 / 1.8 builds.
> > 
> >  The build only took 2 min 44 sec ?
> > 
> > >>>
> > >>> This is pretty much the same we are seeing with our jobs [1]. The UI
> > >>> doesn't show any configured nodes/labels, which I guess is why
> nothing
> > >>> runs. However it doesn't offer the option to assign nodes/labels
> > neither.
> > >>>
> > >>> Michael
> > >>>
> > >>>
> > >>> [1] http://markmail.org/message/zteyrxolwl46jcfh
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> // Jonathan Hsieh (shay)
> > >> // HBase Tech Lead, Software Engineer, Cloudera
> > >> // j...@cloudera.com // @jmhsieh
> > >>
> > >>
> > >
> > >
> > >
> > > --
> > > // Jonathan Hsieh (shay)
> > > // HBase Tech Lead, Software Engineer, Cloudera
> > > // j...@cloudera.com // @jmhsieh
> > >
> > >
> >
>
>
>
> --
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // j...@cloudera.com // @jmhsieh
>



-- 
Gav...


[jira] [Created] (HBASE-17102) Allow tracing thrift requests

2016-11-15 Thread Ashu Pachauri (JIRA)
Ashu Pachauri created HBASE-17102:
-

 Summary: Allow tracing thrift requests
 Key: HBASE-17102
 URL: https://issues.apache.org/jira/browse/HBASE-17102
 Project: HBase
  Issue Type: Improvement
  Components: Thrift
Reporter: Ashu Pachauri


Trace requests coming through the thrift server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [DISCUSS] No regions on Master node in 2.0

2016-11-15 Thread toffer
> In the absence of more information, intuition says master carries meta to 
>avoid a whole class of problems.
Off-hand I think the class of problems we'll eliminate are problems that are 
well understood and being constantly dealt with and hardened to this day (ie 
puts to a region).  
> I think we have to evaluate whether the new pv2 master works with remote meta 
>updates and the fact that those updates can fail partially or succeed without 
>theI think failing meta updates need to be dealt with either way AFAIK 
>eventually procedure state will be stored in HDFS which is also a distributed 
>system.

 

On Saturday, November 12, 2016 9:45 AM, Andrew Purtell 
 wrote:
 

 Thanks Stack and Enis. I concur, it's hard to say for those not intimate
with the new code.

In the absence of more information, intuition says master carries meta to
avoid a whole class of problems.

On Fri, Nov 11, 2016 at 3:27 PM, Enis Söztutar  wrote:

> Thanks Stack for reviving this.
>
> How to move forward here? The Pv2 master is almost done. An ITBLL bakeoff
> > of new Pv2 based assign vs a Master that exclusively hosts hbase:meta?
> >
> >
> I think we have to evaluate whether the new pv2 master works with remote
> meta
> updates and the fact that those updates can fail partially or succeed
> without the
> client getting the reply, etc. Sorry it has been some time I've looked at
> the design.
> Actually what would be very good is to have a design overview / write up of
> the pv2
> in its current / final form so that we can evaluate. Last time I've looked
> there was no
> detailed design doc at all.
>
>
> > St.Ack
> >
> >
> >
> > >
> > > >
> > >
> >
>



-- 
Best regards,

  - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

   

Re: Please update your jenkins job configs ASAP

2016-11-15 Thread Jonathan Hsieh
I see.  I had assumed that setting the label expression constraint in the
"advance project options" would take care of that but when I looked they do
not.

The problem actually was that they were using "slave" instead of "Label
Expression".  After correcting that,  the matrix jobs seems to be building
on the proper machines now.

I've updated 0.98, 1.4 and master matrix jobs.  Hopefully this will get our
jobs back in business.  Will check again later today.

Jon.

On Tue, Nov 15, 2016 at 11:01 AM, Sean Busbey  wrote:

> without the configuration matrix item of where to run, we run on arbitrary
> nodes rather than the H* nodes. That's fine if what we intend. Historically
> the arbitrary nodes have not had enough resources to run our test suite.
>
>
> (Also the image did not come through)
>
> On Tue, Nov 15, 2016 at 11:49 AM, Jonathan Hsieh  wrote:
>
> > Ok, I've fixed the matrix jobs for 0.98, 1.4, and trunk builds are fixed
> > and running against appropriate JDKs now.
> >
> > The fix was to removed the "Slave" Configuration matrix item (that was
> > configured in the advanced options), and only have the JDK configuration
> > matrix items. I've set them up so the look like this now (image is from
> > trunk [1])
> >
> > Jon.
> >
> > [1] [image: Inline image 1]
> >
> > On Tue, Nov 15, 2016 at 9:13 AM, Jonathan Hsieh 
> wrote:
> >
> >> Looks like the matrix jobs -- trunk and 1.4 aren't actually running
> >> anything as well as the updated 0.98 jobs.   This may have something to
> do
> >> with the JDK labels that were also updated recently[1].  Maybe this is
> >> related to the "space in a matrix label name" problem that caused us to
> >> change 1.2, and 1.3 into separate jobs?  (we have one good run in our
> >> history of 0.98 using the now removed latest1.6, latest1.7 labels. [2]
> >>
> >> Jon
> >>
> >> [1] https://cwiki.apache.org/confluence/display/INFRA/JDK+Instal
> >> lation+Matrix
> >> [2] https://builds.apache.org/view/H-L/view/HBase/job/HBase-
> >> 0.98-matrix/369/
> >>
> >> On Tue, Nov 15, 2016 at 12:48 AM, Michael Dürig 
> >> wrote:
> >>
> >>>
> >>> Hi,
> >>>
> >>> On 15.11.16 5:05 , Ted Yu wrote:
> >>>
>  Looking at a reportedly successful build:
>  https://builds.apache.org/job/HBase-1.4/533/console
> 
>  I don't see the JDK 1.7 / 1.8 builds.
> 
>  The build only took 2 min 44 sec ?
> 
> >>>
> >>> This is pretty much the same we are seeing with our jobs [1]. The UI
> >>> doesn't show any configured nodes/labels, which I guess is why nothing
> >>> runs. However it doesn't offer the option to assign nodes/labels
> neither.
> >>>
> >>> Michael
> >>>
> >>>
> >>> [1] http://markmail.org/message/zteyrxolwl46jcfh
> >>>
> >>
> >>
> >>
> >> --
> >> // Jonathan Hsieh (shay)
> >> // HBase Tech Lead, Software Engineer, Cloudera
> >> // j...@cloudera.com // @jmhsieh
> >>
> >>
> >
> >
> >
> > --
> > // Jonathan Hsieh (shay)
> > // HBase Tech Lead, Software Engineer, Cloudera
> > // j...@cloudera.com // @jmhsieh
> >
> >
>



-- 
// Jonathan Hsieh (shay)
// HBase Tech Lead, Software Engineer, Cloudera
// j...@cloudera.com // @jmhsieh


Re: Please update your jenkins job configs ASAP

2016-11-15 Thread Sean Busbey
without the configuration matrix item of where to run, we run on arbitrary
nodes rather than the H* nodes. That's fine if what we intend. Historically
the arbitrary nodes have not had enough resources to run our test suite.


(Also the image did not come through)

On Tue, Nov 15, 2016 at 11:49 AM, Jonathan Hsieh  wrote:

> Ok, I've fixed the matrix jobs for 0.98, 1.4, and trunk builds are fixed
> and running against appropriate JDKs now.
>
> The fix was to removed the "Slave" Configuration matrix item (that was
> configured in the advanced options), and only have the JDK configuration
> matrix items. I've set them up so the look like this now (image is from
> trunk [1])
>
> Jon.
>
> [1] [image: Inline image 1]
>
> On Tue, Nov 15, 2016 at 9:13 AM, Jonathan Hsieh  wrote:
>
>> Looks like the matrix jobs -- trunk and 1.4 aren't actually running
>> anything as well as the updated 0.98 jobs.   This may have something to do
>> with the JDK labels that were also updated recently[1].  Maybe this is
>> related to the "space in a matrix label name" problem that caused us to
>> change 1.2, and 1.3 into separate jobs?  (we have one good run in our
>> history of 0.98 using the now removed latest1.6, latest1.7 labels. [2]
>>
>> Jon
>>
>> [1] https://cwiki.apache.org/confluence/display/INFRA/JDK+Instal
>> lation+Matrix
>> [2] https://builds.apache.org/view/H-L/view/HBase/job/HBase-
>> 0.98-matrix/369/
>>
>> On Tue, Nov 15, 2016 at 12:48 AM, Michael Dürig 
>> wrote:
>>
>>>
>>> Hi,
>>>
>>> On 15.11.16 5:05 , Ted Yu wrote:
>>>
 Looking at a reportedly successful build:
 https://builds.apache.org/job/HBase-1.4/533/console

 I don't see the JDK 1.7 / 1.8 builds.

 The build only took 2 min 44 sec ?

>>>
>>> This is pretty much the same we are seeing with our jobs [1]. The UI
>>> doesn't show any configured nodes/labels, which I guess is why nothing
>>> runs. However it doesn't offer the option to assign nodes/labels neither.
>>>
>>> Michael
>>>
>>>
>>> [1] http://markmail.org/message/zteyrxolwl46jcfh
>>>
>>
>>
>>
>> --
>> // Jonathan Hsieh (shay)
>> // HBase Tech Lead, Software Engineer, Cloudera
>> // j...@cloudera.com // @jmhsieh
>>
>>
>
>
>
> --
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // j...@cloudera.com // @jmhsieh
>
>


Re: Successful: HBase Generate Website

2016-11-15 Thread Stack
I pushed this change.
St.Ack

On Tue, Nov 15, 2016 at 6:58 AM, Apache Jenkins Server <
jenk...@builds.apache.org> wrote:

> Build status: Successful
>
> If successful, the website and docs have been generated. To update the
> live site, follow the instructions below. If failed, skip to the bottom of
> this email.
>
> Use the following commands to download the patch and apply it to a clean
> branch based on origin/asf-site. If you prefer to keep the hbase-site repo
> around permanently, you can skip the clone step.
>
>   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git
>
>   cd hbase-site
>   wget -O- https://builds.apache.org/job/hbase_generate_website/406/
> artifact/website.patch.zip | funzip > 4d1bff9e78884adf689dd587d65afe
> 36a336c56b.patch
>   git fetch
>   git checkout -b asf-site-4d1bff9e78884adf689dd587d65afe36a336c56b
> origin/asf-site
>   git am --whitespace=fix 4d1bff9e78884adf689dd587d65afe36a336c56b.patch
>
> At this point, you can preview the changes by opening index.html or any of
> the other HTML pages in your local 
> asf-site-4d1bff9e78884adf689dd587d65afe36a336c56b
> branch.
>
> There are lots of spurious changes, such as timestamps and CSS styles in
> tables, so a generic git diff is not very useful. To see a list of files
> that have been added, deleted, renamed, changed type, or are otherwise
> interesting, use the following command:
>
>   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site
>
> To see only files that had 100 or more lines changed:
>
>   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'
>
> When you are satisfied, publish your changes to origin/asf-site using
> these commands:
>
>   git commit --allow-empty -m "Empty commit" # to work around a current
> ASF INFRA bug
>   git push origin asf-site-4d1bff9e78884adf689dd587d65afe
> 36a336c56b:asf-site
>   git checkout asf-site
>   git branch -D asf-site-4d1bff9e78884adf689dd587d65afe36a336c56b
>
> Changes take a couple of minutes to be propagated. You can verify whether
> they have been propagated by looking at the Last Published date at the
> bottom of http://hbase.apache.org/. It should match the date in the
> index.html on the asf-site branch in Git.
>
> As a courtesy- reply-all to this email to let other committers know you
> pushed the site.
>
>
>
> If failed, see https://builds.apache.org/job/hbase_generate_website/406/
> console


[jira] [Created] (HBASE-17101) FavoredNodes should not apply to system tables

2016-11-15 Thread Thiruvel Thirumoolan (JIRA)
Thiruvel Thirumoolan created HBASE-17101:


 Summary: FavoredNodes should not apply to system tables
 Key: HBASE-17101
 URL: https://issues.apache.org/jira/browse/HBASE-17101
 Project: HBase
  Issue Type: Sub-task
Reporter: Thiruvel Thirumoolan
Assignee: Thiruvel Thirumoolan


As described in the doc, we would like to start with user tables for favored 
nodes. This task ensures FN does not apply to system tables.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17100) Implement Chore to sync FN info from Master to RegionServers

2016-11-15 Thread Thiruvel Thirumoolan (JIRA)
Thiruvel Thirumoolan created HBASE-17100:


 Summary: Implement Chore to sync FN info from Master to 
RegionServers
 Key: HBASE-17100
 URL: https://issues.apache.org/jira/browse/HBASE-17100
 Project: HBase
  Issue Type: Sub-task
Reporter: Thiruvel Thirumoolan
Assignee: Thiruvel Thirumoolan






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Please update your jenkins job configs ASAP

2016-11-15 Thread Jonathan Hsieh
Ok, I've fixed the matrix jobs for 0.98, 1.4, and trunk builds are fixed
and running against appropriate JDKs now.

The fix was to removed the "Slave" Configuration matrix item (that was
configured in the advanced options), and only have the JDK configuration
matrix items. I've set them up so the look like this now (image is from
trunk [1])

Jon.

[1] [image: Inline image 1]

On Tue, Nov 15, 2016 at 9:13 AM, Jonathan Hsieh  wrote:

> Looks like the matrix jobs -- trunk and 1.4 aren't actually running
> anything as well as the updated 0.98 jobs.   This may have something to do
> with the JDK labels that were also updated recently[1].  Maybe this is
> related to the "space in a matrix label name" problem that caused us to
> change 1.2, and 1.3 into separate jobs?  (we have one good run in our
> history of 0.98 using the now removed latest1.6, latest1.7 labels. [2]
>
> Jon
>
> [1] https://cwiki.apache.org/confluence/display/INFRA/JDK+
> Installation+Matrix
> [2] https://builds.apache.org/view/H-L/view/HBase/job/HBase-
> 0.98-matrix/369/
>
> On Tue, Nov 15, 2016 at 12:48 AM, Michael Dürig 
> wrote:
>
>>
>> Hi,
>>
>> On 15.11.16 5:05 , Ted Yu wrote:
>>
>>> Looking at a reportedly successful build:
>>> https://builds.apache.org/job/HBase-1.4/533/console
>>>
>>> I don't see the JDK 1.7 / 1.8 builds.
>>>
>>> The build only took 2 min 44 sec ?
>>>
>>
>> This is pretty much the same we are seeing with our jobs [1]. The UI
>> doesn't show any configured nodes/labels, which I guess is why nothing
>> runs. However it doesn't offer the option to assign nodes/labels neither.
>>
>> Michael
>>
>>
>> [1] http://markmail.org/message/zteyrxolwl46jcfh
>>
>
>
>
> --
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // j...@cloudera.com // @jmhsieh
>
>



-- 
// Jonathan Hsieh (shay)
// HBase Tech Lead, Software Engineer, Cloudera
// j...@cloudera.com // @jmhsieh


[jira] [Created] (HBASE-17099) Is there a plan to support auth connection by username/password like mysql or redis

2016-11-15 Thread liubangchen (JIRA)
liubangchen created HBASE-17099:
---

 Summary: Is there a plan to support auth connection by 
username/password like mysql or redis
 Key: HBASE-17099
 URL: https://issues.apache.org/jira/browse/HBASE-17099
 Project: HBase
  Issue Type: Wish
  Components: security
Reporter: liubangchen
Priority: Trivial



Product managers  ask our hbase cluster to support auth connection  by 
username/password.

{code}
  private boolean authorizeConnection() throws IOException {
  try {
// If auth method is DIGEST, the token was obtained by the
// real user for the effective user, therefore not required to
// authorize real user. doAs is allowed only for simple or kerberos
// authentication
if (user != null && user.getRealUser() != null
&& (authMethod != AuthMethod.DIGEST)) {
  ProxyUsers.authorize(user, this.getHostAddress(), conf);
}
authorize(user, connectionHeader, getHostInetAddress());
metrics.authorizationSuccess();
  } catch (AuthorizationException ae) {
if (LOG.isDebugEnabled()) {
  LOG.debug("Connection authorization failed: " + ae.getMessage(), ae);
}
metrics.authorizationFailure();
setupResponse(authFailedResponse, authFailedCall,
  new AccessDeniedException(ae), ae.getMessage());
responder.doRespond(authFailedCall);
return false;
  }
  return true;
}
{code}

 Whether  can add a connectionAuthorrizer in method authorizeConnection of 
class RpcServer  to auth connection by init the handler from conf.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-17098) extra newline escape breaks the build with newer bash

2016-11-15 Thread Dmitry Sivachenko (JIRA)
Dmitry Sivachenko created HBASE-17098:
-

 Summary: extra newline escape breaks the build with newer bash
 Key: HBASE-17098
 URL: https://issues.apache.org/jira/browse/HBASE-17098
 Project: HBase
  Issue Type: Bug
Reporter: Dmitry Sivachenko


In hbase-assembly/pom.xml there is an extra newline escape:

`find ${project.build.directory}/dependency -iname NOTICE -or -iname 
NOTICE.txt` \


"\" at the end of line is not needed and should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Please update your jenkins job configs ASAP

2016-11-15 Thread Michael Dürig


Hi,

On 15.11.16 5:05 , Ted Yu wrote:

Looking at a reportedly successful build:
https://builds.apache.org/job/HBase-1.4/533/console

I don't see the JDK 1.7 / 1.8 builds.

The build only took 2 min 44 sec ?


This is pretty much the same we are seeing with our jobs [1]. The UI 
doesn't show any configured nodes/labels, which I guess is why nothing 
runs. However it doesn't offer the option to assign nodes/labels neither.


Michael


[1] http://markmail.org/message/zteyrxolwl46jcfh