[jira] [Created] (HBASE-12297) Support DBB usage in Bloom and HFileIndex area

2014-10-20 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-12297:
--

 Summary: Support DBB usage in Bloom and HFileIndex area
 Key: HBASE-12297
 URL: https://issues.apache.org/jira/browse/HBASE-12297
 Project: HBase
  Issue Type: Sub-task
Reporter: Anoop Sam John
Assignee: Anoop Sam John






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-12298) Support DBB usage in PrefixTree

2014-10-20 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-12298:
--

 Summary: Support DBB usage in PrefixTree
 Key: HBASE-12298
 URL: https://issues.apache.org/jira/browse/HBASE-12298
 Project: HBase
  Issue Type: Sub-task
Reporter: Anoop Sam John
Assignee: ramkrishna.s.vasudevan






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-12300) Hadoop QA should attempt to execute common Maven goals

2014-10-20 Thread Dima Spivak (JIRA)
Dima Spivak created HBASE-12300:
---

 Summary: Hadoop QA should attempt to execute common Maven goals
 Key: HBASE-12300
 URL: https://issues.apache.org/jira/browse/HBASE-12300
 Project: HBase
  Issue Type: Test
  Components: test
Reporter: Dima Spivak


HBASE-12299 and HBASE-12294 have exposed a hole in our pre-commit testing; we 
need to confirm that commits don't break common Maven goals (like those used to 
build documentation and assemble HBase).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-12301) user_permission command does not show global permissions

2014-10-20 Thread Jerry He (JIRA)
Jerry He created HBASE-12301:


 Summary: user_permission command does not show global permissions
 Key: HBASE-12301
 URL: https://issues.apache.org/jira/browse/HBASE-12301
 Project: HBase
  Issue Type: Bug
  Components: security, shell
Affects Versions: 0.98.4, 2.0.0
Reporter: Jerry He


It seems that since 0,98 or later, the shell command does not show global 
permission anymore, even requested by user with the right privilege.

{code}
hbase(main):004:0 user_permission
UserTable,Family,Qualifier:Permission
 hbase  default,table1,,: [Permission: 
actions=READ,WRITE,EXEC,CREATE,ADMIN]
 user2  default,table1,,: [Permission: 
actions=READ,WRITE]
 hbase  default,table2,,: [Permission: 
actions=READ,WRITE,EXEC,CREATE,ADMIN]
 user2  default,table2,,: [Permission: 
actions=READ,WRITE]
{code}


I recall in the older versions, global permissions were shown as permissions on 
the hbase:acl table.

Anyway we need a way to show the global permissions as part of user_permission 
request.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HBASE-12302) VisibilityClient getAuths does not propagate remote service exception correctly

2014-10-20 Thread Jerry He (JIRA)
Jerry He created HBASE-12302:


 Summary: VisibilityClient getAuths does not propagate remote 
service exception correctly
 Key: HBASE-12302
 URL: https://issues.apache.org/jira/browse/HBASE-12302
 Project: HBase
  Issue Type: Bug
  Components: Client, security
Affects Versions: 0.98.7, 2.0.0
Reporter: Jerry He
Priority: Minor
 Fix For: 2.0.0, 0.98.8


From hbase shell, run 'get_auths' with a non-superuser:

{code}
hbase(main):002:0 get_auths 'user2'

ERROR:

Here is some help for this command:
Get the visibility labels set for a particular user
Syntax : get_auths 'user1'

For example:

hbase get_auths 'user1'

{code}

We should expect a AccessDeniedException from the server.

From a Java client,  AccessDeniedException was dumped out, but the end 
exception is

{code}
java.util.NoSuchElementException
at java.util.TreeMap$PrivateEntryIterator.nextEntry(TreeMap.java:1124)
at java.util.TreeMap$ValueIterator.next(TreeMap.java:1171)
at 
org.apache.hadoop.hbase.security.visibility.VisibilityClient.getAuths(VisibilityClient.java:148)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (HBASE-12294) Can't build the docs after the hbase-checkstyle module was added

2014-10-20 Thread Elliott Clark (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elliott Clark reopened HBASE-12294:
---

Seems like adding the parent back is the only thing that will work. I think 
this breaks older mavens 2.x (they are pretty ancient now). Worth it? or should 
we just revert this whole debacle ?

 Can't build the docs after the hbase-checkstyle module was added
 

 Key: HBASE-12294
 URL: https://issues.apache.org/jira/browse/HBASE-12294
 Project: HBase
  Issue Type: Bug
  Components: build
Reporter: Misty Stanley-Jones
Assignee: Elliott Clark
Priority: Blocker
 Fix For: 2.0.0, 0.98.8, 0.99.2

 Attachments: 0001-HBASE-12294-Fix-site-generation.patch, 
 HBASE-12294.patch


 Since the 15th, I have not been able to build the docs. I get these errors:
 {code}
 [ERROR] Failed to execute goal 
 org.apache.maven.plugins:maven-site-plugin:3.3:stage (default-cli) on project 
 hbase-checkstyle: Missing distribution management in project HBase - 
 Checkstyle (org.apache.hbase:hbase-checkstyle:2.0.0-SNAPSHOT) - [Help 1]
 {code}
 {code}
 org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute 
 goal org.apache.maven.plugins:maven-site-plugin:3.3:stage (default-cli) on 
 project hbase-checkstyle: Missing distribution management in project HBase - 
 Checkstyle (org.apache.hbase:hbase-checkstyle:2.0.0-SNAPSHOT)
 at 
 org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
 at 
 org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
 at 
 org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
 at 
 org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
 at 
 org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
 at 
 org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
 at 
 org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
 at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
 at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
 at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
 at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
 at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at 
 org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
 at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
 at 
 org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
 at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
 Caused by: org.apache.maven.plugin.MojoExecutionException: Missing 
 distribution management in project HBase - Checkstyle 
 (org.apache.hbase:hbase-checkstyle:2.0.0-SNAPSHOT)
 at 
 org.apache.maven.plugins.site.AbstractDeployMojo.getSite(AbstractDeployMojo.java:762)
 at 
 org.apache.maven.plugins.site.AbstractDeployMojo.getDeployModuleDirectory(AbstractDeployMojo.java:249)
 at 
 org.apache.maven.plugins.site.AbstractDeployMojo.deploy(AbstractDeployMojo.java:320)
 at 
 org.apache.maven.plugins.site.AbstractDeployMojo.deployTo(AbstractDeployMojo.java:281)
 at 
 org.apache.maven.plugins.site.AbstractDeployMojo.execute(AbstractDeployMojo.java:163)
 at org.apache.maven.plugins.site.SiteStageMojo.execute(SiteStageMojo.java:75)
 at 
 org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
 at 
 org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
 ... 19 more
 {code}
 I'm able to resolve it by adding the attached patch to the POM. [~eclark], is 
 there a specific reason you didn't use inheritance in the checkstyles module?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


HBase code coverage

2014-10-20 Thread 肖春君
Hi Everyone,

I'm trying to get the hbase UT code coverage report, using the built-in clover 
configuration, with the following mvn command:
mvn clean test -fn -PrunLargeTests,hadoop-2.0,clover 
-Dzookeeper.version=3.4.5 -Dhadoop-two.version=2.4.1
mvn clover2:aggregate clover2:clover -Pclover

HBase version: 0.98.5
No change is made to the POM file or source code.

Unfortunately, the build always fails, as shown by the following log.
I'm not sure if it's due to my improper mvn arguments or other reason.
So could anyone help me on how to run hbase ut code coverage?

[INFO] Velocimacro : allowInlineLocal = false : VMs defined inline will be  
global in scope if allowed.
[INFO] Velocimacro : initialization complete.
[INFO] Velocity successfully started.
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] HBase . FAILURE [1.110s]
[INFO] HBase - Common  SKIPPED
[INFO] HBase - Protocol .. SKIPPED
[INFO] HBase - Client  SKIPPED
[INFO] HBase - Hadoop Compatibility .. SKIPPED
[INFO] HBase - Hadoop Two Compatibility .. SKIPPED
[INFO] HBase - Prefix Tree ... SKIPPED
[INFO] HBase - Server  SKIPPED
[INFO] HBase - Testing Util .. SKIPPED
[INFO] HBase - Thrift  SKIPPED
[INFO] HBase - Shell . SKIPPED
[INFO] HBase - Integration Tests . SKIPPED
[INFO] HBase - Examples .. SKIPPED
[INFO] HBase - Assembly .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 26.648s
[INFO] Finished at: Mon Oct 20 08:57:46 PDT 2014
[INFO] Final Memory: 38M/1428M
[INFO] 
[ERROR] Failed to execute goal 
com.atlassian.maven.plugins:maven-clover2-plugin:2.6.3:clover (default-cli) on 
project hbase: An error has occurred in Clover report generation. Could not 
resolve report descriptor: 
/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar: Failed 
to load resource as file 
[/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar]: Could 
not find resource 
'/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar'. - 
[Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Build step 'Execute shell' marked build as failure

  

Re: HBase code coverage

2014-10-20 Thread Manu Kranth Chary
In one of recent Jiras, Jacoco code coverage plugin was added to the pom.
Now you can get code coverage using the following command line :
mvn clean install -DskipTests ; mvn clean package -Dhbase.skip-jacoco=false

Best,
Manukranth.

On Mon, Oct 20, 2014 at 5:30 PM, 肖春君 chunjun.x...@hotmail.com wrote:

 Hi Everyone,

 I'm trying to get the hbase UT code coverage report, using the built-in
 clover configuration, with the following mvn command:
 mvn clean test -fn -PrunLargeTests,hadoop-2.0,clover
 -Dzookeeper.version=3.4.5 -Dhadoop-two.version=2.4.1
 mvn clover2:aggregate clover2:clover -Pclover

 HBase version: 0.98.5
 No change is made to the POM file or source code.

 Unfortunately, the build always fails, as shown by the following log.
 I'm not sure if it's due to my improper mvn arguments or other reason.
 So could anyone help me on how to run hbase ut code coverage?

 [INFO] Velocimacro : allowInlineLocal = false : VMs defined inline will
 be  global in scope if allowed.
 [INFO] Velocimacro : initialization complete.
 [INFO] Velocity successfully started.
 [INFO]
 
 [INFO] Reactor Summary:
 [INFO]
 [INFO] HBase . FAILURE [1.110s]
 [INFO] HBase - Common  SKIPPED
 [INFO] HBase - Protocol .. SKIPPED
 [INFO] HBase - Client  SKIPPED
 [INFO] HBase - Hadoop Compatibility .. SKIPPED
 [INFO] HBase - Hadoop Two Compatibility .. SKIPPED
 [INFO] HBase - Prefix Tree ... SKIPPED
 [INFO] HBase - Server  SKIPPED
 [INFO] HBase - Testing Util .. SKIPPED
 [INFO] HBase - Thrift  SKIPPED
 [INFO] HBase - Shell . SKIPPED
 [INFO] HBase - Integration Tests . SKIPPED
 [INFO] HBase - Examples .. SKIPPED
 [INFO] HBase - Assembly .. SKIPPED
 [INFO]
 
 [INFO] BUILD FAILURE
 [INFO]
 
 [INFO] Total time: 26.648s
 [INFO] Finished at: Mon Oct 20 08:57:46 PDT 2014
 [INFO] Final Memory: 38M/1428M
 [INFO]
 
 [ERROR] Failed to execute goal
 com.atlassian.maven.plugins:maven-clover2-plugin:2.6.3:clover (default-cli)
 on project hbase: An error has occurred in Clover report generation. Could
 not resolve report descriptor:
 /data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar:
 Failed to load resource as file
 [/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar]:
 Could not find resource
 '/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar'.
 - [Help 1]
 [ERROR]
 [ERROR] To see the full stack trace of the errors, re-run Maven with the
 -e switch.
 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
 [ERROR]
 [ERROR] For more information about the errors and possible solutions,
 please read the following articles:
 [ERROR] [Help 1]
 http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
 Build step 'Execute shell' marked build as failure






-- 
Manukranth Kolloju


Re: HBase code coverage

2014-10-20 Thread Ted Yu
The following JIRA introduced  jacoco code coverage report:
https://issues.apache.org/jira/browse/HBASE-12208

Can you use that ?

Cheers

On Mon, Oct 20, 2014 at 5:30 PM, 肖春君 chunjun.x...@hotmail.com wrote:

 Hi Everyone,

 I'm trying to get the hbase UT code coverage report, using the built-in
 clover configuration, with the following mvn command:
 mvn clean test -fn -PrunLargeTests,hadoop-2.0,clover
 -Dzookeeper.version=3.4.5 -Dhadoop-two.version=2.4.1
 mvn clover2:aggregate clover2:clover -Pclover

 HBase version: 0.98.5
 No change is made to the POM file or source code.

 Unfortunately, the build always fails, as shown by the following log.
 I'm not sure if it's due to my improper mvn arguments or other reason.
 So could anyone help me on how to run hbase ut code coverage?

 [INFO] Velocimacro : allowInlineLocal = false : VMs defined inline will
 be  global in scope if allowed.
 [INFO] Velocimacro : initialization complete.
 [INFO] Velocity successfully started.
 [INFO]
 
 [INFO] Reactor Summary:
 [INFO]
 [INFO] HBase . FAILURE [1.110s]
 [INFO] HBase - Common  SKIPPED
 [INFO] HBase - Protocol .. SKIPPED
 [INFO] HBase - Client  SKIPPED
 [INFO] HBase - Hadoop Compatibility .. SKIPPED
 [INFO] HBase - Hadoop Two Compatibility .. SKIPPED
 [INFO] HBase - Prefix Tree ... SKIPPED
 [INFO] HBase - Server  SKIPPED
 [INFO] HBase - Testing Util .. SKIPPED
 [INFO] HBase - Thrift  SKIPPED
 [INFO] HBase - Shell . SKIPPED
 [INFO] HBase - Integration Tests . SKIPPED
 [INFO] HBase - Examples .. SKIPPED
 [INFO] HBase - Assembly .. SKIPPED
 [INFO]
 
 [INFO] BUILD FAILURE
 [INFO]
 
 [INFO] Total time: 26.648s
 [INFO] Finished at: Mon Oct 20 08:57:46 PDT 2014
 [INFO] Final Memory: 38M/1428M
 [INFO]
 
 [ERROR] Failed to execute goal
 com.atlassian.maven.plugins:maven-clover2-plugin:2.6.3:clover (default-cli)
 on project hbase: An error has occurred in Clover report generation. Could
 not resolve report descriptor:
 /data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar:
 Failed to load resource as file
 [/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar]:
 Could not find resource
 '/data/jenkins/workspace/hbase-0_98_5-UT/maven-clover2-plugin-2.6.3.jar'.
 - [Help 1]
 [ERROR]
 [ERROR] To see the full stack trace of the errors, re-run Maven with the
 -e switch.
 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
 [ERROR]
 [ERROR] For more information about the errors and possible solutions,
 please read the following articles:
 [ERROR] [Help 1]
 http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
 Build step 'Execute shell' marked build as failure




[jira] [Created] (HBASE-12303) Seek to next row after family delete markers

2014-10-20 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-12303:
-

 Summary: Seek to next row after family delete markers
 Key: HBASE-12303
 URL: https://issues.apache.org/jira/browse/HBASE-12303
 Project: HBase
  Issue Type: Bug
Reporter: Lars Hofhansl


Currently we seek to the next column when we encounter a family delete marker.
I think we safely seek the current store to next row.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Any strong feelings about Maven versions?

2014-10-20 Thread Sean Busbey
The version of Maven we require for building came up in a comment on
HBASE-12294[1].

Before I file a patch to add an enforcer line in the pom, does anyone have
any strong concerns one way or another on what version it's set to?

FWIW, most of our jenkins jobs currently run on 3.0.3 (trunk, 0.98). The
0.94 related builds pick Maven 3 (latest), and I suspect the precommit
job uses latest since it just relies on the path. The latest available on
asf jenkins appears to be 3.2.1.


[1]: *http://s.apache.org/4JGP http://s.apache.org/4JGP*

-- 
Sean