[jira] [Resolved] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Tubbs resolved ACCUMULO-3576.
-
Resolution: Fixed
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.6.2, 1.7.0
Time Spent: 1h 10m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
[jira] [Created] (ACCUMULO-3578) Update license and notice
Billie Rinaldi created ACCUMULO-3578: Summary: Update license and notice Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315392#comment-14315392
]
Keith Turner commented on ACCUMULO-3576:
With the changes to use guava Precondition and [fluo PR
420|https://github.com/fluo-io/fluo/pull/420] I was able to build and test fluo
against 1.6.2-SNAPSHOT.
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.6.2, 1.7.0
Time Spent: 1h 10m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315406#comment-14315406 ] Keith Turner commented on ACCUMULO-3578: why add server/native/src/main/resources/NOTICE? Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ACCUMULO-3579) Remove org.mortbay.jetty from pom
Josh Elser created ACCUMULO-3579: Summary: Remove org.mortbay.jetty from pom Key: ACCUMULO-3579 URL: https://issues.apache.org/jira/browse/ACCUMULO-3579 Project: Accumulo Issue Type: Task Components: build Reporter: Josh Elser Assignee: Josh Elser Fix For: 1.6.2, 1.7.0 We have a dependency on org.mortbay.jetty:jetty:6.1.26 that appears to be used by nothing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315461#comment-14315461 ] Billie Rinaldi commented on ACCUMULO-3578: -- We only need to address things we're actually bundling. The mortbay jetty jar doesn't make it into our tarball. Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3542) Native tarball doesn't have a NOTICE
[ https://issues.apache.org/jira/browse/ACCUMULO-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated ACCUMULO-3542: - Fix Version/s: (was: 1.6.3) 1.6.2 Native tarball doesn't have a NOTICE Key: ACCUMULO-3542 URL: https://issues.apache.org/jira/browse/ACCUMULO-3542 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2, 1.7.0 Do we build any other tarballs we should check? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (ACCUMULO-3542) Native tarball doesn't have a NOTICE
[ https://issues.apache.org/jira/browse/ACCUMULO-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned ACCUMULO-3542: Assignee: Billie Rinaldi Native tarball doesn't have a NOTICE Key: ACCUMULO-3542 URL: https://issues.apache.org/jira/browse/ACCUMULO-3542 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2, 1.7.0 Do we build any other tarballs we should check? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi resolved ACCUMULO-3578. -- Resolution: Fixed Fix Version/s: 1.7.0 Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2, 1.7.0 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Time Spent: 20m Remaining Estimate: 0h Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ACCUMULO-3542) Native tarball doesn't have a NOTICE
[ https://issues.apache.org/jira/browse/ACCUMULO-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi resolved ACCUMULO-3542. -- Resolution: Fixed Native tarball doesn't have a NOTICE Key: ACCUMULO-3542 URL: https://issues.apache.org/jira/browse/ACCUMULO-3542 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2, 1.7.0 Time Spent: 20m Remaining Estimate: 0h Do we build any other tarballs we should check? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ACCUMULO-3568) getDiskUsage server implementation recreates Connector from user credentials
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser resolved ACCUMULO-3568.
--
Resolution: Fixed
getDiskUsage server implementation recreates Connector from user credentials
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: tserver
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
Time Spent: 10m
Remaining Estimate: 0h
The server-side impl for {{TableOperationsImpl.getDiskUsage}} pulls the
credentials from the RPC and makes a {{Connector}} from them instead of using
its own credentials. With Kerberos enabled, this results in the server
accumulo/hostname@REALM trying to act as user@REALM which (correctly)
fails.
The getDiskUsage implementation should use its own Connector (using the
SystemToken from the ServerContext), perform the correct security checks for
permissions and act on behalf of the user instead of trying to *be* the user.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3568) getDiskUsage server implementation recreates Connector from user credentials
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3568:
-
Component/s: (was: shell)
tserver
getDiskUsage server implementation recreates Connector from user credentials
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: tserver
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
Time Spent: 10m
Remaining Estimate: 0h
The server-side impl for {{TableOperationsImpl.getDiskUsage}} pulls the
credentials from the RPC and makes a {{Connector}} from them instead of using
its own credentials. With Kerberos enabled, this results in the server
accumulo/hostname@REALM trying to act as user@REALM which (correctly)
fails.
The getDiskUsage implementation should use its own Connector (using the
SystemToken from the ServerContext), perform the correct security checks for
permissions and act on behalf of the user instead of trying to *be* the user.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315426#comment-14315426 ] Billie Rinaldi commented on ACCUMULO-3578: -- bq. why add server/native/src/main/resources/NOTICE? I figured I would fix ACCUMULO-3542 while I was addressing issues. I can do that in a different commit, or reference both ticket numbers. Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[
https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315439#comment-14315439
]
Josh Elser commented on ACCUMULO-3578:
--
I'm confused why we have the following in the parent pom still.
{code}
dependency
groupIdorg.mortbay.jetty/groupId
artifactIdjetty/artifactId
version6.1.26/version
/dependency
{code}
Jetty 6 does have a different NOTICE which (I think) we need to propagate to
our NOTICE if we're using it? I don't see anywhere that we're actually using it
though.
Update license and notice
-
Key: ACCUMULO-3578
URL: https://issues.apache.org/jira/browse/ACCUMULO-3578
Project: Accumulo
Issue Type: Bug
Affects Versions: 1.6.1
Reporter: Billie Rinaldi
Assignee: Billie Rinaldi
Fix For: 1.6.2
Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch
Looks like 1.6.1 added some jars to the binary tarball without updating the
license and notice.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315469#comment-14315469 ] Josh Elser commented on ACCUMULO-3578: -- Cool. Thanks for clarifying. I think we're solid then. I'll open a ticket for removing Jetty6 -- maybe someone else knows why (or can say definitively why it's in there). Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315465#comment-14315465 ] Keith Turner commented on ACCUMULO-3578: LGTM [~billie.rinaldi] Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315533#comment-14315533 ] Eric Newton commented on ACCUMULO-3572: --- [~ctubbsii] are we generated another 1.6.2 RC for which this would be included? TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.6.2, 1.7.0 Time Spent: 20m Remaining Estimate: 0h When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Accumulo-1.5 - Build # 462 - Fixed
The Apache Jenkins build system has built Accumulo-1.5 (build #462) Status: Fixed Check console output at https://builds.apache.org/job/Accumulo-1.5/462/ to view the results.
[jira] [Commented] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315454#comment-14315454 ] Keith Turner commented on ACCUMULO-3578: Referencing ACCUMULO-3542 in the commit message would be fine. Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3579) Remove org.mortbay.jetty from pom
[ https://issues.apache.org/jira/browse/ACCUMULO-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated ACCUMULO-3579: - Attachment: 0001-ACCUMULO-3579-Remove-org.mortbay.jetty-from-poms.patch Remove org.mortbay.jetty from pom - Key: ACCUMULO-3579 URL: https://issues.apache.org/jira/browse/ACCUMULO-3579 Project: Accumulo Issue Type: Task Components: build Reporter: Josh Elser Assignee: Josh Elser Fix For: 1.7.0, 1.6.3 Attachments: 0001-ACCUMULO-3579-Remove-org.mortbay.jetty-from-poms.patch We have a dependency on org.mortbay.jetty:jetty:6.1.26 that appears to be used by nothing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3579) Remove org.mortbay.jetty from pom
[
https://issues.apache.org/jira/browse/ACCUMULO-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3579:
-
Status: Patch Available (was: Open)
[~ctubbsii], can you take a look? {{mvn verify -Psunny}} passed for me.
Remove org.mortbay.jetty from pom
-
Key: ACCUMULO-3579
URL: https://issues.apache.org/jira/browse/ACCUMULO-3579
Project: Accumulo
Issue Type: Task
Components: build
Reporter: Josh Elser
Assignee: Josh Elser
Fix For: 1.6.2, 1.7.0
Attachments:
0001-ACCUMULO-3579-Remove-org.mortbay.jetty-from-poms.patch
We have a dependency on org.mortbay.jetty:jetty:6.1.26 that appears to be
used by nothing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3579) Remove org.mortbay.jetty from pom
[ https://issues.apache.org/jira/browse/ACCUMULO-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated ACCUMULO-3579: - Fix Version/s: (was: 1.6.2) 1.6.3 Remove org.mortbay.jetty from pom - Key: ACCUMULO-3579 URL: https://issues.apache.org/jira/browse/ACCUMULO-3579 Project: Accumulo Issue Type: Task Components: build Reporter: Josh Elser Assignee: Josh Elser Fix For: 1.7.0, 1.6.3 Attachments: 0001-ACCUMULO-3579-Remove-org.mortbay.jetty-from-poms.patch We have a dependency on org.mortbay.jetty:jetty:6.1.26 that appears to be used by nothing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated ACCUMULO-3578: - Attachment: ACCUMULO-3578.2.patch Missed javax.servlet-api in the first one. Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch, ACCUMULO-3578.2.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3578) Update license and notice
[ https://issues.apache.org/jira/browse/ACCUMULO-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated ACCUMULO-3578: - Attachment: ACCUMULO-3578.1.patch Update license and notice - Key: ACCUMULO-3578 URL: https://issues.apache.org/jira/browse/ACCUMULO-3578 Project: Accumulo Issue Type: Bug Affects Versions: 1.6.1 Reporter: Billie Rinaldi Assignee: Billie Rinaldi Fix For: 1.6.2 Attachments: ACCUMULO-3578.1.patch Looks like 1.6.1 added some jars to the binary tarball without updating the license and notice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ACCUMULO-3463) README has old version for shell examples
[ https://issues.apache.org/jira/browse/ACCUMULO-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keith Turner resolved ACCUMULO-3463. Resolution: Fixed README has old version for shell examples - Key: ACCUMULO-3463 URL: https://issues.apache.org/jira/browse/ACCUMULO-3463 Project: Accumulo Issue Type: Improvement Components: docs Reporter: Mike Drob Assignee: Keith Turner Labels: Documentation Fix For: 1.7.0 In the README, our examples involving the shell still show version: 1.5.0 which might be confusing to new users. We should probably keep this up to date, hopefully in some sort of automated fashion. Or maybe just those examples from the README entirely, and make it a more minimal document, as has been suggested on other issues in the past. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Newton resolved ACCUMULO-3572. --- Resolution: Fixed Fix Version/s: 1.6.3 1.7.0 TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.7.0, 1.6.3 When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314676#comment-14314676 ] Josh Elser commented on ACCUMULO-3572: -- [~ecn], I don't see any commits on this. Wrong ticket ref? Forgot to push? TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.7.0, 1.6.3 When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
marco polo created ACCUMULO-3572: Summary: TableDiskUsage contains log without a conditional Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314695#comment-14314695 ] Eric Newton commented on ACCUMULO-3572: --- Oops... commited to the wrong repo. Thanks. TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.7.0, 1.6.3 When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ACCUMULO-3573) Make MiniAccumuloCluster use instance.volumes by default
Christopher Tubbs created ACCUMULO-3573:
---
Summary: Make MiniAccumuloCluster use instance.volumes by default
Key: ACCUMULO-3573
URL: https://issues.apache.org/jira/browse/ACCUMULO-3573
Project: Accumulo
Issue Type: Sub-task
Components: mini
Reporter: Christopher Tubbs
Fix For: 1.7.0
Found a TODO in MiniAccumuloConfigImpl that indicated that Mini was still using
INSTANCE_DFS_URI, INSTANCE_DFS_DIR by default. {{#setInstanceLocation()}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314613#comment-14314613 ] John Vines commented on ACCUMULO-3572: -- Or it should just be switched to slf4j loggers which won't do the string appends if the logger is disabled. TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ACCUMULO-3574) preferCachedConnections=false is not respected
Josh Elser created ACCUMULO-3574:
Summary: preferCachedConnections=false is not respected
Key: ACCUMULO-3574
URL: https://issues.apache.org/jira/browse/ACCUMULO-3574
Project: Accumulo
Issue Type: Bug
Components: rpc
Affects Versions: 1.6.1, 1.6.0, 1.5.2, 1.5.1, 1.5.0
Reporter: Josh Elser
Assignee: Josh Elser
Fix For: 1.5.3, 1.7.0, 1.6.3
{code}
PairString,TTransport getAnyTransport(ListThriftTransportKey servers,
boolean preferCachedConnection) throws TTransportException {
if (!preferCachedConnection) {
synchronized (this) {
ListCachedConnection cachedConnList = getCache().get(ttk);
if (cachedConnList != null) {
for (CachedConnection cachedConnection : cachedConnList) {
if (!cachedConnection.isReserved()) {
cachedConnection.setReserved(true);
final String serverAddr = ttk.getServer().toString();
log.trace(Using existing connection to {} timeout {},
serverAddr, ttk.getTimeout());
return new PairString,TTransport(serverAddr,
cachedConnection.transport);
}
}
}
}
}
{code}
It appears that ThriftTransportPool.getAnyTransport is returning a cache
connection when the caller requested that a new connection is returned instead
of a cached one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3575) Accumulo GC ran out of memory
[
https://issues.apache.org/jira/browse/ACCUMULO-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314932#comment-14314932
]
Keith Turner commented on ACCUMULO-3575:
Saw this problem while testing 1.6.2 RC4. Problem probably exist in 1.6.0
though. In most cases this problem can easily be worked around by increasing
Accumulo GC memory. There could be a worst case scenario where an error
condition creates too many walog to ever fit into memory.
Accumulo GC ran out of memory
-
Key: ACCUMULO-3575
URL: https://issues.apache.org/jira/browse/ACCUMULO-3575
Project: Accumulo
Issue Type: Bug
Affects Versions: 1.6.0
Reporter: Keith Turner
Priority: Minor
During CI run (w/ agitation) on 20 node EC2 cluster the Accumulo GC died with
the following errors.
Following was in gc out file
{noformat}
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError=kill -9 %p
# Executing /bin/sh -c kill -9 20970...
{noformat}
Following was in last lines of .log file
{noformat}
2015-02-10 20:19:03,255 [gc.SimpleGarbageCollector] INFO : Collect cycle took
13.07 seconds
2015-02-10 20:19:03,258 [gc.SimpleGarbageCollector] INFO : Beginning garbage
collection of write-ahead logs
2015-02-10 20:19:03,265 [zookeeper.ZooUtil] DEBUG: Trying to read instance id
from hdfs://ip-10-1-2-11:9000/accumulo/instance_id
{noformat}
Restarted GC and same thing happened. Looked in walog dir and saw there
were 333k walog. This is the problem, the GC tries to read the list of files
into memory.
{noformat}
$ hadoop fs -ls -R /accumulo/wal | wc
15/02/10 20:31:35 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
333053 2664424 43629314
{noformat}
I suspect the reason there were so many walogs is because there were many
many failure like the following (which resulted in 0 length walogs, only 199
of the 333K have non-zero length). The following error is from a tserver,
which is probably a result of killing datanodes.
{noformat}
2015-02-10 03:45:00,447 [log.TabletServerLogger] ERROR: Unexpected error
writing to log, retrying attempt 122
java.lang.RuntimeException:
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
/accumulo/wal/ip-10-1-2-21+9997/9906de55-bc93-47f4-887c-4b9540fc3528 could
only be replicated to 0 nodes instead of minReplication (=1). There
are 16 datanode(s) running and no node(s) are excluded in this operation.
at
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1549)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3200)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:641)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:482)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033)
at
org.apache.accumulo.tserver.log.TabletServerLogger.createLoggers(TabletServerLogger.java:190)
at
org.apache.accumulo.tserver.log.TabletServerLogger.access$300(TabletServerLogger.java:53)
at
org.apache.accumulo.tserver.log.TabletServerLogger$1.withWriteLock(TabletServerLogger.java:148)
at
org.apache.accumulo.tserver.log.TabletServerLogger.testLockAndRun(TabletServerLogger.java:115)
at
org.apache.accumulo.tserver.log.TabletServerLogger.initializeLoggers(TabletServerLogger.java:137)
at
org.apache.accumulo.tserver.log.TabletServerLogger.write(TabletServerLogger.java:245)
at
org.apache.accumulo.tserver.log.TabletServerLogger.write(TabletServerLogger.java:230)
at
org.apache.accumulo.tserver.log.TabletServerLogger.log(TabletServerLogger.java:345)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.update(TabletServer.java:1817)
at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown
[jira] [Created] (ACCUMULO-3575) Accumulo GC ran out of memory
Keith Turner created ACCUMULO-3575:
--
Summary: Accumulo GC ran out of memory
Key: ACCUMULO-3575
URL: https://issues.apache.org/jira/browse/ACCUMULO-3575
Project: Accumulo
Issue Type: Bug
Affects Versions: 1.6.0
Reporter: Keith Turner
Priority: Minor
During CI run (w/ agitation) on 20 node EC2 cluster the Accumulo GC died with
the following errors.
Following was in gc out file
{noformat}
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError=kill -9 %p
# Executing /bin/sh -c kill -9 20970...
{noformat}
Following was in last lines of .log file
{noformat}
2015-02-10 20:19:03,255 [gc.SimpleGarbageCollector] INFO : Collect cycle took
13.07 seconds
2015-02-10 20:19:03,258 [gc.SimpleGarbageCollector] INFO : Beginning garbage
collection of write-ahead logs
2015-02-10 20:19:03,265 [zookeeper.ZooUtil] DEBUG: Trying to read instance id
from hdfs://ip-10-1-2-11:9000/accumulo/instance_id
{noformat}
Restarted GC and same thing happened. Looked in walog dir and saw there were
333k walog. This is the problem, the GC tries to read the list of files into
memory.
{noformat}
$ hadoop fs -ls -R /accumulo/wal | wc
15/02/10 20:31:35 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
333053 2664424 43629314
{noformat}
I suspect the reason there were so many walogs is because there were many many
failure like the following (which resulted in 0 length walogs, only 199 of the
333K have non-zero length). The following error is from a tserver, which is
probably a result of killing datanodes.
{noformat}
2015-02-10 03:45:00,447 [log.TabletServerLogger] ERROR: Unexpected error
writing to log, retrying attempt 122
java.lang.RuntimeException:
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
/accumulo/wal/ip-10-1-2-21+9997/9906de55-bc93-47f4-887c-4b9540fc3528 could only
be replicated to 0 nodes instead of minReplication (=1). There
are 16 datanode(s) running and no node(s) are excluded in this operation.
at
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1549)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3200)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:641)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:482)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033)
at
org.apache.accumulo.tserver.log.TabletServerLogger.createLoggers(TabletServerLogger.java:190)
at
org.apache.accumulo.tserver.log.TabletServerLogger.access$300(TabletServerLogger.java:53)
at
org.apache.accumulo.tserver.log.TabletServerLogger$1.withWriteLock(TabletServerLogger.java:148)
at
org.apache.accumulo.tserver.log.TabletServerLogger.testLockAndRun(TabletServerLogger.java:115)
at
org.apache.accumulo.tserver.log.TabletServerLogger.initializeLoggers(TabletServerLogger.java:137)
at
org.apache.accumulo.tserver.log.TabletServerLogger.write(TabletServerLogger.java:245)
at
org.apache.accumulo.tserver.log.TabletServerLogger.write(TabletServerLogger.java:230)
at
org.apache.accumulo.tserver.log.TabletServerLogger.log(TabletServerLogger.java:345)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.update(TabletServer.java:1817)
at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy22.update(Unknown Source)
at
[jira] [Commented] (ACCUMULO-3568) du shell command uses ServerClient incorrectly
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314787#comment-14314787
]
Josh Elser commented on ACCUMULO-3568:
--
Hrm. I forgot what ServerClient was I think. Somehow it's still using the wrong
credentials with Kerberos on.
du shell command uses ServerClient incorrectly
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class which is
meant for Accumulo services to use to communicate with each other. This
results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-2247) random walk fails when server gets EOFException
[
https://issues.apache.org/jira/browse/ACCUMULO-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314806#comment-14314806
]
Josh Elser commented on ACCUMULO-2247:
--
Looks familiar -- ACCUMULO-3213
Despite ACCUMULO-3213 being fixed, it was only the ability to preserve the
RFiles for tests so we can see if there's a repeatable error reading the file.
random walk fails when server gets EOFException
---
Key: ACCUMULO-2247
URL: https://issues.apache.org/jira/browse/ACCUMULO-2247
Project: Accumulo
Issue Type: Bug
Components: client, tserver
Affects Versions: 1.6.0
Environment: Running RW on 10 node test cluster. Client quit with an
unknown error.
1.6-SNAPSHOT, Hadoop 2.2.0, running the agitator. I was *not* agitating data
nodes.
Reporter: Eric Newton
Saw this stack set of errors tin the corresponding server:
{noformat}
2014-01-23 19:19:18,020 [tserver.TabletServer] WARN : lookup failed for
tablet !0;~
java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at
org.apache.accumulo.core.file.rfile.RelativeKey.fastSkip(RelativeKey.java:314)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader._seek(RFile.java:675)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader.seek(RFile.java:607)
at
org.apache.accumulo.core.iterators.system.LocalityGroupIterator.seek(LocalityGroupIterator.java:142)
at
org.apache.accumulo.core.file.rfile.RFile$Reader.seek(RFile.java:979)
at
org.apache.accumulo.server.problems.ProblemReportingIterator.seek(ProblemReportingIterator.java:94)
at
org.apache.accumulo.core.iterators.system.MultiIterator.seek(MultiIterator.java:105)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.StatsIterator.seek(StatsIterator.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.DeletingIterator.seek(DeletingIterator.java:67)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.SkippingIterator.seek(SkippingIterator.java:37)
at
org.apache.accumulo.core.iterators.system.ColumnFamilySkippingIterator.seek(ColumnFamilySkippingIterator.java:123)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.system.SynchronizedIterator.seek(SynchronizedIterator.java:55)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.user.VersioningIterator.seek(VersioningIterator.java:81)
at
org.apache.accumulo.core.iterators.user.WholeRowIterator.seek(WholeRowIterator.java:241)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.readNext(SourceSwitchingIterator.java:116)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:168)
at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1562)
at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1669)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1115)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:662)
2014-01-23 19:19:18,027 [tserver.TabletServer] WARN : exception while doing
multi-scan
java.lang.RuntimeException: java.io.EOFException
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1126)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[jira] [Updated] (ACCUMULO-3568) du shell command uses ServerClient incorrectly
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3568:
-
Summary: du shell command uses ServerClient incorrectly (was: du fails due
to principal mismatch)
du shell command uses ServerClient incorrectly
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
For some reason, the credentials used in the shell to execute a {{du}} with
the system user's instead of the shell user's.
The server caught the mismatch in the principals (at the RPC level and the
Accumulo Credentials object) and prevented the RPC, but need to figure out
why this shell command is doing things differently than all of the rest.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-2247) random walk fails when server gets EOFException
[
https://issues.apache.org/jira/browse/ACCUMULO-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314801#comment-14314801
]
Keith Turner commented on ACCUMULO-2247:
While running CI against 1.6.2 RC4 (with agitation) on a 20 node EC2 cluster I
saw a similar error. I was running 17 ingest and 3 walkers. This problem
caused 2 ingest and 2 walkers to die.Not 100% sure, but I think all four
test clients that died were trying to update their metadata cache and this
error occurred when reading metadata table.
{noformat}
2015-02-09 21:27:20,361 [tserver.TabletServer] WARN : exception while scanning
tablet !0;~
java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:267)
at
org.apache.accumulo.core.file.rfile.RelativeKey.fastSkip(RelativeKey.java:314)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader._seek(RFile.java:675)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader.seek(RFile.java:607)
at
org.apache.accumulo.core.iterators.system.LocalityGroupIterator.seek(LocalityGroupIterator.java:138)
at org.apache.accumulo.core.file.rfile.RFile$Reader.seek(RFile.java:980)
at
org.apache.accumulo.server.problems.ProblemReportingIterator.seek(ProblemReportingIterator.java:94)
at
org.apache.accumulo.core.iterators.system.MultiIterator.seek(MultiIterator.java:105)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.StatsIterator.seek(StatsIterator.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.DeletingIterator.seek(DeletingIterator.java:67)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.SkippingIterator.seek(SkippingIterator.java:42)
at
org.apache.accumulo.core.iterators.system.ColumnFamilySkippingIterator.seek(ColumnFamilySkippingIterator.java:123)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.system.SynchronizedIterator.seek(SynchronizedIterator.java:56)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.user.VersioningIterator.seek(VersioningIterator.java:81)
at
org.apache.accumulo.core.iterators.user.RowEncodingIterator.seek(RowEncodingIterator.java:162)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.readNext(SourceSwitchingIterator.java:121)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:167)
at org.apache.accumulo.tserver.Tablet.nextBatch(Tablet.java:1664)
at org.apache.accumulo.tserver.Tablet.access$3200(Tablet.java:174)
at org.apache.accumulo.tserver.Tablet$Scanner.read(Tablet.java:1804)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$NextBatchTask.run(TabletServer.java:1064)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:744)
{noformat}
Was using openjdk 7. Not 100% sure, the following may be line 267 in
DataInputStream.java
{code:java}
public final byte readByte() throws IOException {
int ch = in.read();
if (ch 0)
throw new EOFException();//this might be
DataInputStream.java:267
return (byte)(ch);
}
{code}
random walk fails when server gets EOFException
---
Key: ACCUMULO-2247
URL: https://issues.apache.org/jira/browse/ACCUMULO-2247
Project: Accumulo
Issue Type: Bug
Components: client, tserver
Affects Versions: 1.6.0
Environment: Running RW on 10 node test cluster. Client quit with an
unknown error.
1.6-SNAPSHOT, Hadoop 2.2.0, running the agitator. I was *not* agitating data
nodes.
Reporter: Eric Newton
Saw this stack set of errors tin the corresponding server:
[jira] [Updated] (ACCUMULO-2247) random walk fails when server gets EOFException
[
https://issues.apache.org/jira/browse/ACCUMULO-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Keith Turner updated ACCUMULO-2247:
---
Affects Version/s: 1.6.0
random walk fails when server gets EOFException
---
Key: ACCUMULO-2247
URL: https://issues.apache.org/jira/browse/ACCUMULO-2247
Project: Accumulo
Issue Type: Bug
Components: client, tserver
Affects Versions: 1.6.0
Environment: Running RW on 10 node test cluster. Client quit with an
unknown error.
1.6-SNAPSHOT, Hadoop 2.2.0, running the agitator. I was *not* agitating data
nodes.
Reporter: Eric Newton
Saw this stack set of errors tin the corresponding server:
{noformat}
2014-01-23 19:19:18,020 [tserver.TabletServer] WARN : lookup failed for
tablet !0;~
java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at
org.apache.accumulo.core.file.rfile.RelativeKey.fastSkip(RelativeKey.java:314)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader._seek(RFile.java:675)
at
org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader.seek(RFile.java:607)
at
org.apache.accumulo.core.iterators.system.LocalityGroupIterator.seek(LocalityGroupIterator.java:142)
at
org.apache.accumulo.core.file.rfile.RFile$Reader.seek(RFile.java:979)
at
org.apache.accumulo.server.problems.ProblemReportingIterator.seek(ProblemReportingIterator.java:94)
at
org.apache.accumulo.core.iterators.system.MultiIterator.seek(MultiIterator.java:105)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.StatsIterator.seek(StatsIterator.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.system.DeletingIterator.seek(DeletingIterator.java:67)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.SkippingIterator.seek(SkippingIterator.java:37)
at
org.apache.accumulo.core.iterators.system.ColumnFamilySkippingIterator.seek(ColumnFamilySkippingIterator.java:123)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at org.apache.accumulo.core.iterators.Filter.seek(Filter.java:64)
at
org.apache.accumulo.core.iterators.system.SynchronizedIterator.seek(SynchronizedIterator.java:55)
at
org.apache.accumulo.core.iterators.WrappingIterator.seek(WrappingIterator.java:101)
at
org.apache.accumulo.core.iterators.user.VersioningIterator.seek(VersioningIterator.java:81)
at
org.apache.accumulo.core.iterators.user.WholeRowIterator.seek(WholeRowIterator.java:241)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.readNext(SourceSwitchingIterator.java:116)
at
org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:168)
at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1562)
at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1669)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1115)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:662)
2014-01-23 19:19:18,027 [tserver.TabletServer] WARN : exception while doing
multi-scan
java.lang.RuntimeException: java.io.EOFException
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1126)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at
[jira] [Commented] (ACCUMULO-3568) du fails due to principal mismatch
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314771#comment-14314771
]
Josh Elser commented on ACCUMULO-3568:
--
It looks like the implementation {{du}} is actually issuing an RPC as the
Accumulo server instead of the client. This transparently passes w/o Kerberos
because there's no verification that the user is who they say they are
(although it would fail if they couldn't read accumulo-site.xml).
{{TableOperationsImpl.getDiskUsage}} shouldn't be using {{ServerClient}}
regardless of whether we are running with kerberos or not.
du fails due to principal mismatch
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
For some reason, the credentials used in the shell to execute a {{du}} with
the system user's instead of the shell user's.
The server caught the mismatch in the principals (at the RPC level and the
Accumulo Credentials object) and prevented the RPC, but need to figure out
why this shell command is doing things differently than all of the rest.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3568) du shell command uses ServerClient incorrectly
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3568:
-
Description: {{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}}
class which is meant for Accumulo services to use to communicate with each
other. This results in the authentication performed for this method being
performed (incorrectly) as the system instead of the client. (was: For some
reason, the credentials used in the shell to execute a {{du}} with the system
user's instead of the shell user's.
The server caught the mismatch in the principals (at the RPC level and the
Accumulo Credentials object) and prevented the RPC, but need to figure out why
this shell command is doing things differently than all of the rest.)
du shell command uses ServerClient incorrectly
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class which is
meant for Accumulo services to use to communicate with each other. This
results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315579#comment-14315579 ] Christopher Tubbs commented on ACCUMULO-3572: - Yes. RC4 failed. This should be included in RC5. Check with [~sonixbp] to be sure. TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.6.2, 1.7.0 Time Spent: 20m Remaining Estimate: 0h When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3579) Remove org.mortbay.jetty from pom
[ https://issues.apache.org/jira/browse/ACCUMULO-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315577#comment-14315577 ] Christopher Tubbs commented on ACCUMULO-3579: - I can look tomorrow, but I thought it was used by the VFS classloader tests, because it was a dependency of MiniDFSCluster. Remove org.mortbay.jetty from pom - Key: ACCUMULO-3579 URL: https://issues.apache.org/jira/browse/ACCUMULO-3579 Project: Accumulo Issue Type: Task Components: build Reporter: Josh Elser Assignee: Josh Elser Fix For: 1.7.0, 1.6.3 Attachments: 0001-ACCUMULO-3579-Remove-org.mortbay.jetty-from-poms.patch We have a dependency on org.mortbay.jetty:jetty:6.1.26 that appears to be used by nothing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315613#comment-14315613 ] Corey J. Nolet commented on ACCUMULO-3572: -- It will be included in RC5 TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.6.2, 1.7.0 Time Spent: 20m Remaining Estimate: 0h When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3568) du shell command uses ServerClient incorrectly
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315121#comment-14315121
]
Josh Elser commented on ACCUMULO-3568:
--
Finally tracked down some more information:
{panel:title=TabletServer.log}
{noformat}
2015-02-10 17:46:51,081 [rpc.UGIAssumingProcessor] [ClientPool 180] TRACE:
Setting remoteUser=jel...@example.com
2015-02-10 17:46:51,082 [rpc.TCredentialsUpdatingInvocationHandler] [ClientPool
180] TRACE: Principal from RPC=jel...@example.com, args=[[ci],
TCredentials(principal:jel...@example.com,
tokenClassName:org.apache.accumulo.core.client.security.tokens.KerberosToken,
token:00 00 00 01, instanceId:6d25daec-07ac-4885-b7a1-4e95c89072b1)]
2015-02-10 17:46:51,086 [rpc.UGIAssumingProcessor] [ClientPool 181] TRACE:
Setting remoteUser=accumulo/hostn...@example.com
2015-02-10 17:46:51,086 [rpc.TCredentialsUpdatingInvocationHandler] [ClientPool
181] TRACE: Principal from RPC=accumulo/hostn...@example.com,
args=[TInfo(traceId:0, parentId:0), TCredentials(principal:jel...@example.com,
tokenClassName:org.apache.accumulo.core.client.security.tokens.KerberosToken,
token:00 00 00 01, instanceId:6d25daec-07ac-4885-b7a1-4e95c89072b1)]
2015-02-10 17:46:51,086 [rpc.TCredentialsUpdatingInvocationHandler] [ClientPool
181] WARN : Principal in credentials object should match kerberos principal.
Expected 'accumulo/hostn...@example.com' but was 'jel...@example.com'
{noformat}
{panel}
The first RPC (as myself in the principal) is for the table existence check
done in {{DUCommand}}. The 2nd call is the problematic one, where the wrong
principal is being extracted from the RPC transport. Still unsure about how
that is happening.
du shell command uses ServerClient incorrectly
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class which is
meant for Accumulo services to use to communicate with each other. This
results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
Keith Turner created ACCUMULO-3576:
--
Summary: Usage of jline.internal.Preconditions breaks mini accumulo
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Fix For: 1.6.2
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
[jira] [Updated] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Keith Turner updated ACCUMULO-3576:
---
Description:
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
{noformat}
was:
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[jira] [Updated] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3576:
-
Fix Version/s: (was: 1.6.2)
1.6.3
1.7.0
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.7.0, 1.6.3
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
[jira] [Assigned] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser reassigned ACCUMULO-3576:
Assignee: Josh Elser
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.6.2
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
[jira] [Resolved] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser resolved ACCUMULO-3576.
--
Resolution: Fixed
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.7.0, 1.6.3
Time Spent: 20m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
[jira] [Commented] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315154#comment-14315154
]
Josh Elser commented on ACCUMULO-3576:
--
Good catch, Keith. That should definitely be the Guava variant, not JLine.
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Fix For: 1.6.2
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
[jira] [Updated] (ACCUMULO-3568) getDiskUsage server implementation recreates Connector from user credentials
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3568:
-
Summary: getDiskUsage server implementation recreates Connector from user
credentials (was: du shell command uses ServerClient incorrectly)
getDiskUsage server implementation recreates Connector from user credentials
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class which is
meant for Accumulo services to use to communicate with each other. This
results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3568) du shell command uses ServerClient incorrectly
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315304#comment-14315304
]
Josh Elser commented on ACCUMULO-3568:
--
After much cursing, finally figured it out. The problem was not the client
doing something bad, but the server *using* the clients credentials instead of
its own.
{code}
@Override
public ListTDiskUsage getDiskUsage(SetString tables, TCredentials
credentials) throws ThriftTableOperationException, ThriftSecurityException,
TException {
try {
final Credentials creds = Credentials.fromThrift(credentials);
Connector conn = instance.getConnector(creds.getPrincipal(),
creds.getToken());
{code}
That explains why I couldn't figure out what was seemingly different on the
client side -- it was nothing. The server should be using its own connector and
enforcing proper permissions to keep users from {{du}}'ing tables which they
have no access to.
du shell command uses ServerClient incorrectly
--
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class which is
meant for Accumulo services to use to communicate with each other. This
results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315309#comment-14315309
]
Keith Turner commented on ACCUMULO-3576:
Was looking into this w/ [~ctubbsii]. Seems like Zookeeper depends on jline
0.9.xx and that was being pulled in instead of jline 2.11. Not sure why this
happened, fluo has no direct dependency on jline. I suppose jline 0.9.xx
does not have this Precondition class.
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.7.0, 1.6.3
Time Spent: 20m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
[jira] [Updated] (ACCUMULO-3568) getDiskUsage server implementation recreates Connector from user credentials
[
https://issues.apache.org/jira/browse/ACCUMULO-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated ACCUMULO-3568:
-
Description:
The server-side impl for {{TableOperationsImpl.getDiskUsage}} pulls the
credentials from the RPC and makes a {{Connector}} from them instead of using
its own credentials. With Kerberos enabled, this results in the server
accumulo/hostname@REALM trying to act as user@REALM which (correctly) fails.
The getDiskUsage implementation should use its own Connector (using the
SystemToken from the ServerContext), perform the correct security checks for
permissions and act on behalf of the user instead of trying to *be* the user.
was:{{TableOperationsImpl.getDiskUsage}} uses the {{ServerClient}} class
which is meant for Accumulo services to use to communicate with each other.
This results in the authentication performed for this method being performed
(incorrectly) as the system instead of the client.
getDiskUsage server implementation recreates Connector from user credentials
Key: ACCUMULO-3568
URL: https://issues.apache.org/jira/browse/ACCUMULO-3568
Project: Accumulo
Issue Type: Bug
Components: shell
Environment: kerberos
Reporter: Josh Elser
Assignee: Josh Elser
Priority: Critical
Fix For: 1.7.0
The server-side impl for {{TableOperationsImpl.getDiskUsage}} pulls the
credentials from the RPC and makes a {{Connector}} from them instead of using
its own credentials. With Kerberos enabled, this results in the server
accumulo/hostname@REALM trying to act as user@REALM which (correctly)
fails.
The getDiskUsage implementation should use its own Connector (using the
SystemToken from the ServerContext), perform the correct security checks for
permissions and act on behalf of the user instead of trying to *be* the user.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3577) VolumeManager FileType needs unit tests
[
https://issues.apache.org/jira/browse/ACCUMULO-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Tubbs updated ACCUMULO-3577:
Fix Version/s: 1.6.3
1.7.0
VolumeManager FileType needs unit tests
---
Key: ACCUMULO-3577
URL: https://issues.apache.org/jira/browse/ACCUMULO-3577
Project: Accumulo
Issue Type: Bug
Reporter: Christopher Tubbs
Fix For: 1.7.0, 1.6.3
The FileType enum in VolumeManager has some behavior which should be unit
tested.
In particular, it should check that the retrieval (or removal) of volumes
from a path works correctly.
At first glance, it looks to me like it is broken, because it is looking for
the first occurrence of a directory which starts with {{/tables}}, in the
case of tables. However, that will break if the volume itself had a path with
{{/tables}} in it (example: {{hdfs://nn1/tablesorting-application/accumulo}},
which would have the directory
{{hdfs://nn1/tablesorting-application/accumulo/tables/...}})
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ACCUMULO-3577) VolumeManager FileType needs unit tests
Christopher Tubbs created ACCUMULO-3577:
---
Summary: VolumeManager FileType needs unit tests
Key: ACCUMULO-3577
URL: https://issues.apache.org/jira/browse/ACCUMULO-3577
Project: Accumulo
Issue Type: Bug
Reporter: Christopher Tubbs
The FileType enum in VolumeManager has some behavior which should be unit
tested.
In particular, it should check that the retrieval (or removal) of volumes from
a path works correctly.
At first glance, it looks to me like it is broken, because it is looking for
the first occurrence of a directory which starts with {{/tables}}, in the case
of tables. However, that will break if the volume itself had a path with
{{/tables}} in it (example: {{hdfs://nn1/tablesorting-application/accumulo}},
which would have the directory
{{hdfs://nn1/tablesorting-application/accumulo/tables/...}})
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Tubbs updated ACCUMULO-3576:
Fix Version/s: (was: 1.6.3)
1.6.2
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.6.2, 1.7.0
Time Spent: 20m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
[jira] [Commented] (ACCUMULO-3577) VolumeManager FileType needs unit tests
[
https://issues.apache.org/jira/browse/ACCUMULO-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315312#comment-14315312
]
Christopher Tubbs commented on ACCUMULO-3577:
-
To be clear, the bug looks like it would appear for any FileType, not just
tables. Example: a volume called {{hdfs://nn1/walkerTexasRanger}} in the case
of {{/wal}} write-ahead log file types.
VolumeManager FileType needs unit tests
---
Key: ACCUMULO-3577
URL: https://issues.apache.org/jira/browse/ACCUMULO-3577
Project: Accumulo
Issue Type: Bug
Reporter: Christopher Tubbs
Fix For: 1.7.0, 1.6.3
The FileType enum in VolumeManager has some behavior which should be unit
tested.
In particular, it should check that the retrieval (or removal) of volumes
from a path works correctly.
At first glance, it looks to me like it is broken, because it is looking for
the first occurrence of a directory which starts with {{/tables}}, in the
case of tables. However, that will break if the volume itself had a path with
{{/tables}} in it (example: {{hdfs://nn1/tablesorting-application/accumulo}},
which would have the directory
{{hdfs://nn1/tablesorting-application/accumulo/tables/...}})
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ACCUMULO-3572) TableDiskUsage contains log without a conditional
[ https://issues.apache.org/jira/browse/ACCUMULO-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Tubbs updated ACCUMULO-3572: Fix Version/s: (was: 1.6.3) 1.6.2 TableDiskUsage contains log without a conditional - Key: ACCUMULO-3572 URL: https://issues.apache.org/jira/browse/ACCUMULO-3572 Project: Accumulo Issue Type: Bug Components: tserver Affects Versions: 1.6.1 Environment: Large system Reporter: marco polo Assignee: Eric Newton Priority: Minor Fix For: 1.6.2, 1.7.0 Time Spent: 20m Remaining Estimate: 0h When performing a du command that is distributed to the tservers, whereby each table file is printed in a log statement. As we are using log4j, this causes the tserver client thread to spend a significant portion of its time in the log appender. We should surround the log statement with a conditional or remove the log statement to prevent the unnecessary cycles. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (ACCUMULO-3576) Usage of jline.internal.Preconditions breaks mini accumulo
[
https://issues.apache.org/jira/browse/ACCUMULO-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Tubbs reopened ACCUMULO-3576:
-
There are a few more instances of this: CredentialProviderFactoryShim and
CredentialProviderToken, which need fixing.
Usage of jline.internal.Preconditions breaks mini accumulo
--
Key: ACCUMULO-3576
URL: https://issues.apache.org/jira/browse/ACCUMULO-3576
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Assignee: Josh Elser
Fix For: 1.6.2, 1.7.0
Time Spent: 20m
Remaining Estimate: 0h
Tried building fluo against 1.6.2 RC4 and mini failed to run w/ the following
problem in the tserver log. I think this may be caused by
[995080c|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=995080c]
which uses {{jline.internal.Preconditions}} in {{ActiveAssignmentRunnable}}.
{noformat}
2015-02-10 17:42:51,739 [tserver.TabletServer$ThriftClientHandler] ERROR:
jline/internal/Preconditions
java.lang.NoClassDefFoundError: jline/internal/Preconditions
at
org.apache.accumulo.tserver.ActiveAssignmentRunnable.init(ActiveAssignmentRunnable.java:41)
at
org.apache.accumulo.tserver.TabletServerResourceManager.addMetaDataAssignment(TabletServerResourceManager.java:716)
at
org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.loadTablet(TabletServer.java:2326)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.accumulo.trace.instrument.thrift.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:47)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
org.apache.accumulo.server.util.CustomNonBlockingServer$1.run(CustomNonBlockingServer.java:77)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: jline.internal.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 22 more
2015-02-10 17:42:51,744 [thrift.ProcessFunction] ERROR: Internal error
processing loadTablet
org.apache.thrift.TException: jline/internal/Preconditions
at
org.apache.accumulo.server.util.RpcWrapper$1.invoke(RpcWrapper.java:55)
at com.sun.proxy.$Proxy10.loadTablet(Unknown Source)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2557)
at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$loadTablet.getResult(TabletClientService.java:2543)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:168)
at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:516)
at
