This is one of the tests I used to figure out how Kerberos worked with Accumulo.
https://gist.github.com/wjsl/93c8528e8f27bbeb31bf You'll see the pattern where I would call `val someUser = loginUserFromKeytabAndReturnUGI(...)` and then execution connections inside of a doAs call. On Tue, Mar 8, 2016 at 7:31 PM, William Slacum <wsla...@gmail.com> wrote: > I think one thing is that we can at least guarantee you can connect to the > KDC. > > It kind of seems like there's an issue with communication between the > client and Accumulo.Can you try `new KerberosToken(principal, keytab, > true)`? I think I ran into this when figuring things out my own. By passing > in `false`, the connection won't be made as that user. I think you have to > manually execute the connection in a PrivilegedAction if you don't replace > the currently logged in user. > > On Tue, Mar 8, 2016 at 7:16 PM, Tristen Georgiou <tgeorg...@phemi.com> > wrote: > >> One thing I've noticed is that my client stack trace makes no mention of >> using an SASL transport (It's the last log dump in this email). Maybe this >> is the problem; Accumulo wants an SASL connection, but for some reason the >> client app isn't using an SASL transport even though I'm using a Kerberos >> Token? >> >> *Tablet server log:* >> >> 2016-03-08 16:09:07,875 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:09:17,884 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:09:27,892 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:09:37,902 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:09:43,142 [server.TThreadPoolServer] ERROR: Error occurred >> during processing of message. >> java.lang.RuntimeException: >> org.apache.thrift.transport.TTransportException >> at >> >> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory$1.run(UGIAssumingTransportFactory.java:51) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory$1.run(UGIAssumingTransportFactory.java:48) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:360) >> at >> >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory.getTransport(UGIAssumingTransportFactory.java:48) >> at >> >> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) >> at >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> at >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> at >> org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.thrift.transport.TTransportException >> at >> >> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) >> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) >> at >> >> org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) >> at >> >> org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) >> at >> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) >> at >> >> org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) >> at >> >> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) >> ... 11 more >> 2016-03-08 16:09:47,908 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:09:57,915 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:10:01,035 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> 2016-03-08 16:10:01,037 [handler.PhemiAuthenticator] INFO : Authenticating >> user: phemi...@dev.phemi.com >> >> *Master server log:* >> >> 2016-03-08 16:11:37,702 [replication.WorkMaker] INFO : Replication table >> is >> not yet online >> 2016-03-08 16:11:43,160 [server.TThreadPoolServer] ERROR: Error occurred >> during processing of message. >> java.lang.RuntimeException: >> org.apache.thrift.transport.TTransportException >> at >> >> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory$1.run(UGIAssumingTransportFactory.java:51) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory$1.run(UGIAssumingTransportFactory.java:48) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:360) >> at >> >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637) >> at >> >> org.apache.accumulo.core.rpc.UGIAssumingTransportFactory.getTransport(UGIAssumingTransportFactory.java:48) >> at >> >> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) >> at >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> at >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> at >> org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.thrift.transport.TTransportException >> at >> >> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) >> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) >> at >> >> org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) >> at >> >> org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) >> at >> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) >> at >> >> org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) >> at >> >> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) >> ... 11 more >> 2016-03-08 16:12:07,705 [replication.WorkMaker] INFO : Replication table >> is >> not yet online >> >> *And the debug log for the client application:* >> >> 2016-03-08 16:11:39,241 DEBUG [main-SendThread(dev:2181)] >> zookeeper.ClientCnxn (ClientCnxn.java:readResponse(717)) - Got ping >> response for sessionid: 0x15342d74d18477f after 0ms >> 2016-03-08 16:11:49,250 DEBUG [main] impl.ServerClient >> (ServerClient.java:executeRaw(101)) - ClientService request failed >> dev:9997, retrying ... >> org.apache.thrift.transport.TTransportException: >> java.net.SocketTimeoutException: 120000 millis timeout while waiting for >> channel to be ready for read. ch : >> java.nio.channels.SocketChannel[connected local=/10.129.0.116:37532 >> remote=dev/10.129.0.110:9997] >> at >> >> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) >> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) >> at >> >> org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:129) >> at >> >> org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101) >> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) >> at >> >> org.apache.accumulo.core.client.impl.ThriftTransportPool$CachedTTransport.readAll(ThriftTransportPool.java:270) >> at >> >> org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:601) >> at >> >> org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:470) >> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) >> at >> >> org.apache.accumulo.core.client.impl.thrift.ClientService$Client.recv_authenticate(ClientService.java:500) >> at >> >> org.apache.accumulo.core.client.impl.thrift.ClientService$Client.authenticate(ClientService.java:486) >> at >> >> org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute(ConnectorImpl.java:70) >> at >> >> org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute(ConnectorImpl.java:67) >> at >> >> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:98) >> at >> >> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:61) >> at >> >> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:67) >> at >> >> org.apache.accumulo.core.client.ZooKeeperInstance.getConnector(ZooKeeperInstance.java:248) >> at >> >> com.phemi.testing.AccumuloKerberosConnection.main(AccumuloKerberosConnection.java:18) >> Caused by: java.net.SocketTimeoutException: 120000 millis timeout while >> waiting for channel to be ready for read. ch : >> java.nio.channels.SocketChannel[connected local=/10.129.0.116:37532 >> remote=dev/10.129.0.110:9997] >> at >> >> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164) >> at >> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) >> at >> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) >> at java.io.FilterInputStream.read(FilterInputStream.java:133) >> at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) >> at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) >> at java.io.BufferedInputStream.read(BufferedInputStream.java:334) >> at >> >> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) >> ... 17 more >> >> >> On Tue, Mar 8, 2016 at 4:03 PM William Slacum <wsla...@gmail.com> wrote: >> >> > Any logs on the Accumulo and/or KDC side? >> > >> > On Tue, Mar 8, 2016 at 5:05 PM, Tristen Georgiou <tgeorg...@phemi.com> >> > wrote: >> > >> > > Here is a simple Java program to attempt to get a connection to >> Accumulo >> > > and list the local users: >> > > >> > > package com.phemi.testing; >> > > >> > > import org.apache.accumulo.core.client.Connector; >> > > import org.apache.accumulo.core.client.Instance; >> > > import org.apache.accumulo.core.client.ZooKeeperInstance; >> > > import org.apache.accumulo.core.client.security.tokens.KerberosToken; >> > > >> > > import java.io.File; >> > > >> > > public class AccumuloKerberosConnection { >> > > public static void main(String[] args) throws Exception { >> > > Instance inst = new ZooKeeperInstance("agile_accumulo", >> "dev"); >> > > KerberosToken token = new KerberosToken(" >> > > accumulo-ph...@dev.phemi.com", new >> > > File("/etc/security/keytabs/accumulo.headless.keytab"), false); >> > > Connector conn = inst.getConnector(token.getPrincipal(), >> token); >> > > >> System.out.println(conn.securityOperations().listLocalUsers()); >> > > } >> > > } >> > > >> > > It always hangs at the getConnector function. >> > > >> > > NOTE: the user and keytab were created by Ambari as the default >> Accumulo >> > > user. >> > > >> > > At first I noticed that there was an error saying that it was not >> > > attempting to connect using SASL (unspecified error) but after some >> > digging >> > > I found that I could get around this using jaas.conf file and >> specifying >> > it >> > > as a Java argument on the command line: >> > > >> > > -Djava.security.auth.login.config=/tmp/jaas.conf >> > > >> > > Where the file contains: >> > > >> > > Client { >> > > com.sun.security.auth.module.Krb5LoginModule required >> > > useKeyTab=true >> > > keyTab="/etc/security/keytabs/accumulo.headless.keytab" >> > > principal="accumulo-phemi" >> > > useTicketCache=false >> > > debug=true; >> > > }; >> > > >> > > Now I'm at a point where it says it's using GSSAPI as SASL mechanism >> > > (good!) but it still hangs at the "Connector conn = >> > > inst.getConnector(token.getPrincipal(), token);" line. >> > > >> > > Any pointers on what I'm doing wrong? >> > > >> > > Tristen >> > > >> > > PS: Here is the debug output: >> > > 2016-03-08 14:02:03,600 WARN [main] client.ClientConfiguration >> > > (ClientConfiguration.java:loadFromSearchPath(227)) - Found no >> client.conf >> > > in default paths. Using default client configuration values. >> > > 2016-03-08 14:02:03,668 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 >> > GMT >> > > 2016-03-08 14:02:03,670 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:host.name >> > > =tgeorgiou-ubuntu-dev >> > > 2016-03-08 14:02:03,670 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> environment:java.version=1.7.0_95 >> > > 2016-03-08 14:02:03,670 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:java.vendor=Oracle >> > > Corporation >> > > 2016-03-08 14:02:03,670 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre >> > > 2016-03-08 14:02:03,670 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > >> > > >> > >> environment:java.class.path=/home/tgeorgiou/dev/JavaTesting/build/classes/main:/home/tgeorgiou/dev/JavaTesting/build/resources/main:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-core/1.7.0/bdf734db2710ee95783fb492616a6b9303ff4b33/accumulo-core-1.7.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-minicluster/1.6.0/74a533cbabb77dfa1c39ef49bac59c8536c20455/accumulo-minicluster-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-common/2.2.0/a840350e4a1f5483f949ec5e72cfa2c6b2b3cf94/hadoop-common-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-client/2.2.0/8bc8c12f1991d1145e40011c8a8935798948246e/hadoop-client-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/log4j/log4j/1.2.17/5af35056b4d257e4b64b9e8069c0746e8b08629f/log4j-1.2.17.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-beanutils/commons-beanutils/1.9.0/427662b038bd8f52097f783f6ea163e45851b2a1/commons-beanutils-1.9.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/net.sf.opencsv/opencsv/2.3/c23708cdb9e80a144db433e23344a788a1fd6599/opencsv-2.3.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.tika/tika-core/1.5/194ca0fb3d73b07737524806fbc3bec89063c03a/tika-core-1.5.jar:/home/tgeorgiou/.m2/repository/com/phemi/agile/udf-client/1.0/udf-client-1.0.jar:/home/tgeorgiou/dev/agile/core/build/libs/agile-core-1.0-SNAPSHOT.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.beust/jcommander/1.32/d85d7f3b1895c02065b5f96cd02e514dd233a1aa/jcommander-1.32.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-collections/commons-collections/3.2.1/761ea405b9b37ced573d2df0d1e3a4e0f9edc668/commons-collections-3.2.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-configuration/commons-configuration/1.6/32cadde23955d7681b0d94a2715846d20b425235/commons-configuration-1.6.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-io/commons-io/2.4/b1b6ea3b7e4aa4f492509a4952029cd8e48019ad/commons-io-2.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-logging/commons-logging/1.1.1/5043bfebc3db072ed80fbd362e7caf00e885d8ae/commons-logging-1.1.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/jline/jline/2.11/9504d5e2da5d78237239c5226e8200ec21182040/jline-2.11.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-fate/1.7.0/76085dea056ed13b5d032e9a0f7f2424cc714bf6/accumulo-fate-1.7.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-start/1.7.0/54f81dd8f769d8d00390dfd751fa88017b605251/accumulo-start-1.7.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-math/2.1/b3c4bdc2778ddccceb8da2acec3e37bfa41303e9/commons-math-2.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-vfs2/2.0/b5af3b9c96b060d77c68fa5ac9384b402dd58013/commons-vfs2-2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.htrace/htrace-core/3.1.0-incubating/f73606e7c9ede5802335c290bf47490ad6d51df3/htrace-core-3.1.0-incubating.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.thrift/libthrift/0.9.1/16c9cccf08caa385b5fc93934cb3216fe6ac6a72/libthrift-0.9.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-gc/1.6.0/3d6b1602261f16de243d82ea5012d932e3873266/accumulo-gc-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-master/1.6.0/74860cb7c8a956c7d9ec9199d9c4013e88d84ec0/accumulo-master-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-server-base/1.6.0/6c184e520e3710a561ecdf225d4c2bf002d65acb/accumulo-server-base-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-tserver/1.6.0/e09b5f010829b1d38022086634f23d7ee97ed118/accumulo-tserver-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-minicluster/2.2.0/1c3b5d0dcdba37f93f8d3d1869c023b71d71df6/hadoop-minicluster-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-annotations/2.2.0/ebd95f271e3bce5c0dca5926bb3eb36530cd9ab6/hadoop-annotations-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.2/2bf96b7aa8b611c177d329452af1dc933e14501c/commons-cli-1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/xmlenc/xmlenc/0.52/d82554efbe65906d83b3d97bd7509289e9db561a/xmlenc-0.52.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-httpclient/commons-httpclient/3.1/964cd74171f427720480efdec40a7c7f6e58426a/commons-httpclient-3.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-net/commons-net/3.1/2298164a7c2484406f2aa5ac85b205d39019896f/commons-net-3.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.servlet/servlet-api/2.5/5959582d97d8b61f4d154ca9e495aafd16726e34/servlet-api-2.5.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.mortbay.jetty/jetty/6.1.26/2f546e289fddd5b1fab1d4199fbb6e9ef43ee4b0/jetty-6.1.26.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.mortbay.jetty/jetty-util/6.1.26/e5642fe0399814e1687d55a3862aa5a3417226a9/jetty-util-6.1.26.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-core/1.9/8341846f18187013bb9e27e46b7ee00a6395daf4/jersey-core-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-json/1.9/1aa73e1896bcc7013fed247157d7f676226eb432/jersey-json-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-server/1.9/3a6ea7cc5e15c824953f9f3ece2201b634d90d18/jersey-server-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/tomcat/jasper-compiler/5.5.23/6d35bd7fb8c4fbc1f5401fb3678aa976d2e4c241/jasper-compiler-5.5.23.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/tomcat/jasper-runtime/5.5.23/96ca5528a93ab47b001476b74320c644beb89dde/jasper-runtime-5.5.23.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.servlet.jsp/jsp-api/2.1/63f943103f250ef1f3a4d5e94d145a0f961f5316/jsp-api-2.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-el/commons-el/1.0/1df2c042b3f2de0124750241ac6c886dbfa2cc2c/commons-el-1.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/net.java.dev.jets3t/jets3t/0.6.1/9f95b944ccbbbeedd397e8f62e5690fd735a45e5/jets3t-0.6.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-core-asl/1.8.8/dd2e90bb710ea3bc4610e24299d6a4c8dac5049b/jackson-core-asl-1.8.8.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-mapper-asl/1.8.8/1bb32d9d2527c083a56e234acca49a48d3c65c8/jackson-mapper-asl-1.8.8.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.avro/avro/1.7.4/416e7030879814f52845b97f04bb50ecd1cef372/avro-1.7.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.google.protobuf/protobuf-java/2.5.0/a10732c76bfacdbd633a7eb0f7968b1059a65dfa/protobuf-java-2.5.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-auth/2.2.0/74e5f8b2134be51312c004d29e33a7bf4377ce20/hadoop-auth-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.42/a86104b0f2e0c0bab5b0df836065823a99b5e334/jsch-0.1.42.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-compress/1.4.1/b02e84a993d88568417536240e970c4b809126fd/commons-compress-1.4.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-common/2.2.0/a9994d261d00295040a402cd2f611a2bac23972a/hadoop-common-2.2.0-tests.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/f2686b55818b9bae3e16d33a3f205a388920aa34/hadoop-hdfs-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-app/2.2.0/9e5bdd970000b330382128350a957609cbcfe348/hadoop-mapreduce-client-app-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-api/2.2.0/655910becbe9c5c60033e9e64e95aab0ec4ce94a/hadoop-yarn-api-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-core/2.2.0/4be274d45f35543d3c4dd8e2bfed2cebc56696c7/hadoop-mapreduce-client-core-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-jobclient/2.2.0/842d0c9d8793fd21bfbb1c6b1fa9fbc05698f76c/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-jobclient/2.2.0/4c75b683a7d96a48172535c115b2067faf211cfc/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-digester/commons-digester/1.8/dc6a73fdbd1fa3f0944e8497c6c872fa21dca37e/commons-digester-1.8.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-beanutils/commons-beanutils-core/1.8.0/175dc721f87e4bc5cc0573f990e28c3cf9117508/commons-beanutils-core-1.8.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.maven.scm/maven-scm-api/1.4/e294693ce217bd6f470b728127854e6ca787fd29/maven-scm-api-1.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.maven.scm/maven-scm-provider-svnexe/1.4/b3213b40157b701ba079b738baac391e41418c18/maven-scm-provider-svnexe-1.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.commons/commons-lang3/3.1/905075e6c80f206bbe6cf1e809d2caa69f420c76/commons-lang3-3.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpclient/4.2.5/666e26e76f2e87d84e4f16acb546481ae1b8e9a6/httpclient-4.2.5.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.httpcomponents/httpcore/4.2.4/3b7f38df6de5dd8b500e602ae8c2dd5ee446f883/httpcore-4.2.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.accumulo/accumulo-trace/1.6.0/b82e2c68b7d6167755aa19452bb86acfb4319289/accumulo-trace-1.6.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-tests/2.2.0/d6bf9776d45f3812a9011d768d571bc554706f05/hadoop-yarn-server-tests-2.2.0-tests.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-hs/2.2.0/7c3b62138f881f1a98f02347b1002b9bde052b81/hadoop-mapreduce-client-hs-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.jettison/jettison/1.1/1a01a2a1218fcf9faa2cc2a6ced025bdea687262/jettison-1.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.xml.bind/jaxb-impl/2.2.3-1/56baae106392040a45a06d4a41099173425da1e6/jaxb-impl-2.2.3-1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-jaxrs/1.8.3/3604ca9f572170e2ef5813141ec1f0e0100efd19/jackson-jaxrs-1.8.3.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.jackson/jackson-xc/1.8.3/1226667dcdb7c259b3ee07e112ed83446554516e/jackson-xc-1.8.3.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/asm/asm/3.1/c157def142714c544bdea2e6144645702adf7097/asm-3.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.thoughtworks.paranamer/paranamer/2.3/4a85963a752c0a2f715c3924bfc686865e7e1bc6/paranamer-2.3.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.xerial.snappy/snappy-java/ >> > > >> > > >> > >> 1.0.4.1/f88b89a5a21a466aeb0ecf0c063605bd584b4947/snappy-java-1.0.4.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.tukaani/xz/1.0/ecff5cb8b1189514c9d1d8d68eb77ac372e000c9/xz-1.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-daemon/commons-daemon/1.0.13/750856a1fdb3ddf721ccf73c3518e4211cffc3a3/commons-daemon-1.0.13.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-common/2.2.0/5600fdda58499e3901bf179f1614a8ca38090871/hadoop-mapreduce-client-common-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-web-proxy/2.2.0/ab2404e576910f14cbcd185f81776ff806571b37/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-shuffle/2.2.0/c4c9da8f8f6ab1e3ba68798f30360eff4ba52187/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.google.inject.extensions/guice-servlet/3.0/610cde0e8da5a8b7d8efb8f0b8987466ffebaaf9/guice-servlet-3.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.google.inject/guice/3.0/9d84f15fe35e2c716a02979fb62f50a29f38aefa/guice-3.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey.jersey-test-framework/jersey-test-framework-grizzly2/1.9/8bf4d5cef8cbf70a160cc2ff78b332db454030bd/jersey-test-framework-grizzly2-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey.contribs/jersey-guice/1.9/5963c28c47df7e5d6ad34cec80c071c368777f7b/jersey-guice-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.codehaus.plexus/plexus-utils/1.5.6/8fb6b798a4036048b3005e058553bf21a87802ed/plexus-utils-1.5.6.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.maven.scm/maven-scm-provider-svn-commons/1.4/54bc1dc24c5d205b4d251a83f4ea63808c21a628/maven-scm-provider-svn-commons-1.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/regexp/regexp/1.3/973df2b78b67bcd3144c3dbbb88da691065a3f8d/regexp-1.3.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-common/2.2.0/ce13e5699bbe644da95bfd7e01549c6a389fec7f/hadoop-yarn-server-common-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-nodemanager/2.2.0/5e7f0f16676afffff62919578bcb5606e3548f36/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-server-resourcemanager/2.2.0/867da9c1c98a2c8c9b6cf7f3f9354818cd8831cf/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/stax/stax-api/1.0.1/49c100caf72d658aca8e58bd74a4ba90fa2b0d70/stax-api-1.0.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.xml.bind/jaxb-api/2.2.2/aeb3021ca93dde265796d82015beecdcff95bf09/jaxb-api-2.2.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-client/2.2.0/f299044dd9e546ca30a30014ef30699306e9ef3e/hadoop-yarn-client-2.2.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.inject/javax.inject/1/6975da39a7040257bd51d21a231b76c915872d38/javax.inject-1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/aopalliance/aopalliance/1.0/235ba8b489512805ac13a8f9ea77a1ca5ebe3e8/aopalliance-1.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.sonatype.sisu.inject/cglib/2.2.1-v20090111/7ce5e983fd0e6c78346f4c9cbfa39d83049dda2/cglib-2.2.1-v20090111.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey.jersey-test-framework/jersey-test-framework-core/1.9/129431673b2735840b9216a651de38b4f1cb3c66/jersey-test-framework-core-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-grizzly2/1.9/1e23ccc25f4dced8857b4296cceed42a7a49200c/jersey-grizzly2-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.activation/activation/1.1/e6cb541461c2834bdea3eb920f1884d1eb508b50/activation-1.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/javax.servlet/javax.servlet-api/3.0.1/6bf0ebb7efd993e222fc1112377b5e92a13b38dd/javax.servlet-api-3.0.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/junit/junit/4.8.2/c94f54227b08100974c36170dcb53329435fe5ad/junit-4.8.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-client/1.9/d3c4b2b5f89db32c96ceddcb863684821910a7bb/jersey-client-1.9.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.grizzly/grizzly-http/2.1.2/aa477bd5b57367c344bf50f1f4af71a24a94ec9f/grizzly-http-2.1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.grizzly/grizzly-http-server/2.1.2/8a1c41c688cb3a34998a3515048a2284e5201192/grizzly-http-server-2.1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.grizzly/grizzly-http-servlet/2.1.2/225700354dd0b7bc6132689c4fa046fa69744e20/grizzly-http-servlet-2.1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish/javax.servlet/3.1/ab7db738667bea1b937efcf3a1845c0d28e6beaf/javax.servlet-3.1.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.grizzly/grizzly-framework/2.1.2/684c82b28f7e7a53c20d30e69d9787abfeb85d32/grizzly-framework-2.1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.grizzly/grizzly-rcm/2.1.2/19c3a4301ae7e38eb0518cfd4f3f34223c1b7f39/grizzly-rcm-2.1.2.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.gmbal/gmbal-api-only/3.0.0-b023/14f077191ad7ec73004ca58de2c90a2137f1d882/gmbal-api-only-3.0.0-b023.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.glassfish.external/management-api/3.0.0-b012/707686d845faede060b79bdf018a25a469a611b4/management-api-3.0.0-b012.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.apache.zookeeper/zookeeper/3.4.6/1b2502e29da1ebaade2357cd1de35a855fa3755/zookeeper-3.4.6.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.google.guava/guava/15.0/ed727a8d9f247e2050281cb083f1c77b09dcb5cd/guava-15.0.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-lang/commons-lang/2.5/b0236b252e86419eef20c31a44579d2aee2f0a69/commons-lang-2.5.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.6/6953717b9850aeb26d1b8375ca07dbd9c50eca4e/slf4j-log4j12-1.7.6.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.4.4/e2ff13c3de2f5a2ab2449a3dace2b0d1c37bd8ee/jackson-databind-2.4.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.4.4/c5cd3347c0a86d0dcfbf3da593d8431d5a789d54/jackson-core-2.4.4.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.6/562424e36df3d2327e8e9301a76027fca17d54ea/slf4j-api-1.7.6.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/commons-codec/commons-codec/1.7/9cd61d269c88f9fb0eb36cea1efcd596ab74772f/commons-codec-1.7.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/io.netty/netty/3.7.0.Final/7a8c35599c68c0bf383df74469aa3e03d9aca87/netty-3.7.0.Final.jar:/home/tgeorgiou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.4.0/d6a66c7a5f01cf500377bd669507a08cfeba882a/jackson-annotations-2.4.0.jar >> > > 2016-03-08 14:02:03,671 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > >> > > >> > >> environment:java.library.path=/home/tgeorgiou/Applications/idea-IC-143.1184.17/bin::/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib >> > > 2016-03-08 14:02:03,671 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> environment:java.io.tmpdir=/tmp >> > > 2016-03-08 14:02:03,671 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:java.compiler=<NA> >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:os.name=Linux >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:os.arch=amd64 >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > environment:os.version=3.13.0-79-generic >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client environment:user.name >> =tgeorgiou >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > environment:user.home=/home/tgeorgiou >> > > 2016-03-08 14:02:03,672 INFO [main] zookeeper.ZooKeeper >> > > (Environment.java:logEnv(100)) - Client >> > > environment:user.dir=/home/tgeorgiou/dev/JavaTesting >> > > 2016-03-08 14:02:03,675 INFO [main] zookeeper.ZooKeeper >> > > (ZooKeeper.java:<init>(438)) - Initiating client connection, >> > > connectString=dev sessionTimeout=30000 >> > > >> watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@4eeba477 >> > > Debug is true storeKey false useTicketCache false useKeyTab true >> > > doNotPrompt false ticketCache is null isInitiator true KeyTab is >> > > /etc/security/keytabs/accumulo.headless.keytab refreshKrb5Config is >> false >> > > principal is accumulo-phemi tryFirstPass is false useFirstPass is >> false >> > > storePass is false clearPass is false >> > > principal is accumulo-ph...@dev.phemi.com >> > > Will use keytab >> > > Commit Succeeded >> > > >> > > 2016-03-08 14:02:03,771 INFO [main-SendThread(dev:2181)] >> zookeeper.Login >> > > (Login.java:login(293)) - successfully logged in. >> > > 2016-03-08 14:02:03,772 INFO [Thread-0] zookeeper.Login >> > > (Login.java:run(127)) - TGT refresh thread started. >> > > 2016-03-08 14:02:03,776 INFO [main-SendThread(dev:2181)] >> > > client.ZooKeeperSaslClient (ZooKeeperSaslClient.java:run(285)) - >> Client >> > > will use GSSAPI as SASL mechanism. >> > > 2016-03-08 14:02:03,780 INFO [Thread-0] zookeeper.Login >> > > (Login.java:getRefreshTime(301)) - TGT valid starting at: Tue >> Mar >> > 08 >> > > 14:02:03 PST 2016 >> > > 2016-03-08 14:02:03,780 INFO [Thread-0] zookeeper.Login >> > > (Login.java:getRefreshTime(302)) - TGT expires: Wed >> Mar >> > 09 >> > > 14:02:03 PST 2016 >> > > 2016-03-08 14:02:03,780 INFO [Thread-0] zookeeper.Login >> > > (Login.java:run(181)) - TGT refresh sleeping until: Wed Mar 09 >> 09:25:53 >> > PST >> > > 2016 >> > > 2016-03-08 14:02:03,807 INFO [main-SendThread(dev:2181)] >> > > zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening >> > > socket connection to server dev/10.129.0.110:2181. Will attempt to >> > > SASL-authenticate using Login Context section 'Client' >> > > 2016-03-08 14:02:03,812 INFO [main-SendThread(dev:2181)] >> > > zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket >> > > connection established to dev/10.129.0.110:2181, initiating session >> > > 2016-03-08 14:02:03,821 INFO [main-SendThread(dev:2181)] >> > > zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session >> > > establishment complete on server dev/10.129.0.110:2181, sessionid = >> > > 0x15342d74d1845ee, negotiated timeout = 30000 >> > > 2016-03-08 14:02:04,078 WARN [main] util.NativeCodeLoader >> > > (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop >> > library >> > > for your platform... using builtin-java classes where applicable >> > > >> > >> > >