Hey Worthy, Awesome!
That zookeeper.connect issue you see should be fixed now -- it's the bug that I was talking about yesterday. If you re-checkout or git pull the latest code from hello-samza on Github, that should work. Cheers, Chris On 10/15/13 9:03 PM, "Worthy LaFollette" <[email protected]> wrote: >Those were all there were in the logs. > >Found part of the issue: > >https://issues.apache.org/jira/browse/HADOOP-7489 > >I set the recommended env variable and got much farther. The job ran for >a >bit, but then failed with the same error. Will try again, but set the >value in the hadoop script directly. > >***** > >2013-10-15 20:58:17.882 java[14099:111b] Unable to load realm info >from SCDynamicStore >Exception in thread "main" java.lang.IllegalArgumentException: >requirement failed: Missing required property 'zookeeper.connect' > at scala.Predef$.require(Predef.scala:145) > at >kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:175) > at kafka.utils.ZKConfig.<init>(ZkUtils.scala:775) > at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:73) > at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:77) > at >org.apache.samza.config.KafkaConfig.getKafkaSystemConsumerConfig(KafkaConf >ig.scala:91) > at >org.apache.samza.system.kafka.KafkaSystemFactory.getAdmin(KafkaSystemFacto >ry.scala:106) > at >org.apache.samza.system.kafka.KafkaSystemFactory.getAdmin(KafkaSystemFacto >ry.scala:41) > at org.apache.samza.util.Util$$anonfun$1.apply(Util.scala:93) > at org.apache.samza.util.Util$$anonfun$1.apply(Util.scala:88) > at >scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scal >a:206) > at >scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scal >a:206) > at scala.collection.immutable.Set$Set2.foreach(Set.scala:101) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > at scala.collection.immutable.Set$Set2.map(Set.scala:87) > at > org.apache.samza.util.Util$.getMaxInputStreamPartitions(Util.scala:88) > at >org.apache.samza.job.yarn.SamzaAppMasterTaskManager.<init>(SamzaAppMasterT >askManager.scala:92) > at >org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:75) > at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala) > > > > >On Tue, Oct 15, 2013 at 8:37 PM, Chris Riccomini ><[email protected]>wrote: > >> Hey Worthy, >> >> That log looks truncated to me. Is that the complete file? If not, >>maybe >> you can throw it up on a Github gist or pastebin link? >> >> My log looks like this: >> >> 13/10/14 12:10:51 INFO nodemanager.NodeManager: STARTUP_MSG: >> /************************************************************ >> STARTUP_MSG: Starting NodeManager >> STARTUP_MSG: host = criccomi-mn/172.19.218.230 >> STARTUP_MSG: args = [] >> STARTUP_MSG: version = 2.0.5-alpha >> STARTUP_MSG: classpath = ...a very long class path... >> STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common -r >> 1488459; compiled by 'jenkins' on 2013-06-01T04:05Z >> STARTUP_MSG: java = 1.6.0_51 >> ************************************************************/ >> 2013-10-14 12:10:52.433 java[64477:213] Unable to load realm mapping >>info >> from SCDynamicStore >> 13/10/14 12:10:52 WARN util.NativeCodeLoader: Unable to load >>native-hadoop >> library for your platform... using builtin-java classes where applicable >> 13/10/14 12:10:53 WARN nodemanager.ContainerExecutor: setsid is not >> available on this machine. So not using it. >> 13/10/14 12:10:53 INFO nodemanager.ContainerExecutor: setsid exited with >> exit code 0 >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Cont >>ai >> nerEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManag >>er >> Impl$ContainerEventDispatcher >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Ap >>pl >> icationEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManag >>er >> Impl$ApplicationEventDispatcher >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.even >>t. >> LocalizationEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Reso >>ur >> ceLocalizationService >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEve >>nt >> Type for class >> org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Contai >>ne >> rsMonitorEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Contai >>ne >> rsMonitorImpl >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.Conta >>in >> ersLauncherEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.Conta >>in >> ersLauncher >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for >> class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManag >>er >> Impl >> 13/10/14 12:10:53 INFO event.AsyncDispatcher: Registering class >> org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class >> org.apache.hadoop.yarn.server.nodemanager.NodeManager >> 13/10/14 12:10:53 INFO impl.MetricsConfig: loaded properties from >> hadoop-metrics2.properties >> 13/10/14 12:10:54 INFO impl.MetricsSystemImpl: Scheduled snapshot period >> at 10 second(s). >> 13/10/14 12:10:54 INFO impl.MetricsSystemImpl: NodeManager metrics >>system >> started >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is >> inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService >> is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerServic >>e >> is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl >> is inited. >> 13/10/14 12:10:54 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.eve >>nt >> .LogHandlerEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.Non >>Ag >> gregatingLogHandler >> 13/10/14 12:10:54 INFO event.AsyncDispatcher: Registering class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.even >>t. >> LocalizerEventType for class >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Reso >>ur >> ceLocalizationService$LocalizerTracker >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService$LocalizerTracker is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:containers-launcher is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxSer >>vi >> ces is inited. >> 13/10/14 12:10:54 INFO monitor.ContainersMonitorImpl: Using >> ResourceCalculatorPlugin : null >> 13/10/14 12:10:54 INFO monitor.ContainersMonitorImpl: Using >> ResourceCalculatorProcessTree : null >> 13/10/14 12:10:54 INFO monitor.ContainersMonitorImpl: Physical memory >> check enabled: true >> 13/10/14 12:10:54 INFO monitor.ContainersMonitorImpl: Virtual memory >>check >> enabled: true >> 13/10/14 12:10:54 INFO service.AbstractService: >>Service:containers-monitor >> is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: Service:Dispatcher is >> inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghan >>dl >> er.NonAggregatingLogHandler is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.Contai >>ne >> rManagerImpl is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is >> inited. >> 13/10/14 12:10:54 INFO service.AbstractService: Service:Dispatcher is >> inited. >> 13/10/14 12:10:54 INFO nodemanager.NodeStatusUpdaterImpl: Initialized >> nodemanager for null: physical-memory=8192 virtual-memory=81920 >> physical-cores=8 virtual-cores=16 >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl >>is >> inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is inited. >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is >> started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService >> is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerServic >>e >> is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl >> is started. >> 13/10/14 12:10:54 INFO ipc.Server: Starting Socket Reader #1 for port >>61403 >> 13/10/14 12:10:54 INFO pb.RpcServerFactoryPBImpl: Adding protocol >> org.apache.hadoop.yarn.api.ContainerManagerPB to the server >> 13/10/14 12:10:54 INFO ipc.Server: IPC Server Responder: starting >> 13/10/14 12:10:54 INFO ipc.Server: IPC Server listener on 61403: >>starting >> 13/10/14 12:10:54 INFO containermanager.ContainerManagerImpl: >> ContainerManager started at criccomi-mn/172.19.218.230:61403 >> 13/10/14 12:10:54 INFO ipc.Server: Starting Socket Reader #1 for port >>8040 >> 13/10/14 12:10:54 INFO pb.RpcServerFactoryPBImpl: Adding protocol >> org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to >> the server >> 13/10/14 12:10:54 INFO ipc.Server: IPC Server Responder: starting >> 13/10/14 12:10:54 INFO ipc.Server: IPC Server listener on 8040: starting >> 13/10/14 12:10:54 INFO localizer.ResourceLocalizationService: Localizer >> started on port 8040 >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService$LocalizerTracker is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> Service:containers-launcher is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxSer >>vi >> ces is started. >> 13/10/14 12:10:54 INFO monitor.ContainersMonitorImpl: >> ResourceCalculatorPlugin is unavailable on this system. >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Contai >>ne >> rsMonitorImpl is disabled. >> 13/10/14 12:10:54 INFO service.AbstractService: >>Service:containers-monitor >> is started. >> 13/10/14 12:10:54 INFO service.AbstractService: Service:Dispatcher is >> started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghan >>dl >> er.NonAggregatingLogHandler is started. >> 13/10/14 12:10:54 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.Contai >>ne >> rManagerImpl is started. >> 13/10/14 12:10:54 INFO webapp.WebServer: Instantiating NMWebApp at >> 0.0.0.0:8042 >> 13/10/14 12:10:54 INFO mortbay.log: Logging to >> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via >> org.mortbay.log.Slf4jLog >> 13/10/14 12:10:55 INFO http.HttpServer: Added global filter 'safety' >> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) >> 13/10/14 12:10:55 INFO http.HttpServer: Added filter static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) >>to >> context node >> 13/10/14 12:10:55 INFO http.HttpServer: Added filter static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) >>to >> context static >> 13/10/14 12:10:55 INFO http.HttpServer: Added filter static_user_filter >> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) >>to >> context logs >> 13/10/14 12:10:55 INFO http.HttpServer: adding path spec: /node >> 13/10/14 12:10:55 INFO http.HttpServer: adding path spec: /node/* >> 13/10/14 12:10:55 INFO http.HttpServer: adding path spec: /ws >> 13/10/14 12:10:55 INFO http.HttpServer: adding path spec: /ws/* >> 13/10/14 12:10:55 INFO http.HttpServer: Added global filter 'guice' >> (class=com.google.inject.servlet.GuiceFilter) >> 13/10/14 12:10:55 INFO http.HttpServer: Jetty bound to port 8042 >> 13/10/14 12:10:55 INFO mortbay.log: jetty-6.1.26 >> 13/10/14 12:10:55 INFO mortbay.log: Extract >> >>jar:file:/Users/criccomi/Code/hello-samza/deploy/yarn/share/hadoop/yarn/h >>ad >> oop-yarn-common-2.0.5-alpha.jar!/webapps/node to >> >>/var/folders/jl/cxz2crt15cq_5jj9x0lnqwwh00033y/T/Jetty_0_0_0_0_8042_node_ >>__ >> _19tj0x/webapp >> 13/10/14 12:10:55 INFO mortbay.log: Started >> [email protected]:8042 >> 13/10/14 12:10:55 INFO webapp.WebApps: Web app /node started at 8042 >> 13/10/14 12:10:56 INFO webapp.WebApps: Registered webapp guice modules >> 13/10/14 12:10:56 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is >> started. >> 13/10/14 12:10:56 INFO service.AbstractService: Service:Dispatcher is >> started. >> 13/10/14 12:10:56 INFO nodemanager.NodeStatusUpdaterImpl: Connecting to >> ResourceManager at /0.0.0.0:8031 >> 13/10/14 12:10:57 INFO ipc.Client: Retrying connect to server: >> 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is >> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) >> 13/10/14 12:10:57 INFO nodemanager.NodeStatusUpdaterImpl: Registered >>with >> ResourceManager as criccomi-mn:61403 with total resource of >><memory:8192, >> vCores:16> >> 13/10/14 12:10:57 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl >>is >> started. >> 13/10/14 12:10:57 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is >>started. >> 13/10/14 12:11:09 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl >>is >> stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: Service:Dispatcher is >> stopped. >> 13/10/14 12:11:09 INFO mortbay.log: Stopped >> [email protected]:8042 >> 13/10/14 12:11:09 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is >> stopped. >> 13/10/14 12:11:09 INFO ipc.Server: Stopping server on 61403 >> 13/10/14 12:11:09 INFO ipc.Server: Stopping IPC Server Responder >> 13/10/14 12:11:09 INFO ipc.Server: Stopping IPC Server listener on 61403 >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghan >>dl >> er.NonAggregatingLogHandler is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: Service:Dispatcher is >> stopped. >> 13/10/14 12:11:09 INFO monitor.ContainersMonitorImpl: >> ResourceCalculatorPlugin is unavailable on this system. >> >>org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Contai >>ne >> rsMonitorImpl is disabled. >> 13/10/14 12:11:09 INFO service.AbstractService: >>Service:containers-monitor >> is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxSer >>vi >> ces is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> Service:containers-launcher is stopped. >> 13/10/14 12:11:09 INFO ipc.Server: Stopping server on 8040 >> 13/10/14 12:11:09 INFO ipc.Server: Stopping IPC Server listener on 8040 >> 13/10/14 12:11:09 INFO ipc.Server: Stopping IPC Server Responder >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService$LocalizerTracker is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.locali >>ze >> r.ResourceLocalizationService is stopped. >> 13/10/14 12:11:09 INFO localizer.ResourceLocalizationService: Public >>cache >> exiting >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.Contai >>ne >> rManagerImpl is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl >> is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService >> is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> >>Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerServic >>e >> is stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is >> stopped. >> 13/10/14 12:11:09 INFO service.AbstractService: >> Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is >>stopped. >> 13/10/14 12:11:09 INFO impl.MetricsSystemImpl: Stopping NodeManager >> metrics system... >> 13/10/14 12:11:09 INFO impl.MetricsSystemImpl: NodeManager metrics >>system >> stopped. >> 13/10/14 12:11:09 INFO impl.MetricsSystemImpl: NodeManager metrics >>system >> shutdown complete. >> 13/10/14 12:11:09 INFO nodemanager.NodeManager: SHUTDOWN_MSG: >> /************************************************************ >> SHUTDOWN_MSG: Shutting down NodeManager at criccomi-mn/172.19.218.230 >> ************************************************************/ >> >> >> Cheers, >> Chris >> >> On 10/15/13 7:16 PM, "Worthy LaFollette" <[email protected]> wrote: >> >> >nm.log: >> >13/10/14 19:22:49 INFO nodemanager.NodeManager: STARTUP_MSG: >> >/************************************************************ >> >STARTUP_MSG: Starting NodeManager >> >STARTUP_MSG: host = Worthys-MacBook-Pro-2.local/10.252.27.133 >> >STARTUP_MSG: args = [] >> >STARTUP_MSG: version = 2.0.5-alpha >> > >> >rm.log: >> >13/10/14 19:22:49 INFO resourcemanager.ResourceManager: STARTUP_MSG: >> >/************************************************************ >> >STARTUP_MSG: Starting ResourceManager >> >STARTUP_MSG: host = Worthys-MacBook-Pro-2.local/10.252.27.133 >> >STARTUP_MSG: args = [] >> >STARTUP_MSG: version = 2.0.5-alpha >> > >> > >> > >> > >> >On Tue, Oct 15, 2013 at 9:34 AM, Chris Riccomini >> ><[email protected]>wrote: >> > >> >> Hey Worthy, >> >> >> >> What do the deploy/yarn/logs/rm.log and deploy/yarn/logs/nm.log files >> >>say? >> >> >> >> I'm a bit stumped. We might have to mail the YARN mailing list for >> >>help. I >> >> ran a clean checkout for hello-samza last night, and fixed one bug >> >>(which >> >> is now up on Github), but I don't believe it's related to your issue. >> >> Other than that one bug, I was able to startup and run successfully >> >> without seeing this problem. >> >> >> >> Cheers, >> >> Chris >> >> >> >> P.S. Bug fix was >> >> >> >> >> >>https://github.com/linkedin/hello-samza/commit/4d35f4e664a3afea75e7a399e6 >> >>5b >> >> 8308cc2ed8a6 >> >> >> >> On 10/14/13 10:36 PM, "Worthy LaFollette" <[email protected]> wrote: >> >> >> >> >I just ran the example as specified, no changes on what otherwise >> >>should >> >> >have been a clean machine (Mac OS - 10.8.5). >> >> > >> >> >1) No >> >> >2) Former - just bin/grid >> >> >3) No >> >> >4) No >> >> > >> >> >Also confirmed that no Network filters were in play to prevent the >> >> >connection. >> >> > >> >> > >> >> >On Mon, Oct 14, 2013 at 8:19 PM, Chris Riccomini >> >> ><[email protected]>wrote: >> >> > >> >> >> Hey Worthy, >> >> >> >> >> >> Hmm. That's exciting. A few questions: >> >> >> >> >> >> 1. Do you have kerberos setup on your machine? Running `klist` >>should >> >> >>give >> >> >> you a list of Kerberos credentials. >> >> >> 2. Are you simply running the bin/grid script, or are you trying >>to >> >>run >> >> >> Samza jobs on a "real" YARN cluster? >> >> >> 3. Did you change the yarn-site.xml configuration at all? >> >> >> 4. Do you have any Hadoop-related environment variables set? ($ >>env | >> >> >>grep >> >> >> HADOOP, $ env | grep YARN). >> >> >> >> >> >> Cheers, >> >> >> Chris >> >> >> ________________________________________ >> >> >> From: Worthy LaFollette [[email protected]] >> >> >> Sent: Monday, October 14, 2013 7:37 PM >> >> >> To: [email protected] >> >> >> Subject: Re: Hello Samza example >> >> >> >> >> >> Rebuilt and it worked... Now getting a different error: >> >> >> >> >> >> Application application_1381794085727_0001 failed 1 times due to >> >>Error >> >> >> launching appattempt_1381794085727_0001_000001. Got exception: >> >> >> java.lang.reflect.UndeclaredThrowableException >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.u >>>>>>nw >> >>>>ra >> >> >>pAndThrowException(YarnRemoteExceptionPBImpl.java:135) >> >> >> >> >> >> at >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagerPBClientImpl.st >> >> >>artContainer(ContainerManagerPBClientImpl.java:109) >> >> >> >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.l >>>>>>au >> >>>>nc >> >> >>h(AMLauncher.java:111) >> >> >> >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.r >>>>>>un >> >>>>(A >> >> >>MLauncher.java:255) >> >> >> >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. >>>>>>ja >> >>>>va >> >> >>:1145) >> >> >> >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor >>>>>>.j >> >>>>av >> >> >>a:615) >> >> >> >> >> >> at java.lang.Thread.run(Thread.java:722) >> >> >> Caused by: com.google.protobuf.ServiceException: >> >> >> java.util.ServiceConfigurationError: >> >> >> org.apache.hadoop.security.SecurityInfo: Error reading >>configuration >> >> >>file >> >> >> at >> >> >> >> >> >> >> >> >> >>>>>>org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEng >>>>>>in >> >>>>e. >> >> >>java:212) >> >> >> >> >> >> at com.sun.proxy.$Proxy72.startContainer(Unknown Source) >> >> >> at >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagerPBClientImpl.st >> >> >>artContainer(ContainerManagerPBClientImpl.java:106) >> >> >> >> >> >> ... 5 more >> >> >> >> >> >> >> >> >> >> >> >> On Mon, Oct 14, 2013 at 5:40 PM, Chris Riccomini >> >> >><[email protected] >> >> >> >wrote: >> >> >> >> >> >> > Hey Worthy, >> >> >> > >> >> >> > This was a bug that I introduced last week. We received a pull >> >> >>request on >> >> >> > the GH repo, which got merged in about 8 hours ago. >> >> >> > >> >> >> > https://github.com/linkedin/hello-samza/pull/5 >> >> >> > >> >> >> > Let me know if it still isn't working (or send a new pull >>request >> >>:). >> >> >> > >> >> >> > Cheers, >> >> >> > Chris >> >> >> > >> >> >> > On 10/14/13 5:24 PM, "Worthy LaFollette" <[email protected]> >> wrote: >> >> >> > >> >> >> > >On a related note - I am getting the following for the >>wikipedia >> >> >>buildt. >> >> >> > >I >> >> >> > >am suspecting I have something misconfigured somewhere.. >> >> >> > > >> >> >> > >****** >> >> >> > > >> >> >> > >ERROR] Failed to execute goal >> >> >> > >org.apache.maven.plugins:maven-compiler-plugin:3.1:compile >> >> >> > >(default-compile) on project samza-wikipedia: Compilation >>failure >> >> >> > >[ERROR] >> >> >> > >> >> >> >> >> >> >>>>>>>/Users/worthylafollette/repos/incubator-samza/hello-samza/samza-wiki >>>>>>>pe >> >>>>>di >> >> >>>a/ >> >> >> > >> >> >> >> >> >> >>>>>>>src/main/java/samza/examples/wikipedia/system/WikipediaSystemAdmin.j >>>>>>>av >> >>>>>a: >> >> >>>[3 >> >> >> > >2,8] >> >> >> > >samza.examples.wikipedia.system.WikipediaSystemAdmin is not >> >>abstract >> >> >>and >> >> >> > >does not override abstract method >> >> >> > >getLastOffsets(java.util.Set<java.lang.String>) in >> >> >> > >org.apache.samza.system.SystemAdmin >> >> >> > >[ERROR] -> [Help 1] >> >> >> > >[ERROR] >> >> >> > >[ERROR] To see the full stack trace of the errors, re-run Maven >> >>with >> >> >>the >> >> >> > >-e >> >> >> > >switch. >> >> >> > >[ERROR] Re-run Maven using the -X switch to enable full debug >> >> >>logging. >> >> >> > >[ERROR] >> >> >> > >[ERROR] For more information about the errors and possible >> >>solutions, >> >> >> > >please read the following articles: >> >> >> > >[ERROR] [Help 1] >> >> >> > > >> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException >> >> >> > >[ERROR] >> >> >> > >[ERROR] After correcting the problems, you can resume the build >> >>with >> >> >>the >> >> >> > >command >> >> >> > >[ERROR] mvn <goals> -rf :samza-wikipedia >> >> >> > > >> >> >> > > >> >> >> > >On Mon, Oct 14, 2013 at 12:15 PM, Jakob Homan >><[email protected]> >> >> >> wrote: >> >> >> > > >> >> >> > >> Can you post exactly what's missing? If it's short, here >>would >> >>be >> >> >> fine. >> >> >> > >> If it's longer, github gists would be good. >> >> >> > >> >> >> >> > >> Thanks, >> >> >> > >> jakob >> >> >> > >> >> >> >> > >> >> >> >> > >> On Mon, Oct 14, 2013 at 11:40 AM, Isabelly Rocha < >> >> >> [email protected] >> >> >> > >> >wrote: >> >> >> > >> >> >> >> > >> > Hey, >> >> >> > >> > >> >> >> > >> > I want to use Samza and I started downloading this "Hello >> >>Sanza" >> >> >> > >>example, >> >> >> > >> > but when I run the grid script I get a lot of file missing >> >>error >> >> >> > >> messages.. >> >> >> > >> > Is it not updated or it's probably me doing something >>wrong? >> >> >> > >> > >> >> >> > >> > Thanks for your attention, >> >> >> > >> > Isabelly Rocha >> >> >> > >> > >> >> >> > >> >> >> >> > >> >> >> > >> >> >> >> >> >> >> >> >>
