Arthur Vivian created SAMZA-939:
-----------------------------------

             Summary: Job fails to start with StreamAppender when priority is 
set to debug
                 Key: SAMZA-939
                 URL: https://issues.apache.org/jira/browse/SAMZA-939
             Project: Samza
          Issue Type: Bug
          Components: log4j
    Affects Versions: 0.10.0
            Reporter: Arthur Vivian


Issue is as described in SAMZA-723, however now it seems to only happen when 
the priority in the log4j.xml file is set to "debug". I've tested this in 
several of our own jobs and hello-samza the result is that same in all.

log4j.xml used with hello-samza:
{code:xml}
<!DOCTYPE log4j:configuration SYSTEM "log4j.dtd">
<log4j:configuration xmlns:log4j="http://jakarta.apache.org/log4j/";>
  <appender name="jmx" class="org.apache.samza.logging.log4j.JmxAppender" />

  <appender name="RollingAppender" 
class="org.apache.log4j.DailyRollingFileAppender">
     <param name="File" value="${samza.log.dir}/${samza.container.name}.log" />
     <param name="DatePattern" value="'.'yyyy-MM-dd" />
     <layout class="org.apache.log4j.PatternLayout">
      <param name="ConversionPattern" value="%d{yyyy-MM-dd HH:mm:ss} %c{1} [%p] 
%m%n" />
     </layout>
  </appender>
  <appender name="StreamAppender" 
class="org.apache.samza.logging.log4j.StreamAppender">
   <layout class="org.apache.log4j.PatternLayout">
     <param name="ConversionPattern" value="%X{containerName} %X{jobName} 
%X{jobId} %d{yyyy-MM-dd HH:mm:ss} %c{1} [%p] %m%n" />
   </layout>
</appender>
  <root>
    <priority value="debug" />
    <appender-ref ref="RollingAppender"/>
    <appender-ref ref="jmx" />
    <appender-ref ref="StreamAppender"/>
  </root>
</log4j:configuration>
{code}

config used when running WikipediaFeedStreamTask:
{code}
job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
job.name=wikipedia-feed

# YARN
yarn.package.path=file://${basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz

# Task
task.class=samza.examples.wikipedia.task.WikipediaFeedStreamTask
task.inputs=wikipedia.#en.wikipedia,wikipedia.#en.wiktionary,wikipedia.#en.wikinews

task.log4j.system=kafka
# Serializers
serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory

# Wikipedia System
systems.wikipedia.samza.factory=samza.examples.wikipedia.system.WikipediaSystemFactory
systems.wikipedia.host=irc.wikimedia.org
systems.wikipedia.port=6667

# Kafka System
systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory
systems.kafka.samza.msg.serde=json
systems.kafka.consumer.zookeeper.connect=localhost:2181/
systems.kafka.producer.bootstrap.servers=localhost:9092

# Job Coordinator
job.coordinator.system=kafka
job.coordinator.replication.factor=1

{code}

stderr:
java version "1.8.0_72"
Java(TM) SE Runtime Environment (build 1.8.0_72-b15)
Java HotSpot(TM) 64-Bit Server VM (build 25.72-b15, mixed mode)
Exception in thread "main" org.apache.kafka.common.errors.TimeoutException: 
Failed to update metadata after 60000 ms.







--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to