[ 
https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439743#comment-15439743
 ] 

Luke Cwik commented on BEAM-592:
--------------------------------

Unless runners shade all their dependencies it will be near impossible to 
maintain having multiple runners included at the same time.

Splitting up the profiles to be per runner for the examples package seems like 
the right thing to do.

> StackOverflowError Failed example/java/WordCount When Using SparkRunner
> -----------------------------------------------------------------------
>
>                 Key: BEAM-592
>                 URL: https://issues.apache.org/jira/browse/BEAM-592
>             Project: Beam
>          Issue Type: Bug
>            Reporter: Mark Liu
>
> WordCount(example/java/WordCount) failed running with sparkRunner in 
> following command:
> {code}
> mvn clean compile exec:java 
> -Dexec.mainClass=org.apache.beam.examples.WordCount 
> -Dexec.args="--inputFile=/tmp/kinglear.txt --runner=SparkRunner 
> --sparkMaster=local --tempLocation=/tmp/out"
> {code}
> Following is part of stacktrace:
> {code}
> Caused by: java.lang.StackOverflowError
>       at 
> java.util.concurrent.CopyOnWriteArrayList.toArray(CopyOnWriteArrayList.java:374)
>       at java.util.logging.Logger.accessCheckedHandlers(Logger.java:1782)
>       at 
> java.util.logging.LogManager$RootLogger.accessCheckedHandlers(LogManager.java:1668)
>       at java.util.logging.Logger.getHandlers(Logger.java:1776)
>       at java.util.logging.Logger.log(Logger.java:735)
>       at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
>       at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
>       at 
> org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
>       at 
> org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
>       at java.util.logging.Logger.log(Logger.java:738)
>       at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
>       at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
>       at 
> org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
>       at 
> org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
> ...
> {code}
> According to [http://slf4j.org/legacy.html#jul-to-slf4j] and in particular 
> section: "jul-to-slf4j.jar and slf4j-jdk14.jar cannot be present 
> simultaneously".
> Change slf4j-jdk14 dependency scope to test solve the above problem, but 
> WordCountIT still failed in same reason. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to