I am trying to incorporate akka http to spark. when submitting job with command
spark-submit --class example.MyHttp /path/to/target/scala-2.11/my-assembly-0.1.jar it throws exceptions "Could not resolve substitution to a value: ${akka.stream.blocking-io-dispatcher}" Exception in thread "main" com.typesafe.config.ConfigException$UnresolvedSubstitution: reference.conf @ jar:file:/path/to/project/target/scala-2.11/my-assembly-0.1.jar!/reference.conf: 42: Could not resolve substitution to a value: ${akka.stream.blocking-io-dispatcher} at com.typesafe.config.impl.ConfigReference.resolveSubstitutions(ConfigReference.java:108) at com.typesafe.config.impl.ResolveContext.realResolve(ResolveContext.java:179) at com.typesafe.config.impl.ResolveContext.resolve(ResolveContext.java:142) at com.typesafe.config.impl.SimpleConfigObject$ResolveModifier.modifyChildMayThrow(SimpleConfigObject.java:379) at com.typesafe.config.impl.SimpleConfigObject.modifyMayThrow(SimpleConfigObject.java:312) at com.typesafe.config.impl.SimpleConfigObject.resolveSubstitutions(SimpleConfigObject.java:398) at com.typesafe.config.impl.ResolveContext.realResolve(ResolveContext.java:179) at com.typesafe.config.impl.ResolveContext.resolve(ResolveContext.java:142) at com.typesafe.config.impl.SimpleConfigObject$ResolveModifier.modifyChildMayThrow(SimpleConfigObject.java:379) at com.typesafe.config.impl.SimpleConfigObject.modifyMayThrow(SimpleConfigObject.java:312) After googling a bit, it seems to be the problem when merging multiple reference.conf files. But I don't find a solution for this problem. My sbt looks below scalaVersion := "2.11.8" libraryDependencies ++= Seq( "com.typesafe.akka" %% "akka-http" % "10.0.6", "com.typesafe.akka" %% "akka-http-xml" % "10.0.6", "org.apache.spark" %% "spark-streaming" % "2.1.0" % "provided", "com.typesafe" % "config" % "1.3.1", "org.scalatest" %% "scalatest" % "2.2.6" % "test" ) assemblyMergeStrategy in assembly := { case PathList("META-INF", xs @ _*) => MergeStrategy.discard case x => MergeStrategy.first } How can I fix it? I appreciate any suggestions. Thanks -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.