This is the version of Kafka Spark depends on:
[INFO] +- org.apache.kafka:kafka_2.10:jar:0.8.2.1:compile
On Thu, Apr 7, 2016 at 9:14 AM, Haroon Rasheed <rasheed.s...@gmail.com>
wrote:
> Try removing libraryDependencies += "org.apache.kafka" %% "kafka" % "1.6.0"
> compile. I guess the internal dependencies are automatically pulled when
> you add spark-streaming-kafka_2.10.
>
> Also try changing the version to 1.6.1 or lower. Just to see if the links
> are broken.
>
> Regards,
> Haroon Syed
>
> On 7 April 2016 at 09:08, Sudhanshu Janghel <
> sudhanshu.jang...@cloudwick.com> wrote:
>
>> Hello,
>>
>> I am new to building kafka and wish to understand how to make fat jars in
>> intellij.
>> The sbt assembly seems confusing and I am unable to resolve the
>> dependencies.
>>
>> here is my build.sbt
>>
>> name := "twitter"
>>
>> version := "1.0"
>> scalaVersion := "2.10.4"
>>
>>
>>
>> //libraryDependencies += "org.slf4j" % "slf4j-api" % "1.7.7" % "provided"
>> //libraryDependencies += "org.slf4j" % "slf4j-log4j12" % "1.7.7" % "provided"
>> //libraryDependencies += "com.google.guava" % "guava" % "11.0.2"
>> exclude("log4j", "log4j") exclude("org.slf4j","slf4j-log4j12")
>> exclude("org.slf4j","slf4j-api")
>> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "1.6.0"
>> libraryDependencies += "org.apache.kafka" %% "kafka" % "1.6.0"
>> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka_2.10" %
>> "1.6.0"
>>
>>
>>
>> adn here is my assembly.sbt
>>
>> addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.3")
>>
>>
>> the error faced is
>>
>> Error:Error while importing SBT project:<br/>...<br/><pre>[info] Resolving
>> org.scala-sbt#tracking;0.13.8 ...
>> [info] Resolving org.scala-sbt#cache;0.13.8 ...
>> [info] Resolving org.scala-sbt#testing;0.13.8 ...
>> [info] Resolving org.scala-sbt#test-agent;0.13.8 ...
>> [info] Resolving org.scala-sbt#test-interface;1.0 ...
>> [info] Resolving org.scala-sbt#main-settings;0.13.8 ...
>> [info] Resolving org.scala-sbt#apply-macro;0.13.8 ...
>> [info] Resolving org.scala-sbt#command;0.13.8 ...
>> [info] Resolving org.scala-sbt#logic;0.13.8 ...
>> [info] Resolving org.scala-sbt#precompiled-2_8_2;0.13.8 ...
>> [info] Resolving org.scala-sbt#precompiled-2_9_2;0.13.8 ...
>> [info] Resolving org.scala-sbt#precompiled-2_9_3;0.13.8 ...
>> [trace] Stack trace suppressed: run 'last *:update' for the full output.
>> [trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for the
>> full output.
>> [error] (*:update) sbt.ResolveException: unresolved dependency:
>> com.eed3si9n#sbt-assembly;0.14.3: not found
>> [error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
>> [error] (*:ssExtractDependencies) sbt.ResolveException: unresolved
>> dependency: com.eed3si9n#sbt-assembly;0.14.3: not found
>> [error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
>> [error] Total time: 18 s, completed Apr 7, 2016 5:05:06 PM
>>
>>
>>
>>
>
