Dongjoon Hyun created SPARK-27550:
-------------------------------------
Summary: Fix `test-dependencies.sh` not to use `kafka-0-8` profile
for Scala-2.12
Key: SPARK-27550
URL: https://issues.apache.org/jira/browse/SPARK-27550
Project: Spark
Issue Type: Task
Components: Tests
Affects Versions: 2.4.3
Reporter: Dongjoon Hyun
Kakfa 0.8 doesn't have Scala-2.12 artifacts, e.g.,
`org.apache.kafka:kafka_2.12:jar:0.8.2.1`. This issue aims to fix
`test-dependencies.sh` script to understand Scala binary version.
{code}
$ dev/change-scala-version.sh 2.12
$ dev/test-dependencies.sh
Using `mvn` from path: /usr/local/bin/mvn
Using `mvn` from path: /usr/local/bin/mvn
Performing Maven install for hadoop-2.6
Using `mvn` from path: /usr/local/bin/mvn
[ERROR] Failed to execute goal on project spark-streaming-kafka-0-8_2.12: Could
not resolve dependencies for project
org.apache.spark:spark-streaming-kafka-0-8_2.12:jar:spark-335572: Could not
find artifact org.apache.kafka:kafka_2.12:jar:0.8.2.1 in central
(https://repo.maven.apache.org/maven2) -> [Help 1]
{code}
Please note that this issue doesn't aim to update `spark-deps-hadoop-2.6`
manifest here.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
