[
https://issues.apache.org/jira/browse/SPARK-25930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-25930:
----------------------------------------
Description:
This line
[https://github.com/apache/spark/blob/c71db43e11fb90d6675421604ad29f596f2b8bfe/resource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh#L32]
detects the scala version based on the line that does not contain character `[`
All lines contain text in brackets besides the scala version:
[WARNING] Failed to retrieve plugin descriptor for
org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin
org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be
resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in
[https://repo.maven.apache.org/maven2] was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced
[INFO]
2.11
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM 3.0.0-SNAPSHOT ............ SUCCESS [ 0.446 s]
[INFO] Spark Project Tags ................................. SKIPPED
[INFO] Spark Project Sketch ............................... SKIPPED
If the plugin is not installed several lines will be added to the output :
[INFO] — maven-help-plugin:2.1.1:evaluate (default-cli) @ spark-parent_2.11 —
Downloading from central:
[https://repo.maven.apache.org/maven2/org/apache/maven/plugin-tools/maven-plugin-tools-api/2.4.3/maven-plugin-tools-api-2.4.3.pom]
This will mess with the logic above and the scala version will be wrong failing
the tests.
We should only pick the last line. Although tests are run now manually, this
should be fixed.
was:
This line
[https://github.com/apache/spark/blob/c71db43e11fb90d6675421604ad29f596f2b8bfe/resource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh#L32]
detects the scala version based on the line that does not contain character `[`
All lines contain text in brackets besides the scala version:
[WARNING] Failed to retrieve plugin descriptor for
org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin
org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be
resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in
https://repo.maven.apache.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced
[INFO]
2.11
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM 3.0.0-SNAPSHOT ............ SUCCESS [ 0.446 s]
[INFO] Spark Project Tags ................................. SKIPPED
[INFO] Spark Project Sketch ............................... SKIPPED
If the plugin is not installed several lines will be added to the output :
[INFO] --- maven-help-plugin:2.1.1:evaluate (default-cli) @ spark-parent_2.11
---
Downloading from central:
[https://repo.maven.apache.org/maven2/org/apache/maven/plugin-tools/maven-plugin-tools-api/2.4.3/maven-plugin-tools-api-2.4.3.pom]
This will mess with the logic above and the scala version will be wrong failing
the tests.
We should only pick the last string. Although tests are run now manually, this
should be fixed.
> Fix scala version string detection when maven-help-plugin is not pre-installed
> ------------------------------------------------------------------------------
>
> Key: SPARK-25930
> URL: https://issues.apache.org/jira/browse/SPARK-25930
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 2.4.0, 3.0.0
> Reporter: Stavros Kontopoulos
> Priority: Minor
>
> This line
> [https://github.com/apache/spark/blob/c71db43e11fb90d6675421604ad29f596f2b8bfe/resource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh#L32]
> detects the scala version based on the line that does not contain character
> `[`
> All lines contain text in brackets besides the scala version:
> [WARNING] Failed to retrieve plugin descriptor for
> org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin
> org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not
> be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in
> [https://repo.maven.apache.org/maven2] was cached in the local repository,
> resolution will not be reattempted until the update interval of central has
> elapsed or updates are forced
> [INFO]
> 2.11
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM 3.0.0-SNAPSHOT ............ SUCCESS [ 0.446
> s]
> [INFO] Spark Project Tags ................................. SKIPPED
> [INFO] Spark Project Sketch ............................... SKIPPED
> If the plugin is not installed several lines will be added to the output :
> [INFO] — maven-help-plugin:2.1.1:evaluate (default-cli) @ spark-parent_2.11 —
> Downloading from central:
> [https://repo.maven.apache.org/maven2/org/apache/maven/plugin-tools/maven-plugin-tools-api/2.4.3/maven-plugin-tools-api-2.4.3.pom]
> This will mess with the logic above and the scala version will be wrong
> failing the tests.
> We should only pick the last line. Although tests are run now manually, this
> should be fixed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
