shanyu zhao created SPARK-25999:
-----------------------------------
Summary: Spark make-distribution failure with --r and
-Phadoop-provided
Key: SPARK-25999
URL: https://issues.apache.org/jira/browse/SPARK-25999
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 2.4.0, 2.3.2
Reporter: shanyu zhao
It is not possible to build a distribution that doesn't contain hadoop
dependencies but include SparkR. This is because R/check_cran.sh builds R
document which depends on hadoop dependencies in assembly/target/scala-xxx/jars
folder.
To reproduce:
MAVEN_BUILD_OPTS="-Dmaven.javadoc.skip=true -Pyarn -Phadoop-2.7 -Phive -Psparkr
-Phadoop-provided"
./dev/make-distribution.sh --tgz --r $MAVEN_BUILD_OPTS
Error:
* creating vignettes ... ERROR
...
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/Logger
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
