Re: Build zeppelin 0.8 with spark 2.3
You don't need to build with spark 2.3 to make zeppelin support spark 2.3. Starting from branch-0.8, you can build zeppelin without specifying any spark profile and it would support all versions of spark. mvn clean package -DskipTests Felix Cheung 于2018年3月20日周二 上午12:50写道: > Are you running with branch-0.8? I think there is a recent change in > master for this. > > > From: Felix Cheung > Sent: Monday, March 19, 2018 9:49:10 AM > To: dev@zeppelin.apache.org; dev@zeppelin.apache.org > Subject: Re: Build zeppelin 0.8 with spark 2.3 > > Spark 2.3 does not support Scala 2.10. There should be a script to switch > Zeppelin to build for Scala 2.11 only... > > > From: Xiaohui Liu > Sent: Sunday, March 18, 2018 9:20:13 PM > To: dev@zeppelin.apache.org > Subject: Build zeppelin 0.8 with spark 2.3 > > Hi, > > I am building zep 0.8 with Spark 2.3. > > >> ./dev/change_scala_version.sh 2.11 > > >> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests > > But it fails with the following error: > > [ERROR] Failed to execute goal on project spark-scala-2.10: Could not > resolve dependencies for project > org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following > artifacts could not be resolve > d: org.apache.spark:spark-repl_2.10:jar:2.3.0, > org.apache.spark:spark-core_2.10:jar:2.3.0, > org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find > org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/ > /repo.maven.apache.org/maven2 was cached in the local repository, > resolution will not be reattempted until the update interval of central has > elapsed or updates are forced -> [Help 1] > > > This is because that there is no scala_2.10 build for spark-core version > 2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core). > > Any suggestion to mitigate this problem? > > Regards >
Re: Build zeppelin 0.8 with spark 2.3
Are you running with branch-0.8? I think there is a recent change in master for this. From: Felix Cheung Sent: Monday, March 19, 2018 9:49:10 AM To: dev@zeppelin.apache.org; dev@zeppelin.apache.org Subject: Re: Build zeppelin 0.8 with spark 2.3 Spark 2.3 does not support Scala 2.10. There should be a script to switch Zeppelin to build for Scala 2.11 only... From: Xiaohui Liu Sent: Sunday, March 18, 2018 9:20:13 PM To: dev@zeppelin.apache.org Subject: Build zeppelin 0.8 with spark 2.3 Hi, I am building zep 0.8 with Spark 2.3. >> ./dev/change_scala_version.sh 2.11 >> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests But it fails with the following error: [ERROR] Failed to execute goal on project spark-scala-2.10: Could not resolve dependencies for project org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following artifacts could not be resolve d: org.apache.spark:spark-repl_2.10:jar:2.3.0, org.apache.spark:spark-core_2.10:jar:2.3.0, org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/ /repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] This is because that there is no scala_2.10 build for spark-core version 2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core). Any suggestion to mitigate this problem? Regards
Re: Build zeppelin 0.8 with spark 2.3
Spark 2.3 does not support Scala 2.10. There should be a script to switch Zeppelin to build for Scala 2.11 only... From: Xiaohui Liu Sent: Sunday, March 18, 2018 9:20:13 PM To: dev@zeppelin.apache.org Subject: Build zeppelin 0.8 with spark 2.3 Hi, I am building zep 0.8 with Spark 2.3. >> ./dev/change_scala_version.sh 2.11 >> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests But it fails with the following error: [ERROR] Failed to execute goal on project spark-scala-2.10: Could not resolve dependencies for project org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following artifacts could not be resolve d: org.apache.spark:spark-repl_2.10:jar:2.3.0, org.apache.spark:spark-core_2.10:jar:2.3.0, org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/ /repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] This is because that there is no scala_2.10 build for spark-core version 2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core). Any suggestion to mitigate this problem? Regards
Build zeppelin 0.8 with spark 2.3
Hi, I am building zep 0.8 with Spark 2.3. >> ./dev/change_scala_version.sh 2.11 >> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests But it fails with the following error: [ERROR] Failed to execute goal on project spark-scala-2.10: Could not resolve dependencies for project org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following artifacts could not be resolve d: org.apache.spark:spark-repl_2.10:jar:2.3.0, org.apache.spark:spark-core_2.10:jar:2.3.0, org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/ /repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] This is because that there is no scala_2.10 build for spark-core version 2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core). Any suggestion to mitigate this problem? Regards