Re: Required file not found in building
Thanks Sean, I followed suit (brew install zinc) and that is working. 2014-12-01 22:39 GMT-08:00 Sean Owen so...@cloudera.com: I'm having no problems with the build or zinc on my Mac. I use zinc from brew install zinc. On Tue, Dec 2, 2014 at 3:02 AM, Stephen Boesch java...@gmail.com wrote: Mac as well. Just found the problem: I had created an alias to zinc a couple of months back. Apparently that is not happy with the build anymore. No problem now that the issue has been isolated - just need to fix my zinc alias. 2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com: I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Required file not found in building
It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
Mac as well. Just found the problem: I had created an alias to zinc a couple of months back. Apparently that is not happy with the build anymore. No problem now that the issue has been isolated - just need to fix my zinc alias. 2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com: I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
The zinc src zip for 0.3.5.3 was downloaded and exploded. Then I ran sbt dist/create . zinc is being launched from dist/target/zinc-0.3.5.3/bin/zinc 2014-12-01 20:12 GMT-08:00 Ted Yu yuzhih...@gmail.com: I use zinc 0.2.0 and started zinc with the same command shown below. I don't observe such error. How did you install zinc-0.3.5.3 ? Cheers On Mon, Dec 1, 2014 at 8:00 PM, Stephen Boesch java...@gmail.com wrote: Anyone maybe can assist on how to run zinc with the latest maven build? I am starting zinc as follows: /shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home $SCALA_HOME -nailed -start The pertinent env vars are: 19:58:11/lib $echo $SCALA_HOME /shared/scala 19:58:14/lib $which scala /shared/scala/bin/scala 19:58:16/lib $scala -version Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL When I do *not *start zinc then the maven build works .. but v slowly since no incremental compiler available. When zinc is started as shown above then the error occurs on all of the modules except parent: [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) [error] Required file not found: scala-compiler-2.10.4.jar [error] See zinc -help for information about locating necessary files 2014-12-01 19:02 GMT-08:00 Stephen Boesch java...@gmail.com: Mac as well. Just found the problem: I had created an alias to zinc a couple of months back. Apparently that is not happy with the build anymore. No problem now that the issue has been isolated - just need to fix my zinc alias. 2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com: I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
I used the following for brew: http://repo.typesafe.com/typesafe/zinc/com/typesafe/zinc/dist/0.3.0/zinc-0.3.0.tgz After starting zinc, I issued the same mvn command but didn't encounter the error you saw. FYI On Mon, Dec 1, 2014 at 8:18 PM, Stephen Boesch java...@gmail.com wrote: The zinc src zip for 0.3.5.3 was downloaded and exploded. Then I ran sbt dist/create . zinc is being launched from dist/target/zinc-0.3.5.3/bin/zinc 2014-12-01 20:12 GMT-08:00 Ted Yu yuzhih...@gmail.com: I use zinc 0.2.0 and started zinc with the same command shown below. I don't observe such error. How did you install zinc-0.3.5.3 ? Cheers On Mon, Dec 1, 2014 at 8:00 PM, Stephen Boesch java...@gmail.com wrote: Anyone maybe can assist on how to run zinc with the latest maven build? I am starting zinc as follows: /shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home $SCALA_HOME -nailed -start The pertinent env vars are: 19:58:11/lib $echo $SCALA_HOME /shared/scala 19:58:14/lib $which scala /shared/scala/bin/scala 19:58:16/lib $scala -version Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL When I do *not *start zinc then the maven build works .. but v slowly since no incremental compiler available. When zinc is started as shown above then the error occurs on all of the modules except parent: [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) [error] Required file not found: scala-compiler-2.10.4.jar [error] See zinc -help for information about locating necessary files 2014-12-01 19:02 GMT-08:00 Stephen Boesch java...@gmail.com: Mac as well. Just found the problem: I had created an alias to zinc a couple of months back. Apparently that is not happy with the build anymore. No problem now that the issue has been isolated - just need to fix my zinc alias. 2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com: I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
I'm having no problems with the build or zinc on my Mac. I use zinc from brew install zinc. On Tue, Dec 2, 2014 at 3:02 AM, Stephen Boesch java...@gmail.com wrote: Mac as well. Just found the problem: I had created an alias to zinc a couple of months back. Apparently that is not happy with the build anymore. No problem now that the issue has been isolated - just need to fix my zinc alias. 2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com: I tried the same command on MacBook and didn't experience the same error. Which OS are you using ? Cheers On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote: It seems there were some additional settings required to build spark now . This should be a snap for most of you ot there about what I am missing. Here is the command line I have traditionally used: mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests That command line is however failing with the lastest from HEAD: INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 --- [INFO] Using zinc server for incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) *[error] Required file not found: scala-compiler-2.10.4.jar* *[error] See zinc -help for information about locating necessary files* [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .. SUCCESS [4.077s] [INFO] Spark Project Networking .. FAILURE [0.445s] OK let's try zinc -help: 18:38:00/spark2 $*zinc -help* Nailgun server running with 1 cached compiler Version = 0.3.5.1 Zinc compiler cache limit = 5 Resident scalac cache limit = 0 Analysis cache limit = 5 Compiler(Scala 2.10.4) [74ff364f] Setup = { * scala compiler = /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar* scala library = /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar scala extra = { /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar /shared/zinc-0.3.5.1/lib/scala-reflect.jar } sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar compiler interface sources = /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar java home = fork java = false cache directory = /Users/steve/.zinc/0.3.5.1 } Does that compiler jar exist? Yes! 18:39:34/spark2 $ll /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar -rw-r--r-- 1 steve staff 14445780 Apr 9 2014 /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org