I run into errors while trying to build Spark from the 1.4 release branch: https://github.com/apache/spark/tree/branch-1.4. Any help will be much appreciated. Here is the log file from my windows 8.1 PC. (F.Y.I, I installed all the dependencies like Java 7, Maven 3.2.5 and set the environment variables)
C:\Program Files\Apache Software Foundation\spark-branch-1.4>mvn -Psparkr -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package [INFO] Scanning for projects... [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] Spark Project Parent POM [INFO] Spark Launcher Project [INFO] Spark Project Networking [INFO] Spark Project Shuffle Streaming Service [INFO] Spark Project Unsafe [INFO] Spark Project Core [INFO] Spark Project Bagel [INFO] Spark Project GraphX [INFO] Spark Project Streaming [INFO] Spark Project Catalyst [INFO] Spark Project SQL [INFO] Spark Project ML Library [INFO] Spark Project Tools [INFO] Spark Project Hive [INFO] Spark Project REPL [INFO] Spark Project YARN [INFO] Spark Project Assembly [INFO] Spark Project External Twitter [INFO] Spark Project External Flume Sink [INFO] Spark Project External Flume [INFO] Spark Project External MQTT [INFO] Spark Project External ZeroMQ [INFO] Spark Project External Kafka [INFO] Spark Project Examples [INFO] Spark Project External Kafka Assembly [INFO] Spark Project YARN Shuffle Service [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spark Project Parent POM 1.4.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ spark-parent_2.10 -- - [INFO] [INFO] --- maven-enforcer-plugin:1.4:enforce (enforce-versions) @ spark -parent_2 .10 --- [INFO] [INFO] --- scala-maven-plugin:3.2.0:add-source (eclipse-add-source) @ spark -pare nt_2.10 --- [INFO] Add Source directory: C:\Program Files\Apache Software Foundation\ spark-b ranch-1.4\src\main\scala [INFO] Add Test Source directory: C:\Program Files\Apache Software Foundation\sp ark-branch-1.4\src\test\scala [INFO] [INFO] --- build-helper-maven-plugin:1.9.1:add-source (add-scala-sources) @ spar k-parent_2.10 --- [INFO] Source directory: C:\Program Files\Apache Software Foundation\spark -branc h-1.4\src\main\scala added. [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark -parent_2. 10 --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM ........................... FAILURE [ 23.528 s] [INFO] Spark Launcher Project ............................. SKIPPED [INFO] Spark Project Networking ........................... SKIPPED [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED [INFO] Spark Project Unsafe ............................... SKIPPED [INFO] Spark Project Core ................................. SKIPPED [INFO] Spark Project Bagel ................................ SKIPPED [INFO] Spark Project GraphX ............................... SKIPPED [INFO] Spark Project Streaming ............................ SKIPPED [INFO] Spark Project Catalyst ............................. SKIPPED [INFO] Spark Project SQL .................................. SKIPPED [INFO] Spark Project ML Library ........................... SKIPPED [INFO] Spark Project Tools ................................ SKIPPED [INFO] Spark Project Hive ................................. SKIPPED [INFO] Spark Project REPL ................................. SKIPPED [INFO] Spark Project YARN ................................. SKIPPED [INFO] Spark Project Assembly ............................. SKIPPED [INFO] Spark Project External Twitter ..................... SKIPPED [INFO] Spark Project External Flume Sink .................. SKIPPED [INFO] Spark Project External Flume ....................... SKIPPED [INFO] Spark Project External MQTT ........................ SKIPPED [INFO] Spark Project External ZeroMQ ...................... SKIPPED [INFO] Spark Project External Kafka ....................... SKIPPED [INFO] Spark Project Examples ............................. SKIPPED [INFO] Spark Project External Kafka Assembly .............. SKIPPED [INFO] Spark Project YARN Shuffle Service ................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 24.680 s [INFO] Finished at: 2015-06-03T02:11:35-07:00 [INFO] Final Memory: 27M/224M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-p lugin:1.5:process (default) on project spark-parent_2.10: Error finding remote r esources manifests: C:\Program Files\Apache Software Foundation\spark -branch-1.4 \target\maven-shared-archive-resources\META-INF\NOTICE (The system cannot find t he path specified) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e swit ch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please rea d the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionE xception C:\Program Files\Apache Software Foundation\spark-branch-1.4> On Tue, Jun 2, 2015 at 7:17 PM, Shivaram Venkataraman < shivaram.venkatara...@gmail.com> wrote: > No worries - Also cc'ing user@spark.apache.org might get faster responses > ! > > Shivaram > > On Tue, Jun 2, 2015 at 6:05 PM, Daniel Emaasit <daniel.emaa...@gmail.com> > wrote: > >> Oops, My bad. I was building from the wrong Directory. >> >> >> On Tue, Jun 2, 2015 at 5:57 PM, Daniel Emaasit <daniel.emaa...@gmail.com> >> wrote: >> >>> Hello Shivaram, >>> While I was able to build Spark 1.3.0. I am getting errors building >>> Spark 1.4.0. I was trying to build from the 1.4 branch from >>> https://github.com/apache/spark/tree/branch-1.4 >>> Here is the log file. >>> >>> C:\Program Files\Apache Software Foundation\spark-branch-1.4>cd build >>> >>> C:\Program Files\Apache Software Foundation\spark-branch-1.4\build>ls >>> mvn sbt sbt-launch-lib.bash >>> >>> C:\Program Files\Apache Software Foundation\spark-branch-1.4\build>mvn >>> -Psparkr >>> -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package >>> [INFO] Scanning for projects... >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] BUILD FAILURE >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Total time: 0.469 s >>> [INFO] Finished at: 2015-06-02T17:47:28-07:00 >>> [INFO] Final Memory: 4M/121M >>> [INFO] >>> ------------------------------------------------------------------------ >>> [WARNING] The requested profile "sparkr" could not be activated because >>> it does >>> not exist. >>> [WARNING] The requested profile "yarn" could not be activated because it >>> does no >>> t exist. >>> [WARNING] The requested profile "hadoop-2.4" could not be activated >>> because it d >>> oes not exist. >>> [ERROR] The goal you specified requires a project to execute but there >>> is no POM >>> in this directory (C:\Program Files\Apache Software >>> Foundation\spark-branch-1.4 >>> \build). Please verify you invoked Maven from the correct directory. -> >>> [Help 1] >>> >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with the >>> -e swit >>> ch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, >>> please rea >>> d the following articles: >>> [ERROR] [Help 1] >>> http://cwiki.apache.org/confluence/display/MAVEN/MissingProject >>> Exception >>> C:\Program Files\Apache Software Foundation\spark-branch-1.4\build> >>> >>> -- >>> Daniel Emaasit >>> Ph.D. Research Assistant >>> Transportation Research Center (TRC) >>> University of Nevada, Las Vegas >>> Las Vegas, NV 89154-4015 >>> Cell: 615-649-2489 >>> www.danielemaasit.com <http://www.danielemaasit.com/> >>> >>> >>> >>> >> >> >> -- >> Daniel Emaasit >> Ph.D. Research Assistant >> Transportation Research Center (TRC) >> University of Nevada, Las Vegas >> Las Vegas, NV 89154-4015 >> Cell: 615-649-2489 >> www.danielemaasit.com <http://www.danielemaasit.com/> >> >> >> >> > -- Daniel Emaasit Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com <http://www.danielemaasit.com/>
