I think my maven is broken, I used another node in the cluster to compile 2.0.0 and got "successful"
[INFO] [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ java8-tests_2.11 --- [INFO] [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ java8-tests_2.11 --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM ........................... SUCCESS [ 1.972 s] [INFO] Spark Project Tags ................................. SUCCESS [ 3.280 s] [INFO] Spark Project Sketch ............................... SUCCESS [ 5.449 s] [INFO] Spark Project Networking ........................... SUCCESS [ 5.197 s] [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 3.816 s] [INFO] Spark Project Unsafe ............................... SUCCESS [ 8.275 s] [INFO] Spark Project Launcher ............................. SUCCESS [ 5.229 s] [INFO] Spark Project Core ................................. SUCCESS [01:41 min] [INFO] Spark Project GraphX ............................... SUCCESS [ 25.111 s] [INFO] Spark Project Streaming ............................ SUCCESS [ 54.290 s] [INFO] Spark Project Catalyst ............................. SUCCESS [01:15 min] [INFO] Spark Project SQL .................................. SUCCESS [01:55 min] [INFO] Spark Project ML Local Library ..................... SUCCESS [ 16.132 s] [INFO] Spark Project ML Library ........................... SUCCESS [01:32 min] [INFO] Spark Project Tools ................................ SUCCESS [ 5.136 s] [INFO] Spark Project Hive ................................. SUCCESS [ 53.472 s] [INFO] Spark Project REPL ................................. SUCCESS [ 11.716 s] [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [ 4.102 s] [INFO] Spark Project YARN ................................. SUCCESS [ 26.685 s] [INFO] Spark Project Hive Thrift Server ................... SUCCESS [ 23.611 s] [INFO] Spark Project Assembly ............................. SUCCESS [ 1.342 s] [INFO] Spark Project External Flume Sink .................. SUCCESS [ 9.630 s] [INFO] Spark Project External Flume ....................... SUCCESS [ 15.323 s] [INFO] Spark Project External Flume Assembly .............. SUCCESS [ 1.434 s] [INFO] Spark Integration for Kafka 0.8 .................... SUCCESS [ 20.958 s] [INFO] Spark Project Examples ............................. SUCCESS [ 22.080 s] [INFO] Spark Project External Kafka Assembly .............. SUCCESS [ 2.421 s] [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [ 16.255 s] [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [ 2.578 s] [INFO] Spark Project Java 8 Tests ......................... SUCCESS [ 5.573 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 12:16 min [INFO] Finished at: 2016-07-29T15:58:41+08:00 [INFO] Final Memory: 127M/4210M [INFO] ------------------------------------------------------------------------ I tried to reinstall my maven 3.3.9, deleted .m2, still got following error. [ERROR] Plugin org.scalastyle:scalastyle-maven-plugin:0.8.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.scalastyle:scalastyle-maven-plugin:jar:0.8.0: Could not transfer artifact org.scalastyle:scalastyle-maven-plugin:pom:0.8.0 from/to central ( https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException On Fri, Jul 29, 2016 at 1:46 PM, Ascot Moss <ascot.m...@gmail.com> wrote: > I just run > > wget https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom, > can get it without issue. > > On Fri, Jul 29, 2016 at 1:44 PM, Ascot Moss <ascot.m...@gmail.com> wrote: > >> Hi thanks! >> >> mvn dependency:tree >> >> [INFO] Scanning for projects... >> >> Downloading: >> https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom >> >> [ERROR] [ERROR] Some problems were encountered while processing the POMs: >> >> [FATAL] Non-resolvable parent POM for >> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact >> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): >> sun.security.validator.ValidatorException: PKIX path building failed: >> sun.security.provider.certpath.SunCertPathBuilderException: unable to find >> valid certification path to requested target and 'parent.relativePath' >> points at wrong local POM @ line 22, column 11 >> >> @ >> >> [ERROR] The build could not read 1 project -> [Help 1] >> >> [ERROR] >> >> [ERROR] The project org.apache.spark:spark-parent_2.11:2.0.0 >> (/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error >> >> [ERROR] Non-resolvable parent POM for >> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact >> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): >> sun.security.validator.ValidatorException: PKIX path building failed: >> sun.security.provider.certpath.SunCertPathBuilderException: unable to find >> valid certification path to requested target and 'parent.relativePath' >> points at wrong local POM @ line 22, column 11 -> [Help 2] >> >> [ERROR] >> >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> -e switch. >> >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> >> [ERROR] >> >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException >> >> [ERROR] [Help 2] >> http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException >> >> >> >> >> >> >> On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng <mengdong0...@gmail.com> >> wrote: >> >>> Before build, first do a "mvn dependency:tree" to make sure the >>> dependency is right >>> >>> On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss <ascot.m...@gmail.com> >>> wrote: >>> >>>> Thanks for your reply. >>>> >>>> Is there a way to find the correct Hadoop profile name? >>>> >>>> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen <so...@cloudera.com> wrote: >>>> >>>>> You have at least two problems here: wrong Hadoop profile name, and >>>>> some kind of firewall interrupting access to the Maven repo. It's not >>>>> related to Spark. >>>>> >>>>> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss <ascot.m...@gmail.com> >>>>> wrote: >>>>> > Hi, >>>>> > >>>>> > I tried to build spark, >>>>> > >>>>> > (try 1) >>>>> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive >>>>> > -Phive-thriftserver -DskipTests clean package >>>>> > >>>>> > [INFO] Spark Project Parent POM ........................... FAILURE >>>>> [ 0.658 >>>>> > s] >>>>> > >>>>> > [INFO] Spark Project Tags ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Sketch ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Networking ........................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Unsafe ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Launcher ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Core ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project GraphX ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Streaming ............................ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Catalyst ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project SQL .................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project ML Local Library ..................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project ML Library ........................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Tools ................................ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Hive ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project REPL ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project YARN Shuffle Service ................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project YARN ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Hive Thrift Server ................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Assembly ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume Sink .................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume ....................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume Assembly .............. SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.8 .................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Examples ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Kafka Assembly .............. SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Java 8 Tests ......................... SKIPPED >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [INFO] BUILD FAILURE >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [INFO] Total time: 1.090 s >>>>> > >>>>> > [INFO] Finished at: 2016-07-29T07:01:57+08:00 >>>>> > >>>>> > [INFO] Final Memory: 30M/605M >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [WARNING] The requested profile "hadoop-2.7.0" could not be activated >>>>> > because it does not exist. >>>>> > >>>>> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one >>>>> of its >>>>> > dependencies could not be resolved: Failed to read artifact >>>>> descriptor for >>>>> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not >>>>> transfer >>>>> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to >>>>> central >>>>> > (https://repo1.maven.org/maven2): >>>>> sun.security.validator.ValidatorException: >>>>> > PKIX path building failed: >>>>> > sun.security.provider.certpath.SunCertPathBuilderException: unable >>>>> to find >>>>> > valid certification path to requested target -> [Help 1] >>>>> > >>>>> > [ERROR] >>>>> > >>>>> > [ERROR] To see the full stack trace of the errors, re-run Maven with >>>>> the -e >>>>> > switch. >>>>> > >>>>> > [ERROR] Re-run Maven using the -X switch to enable full debug >>>>> logging. >>>>> > >>>>> > [ERROR] >>>>> > >>>>> > [ERROR] For more information about the errors and possible >>>>> solutions, please >>>>> > read the following articles: >>>>> > >>>>> > [ERROR] [Help 1] >>>>> > >>>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException >>>>> > >>>>> > >>>>> > (try 2) >>>>> > >>>>> > ./build/mvn -DskipTests clean package >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [INFO] Reactor Summary: >>>>> > >>>>> > [INFO] >>>>> > >>>>> > [INFO] Spark Project Parent POM ........................... FAILURE >>>>> [ 0.653 >>>>> > s] >>>>> > >>>>> > [INFO] Spark Project Tags ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Sketch ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Networking ........................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Unsafe ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Launcher ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Core ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project GraphX ............................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Streaming ............................ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Catalyst ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project SQL .................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project ML Local Library ..................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project ML Library ........................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Tools ................................ SKIPPED >>>>> > >>>>> > [INFO] Spark Project Hive ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project REPL ................................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project Assembly ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume Sink .................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume ....................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Flume Assembly .............. SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.8 .................... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Examples ............................. SKIPPED >>>>> > >>>>> > [INFO] Spark Project External Kafka Assembly .............. SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED >>>>> > >>>>> > [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED >>>>> > >>>>> > [INFO] Spark Project Java 8 Tests ......................... SKIPPED >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [INFO] BUILD FAILURE >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [INFO] Total time: 1.067 s >>>>> > >>>>> > [INFO] Finished at: 2016-07-29T07:02:52+08:00 >>>>> > >>>>> > [INFO] Final Memory: 29M/605M >>>>> > >>>>> > [INFO] >>>>> > >>>>> ------------------------------------------------------------------------ >>>>> > >>>>> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one >>>>> of its >>>>> > dependencies could not be resolved: Failed to read artifact >>>>> descriptor for >>>>> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not >>>>> transfer >>>>> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to >>>>> central >>>>> > (https://repo1.maven.org/maven2): >>>>> sun.security.validator.ValidatorException: >>>>> > PKIX path building failed: >>>>> > sun.security.provider.certpath.SunCertPathBuilderException: unable >>>>> to find >>>>> > valid certification path to requested target -> [Help 1] >>>>> > >>>>> > [ERROR] >>>>> > >>>>> > [ERROR] To see the full stack trace of the errors, re-run Maven with >>>>> the -e >>>>> > switch. >>>>> > >>>>> > [ERROR] Re-run Maven using the -X switch to enable full debug >>>>> logging. >>>>> > >>>>> > [ERROR] >>>>> > >>>>> > [ERROR] For more information about the errors and possible >>>>> solutions, please >>>>> > read the following articles: >>>>> > >>>>> > [ERROR] [Help 1] >>>>> > >>>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException >>>>> > >>>>> > >>>>> > Any idea? What would be the build command for 2.0 now? >>>>> > >>>>> > >>>>> > Regards >>>>> > >>>>> > >>>>> > >>>>> > >>>>> >>>> >>>> >>> >> >
