I deleted my $HOME/.m2 before and was able to build Impala. I can't access that URL either. Impala uses few Maven repositories, so if it can't find the dependencies it needs from one repository, it will use the next one.
[INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building YARN Extras 0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading from impala.cdh.repo: https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom Downloading from cdh.rcs.releases.repo: https://repository.cloudera.com/content/groups/cdh-releases-rcs/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom Downloaded from cdh.rcs.releases.repo: https://repository.cloudera.com/content/groups/cdh-releases-rcs/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom (1.2 kB at 9.2 kB/s) Something weird that your yarn-extras requires jackson-mapper 1.9.13 and not 1.9.2. I ran mvn dependency:tree on yarn-extras and got the following output. [INFO] org.apache.impala:yarn-extras:jar:0.1-SNAPSHOT [INFO] +- net.minidev:json-smart:jar:2.3:compile [INFO] | \- net.minidev:accessors-smart:jar:1.2:compile [INFO] | \- org.ow2.asm:asm:jar:5.0.4:compile [INFO] +- org.apache.hadoop:hadoop-common:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] | +- org.apache.hadoop:hadoop-annotations:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] | | \- jdk.tools:jdk.tools:jar:1.8:system [INFO] | +- com.google.guava:guava:jar:11.0.2:compile [INFO] | +- commons-cli:commons-cli:jar:1.2:compile [INFO] | +- org.apache.commons:commons-math3:jar:3.1.1:compile [INFO] | +- org.apache.httpcomponents:httpclient:jar:4.5.3:compile [INFO] | | \- org.apache.httpcomponents:httpcore:jar:4.4.6:compile [INFO] | +- commons-codec:commons-codec:jar:1.4:compile [INFO] | +- commons-io:commons-io:jar:2.6:compile [INFO] | +- commons-net:commons-net:jar:3.1:compile [INFO] | +- commons-collections:commons-collections:jar:3.2.2:compile [INFO] | +- javax.servlet:javax.servlet-api:jar:3.1.0:compile [INFO] | +- org.eclipse.jetty:jetty-server:jar:9.3.20.v20170531:compile [INFO] | | +- org.eclipse.jetty:jetty-http:jar:9.3.20.v20170531:compile [INFO] | | \- org.eclipse.jetty:jetty-io:jar:9.3.20.v20170531:compile [INFO] | +- org.eclipse.jetty:jetty-util:jar:9.3.20.v20170531:compile [INFO] | +- org.eclipse.jetty:jetty-servlet:jar:9.3.20.v20170531:compile [INFO] | | \- org.eclipse.jetty:jetty-security:jar:9.3.20.v20170531:compile [INFO] | +- org.eclipse.jetty:jetty-webapp:jar:9.3.20.v20170531:compile [INFO] | | \- org.eclipse.jetty:jetty-xml:jar:9.3.20.v20170531:compile [INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:runtime [INFO] | +- com.sun.jersey:jersey-core:jar:1.19:compile [INFO] | | \- javax.ws.rs:jsr311-api:jar:1.1.1:compile [INFO] | +- com.sun.jersey:jersey-servlet:jar:1.19:compile [INFO] | +- com.sun.jersey:jersey-json:jar:1.19:compile [INFO] | | +- org.codehaus.jettison:jettison:jar:1.1:compile [INFO] | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile [INFO] | | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.2:compile [INFO] | | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.2:compile [INFO] | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.2:compile [INFO] | | \- org.codehaus.jackson:jackson-xc:jar:1.9.2:compile [INFO] | +- com.sun.jersey:jersey-server:jar:1.19:compile [INFO] | +- commons-logging:commons-logging:jar:1.1.3:compile [INFO] | +- log4j:log4j:jar:1.2.17:compile [INFO] | +- commons-lang:commons-lang:jar:2.6:compile [INFO] | +- commons-beanutils:commons-beanutils:jar:1.9.3:compile [INFO] | +- org.apache.commons:commons-configuration2:jar:2.1.1:compile [INFO] | +- org.apache.commons:commons-lang3:jar:3.7:compile [INFO] | +- org.slf4j:slf4j-api:jar:1.7.25:compile [INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.25:compile [INFO] | +- org.apache.avro:avro:jar:1.8.2-cdh6.x-SNAPSHOT:compile [INFO] | | +- com.thoughtworks.paranamer:paranamer:jar:2.8:compile [INFO] | | +- org.xerial.snappy:snappy-java:jar:1.1.4:compile [INFO] | | \- org.tukaani:xz:jar:1.6:compile [INFO] | +- com.google.re2j:re2j:jar:1.1:compile [INFO] | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile [INFO] | +- com.google.code.gson:gson:jar:2.2.4:compile [INFO] | +- org.apache.hadoop:hadoop-auth:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] | | +- com.nimbusds:nimbus-jose-jwt:jar:4.41.1:compile [INFO] | | | \- com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile [INFO] | | \- org.apache.curator:curator-framework:jar:2.12.0:compile [INFO] | +- com.jcraft:jsch:jar:0.1.54:compile [INFO] | +- org.apache.curator:curator-client:jar:2.12.0:compile [INFO] | +- org.apache.curator:curator-recipes:jar:2.12.0:compile [INFO] | +- com.google.code.findbugs:jsr305:jar:3.0.0:compile [INFO] | +- org.apache.htrace:htrace-core4:jar:4.1.0-incubating:compile [INFO] | +- org.apache.zookeeper:zookeeper:jar:3.4.5-cdh6.x-SNAPSHOT:compile [INFO] | | +- jline:jline:jar:2.12:compile [INFO] | | +- io.netty:netty:jar:3.10.5.Final:compile [INFO] | | \- org.apache.yetus:audience-annotations:jar:0.5.0:compile [INFO] | +- org.apache.commons:commons-compress:jar:1.4.1:compile [INFO] | +- org.apache.kerby:kerb-simplekdc:jar:1.0.0:compile [INFO] | | +- org.apache.kerby:kerb-client:jar:1.0.0:compile [INFO] | | | +- org.apache.kerby:kerby-config:jar:1.0.0:compile [INFO] | | | +- org.apache.kerby:kerb-core:jar:1.0.0:compile [INFO] | | | | \- org.apache.kerby:kerby-pkix:jar:1.0.0:compile [INFO] | | | | +- org.apache.kerby:kerby-asn1:jar:1.0.0:compile [INFO] | | | | \- org.apache.kerby:kerby-util:jar:1.0.0:compile [INFO] | | | +- org.apache.kerby:kerb-common:jar:1.0.0:compile [INFO] | | | | \- org.apache.kerby:kerb-crypto:jar:1.0.0:compile [INFO] | | | \- org.apache.kerby:kerb-util:jar:1.0.0:compile [INFO] | | \- org.apache.kerby:kerb-admin:jar:1.0.0:compile [INFO] | | +- org.apache.kerby:kerb-server:jar:1.0.0:compile [INFO] | | | \- org.apache.kerby:kerb-identity:jar:1.0.0:compile [INFO] | | \- org.apache.kerby:kerby-xdr:jar:1.0.0:compile [INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.9.5:compile [INFO] | +- org.codehaus.woodstox:stax2-api:jar:3.1.4:compile [INFO] | \- com.fasterxml.woodstox:woodstox-core:jar:5.0.3:compile [INFO] +- org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] | +- javax.xml.bind:jaxb-api:jar:2.2.11:compile [INFO] | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.9.5:compile [INFO] \- org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] +- org.apache.hadoop:hadoop-hdfs-client:jar:3.0.0-cdh6.x-SNAPSHOT:compile [INFO] | \- com.squareup.okhttp:okhttp:jar:2.7.5:compile [INFO] | \- com.squareup.okio:okio:jar:1.6.0:compile [INFO] +- com.sun.jersey:jersey-client:jar:1.19:compile [INFO] +- com.google.inject.extensions:guice-servlet:jar:4.0:compile [INFO] +- com.google.inject:guice:jar:4.0:compile [INFO] | +- javax.inject:javax.inject:jar:1:compile [INFO] | \- aopalliance:aopalliance:jar:1.0:compile [INFO] +- com.sun.jersey.contribs:jersey-guice:jar:1.19:compile [INFO] +- com.fasterxml.jackson.core:jackson-core:jar:2.9.5:compile [INFO] +- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.9.5:compile [INFO] \- com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.9.5:compile [INFO] \- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.9.5:compile On Wed, Jul 4, 2018, 7:40 AM Quanlong Huang <[email protected]> wrote: > Hi Fredy, > > > Thanks for looking into this. But try deleting $HOME/.m2 and > $IMPALA_HOME/toolchain does not help. > > > $HOME/.m2 is the local repository of maven which acts as a cache for pom > files and jars. I think you have built successfully when you have access to > Cloudera network. Once the files are cached in $HOME/.m2, your build can > still succeed unless the dependencies' versions change. > > > Could you try to remove (or just move away) > $HOME/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1 > and see if you can build FE without access to Cloudera network? > Can you access the following link outside of Cloudera network? > https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/ > > jackson-mapper-asl-1.9.13-cloudera.1.pom > <https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom> > > > Thanks, > Quanlong > > At 2018-07-04 14:40:47, "Fredy Wijaya" <[email protected]> > wrote: > >Hi Quanlong, > > > >I'm able to build Impala on my personal computer without any access to > >Cloudera network. Can you try to delete $HOME/.m2 and > >$IMPALA_HOME/toolchain and run the build again? > > > >On Tue, Jul 3, 2018 at 11:45 PM Quanlong Huang <[email protected]> > >wrote: > > > >> Hi Cloudera folks, > >> > >> > >> Recently, I'm building the master branch in my dev machine. It failed at > >> building yarn-extras with the following logs: > >> > >> > >> > >> [INFO] BUILD FAILURE > >> > >> [ERROR] Failed to execute goal on project yarn-extras: Could not resolve > >> dependencies for project org.apache.impala:yarn-extras:jar:0.1-SNAPSHOT: > >> Failed to collect dependencies for [net.minidev:json-smart:jar > >> > >> :2.3 (compile), > org.apache.hadoop:hadoop-common:jar:3.0.0-cdh6.x-SNAPSHOT > >> (compile), org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-cdh6.x-SNAPSHOT > >> (compile), org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-cdh6. > >> > >> x-SNAPSHOT (compile)]: Failed to read artifact descriptor for > >> org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13-cloudera.1: Could not > >> transfer artifact > org.codehaus.jackson:jackson-mapper-asl:pom:1.9.13-clou > >> > >> dera.1 from/to impala.cdh.repo ( > >> > https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven > ): > >> Access denied to: > >> > https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/ > >> > >> > codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom > >> , ReasonPhrase:Forbidden. -> [Help 1] > >> > >> [ERROR] > >> > >> [ERROR] To see the full stack trace of the errors, re-run Maven with the > >> -e switch. > >> > >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. > >> > >> [ERROR] > >> > >> [ERROR] For more information about the errors and possible solutions, > >> please read the following articles: > >> > >> [ERROR] [Help 1] > >> > http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException > >> > >> mvn -B install -DskipTests exited with code 0 > >> > >> make[3]: *** [common/yarn-extras/CMakeFiles/yarn-extras] Error 1 > >> > >> make[2]: *** [common/yarn-extras/CMakeFiles/yarn-extras.dir/all] Error 2 > >> > >> make[1]: *** [fe/CMakeFiles/fe.dir/rule] Error 2 > >> > >> make: *** [fe] Error 2 > >> > >> Error in /mnt/volume1/impala-orc/tmp/incubator-impala/bin/make_impala.sh > >> at line 180: ${MAKE_CMD} ${MAKE_ARGS} ${MAKE_TARGETS} > >> > >> > >> > >> Looks like I can't download > >> > https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom > >> When I open the link in my browser, it shows "Assess Denied" too: > >> > >> > >> <Error> > >> <Code>AccessDenied</Code> > >> <Message>Access Denied</Message> > >> <RequestId>663ADBE877FAF5DE</RequestId> > >> <HostId> > >> > >> > fbg/oUcDXyb/nfruO+8UNWd8NYQ8efFlHRIsemHC2NHQjgOYsdVF31lPia+X5FgldapvX0nREec= > >> </HostId> > >> </Error> > >> > >> > >> Maybe other guys outside of Cloudera will encounter the same error. > Could > >> you help to have a look? > >> > >> > >> Thanks, > >> Quanlong >
