Looks like it's due to stale env variables. When I open a new session I can run buildall.sh successfully... Thank you so much, Fredy!
At 2018-07-04 22:05:47，"Fredy Wijaya" <[email protected]> wrote： >I deleted my $HOME/.m2 before and was able to build Impala. >I can't access that URL either. > Impala uses few Maven repositories, so if it can't find the dependencies >it needs from one repository, it will use the next one. > >[INFO] Scanning for projects... >[INFO] >[INFO] >------------------------------------------------------------------------ >[INFO] Building YARN Extras 0.1-SNAPSHOT >[INFO] >------------------------------------------------------------------------ > >Downloading from impala.cdh.repo: >https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom >Downloading from cdh.rcs.releases.repo: >https://repository.cloudera.com/content/groups/cdh-releases-rcs/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom >Downloaded from cdh.rcs.releases.repo: >https://repository.cloudera.com/content/groups/cdh-releases-rcs/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.pom >(1.2 kB at 9.2 kB/s) > >Something weird that your yarn-extras requires jackson-mapper 1.9.13 and >not 1.9.2. I ran mvn dependency:tree on yarn-extras and got the following >output. > >[INFO] org.apache.impala:yarn-extras:jar:0.1-SNAPSHOT >[INFO] +- net.minidev:json-smart:jar:2.3:compile >[INFO] | \- net.minidev:accessors-smart:jar:1.2:compile >[INFO] | \- org.ow2.asm:asm:jar:5.0.4:compile >[INFO] +- org.apache.hadoop:hadoop-common:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] | +- >org.apache.hadoop:hadoop-annotations:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] | | \- jdk.tools:jdk.tools:jar:1.8:system >[INFO] | +- com.google.guava:guava:jar:11.0.2:compile >[INFO] | +- commons-cli:commons-cli:jar:1.2:compile >[INFO] | +- org.apache.commons:commons-math3:jar:3.1.1:compile >[INFO] | +- org.apache.httpcomponents:httpclient:jar:4.5.3:compile >[INFO] | | \- org.apache.httpcomponents:httpcore:jar:4.4.6:compile >[INFO] | +- commons-codec:commons-codec:jar:1.4:compile >[INFO] | +- commons-io:commons-io:jar:2.6:compile >[INFO] | +- commons-net:commons-net:jar:3.1:compile >[INFO] | +- commons-collections:commons-collections:jar:3.2.2:compile >[INFO] | +- javax.servlet:javax.servlet-api:jar:3.1.0:compile >[INFO] | +- org.eclipse.jetty:jetty-server:jar:9.3.20.v20170531:compile >[INFO] | | +- org.eclipse.jetty:jetty-http:jar:9.3.20.v20170531:compile >[INFO] | | \- org.eclipse.jetty:jetty-io:jar:9.3.20.v20170531:compile >[INFO] | +- org.eclipse.jetty:jetty-util:jar:9.3.20.v20170531:compile >[INFO] | +- org.eclipse.jetty:jetty-servlet:jar:9.3.20.v20170531:compile >[INFO] | | \- >org.eclipse.jetty:jetty-security:jar:9.3.20.v20170531:compile >[INFO] | +- org.eclipse.jetty:jetty-webapp:jar:9.3.20.v20170531:compile >[INFO] | | \- org.eclipse.jetty:jetty-xml:jar:9.3.20.v20170531:compile >[INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:runtime >[INFO] | +- com.sun.jersey:jersey-core:jar:1.19:compile >[INFO] | | \- javax.ws.rs:jsr311-api:jar:1.1.1:compile >[INFO] | +- com.sun.jersey:jersey-servlet:jar:1.19:compile >[INFO] | +- com.sun.jersey:jersey-json:jar:1.19:compile >[INFO] | | +- org.codehaus.jettison:jettison:jar:1.1:compile >[INFO] | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile >[INFO] | | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.2:compile >[INFO] | | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.2:compile >[INFO] | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.2:compile >[INFO] | | \- org.codehaus.jackson:jackson-xc:jar:1.9.2:compile >[INFO] | +- com.sun.jersey:jersey-server:jar:1.19:compile >[INFO] | +- commons-logging:commons-logging:jar:1.1.3:compile >[INFO] | +- log4j:log4j:jar:1.2.17:compile >[INFO] | +- commons-lang:commons-lang:jar:2.6:compile >[INFO] | +- commons-beanutils:commons-beanutils:jar:1.9.3:compile >[INFO] | +- org.apache.commons:commons-configuration2:jar:2.1.1:compile >[INFO] | +- org.apache.commons:commons-lang3:jar:3.7:compile >[INFO] | +- org.slf4j:slf4j-api:jar:1.7.25:compile >[INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.25:compile >[INFO] | +- org.apache.avro:avro:jar:1.8.2-cdh6.x-SNAPSHOT:compile >[INFO] | | +- com.thoughtworks.paranamer:paranamer:jar:2.8:compile >[INFO] | | +- org.xerial.snappy:snappy-java:jar:1.1.4:compile >[INFO] | | \- org.tukaani:xz:jar:1.6:compile >[INFO] | +- com.google.re2j:re2j:jar:1.1:compile >[INFO] | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile >[INFO] | +- com.google.code.gson:gson:jar:2.2.4:compile >[INFO] | +- org.apache.hadoop:hadoop-auth:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] | | +- com.nimbusds:nimbus-jose-jwt:jar:4.41.1:compile >[INFO] | | | \- >com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile >[INFO] | | \- org.apache.curator:curator-framework:jar:2.12.0:compile >[INFO] | +- com.jcraft:jsch:jar:0.1.54:compile >[INFO] | +- org.apache.curator:curator-client:jar:2.12.0:compile >[INFO] | +- org.apache.curator:curator-recipes:jar:2.12.0:compile >[INFO] | +- com.google.code.findbugs:jsr305:jar:3.0.0:compile >[INFO] | +- org.apache.htrace:htrace-core4:jar:4.1.0-incubating:compile >[INFO] | +- >org.apache.zookeeper:zookeeper:jar:3.4.5-cdh6.x-SNAPSHOT:compile >[INFO] | | +- jline:jline:jar:2.12:compile >[INFO] | | +- io.netty:netty:jar:3.10.5.Final:compile >[INFO] | | \- org.apache.yetus:audience-annotations:jar:0.5.0:compile >[INFO] | +- org.apache.commons:commons-compress:jar:1.4.1:compile >[INFO] | +- org.apache.kerby:kerb-simplekdc:jar:1.0.0:compile >[INFO] | | +- org.apache.kerby:kerb-client:jar:1.0.0:compile >[INFO] | | | +- org.apache.kerby:kerby-config:jar:1.0.0:compile >[INFO] | | | +- org.apache.kerby:kerb-core:jar:1.0.0:compile >[INFO] | | | | \- org.apache.kerby:kerby-pkix:jar:1.0.0:compile >[INFO] | | | | +- org.apache.kerby:kerby-asn1:jar:1.0.0:compile >[INFO] | | | | \- org.apache.kerby:kerby-util:jar:1.0.0:compile >[INFO] | | | +- org.apache.kerby:kerb-common:jar:1.0.0:compile >[INFO] | | | | \- org.apache.kerby:kerb-crypto:jar:1.0.0:compile >[INFO] | | | \- org.apache.kerby:kerb-util:jar:1.0.0:compile >[INFO] | | \- org.apache.kerby:kerb-admin:jar:1.0.0:compile >[INFO] | | +- org.apache.kerby:kerb-server:jar:1.0.0:compile >[INFO] | | | \- org.apache.kerby:kerb-identity:jar:1.0.0:compile >[INFO] | | \- org.apache.kerby:kerby-xdr:jar:1.0.0:compile >[INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.9.5:compile >[INFO] | +- org.codehaus.woodstox:stax2-api:jar:3.1.4:compile >[INFO] | \- com.fasterxml.woodstox:woodstox-core:jar:5.0.3:compile >[INFO] +- >org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] | +- javax.xml.bind:jaxb-api:jar:2.2.11:compile >[INFO] | \- >com.fasterxml.jackson.core:jackson-annotations:jar:2.9.5:compile >[INFO] \- >org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] +- >org.apache.hadoop:hadoop-hdfs-client:jar:3.0.0-cdh6.x-SNAPSHOT:compile >[INFO] | \- com.squareup.okhttp:okhttp:jar:2.7.5:compile >[INFO] | \- com.squareup.okio:okio:jar:1.6.0:compile >[INFO] +- com.sun.jersey:jersey-client:jar:1.19:compile >[INFO] +- com.google.inject.extensions:guice-servlet:jar:4.0:compile >[INFO] +- com.google.inject:guice:jar:4.0:compile >[INFO] | +- javax.inject:javax.inject:jar:1:compile >[INFO] | \- aopalliance:aopalliance:jar:1.0:compile >[INFO] +- com.sun.jersey.contribs:jersey-guice:jar:1.19:compile >[INFO] +- com.fasterxml.jackson.core:jackson-core:jar:2.9.5:compile >[INFO] +- >com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.9.5:compile >[INFO] \- >com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.9.5:compile >[INFO] \- >com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.9.5:compile > > >On Wed, Jul 4, 2018, 7:40 AM Quanlong Huang <[email protected]> wrote: > >> Hi Fredy, >> >> >> Thanks for looking into this. But try deleting $HOME/.m2 and >> $IMPALA_HOME/toolchain does not help. >> >> >> $HOME/.m2 is the local repository of maven which acts as a cache for pom >> files and jars. I think you have built successfully when you have access to >> Cloudera network. Once the files are cached in $HOME/.m2, your build can >> still succeed unless the dependencies' versions change. >> >> >> Could you try to remove (or just move away) >> $HOME/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1 >> and see if you can build FE without access to Cloudera network? >> Can you access the following link outside of Cloudera network? >> https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/ >> >> jackson-mapper-asl-1.9.13-cloudera.1.pom >> <https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom> >> >> >> Thanks, >> Quanlong >> >> At 2018-07-04 14:40:47, "Fredy Wijaya" <[email protected]> >> wrote: >> >Hi Quanlong, >> > >> >I'm able to build Impala on my personal computer without any access to >> >Cloudera network. Can you try to delete $HOME/.m2 and >> >$IMPALA_HOME/toolchain and run the build again? >> > >> >On Tue, Jul 3, 2018 at 11:45 PM Quanlong Huang <[email protected]> >> >wrote: >> > >> >> Hi Cloudera folks, >> >> >> >> >> >> Recently, I'm building the master branch in my dev machine. It failed at >> >> building yarn-extras with the following logs: >> >> >> >> >> >> >> >> [INFO] BUILD FAILURE >> >> >> >> [ERROR] Failed to execute goal on project yarn-extras: Could not resolve >> >> dependencies for project org.apache.impala:yarn-extras:jar:0.1-SNAPSHOT: >> >> Failed to collect dependencies for [net.minidev:json-smart:jar >> >> >> >> :2.3 (compile), >> org.apache.hadoop:hadoop-common:jar:3.0.0-cdh6.x-SNAPSHOT >> >> (compile), org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-cdh6.x-SNAPSHOT >> >> (compile), org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-cdh6. >> >> >> >> x-SNAPSHOT (compile)]: Failed to read artifact descriptor for >> >> org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13-cloudera.1: Could not >> >> transfer artifact >> org.codehaus.jackson:jackson-mapper-asl:pom:1.9.13-clou >> >> >> >> dera.1 from/to impala.cdh.repo ( >> >> >> https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven >> ): >> >> Access denied to: >> >> >> https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/ >> >> >> >> >> codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom >> >> , ReasonPhrase:Forbidden. -> [Help 1] >> >> >> >> [ERROR] >> >> >> >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> >> -e switch. >> >> >> >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> >> >> >> [ERROR] >> >> >> >> [ERROR] For more information about the errors and possible solutions, >> >> please read the following articles: >> >> >> >> [ERROR] [Help 1] >> >> >> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException >> >> >> >> mvn -B install -DskipTests exited with code 0 >> >> >> >> make[3]: *** [common/yarn-extras/CMakeFiles/yarn-extras] Error 1 >> >> >> >> make[2]: *** [common/yarn-extras/CMakeFiles/yarn-extras.dir/all] Error 2 >> >> >> >> make[1]: *** [fe/CMakeFiles/fe.dir/rule] Error 2 >> >> >> >> make: *** [fe] Error 2 >> >> >> >> Error in /mnt/volume1/impala-orc/tmp/incubator-impala/bin/make_impala.sh >> >> at line 180: ${MAKE_CMD} ${MAKE_ARGS} ${MAKE_TARGETS} >> >> >> >> >> >> >> >> Looks like I can't download >> >> >> https://native-toolchain.s3.amazonaws.com/build/cdh_components/422770/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.13-cloudera.1/jackson-mapper-asl-1.9.13-cloudera.1.pom >> >> When I open the link in my browser, it shows "Assess Denied" too: >> >> >> >> >> >> <Error> >> >> <Code>AccessDenied</Code> >> >> <Message>Access Denied</Message> >> >> <RequestId>663ADBE877FAF5DE</RequestId> >> >> <HostId> >> >> >> >> >> fbg/oUcDXyb/nfruO+8UNWd8NYQ8efFlHRIsemHC2NHQjgOYsdVF31lPia+X5FgldapvX0nREec= >> >> </HostId> >> >> </Error> >> >> >> >> >> >> Maybe other guys outside of Cloudera will encounter the same error. >> Could >> >> you help to have a look? >> >> >> >> >> >> Thanks, >> >> Quanlong >>
