Build failed in Jenkins: Hadoop-Common-trunk #479

[Apache Jenkins Server]

See 

--
[...truncated 18484 lines...]
[DEBUG]   (s) reportsDirectory = 

[DEBUG]   (s) runOrder = filesystem
[DEBUG]   (s) session = org.apache.maven.execution.MavenSession@1628b8d
[DEBUG]   (s) skip = false
[DEBUG]   (s) skipTests = false
[DEBUG]   (s) systemPropertyVariables = {hadoop.log.dir=null, 
hadoop.tmp.dir=null, java.net.preferIPv4Stack=true, 
java.security.egd=file:///dev/urandom, 
java.security.krb5.conf=
 test.build.classes=null, 
test.build.data=
 
test.build.dir=
 test.build.webapps=null, test.cache.data=null}
[DEBUG]   (s) testClassesDirectory = 

[DEBUG]   (s) testFailureIgnore = false
[DEBUG]   (s) testNGArtifactName = org.testng:testng
[DEBUG]   (s) testSourceDirectory = 

[DEBUG]   (s) trimStackTrace = true
[DEBUG]   (s) useFile = true
[DEBUG]   (s) useManifestOnlyJar = true
[DEBUG]   (s) useSystemClassLoader = true
[DEBUG]   (s) useUnlimitedThreads = false
[DEBUG]   (s) workingDirectory = 

[DEBUG] -- end configuration --
[INFO] No tests to run.
[INFO] Surefire report directory: 

[DEBUG] dummy:dummy:jar:1.0 (selected for null)
[DEBUG]   org.apache.maven.surefire:surefire-booter:jar:2.12:compile (selected 
for compile)
[DEBUG] org.apache.maven.surefire:surefire-api:jar:2.12:compile (selected 
for compile)
[DEBUG] Adding to surefire booter test classpath: 
/home/jenkins/.m2/repository/org/apache/maven/surefire/surefire-booter/2.12/surefire-booter-2.12.jar
 Scope: compile
[DEBUG] Adding to surefire booter test classpath: 
/home/jenkins/.m2/repository/org/apache/maven/surefire/surefire-api/2.12/surefire-api-2.12.jar
 Scope: compile
[DEBUG] Setting system property [java.net.preferIPv4Stack]=[true]
[DEBUG] Setting system property 
[java.security.krb5.conf]=[
[DEBUG] Setting system property [tar]=[true]
[DEBUG] Setting system property 
[test.build.data]=[
[DEBUG] Setting system property 
[user.dir]=[
[DEBUG] Setting system property [localRepository]=[/home/jenkins/.m2/repository]
[DEBUG] Setting system property 
[test.build.dir]=[
[DEBUG] Setting system property 
[basedir]=[
[DEBUG] Setting system property [java.security.egd]=[file:///dev/urandom]
[DEBUG] Using JVM: /home/jenkins/tools/java/jdk1.6.0_26/jre/bin/java
[DEBUG] Setting environment variable 
[LD_LIBRARY_PATH]=[/home/jenkins/tools/java/jdk1.6.0_26/jre/lib/i386/server:/home/jenkins/tools/java/jdk1.6.0_26/jre/lib/i386:/home/jenkins/tools/java/jdk1.6.0_26/jre/../lib/i386:
[DEBUG] Setting environment variable [MALLOC_ARENA_MAX]=[4]
[DEBUG] dummy:dummy:jar:1.0 (selected for null)
[DEBUG]   org.apache.maven.surefire:surefire-junit3:jar:2.12:test (selected for 
test)
[DEBUG] org.apache.maven.surefire:surefire-api:jar:2.12:test (selected for 
test)
[DEBUG] Adding to surefire test classpath: 
/home/jenkins/.m2/repository/org/apache/maven/surefire/surefire-junit3/2.12/surefire-junit3-2.12.jar
 Scope: test
[DEBUG] Adding to surefire test classpath: 
/home/jenkins/.m2/repository/org/apache/maven/surefire/surefire-api/2.12/surefire-api-2.12.jar
 Scope: test
[DEBUG] test classpath classpath:
[DEBUG]   

[DEBUG]   

hive query optimization

[abhiTowson cal]

Hi all,

Some queries in hive are executing for too long.So i have overriden
some parameters in hive, for some querys performance increased rapidly
when i overriden this properities  for some querys no change in
performance.Can any one you
tell me any other optimizations in hive apart from partitions and
buckets,

set io.sort.mb=512;
set io.sort.factor=100;
set mapred.reduce.parallel.copies=40;
set hive.map.aggr =true;
set hive.exec.parallel=true;
set hive.groupby.skewindata=true;
set mapred.job.reuse.jvm.num.tasks=-1;

default values were

io.sort.mb=256;
io.sort.factor=10;
mapred.reduce.parallel.copies=10;

Thanks
Abhishek

[jira] [Resolved] (HADOOP-7726) eclipse target does not build with 0.24.0

[Harsh J (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Harsh J resolved HADOOP-7726.
-

Resolution: Cannot Reproduce

(This has nothing to do with the eclipse-plugin)

No longer an issue on trunk/2.x branches. Please see 
http://wiki.apache.org/hadoop/HowToContribute to import sources into eclipse.

> eclipse target does not build with 0.24.0
> -
>
> Key: HADOOP-7726
> URL: https://issues.apache.org/jira/browse/HADOOP-7726
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.24.0
> Environment: Fedora 15
>Reporter: Tim Broberg
>
> I'm new to hadoop, java, and eclipse, so please forgive me if I jumble 
> multiple issues together or mistake the symptoms of one problem for a 
> separate issue.
> Attempting to follow the build instructions from 
> http://wiki.apache.org/hadoop/EclipseEnvironment, the following commands are 
> to be executed:
>   1 - mvn test -DskipTests
>   2 - mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true
>   3 - cd hdfs; ant compile eclipse
>   4 - cd ../; cd mapreduce; ant compile eclipse
> A - If "mvn test -DskipTests" is used for #1, #2 fails with "[ERROR] Failed 
> to execute goal on project hadoop-yarn-common: Could not resolve dependencies 
> for project org.apache.hadoop:hadoop-yarn-common:jar:0.24.0-SNAPSHOT:"
> Per Luke Lu's suggestion, "mvn install -DskipTests -P-cbuild" instead of step 
> #1 cleared up this issue.
> B - For steps #3, and #4 there are no hdfs or mapreduce subdirectories. These 
> appear to have been renamed "hadoop-hdfs-project" and 
> "hadoop-mapreduce-project".
> C - For step #3, if I then go to hadoop-hdfs-project instead and perform "ant 
> compile eclipse" no build.xml file is found - "Buildfile: build.xml does not 
> exist!"
> D - For step #4, if I go to hadoop-mapreduce-project and do "ant compile 
> eclipse" a set of errors much like #A is produced:
> > [ivy:resolve]   ::
> > [ivy:resolve]   ::  UNRESOLVED DEPENDENCIES ::
> > [ivy:resolve]   ::
> > [ivy:resolve]   ::
> > org.apache.hadoop#hadoop-yarn-server-common;0.24.0-SNAPSHOT: not found
> > [ivy:resolve]   ::
> > org.apache.hadoop#hadoop-mapreduce-client-core;0.24.0-SNAPSHOT: not found
> > [ivy:resolve]   ::
> > org.apache.hadoop#hadoop-yarn-common;0.24.0-SNAPSHOT: not found
> > [ivy:resolve]   ::
> E - If I ignore these issues and import the projects generated in step #2, I 
> get a bunch of errors related to the lack of an M2_REPO definition. Adding 
> this variable needs to be included in the build scripts or documentation in 
> the wiki.
> F - Once that is resolved, eclipse shows hundreds of errors and warnings 
> starting with "AvroRecord" cannot be resolved to a type.
> Thanks so much for your work on this, but it needs a little more effort in 
> documentation and/or development before it is usable again.
> Thanks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira