Re: Hadoop Annotations support

2011-07-02 Thread Niels Basjes
I assume you mean something like this:

https://github.com/SpringSource/spring-hadoop

On Sat, Jul 2, 2011 at 04:22, Raja Nagendra Kumar
nagendra.r...@tejasoft.com wrote:

 Hi,

 Is there any plans for Hadoop to support annodations specially for the api
 level configurations eliminations.. eg.

 conf.setMapperClass(MaxTemperatureMapper.class);
 conf.setCombinerClass(MaxTemperatureReducer.class);
 conf.setReducerClass(MaxTemperatureReducer.class);

 can be easily elimiated through proper class level annotations.


 Regards,
 Raja Nagendra Kumar,
 C.T.O
 www.tejasoft.com

 --
 View this message in context: 
 http://old.nabble.com/Hadoop-Annotations-support-tp31977831p31977831.html
 Sent from the Hadoop core-dev mailing list archive at Nabble.com.





-- 
Best regards / Met vriendelijke groeten,

Niels Basjes


Hadoop-Common-trunk - Build # 735 - Still Failing

2011-07-02 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Common-trunk/735/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 24566 lines...]
jar:
  [tar] Nothing to do: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/classes/bin.tgz
 is up to date.
  [jar] Building jar: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/hadoop-common-0.23.0-SNAPSHOT.jar
  [jar] Building jar: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/hadoop-common-0.23.0-SNAPSHOT-sources.jar

ivy-resolve-test:

ivy-retrieve-test:

generate-test-records:

generate-avro-records:
Trying to override old definition of task schema

generate-avro-protocols:
Trying to override old definition of task schema

compile-core-test:
[javac] Compiling 9 source files to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/core/classes
   [clover] Clover Version 3.0.2, built on April 13 2010 (build-790)
   [clover] Loaded from: /homes/hudson/tools/clover/latest/lib/clover.jar
   [clover] Clover: Open Source License registered to Apache.
   [clover] Updating existing database at 
'/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/clover/db/hadoop_coverage.db'.
   [clover] Processing files at 1.6 source level.
   [clover] Clover all over. Instrumented 0 files (0 packages).
   [clover] Elapsed time = 0 secs.
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
Trying to override old definition of task paranamer
[paranamer] Generating parameter names from 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/src/test/core 
to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/core/classes
   [delete] Deleting directory 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/cache
[mkdir] Created dir: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/cache
 [copy] Copying 1 file to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/cache

run-test-core:
[mkdir] Created dir: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/data
 [copy] Copying 3 files to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/webapps
[mkdir] Created dir: 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/logs
 [copy] Copying 1 file to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/extraconf
 [copy] Copying 1 file to 
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build-fi/test/extraconf

checkfailure:

BUILD FAILED
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk/trunk/build.xml:859: 
Tests failed!

Total time: 9 minutes 27 seconds
[FINDBUGS] Skipping publisher since build result is FAILURE
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Recording test results
Publishing Javadoc
Recording fingerprints
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
6 tests failed.
FAILED:  
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.testOneBlockPlusOneEntry

Error Message:
expected:1 but was:0

Stack Trace:
junit.framework.AssertionFailedError: expected:1 but was:0
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.checkBlockIndex(TestTFileByteArrays.java:665)
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.__CLR3_0_2qcmd5m12rl(TestTFileByteArrays.java:157)
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.testOneBlockPlusOneEntry(TestTFileByteArrays.java:151)


FAILED:  org.apache.hadoop.io.file.tfile.TestTFileByteArrays.testTwoBlocks

Error Message:
expected:1 but was:0

Stack Trace:
junit.framework.AssertionFailedError: expected:1 but was:0
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.checkBlockIndex(TestTFileByteArrays.java:665)
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.__CLR3_0_2sehq6f12ru(TestTFileByteArrays.java:165)
at 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays.testTwoBlocks(TestTFileByteArrays.java:160)


FAILED:  org.apache.hadoop.io.file.tfile.TestTFileByteArrays.testThreeBlocks

Error Message:
expected:2 but was:1

Stack Trace:
junit.framework.AssertionFailedError: expected:2 but was:1
at 

Hadoop Slave Configuration support with regular expressions

2011-07-02 Thread Raja Nagendra Kumar

Hi,

Instead of explicit ip or host name in slave machines, would it be possible
to provide host name int he form of regular expression say

teja* to say all machines on lan with names starting with teja e.g tejanag,
tejamedha etc are the slaves, so that hadoop master can discover all such
names matching the pattern provided through netbios discovery etc.. If the
IP address is provided instead of name, say 192.168.0.* then master can run
through all the 1 to 255 and discover the slaves.

It would be nice to eliminate too much configuration by design or at make
configuration more expressive for less changes.

Regards,
Raja Nagendra Kumar,
C.T.O
www.tejasoft.com
-Hadoop Adoption Consulting
-- 
View this message in context: 
http://old.nabble.com/Hadoop-Slave-Configuration-support-with-regular-expressions-tp31981964p31981964.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.