Build failed in Jenkins: Hadoop-Common-trunk #433

See https://builds.apache.org/job/Hadoop-Common-trunk/433/changes Changes: [todd] HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe. [vinodkv] Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release. [eli] HADOOP-8485.

Build failed in Jenkins: Hadoop-Common-0.23-Build #277

See https://builds.apache.org/job/Hadoop-Common-0.23-Build/277/ -- [...truncated 93281 lines...] Running org.apache.hadoop.fs.viewfs.TestViewFsWithAuthorityLocalFs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.12 sec Running

Hadoop-Git-Eclipse

Hi I have done MapReduce programming using Eclipse before but now I need to learn the Hadoop code internals for one of my projects. I have forked Hadoop from github (https://github.com/apache/hadoop-common ) and need to configure it to work with Eclipse. All the links I could find list

Re: Reg:Sequence id generation

Hi all, I have a scenario where all my tables are in DB2 and after dumping them into HDFS. A unique sequence id (or) unique identifier an extra column should be added at beginning or at the end of the table can anyone help me on this please. Thanks Regards Abhi.

Re: Reg:Sequence id generation

or some string + timestamp+ lastrow +1 On Thu, Jun 7, 2012 at 6:52 PM, shashwat shriparv dwivedishash...@gmail.com wrote: Try something like this : public class MyUniqueNumber { private static MyUniqueNumber myUniqueNumber; int number; int seedValue=365432; //custom seed

Re: Reg:Sequence id generation

Can try snowflake https://github.com/twitter/snowflake On Thu, Jun 7, 2012 at 6:20 PM, abhishek dodda abhishek.dod...@gmail.com wrote: Hi all, I have a scenario where all my tables are in DB2 and after dumping them into HDFS. A unique sequence id (or) unique identifier an extra column should

Re: Reg:Sequence id generation

Actually trying to look how we can write a mapreduce program. On Thu, Jun 7, 2012 at 7:12 AM, Harsh J ha...@cloudera.com wrote: Ashish - Note though that Twitter's Snowflake is only roughly sequential in generation. Abhishek - Do you really require proper sequence IDs? Why not just keep and

Re: Reg:Sequence id generation

Actually trying to code this using map reduce program. On Thu, Jun 7, 2012 at 6:22 AM, shashwat shriparv dwivedishash...@gmail.com wrote: Try something like this : public class MyUniqueNumber {    private static MyUniqueNumber myUniqueNumber;    int number;    int seedValue=365432;

[jira] [Created] (HADOOP-8490) Add Configuration to FileSystem cache key

Daryn Sharp created HADOOP-8490: --- Summary: Add Configuration to FileSystem cache key Key: HADOOP-8490 URL: https://issues.apache.org/jira/browse/HADOOP-8490 Project: Hadoop Common Issue Type:

[jira] [Reopened] (HADOOP-8368) Use CMake rather than autotools to build native code

[ https://issues.apache.org/jira/browse/HADOOP-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reopened HADOOP-8368: Since Jerkins builds are failing after this. I will revert the patch again.

[jira] [Created] (HADOOP-8491) We need to check for short writes when using FileChannel#write and related methods

Colin Patrick McCabe created HADOOP-8491: Summary: We need to check for short writes when using FileChannel#write and related methods Key: HADOOP-8491 URL:

[jira] [Created] (HADOOP-8492) Rename ProcessTree.isSetsidAvailable

Bikas Saha created HADOOP-8492: -- Summary: Rename ProcessTree.isSetsidAvailable Key: HADOOP-8492 URL: https://issues.apache.org/jira/browse/HADOOP-8492 Project: Hadoop Common Issue Type: Bug

Randomly failing test

Can someone guide me in making the test org.apache.hadoop.mapred.TestReduceFetchFromPartialMem less flaky? I see test failures mentioned in MAPREDUCE-4094 and MAPREDUCE-4096 but no fix is available so far. Thanks. -- Asokan ATTENTION: - The

Doubt regarding the classes to look for tweaking Reducer during Shuffle phase

Hi all, I am new to Hadoop Development and am working on a project which involves writing the intermediate Map output to a Parallel File system(Lustre) and tweaking the Reducer to read from the same during shuffle phase. My doubt is : *What classes do I need to look for to solve the above

[jira] [Created] (HADOOP-8493) Extend Path with Path#toFile() and Path(File) to better support path cross-platform differences

Ivan Mitic created HADOOP-8493: -- Summary: Extend Path with Path#toFile() and Path(File) to better support path cross-platform differences Key: HADOOP-8493 URL: https://issues.apache.org/jira/browse/HADOOP-8493

RE: Randomly failing test

Hi Chris, Thanks for your reply. I submitted a patch for MAPREDUCE-2454. I got this failing test error and I am blocked on this. Can you please advise me how I proceed submitting the patch? I can spend some time investigating how to make the test more deterministic if that is

Re: Randomly failing test

It would be surprising if the test became flakier with those modifications if the changes did not also change the semantics. From the test output, the patch is causing an assertion to fail: more records are hitting disk than expected. -C On Thu, Jun 7, 2012 at 7:07 PM, Asokan, M