Contribute

2010-07-14 Thread Saikat Kanjilal
Hi all,I would like to begin contributing to hadoop specifically 1) in writing some of the test projects and working on one or more of the research projects on the Project Suggestions wiki (http://wiki.apache.org/hadoop/ProjectSuggestions). I was wondering how accurate the current set of task

RE: Contribute

2010-07-19 Thread Saikat Kanjilal
Hi Folks,As I have not heard back from anyone on this topic, I will start this effort by taking the task on the Project Suggestions page to write junit test cases for the hadoop examples. Please let me know if anyone is working on this or has already done this to avoid duplication and I will p

RE: MapReduce Usage in Search Engines

2010-07-30 Thread Saikat Kanjilal
Hello Yuhendar,I'll add as much as I can at a high level from what I have learned so far about map-reduce to answer your questions: 1) The goal behind map-reduce is to perform a distributed computation which breaks up a large computation intensive problem into smaller chunks and solve those in

Re: hadoop ANT build ERROR HELP!!!!

2010-08-03 Thread Saikat Kanjilal
Hi Ahmad, Can you share some more details on what your environment looks like (jdk version, OS , version of ant etc) Thanks Sent from my iPhone On Aug 3, 2010, at 4:27 AM, Ahmad Shahzad wrote: > Hi All, > Can anyone guide me regarding this error, i get this error when i > compile the

Re: How to Build Hadoop code in eclipse

2010-08-07 Thread Saikat Kanjilal
I've been able to build the code successfully in Eclipse by using the svn plugin and importing the code and using ant. I actually followed the wiki instructions and did an svn checkout inside Eclipse and was able to run all of the ant targets successfully. Sent from my iPhone On Aug 7, 2010,

JIRA 6891

2010-08-10 Thread Saikat Kanjilal
Hi Folks,I am nearing completion for JIRA 6891 and had a question. I have written a Junit test suite using junit 4 that drives all the examples. This is currently working inside Eclipse and I will be moving this over to work from the main hadoop ant file. Almost all of the examples seem to b

Re: HELP !!!! configuring hadoop on ECLIPSE

2010-08-11 Thread Saikat Kanjilal
Here's how you can proceed: 1) untar your release to some directory 2) create a new java project in eclipse and associate the source subfolders of the eclipse project and associate that with the hadoop source subdirectory 3) now open up the eclipse ant targets and you should be able to run any of

Re: JIRA 6891

2010-08-11 Thread Saikat Kanjilal
reshwari > > On 8/11/10 9:59 AM, "Saikat Kanjilal" wrote: > > > > Hi Folks,I am nearing completion for JIRA 6891 and had a question. I have > written a Junit test suite using junit 4 that drives all the examples. This > is currently working inside Eclipse and I

Response

2010-08-11 Thread Saikat Kanjilal
work as far as I remember. You > > > should work on trunk instead of branch 0.20, because HADOOP-6891 is an > > > improvement and cannot go into 0.20 releases. See > > > org.apache.hadoop.mapreduce.TestMapReduceLocal in MapReduce project which > > > has a ju

FW: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that run the Hadoop examples

2010-09-04 Thread Saikat Kanjilal
/browse/MAPREDUCE-2008 > > Project: Hadoop Map/Reduce > > Issue Type: New Feature > > Components: examples, test > >Affects Versions: 0.20.2 > > Environment: N/A > >Reporter: Saikat Kanjilal > >

Re: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that run the Hadoop examples

2010-09-05 Thread Saikat Kanjilal
op/HowToDevelopUnitTests > > Thanks, > Eli > > On Sat, Sep 4, 2010 at 10:27 PM, Saikat Kanjilal wrote: >> >> HI Folks,I am working on this jira task and had some additional questions:1) >> It seems that whenever I go to run the test or the test-core target on

Re: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that run the Hadoop examples

2010-09-05 Thread Saikat Kanjilal
e with your tree. > > Looks like there are already some of the examples being driven as > tests in src/test/mapred/org/apache/hadoop/examples. I'd start there > and see which ones are missing and add them. Good idea btw, thanks > for working on this. > > Thanks, > El

RE: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that run the Hadoop examples

2010-09-08 Thread Saikat Kanjilal
o a > handful of flaky tests). What failures are you seeing? > > Info on how to add unit tests: > > http://wiki.apache.org/hadoop/HowToDevelopUnitTests > > Thanks, > Eli > > On Sat, Sep 4, 2010 at 10:27 PM, Saikat Kanjilal wrote: > > > > HI Folks,I am work

RE: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that run the Hadoop examples

2010-09-17 Thread Saikat Kanjilal
Fri, 17 Sep 2010 11:26:40 -0700 > Subject: Re: FW: [jira] Moved: (MAPREDUCE-2008) write Junit test cases that > run the Hadoop examples > From: e...@cloudera.com > To: common-dev@hadoop.apache.org > > On Sat, Sep 4, 2010 at 10:27 PM, Saikat Kanjilal wrote: > > > > H

Re: pointers to Hadoop eclipse

2011-03-17 Thread Saikat Kanjilal
1) install svn plugin inside eclipse 2) specify the appropriate repository location for hadoop 3) check out code using the plugin inside eclipse 4) make code changes, compile using ant targets, also run tests Hope that helps, let me know if you need more details. Sent from my iPhone On Mar 17, 2

Research projects for hadoop

2011-09-09 Thread Saikat Kanjilal
Hi Folks,I was looking through the following wiki page: http://wiki.apache.org/hadoop/HadoopResearchProjects and was wondering if there's been any work done (or any interest to do work) for the following topics: Integration of Virtualization (such as Xen) with Hadoop toolsHow does one integr

RE: Research projects for hadoop

2011-09-09 Thread Saikat Kanjilal
us map tasks. > However if I virtualize the box, I lose at least 1 core per VM so I end up > with 4 nodes that have less capabilities and performance than I would have > under my original box > > > -----Original Message- > From: Saikat Kanjilal [mailto:sxk1...@hotmail.com

RE: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Saikat Kanjilal
Me 2, let me know as well. > Date: Tue, 8 May 2012 10:35:34 -0700 > From: mrra...@yahoo.com > Subject: Re: Project announcement: Sailfish (also, looking for colloborators) > To: common-dev@hadoop.apache.org > > Hi Sriram, > >I'm interested in getting involved. Let me know in what capaci

RE: [jira] [Created] (HADOOP-9674) RPC#Server#start does not block until server is fully initialized and listening

2013-06-26 Thread Saikat Kanjilal
Is the solution for the call to block till the initialization completes? > Date: Thu, 27 Jun 2013 04:39:20 + > From: j...@apache.org > To: common-dev@hadoop.apache.org > Subject: [jira] [Created] (HADOOP-9674) RPC#Server#start does not block until > server is fully initialized and listening >

Re: DI framework

2016-11-26 Thread Saikat Kanjilal
https://github.com/pmazak/Spit-DI http://paulmazak.blogspot.com/2015/06/dependency-injection-on-hadoop.html [https://farm8.staticflickr.com/7393/9059912714_18d77cbbab.jpg] Dependency Injection on Hadoop (without Guice)<

[jira] Created: (HADOOP-6891) write Junit test cases that run the Hadoop examples

2010-07-29 Thread Saikat Kanjilal (JIRA)
Components: test Affects Versions: 0.20.2 Environment: N/A Reporter: Saikat Kanjilal Priority: Minor Fix For: 0.20.3 I will be adding junit test cases that run the hadoop examples, specifically I'll be adding a test suite that tests everything unde

[jira] Created: (HADOOP-6959) Provisioning of long running Services via HOD

2010-09-19 Thread Saikat Kanjilal (JIRA)
work on any environment Reporter: Saikat Kanjilal Priority: Minor Work on a computation model for services on the grid. The model would include: Various tools for defining clients and servers of the service, and at the least a C++ and Java instantiation of the abstractions

[jira] Created: (HADOOP-6960) Hadoop Security Design

2010-09-19 Thread Saikat Kanjilal (JIRA)
Hadoop Security Design -- Key: HADOOP-6960 URL: https://issues.apache.org/jira/browse/HADOOP-6960 Project: Hadoop Common Issue Type: New Feature Reporter: Saikat Kanjilal Priority: Minor An end

[jira] Created: (HADOOP-6961) Integration of Virtualization (such as Xen) with Hadoop tools

2010-09-19 Thread Saikat Kanjilal (JIRA)
Feature Environment: All Reporter: Saikat Kanjilal How does one integrate sandboxing of arbitrary user code in C++ and other languages in a VM such as Xen with the Hadoop framework? How does this interact with SGE, Torque, Condor? As each individual machine has more and more