[jira] [Resolved] (MAPREDUCE-4694) Inconsistency in reduce input record counters between the stable and evolving APIs

2017-03-08 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4694. Resolution: Won't Fix Assignee: (was: Harsh J) This bug's existed for ov

[jira] [Resolved] (MAPREDUCE-2584) Check for serializers early, and give out more information regarding missing serializers

2016-10-26 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2584. Resolution: Not A Problem Target Version/s: (was: 2.0.0-alpha) This may not be a

[jira] [Resolved] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6199. Resolution: Fixed Uh sorry, the commit message timeline is confusing on this. This is indeed

[jira] [Resolved] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6286. Resolution: Fixed Uh sorry, the commit message timeline is confusing on this. This is indeed

[jira] [Reopened] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-6286: Reopening this to set the right resolution state. Since the fix was reverted and never added back

[jira] [Reopened] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-6199: This was reverted and never added back. Reopening to set the right state as it isn't &

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: > MRBench: setting the baseDir parameter has no eff

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: Assignee: Wilfred Spiegelenburg > MRBench: setting the baseDir parameter has no eff

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Fixed > MRBench: setting the baseDir parameter has no eff

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Later (Trying a resolve to reset the IN-PROGRESS state as there seems to be no

[jira] [Resolved] (MAPREDUCE-4045) RM UI -> Applications -> Application Master Link -> Job Link -> New Maps/Reduces leads to circular redirect error

2016-03-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4045. Resolution: Duplicate Fix Version/s: MAPREDUCE-3706 > RM UI -> Applic

[jira] [Resolved] (MAPREDUCE-6592) MR ApplicationMaster is not supposed to resolve rack locality! It should ask RM or NN about the topology

2015-12-29 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6592. Resolution: Duplicate Assignee: Harsh J Dupe of YARN-435 > MR ApplicationMaster is

Re: Cannot connect to git.apache.org

2015-07-18 Thread Harsh J
Ted's URL fetches you a mirrored repository from GitHub.com instead, which is absolutely fine to use as an alternate. There might have been an infrastructure issue when you were attempting to access the original Apache git repository. In trying the regular Apache git repository now, it appears to

[jira] [Created] (MAPREDUCE-6383) Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails

2015-06-03 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6383: -- Summary: Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails Key: MAPREDUCE-6383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6383

[jira] [Resolved] (MAPREDUCE-6179) Running any MapReduce jobs is throwing Heap Error

2015-06-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6179. Resolution: Invalid Please use user@ mailing lists for general questions. The JIRA is not a

[jira] [Created] (MAPREDUCE-6325) Support use of ephemeral client ports for shuffle/etc.

2015-04-21 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6325: -- Summary: Support use of ephemeral client ports for shuffle/etc. Key: MAPREDUCE-6325 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6325 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4931) Add user-APIs for classpath precedence control

2015-03-24 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4931. Resolution: Not a Problem Target Version/s: (was: 3.0.0) Closing out as Not A

[jira] [Resolved] (MAPREDUCE-3536) consider whether the same instance of a ServiceStateChangeListener should be allowed to listen to events

2015-03-18 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-3536. Resolution: Duplicate > consider whether the same instance of a ServiceStateChangeListe

[jira] [Resolved] (MAPREDUCE-5556) mapred docs have incorrect classpath

2015-03-18 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5556. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Harsh J Hadoop Flags

[jira] [Resolved] (MAPREDUCE-6276) Error in encrypted shuffle

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6276. Resolution: Invalid Please use the community lists/forums for user-level issues. The JIRA is

[jira] [Resolved] (MAPREDUCE-6145) No space in an error output message

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6145. Resolution: Not a Problem @Avinash - I suggest emailing u...@hadoop.apache.org for general

[jira] [Resolved] (MAPREDUCE-2557) Counters don't reset state when readFields() called

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2557. Resolution: Duplicate This should be resolved via MAPREDUCE-6199 (which adds in a reset API as

[jira] [Resolved] (MAPREDUCE-1557) MapReduce teragen example should print correct error message for invalid inputs. Currently throws ArrayIndexOutOfBoundsException .

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1557. Resolution: Duplicate > MapReduce teragen example should print correct error message

[jira] [Resolved] (MAPREDUCE-2397) Allow user to sort jobs in different sections (Completed, Failed, etc.) by the various columns available

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2397. Resolution: Won't Fix MR2 has this feature already. > Allow user to sort jobs in d

[jira] [Resolved] (MAPREDUCE-2561) Typo in a comment in TaskInProgress.java

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2561. Resolution: Not a Problem Resolving as this has gone stale. If there's a substantial amou

[jira] [Resolved] (MAPREDUCE-6039) mapreduce.v2.hs.webapp.dao.TestJobInfo is using old name of job history file

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6039. Resolution: Not a Problem Resolving per Jason's earlier comment. Separate JIRA can be fil

[jira] [Resolved] (MAPREDUCE-1096) Add getNames method to VerticaRecord to retrieve input column names

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1096. Resolution: Not a Problem The vertica contrib connector does not exist anymore in the current

[jira] [Resolved] (MAPREDUCE-410) JobTracker TaskInitialization failure on cygwin

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-410. --- Resolution: Cannot Reproduce This has gone stale. Checkout the windows support in branch-1-win (or

Re: MR Code example with Kerberos Authentication

2015-02-23 Thread Harsh J
usly been answered. > > > Thanks > > Rahul -- Harsh J

Re: Hadoop-QA finds FindBugs issues in code I did not even touch

2014-12-27 Thread Harsh J
t; FindBugs, but they occur in files I did not touch and that are not affected > by my patches. A clear sign is that both patches, which are completely > different, introduce the same set of new FindBugs issues. What can I do in > that case? > > Thanks, and merry christmas, > Jens -- Harsh J

Re: Using hadoop with other distributed filesystems

2014-12-17 Thread Harsh J
g.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2202) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2378) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2402) > 2014-12-17 20:02:34,036 INFO org.apache.hadoop.util.ExitUtil: Exiting with > status 1 > > > I really appreciate if any one help about these problems. > Thanks in advance, > > -- > Behrooz -- Harsh J

[jira] [Created] (MAPREDUCE-6194) Bubble up final exception in failures during creation of output collectors

2014-12-13 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6194: -- Summary: Bubble up final exception in failures during creation of output collectors Key: MAPREDUCE-6194 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6194 Project

[jira] [Resolved] (MAPREDUCE-6177) Minor typo in the EncryptedShuffle document about ssl-client.xml

2014-12-08 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6177. Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Thank you for

[jira] [Resolved] (MAPREDUCE-1587) NPE in JobClient querying an (empty) queue

2014-07-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1587. Resolution: Cannot Reproduce No longer an issue with recent releases (for the described

Re: How to process part of a file in Hadoop?

2014-02-07 Thread Harsh J
tute of Technology,* > *Tiruchirappalli - 620015.* > *+91-9941506562* -- Harsh J

Re: how to set org.apache.hadoop classpath?

2014-01-27 Thread Harsh J
tion in error,please > immediately notify the sender by return e-mail, and delete the original > message and all copies from > your system. Thank you. > --- -- Harsh J

[jira] [Resolved] (MAPREDUCE-5705) mapreduce.task.io.sort.mb hardcoded cap at 2047

2014-01-04 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5705. Resolution: Duplicate What Gera said. Also, please see MAPREDUCE-4866. Marking this one as a

Re: About block splitting, input split and TextInputFormat in MapReduce

2013-10-18 Thread Harsh J
r value of > InputSplit. But it is not correct because of SPLIT_SLOPE. But this is wrong, > I think! Please let me know the exact reason of InputSplitting mechanism! > > (Let we consider that the last remaining data is 64.8MB (bytesRemaining) and > splitSize is 64MB, so bytesRemaining / splitSize == 1.01 < SPLIT_SLOP, so it > just becomes one input splits!!) > > > > Thank you for reading my very long question! -- Harsh J

[jira] [Resolved] (MAPREDUCE-113) [mapred] Job submission to an invalid queue should fail.

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-113. --- Resolution: Not A Problem Looks like we already have this immediate-failure (regardless of ACLs

[jira] [Resolved] (MAPREDUCE-104) Not able to refresh file cache

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-104. --- Resolution: Cannot Reproduce This has gone stale. I tried running a test as described by Hairong

[jira] [Resolved] (MAPREDUCE-102) NPE in tracker expiry thread.

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-102. --- Resolution: Not A Problem Not a problem anymore on any of the recent stable releases - and we&#x

[jira] [Resolved] (MAPREDUCE-5) Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException

2013-09-02 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5. - Resolution: Not A Problem This one's been stale for a long time, and given the below comment from

[jira] [Created] (MAPREDUCE-5492) Suppress expected log output stated on MAPREDUCE-5

2013-09-02 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-5492: -- Summary: Suppress expected log output stated on MAPREDUCE-5 Key: MAPREDUCE-5492 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5492 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4560) Job can get stuck in a deadlock between mappers and reducers for low values of mapreduce.job.reduce.slowstart.completedmaps (<<1)

2013-09-02 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4560. Resolution: Duplicate Fix Version/s: (was: 2.0.0-alpha) Resolving as Dupe as noted

Re: Abstraction layer to support both YARN and Mesos

2013-07-26 Thread Harsh J
because MRv2's code base is tightly > coupled with YARN currently. Thoughts? > > - Tsuyoshi -- Harsh J

Re: I wrote a scheduler. How to compile and put it to action?

2013-07-08 Thread Harsh J
e some experts can shed some > light. > > Sincerely, > Sreejith R > > P. S: I had asked another question recently. I got very good answers. I > was so busy I couldn't even thank them. Special thanks to Kun Ling -- Harsh J

[jira] [Created] (MAPREDUCE-5288) ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues

2013-06-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-5288: -- Summary: ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues Key: MAPREDUCE-5288 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5288

Re: How to handle multiline record for inputsplit?

2013-05-20 Thread Harsh J
in a single InputSplit ? > Any work around or hint will be really useful. > > Thanks in advance. > DR > -- Harsh J

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-17 Thread Harsh J
gt; 24th at 2:00pm PDT. > > Thanks, > Tom Graves > -- Harsh J

Re: which mapreduce project to work on?

2013-05-15 Thread Harsh J
at some reduce > work begin before all maps ends their job. > > The very first question is which project from svn is more adequate to work > on/develop? > > Second, is there a possibility to implement such a thing and if yes which > classes/packages should I look in? > > > thanks, > Elma > > -- Harsh J

Re: JVM vs container memory configs

2013-05-05 Thread Harsh J
While I think work should be done to make the numbers nearby, we should ideally raise the JVM heap value than lower the memory.mb resource request of MR tasks. Otherwise, with YARN, users will start seeing more containers per node than before. Also good to raise heap plus the sort buffer memory of

Re: JVM vs container memory configs

2013-05-05 Thread Harsh J
t; should be left on top of mapred.child.java.opts (or other similar JVM opts) > for > the container memory itself? > > I would like to have separated java option settings for map/reduce parts. > Something like > mapred.map.child.java.opts mapred.reduce.child.java.opts. > -- Harsh J

Re: Versions - Confusion

2013-05-01 Thread Harsh J
t;> > I was confused with Hadoop versioning. >> > I found that, some people working on version starting with "0". >> > Some others, working on version starting with "2". >> > Also, i was confused with "branch". >> > >> > Which version is really current version. >> > *Regards* >> > *S.Suresh,* >> > *Research Scholar,* >> > *Department of Computer Applications,* >> > *National Institute of Technology,* >> > *Tiruchirappalli - 620015.* >> > *+91-9941506562* >> -- Harsh J

Re: Build failed for Hadoop-1.0.4

2013-04-29 Thread Harsh J
myself with the Hadoop code base, would > install cygwin later on and run. Initially, I build one of the Hadoop > version(I don't remember which one but was successful in building with ant > but now I got this error, file missing. > > Regards > thoihen > > > Regards > thoihen -- Harsh J

Re: MapTask.java -sort part

2013-04-23 Thread Harsh J
priate version for me ? > > Samaneh > > > On Tue, Apr 23, 2013 at 10:01 AM, Harsh J wrote: > >> Note that the Reducer also does a merge sort over the acquired map >> data; but am not sure if you looked there as well. >> >> Mariappan's pointed JIRA (M

Re: MapTask.java -sort part

2013-04-23 Thread Harsh J
dSpill method but no changes seen in result. I have expected to get > unsorted keys as mapper output but was not like that. > > My question is did i perform right action to disable sort or something else > needs to be done ? > > Samaneh -- Harsh J

Re: JobConf and MiniMapRedCluster

2013-04-17 Thread Harsh J
ome light googling that, at some point > > ** some version of JobConf was deprecated, and that maybe again it was > undeprecated or maybe moved** > > Will have to look into this more formally to really determine what's going on. > > > > On Apr 18, 2013, at 1:

Re: JobConf and MiniMapRedCluster

2013-04-17 Thread Harsh J
updates if this makes sense :) > > Would love to bring the minimrcluster class up to date! > > On Apr 18, 2013, at 12:49 AM, Harsh J wrote: > >> Why do you imagine a test case would need the Configured and Tool >> interfaces, which are more useful for actua

Re: JobConf and MiniMapRedCluster

2013-04-17 Thread Harsh J
gt; Any plans to update this or should file a JIRA? > > -- > Jay Vyas > http://jayunit100.blogspot.com -- Harsh J

Re: [VOTE] Release Apache Hadoop 0.23.7

2013-04-16 Thread Harsh J
;> http://people.apache.org/~tgraves/hadoop-0.23.7-candidate-0/ >> The RC tag in svn is here: >> http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.7-rc0/ >> >> The maven artifacts are available via repository.apache.org. >> >> Please try the release and vote; the vote will run for the usual 7 days. >> >> thanks, >> Tom Graves >> > -- Harsh J

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-16 Thread Harsh J
y the release and vote; the vote will run for the usual 7 days. >> >> thanks, >> Arun >> >> >> -- >> Arun C. Murthy >> Hortonworks Inc. >> http://hortonworks.com/ >> >> >> -- Harsh J

[jira] [Resolved] (MAPREDUCE-5100) jobconf_history.jsp is not showing job configs in case of retired jobs

2013-04-12 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5100. Resolution: Cannot Reproduce Fix Version/s: 1.3.0 Tried on branch-1 and an earlier

[jira] [Resolved] (MAPREDUCE-5106) mapreduce.jobtracker.split.metainfo.maxsize can be set at job level

2013-03-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5106. Resolution: Not A Problem Looking at branch-1's implementation (JobInProgress), this is

Re: Help on submitting a patch for an unassigned bug

2013-03-26 Thread Harsh J
to contribute to Hadoop' > on Wiki but couldn't find related to assigning the bug or may be I missed > out somewhere. > > Thanks in advance. > > Regards, > Niranjan -- Harsh J

[jira] [Reopened] (MAPREDUCE-1380) Adaptive Scheduler

2013-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-1380: Unsure why this was resolved as fixed. Its not been committed anywhere, so reopening as

Re: shuffling one intermediate pair to more than one reducer

2013-03-24 Thread Harsh J
rowse/MAPREDUCE-5063 > > Thank you. > -- > > > Thanx and Regards > Vikas Jadhav -- Harsh J

[jira] [Resolved] (MAPREDUCE-1849) Implement a FlumeJava-like library for operations over parallel collections using Hadoop MapReduce

2013-03-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1849. Resolution: Implemented Crunch is now a top level Apache project (Apache Crunch): http

Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI().

2013-03-22 Thread Harsh J
at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3797) > ... 12 more > 2013-03-21 21:04:56,979 INFO org.apache.hadoop.hdfs.DFSClient: > read.type=dfs block=blk_972265969568196888_2183 > src=/home/ec2-user/Hadoop/tmp/mapred/staging/ec2-user/.staging/job_201303212104_0005/job.splitmetainfo > > > Xiao Yu -- Harsh J

Re: Why In-memory Mapoutput is necessary in ReduceCopier

2013-03-17 Thread Harsh J
>> call ramManager.canFitInMemory(). why not store all the data to disk? >> >> 3. According to the comment, Hadoop will put a file in memory if it meets: >> a, the size of the (decompressed) file should be less than 25% of the total >> inmem fs; b, there is space available in the inmem fs. Why ? Is it because >> of the performance? >> >> >> >> Thanks >> >> yours, >> Ling Kun >> >> -- >> http://www.lingcc.com >> > > > > -- > http://www.lingcc.com -- Harsh J

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-27 Thread Harsh J
Merge patch for this is available on >>> HADOOP-8562<https://issues.apache.org/jira/browse/HADOOP-8562> >>> . >>> >>> Highlights of the work done so far: >>> 1. Necessary changes in Hadoop to run natively on Windows. These changes >>> handle differences in platforms related to path names, process/task >>> management etc. >>> 2. Addition of winutils tools for managing file permissions and >>>ownership, >>> user group mapping, hardlinks, symbolic links, chmod, disk utilization, >>>and >>> process/task management. >>> 3. Added cmd scripts equivalent to existing shell scripts >>> hadoop-daemon.sh, start and stop scripts. >>> 4. Addition of block placement policy implemnation to support cloud >>> enviroment, more specifically Azure. >>> >>> We are very close to wrapping up the work in branch-trunk-win and >>>getting >>> ready for a merge. Currently the merge patch is passing close to 100% of >>> unit tests on Linux. Soon I will call for a vote to merge this branch >>>into >>> trunk. >>> >>> Next steps: >>> 1. Call for vote to merge branch-trunk-win to trunk, when the work >>> completes and precommit build is clean. >>> 2. Start a discussion on adding Jenkins precommit builds on windows and >>> how to integrate that with the existing commit process. >>> >>> Let me know if you have any questions. >>> >>> Regards, >>> Suresh >>> >>> >> >> >>-- >>http://hortonworks.com/download/ > -- Harsh J

Re: mapreduce.jobtracker.address vs. yarn.resourcemanager.address

2013-02-10 Thread Harsh J
ht to you Harsh? > > Was there a conclusion on: may I deprecate it, or is there a larger > decision being waited on? > > -Sandy > > On Fri, Feb 8, 2013 at 9:35 PM, Harsh J wrote: > >> Yes, there isn't a "classic" version of mapreduce.framework.name now &

Re: API incompatibility between Hadoop 1.0 and Hadoop 2.0

2013-02-08 Thread Harsh J
th. > For example JobContext was class in 1.0 while Interface in 2.0. So, user > has to change code. > I was more interested in such cases (if it was documented) > > 2013/2/8 Harsh J > >> Hey Lohit, >> >> It may not be exactly in the form you're

Re: mapreduce.jobtracker.address vs. yarn.resourcemanager.address

2013-02-08 Thread Harsh J
gt; cannot be run with Hadoop 2.0 *(by which time we should remove JT/TT etc.), >> then we can deprecate these configs. >> >> Thanks, >> +Vinod >> >> On Feb 8, 2013, at 2:15 PM, Sandy Ryza wrote: >> >> > Is there a reason why mapreduce.jobtracker.address is not deprecated to >> > yarn.resourcemanager.address? >> > >> > thanks, >> > Sandy >> >> > > > -- > Alejandro -- Harsh J

Re: API incompatibility between Hadoop 1.0 and Hadoop 2.0

2013-02-08 Thread Harsh J
t; Is there a documented list of API incompatibility between version 1.0 and > version 2.0 of APIs. > > -- > Have a Nice Day! > Lohit -- Harsh J

Re: pre-historic record IO stuff, is this used anywhere?

2013-02-08 Thread Harsh J
g compiles fine. > > To me all this is dead code, if so, can we nuke them? > > Thx > > -- > Alejandro -- Harsh J

[jira] [Resolved] (MAPREDUCE-4678) Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException

2013-01-15 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4678. Resolution: Fixed Fix Version/s: (was: 3.0.0) 0.23.6

[jira] [Created] (MAPREDUCE-4931) Add user-APIs for classpath precedence control

2013-01-10 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4931: -- Summary: Add user-APIs for classpath precedence control Key: MAPREDUCE-4931 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4931 Project: Hadoop Map/Reduce

Re: running Combiner for all the task on the node.

2013-01-02 Thread Harsh J
nt of Computer Applications,* > *National Institute of Technology,* > *Tiruchirappalli - 620015.* > *+91-9941506562* -- Harsh J

Re: How to compile the JobTracker.java

2012-12-17 Thread Harsh J
; code on Eclipse. > > Thank in advance. > > -- > Atenciosamente, > *Tiago Rodrigo Kepe* > Graduando em Ciência da Computação - UFPR > Analista de Desenvolvimento na Siemens Enterprise. -- Harsh J

Re: Fate of skipping-bad-records feature (MAPREDUCE-4840)

2012-12-03 Thread Harsh J
meone is aware of that and there's a plan to fix, so I'm > wondering where that is tracked. I'm not aware of anyone working on this. I did attempt it myself once, pre-MR2 days, but we wound up deciding it is unsuitable to support this ourselves. -- Harsh J

[jira] [Resolved] (MAPREDUCE-4172) Clean up java warnings in the hadoop-mapreduce-project sub projects

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4172. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Resolved] (MAPREDUCE-4173) Clean up hadoop-mapreduce-client-app

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4173. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Resolved] (MAPREDUCE-4174) Clean up hadoop-mapreduce-client-common

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4174. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Resolved] (MAPREDUCE-4175) Clean up hadoop-mapreduce-client-core

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4175. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Resolved] (MAPREDUCE-4176) Clean up hadoop-mapreduce-client-hs

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4176. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Resolved] (MAPREDUCE-4182) Remove an used import from TestDistributedShell

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4182. Resolution: Won't Fix Setting proper resolution. > Remove an used imp

[jira] [Reopened] (MAPREDUCE-4182) Remove an used import from TestDistributedShell

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-4182: > Remove an used import from TestDistributedSh

[jira] [Resolved] (MAPREDUCE-4183) Clean up yarn-common

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4183. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these for

[jira] [Reopened] (MAPREDUCE-3968) add support for getNumMapTasks() into mapreduce JobContext

2012-11-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-3968: Radim, I think this can go in - my earlier questions were just to know purpose. Sorry I did not

Re: Shuffle phase: fine-grained control of data flow

2012-11-07 Thread Harsh J
p 1.0.4 to choose reduce nodes > does not help reduce network traffic. If JobTracker is fully aware of > locations of every map output, why not take advantage of this topology > knowledge? > > So, is there anyone who knows where to develop such codes upon? Many thanks. > > Regards. > -- > Jiwei -- Harsh J

[jira] [Resolved] (MAPREDUCE-4773) MultipleOutput with different output path for each

2012-11-06 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4773. Resolution: Not A Problem Good to know. In future, please use the user-lists when you have an

Re: hadoop log files

2012-11-06 Thread Harsh J
menode ,datanode and etc . > Where can i see my logs that i added to different part of the source code > like MapTask.java file ? > > Cheers, > Samaneh -- Harsh J

[jira] [Created] (MAPREDUCE-4695) Fix LocalRunner on trunk after MAPREDUCE-3223 broke it

2012-10-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4695: -- Summary: Fix LocalRunner on trunk after MAPREDUCE-3223 broke it Key: MAPREDUCE-4695 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4695 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4694) Inconsistency in reduce record and counters between the stable and evolving APIs

2012-10-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4694: -- Summary: Inconsistency in reduce record and counters between the stable and evolving APIs Key: MAPREDUCE-4694 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4694

[jira] [Resolved] (MAPREDUCE-4678) Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException

2012-09-28 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4678. Resolution: Fixed Fix Version/s: 3.0.0 Target Version/s: (was: 3.0.0

[jira] [Created] (MAPREDUCE-4692) Investigate and remove MR1 JTConfig and its constants use in the MR project on trunk

2012-09-28 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4692: -- Summary: Investigate and remove MR1 JTConfig and its constants use in the MR project on trunk Key: MAPREDUCE-4692 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4692

Re: I want join of you

2012-09-27 Thread Harsh J
Welcome to the development community, Lamosi! Take a look at http://wiki.apache.org/hadoop/HowToContribute to get started. On Fri, Sep 28, 2012 at 7:00 AM, Lamosi wrote: > Because I want to learn someting about hadoop, so I want to subscribe to > the list,tank you. -- Harsh J

[jira] [Resolved] (MAPREDUCE-4690) remove deprecated properties in the default configurations

2012-09-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4690. Resolution: Duplicate Fix Version/s: (was: 3.0.0) Hi, please see MAPREDUCE-3223 for

[jira] [Created] (MAPREDUCE-4677) Text IF/OF separator character configuration should support passing non-XML-serializable characters

2012-09-23 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4677: -- Summary: Text IF/OF separator character configuration should support passing non-XML-serializable characters Key: MAPREDUCE-4677 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Resolved] (MAPREDUCE-3024) Make all poms to have hadoop-project POM as common parent

2012-09-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-3024. Resolution: Fixed Fix Version/s: (was: 0.24.0) 3.0.0 This seems

  1   2   3   4   >