Implement a Map-Reduce application which can be used to reliably launch
speculative tasks
-
Key: HADOOP-2214
URL: https://issues.apache.org/jira/browse/HADOOP-2214
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542931
]
Edward Yoon commented on HADOOP-2171:
-
And i think HADOOP-2068 is different issue from it.
> [Hbase Shell] Sock
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: Appends.doc
Thanks for you comments. Your understanding is absolutely correc
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: (was: Appends.htm)
> Append to files in HDFS
> ---
>
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: (was: Appends.doc)
> Append to files in HDFS
> ---
>
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: (was: Appends-1.xhtml)
> Append to files in HDFS
> -
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: Appends.html
An html version of this design document.
> Append to files in
[
https://issues.apache.org/jira/browse/HADOOP-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-2149:
-
Status: Open (was: Patch Available)
I would like to request Raghu to review this patch.
[
https://issues.apache.org/jira/browse/HADOOP-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-2078:
-
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this
[
https://issues.apache.org/jira/browse/HADOOP-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542772
]
Hudson commented on HADOOP-1917:
Integrated in Hadoop-Nightly #304 (See
[http://lucene.zones.apache.org:8080/hudson
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542959
]
Jim Kellerman commented on HADOOP-1700:
---
One more comment. As I am not entirely familiar with the internals of
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542956
]
Jim Kellerman commented on HADOOP-1700:
---
Comments on the document.
In the Requirements section:
> There can
[
https://issues.apache.org/jira/browse/HADOOP-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542957
]
Devaraj Das commented on HADOOP-2211:
-
+1 to the finite timeout
> The default task timeout for streaming should
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542954
]
Edward Yoon commented on HADOOP-2171:
-
http://shell.hadoop.co.kr/PHPClient.php
You can see the example by click
[
https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542937
]
Sanjay Radia commented on HADOOP-1989:
--
Did the failed CRC test just work when you ran it again or did you fix
java.lang.ArithmeticException: / by zero in ChecksumFileSystem.open
---
Key: HADOOP-2212
URL: https://issues.apache.org/jira/browse/HADOOP-2212
Project: Hadoop
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HADOOP-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1707:
-
Attachment: DataTransferProtocol.doc
A document that describes the streaming protocol us
[
https://issues.apache.org/jira/browse/HADOOP-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542930
]
Mukund Madhugiri commented on HADOOP-2190:
--
Can the command output be along the lines of what we see on lin
Job submission gets Job tracker still initializing message while Namenode is in
safemode
Key: HADOOP-2213
URL: https://issues.apache.org/jira/browse/HADOOP-2213
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542929
]
Edward Yoon commented on HADOOP-2171:
-
>> Have you considered having your clients making HTTP requests against t
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542867
]
Arun C Murthy commented on HADOOP-2141:
---
bq. Is there a strong reason for disabling it for maps ?
To me it lo
[
https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1989:
-
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542900
]
Owen O'Malley commented on HADOOP-2141:
---
Ok, after talking to Koji, it looks like part of the problem was that
[
https://issues.apache.org/jira/browse/HADOOP-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542872
]
Milind Bhandarkar commented on HADOOP-2085:
---
A few comments on the patch:
If mapred.join.expr is not spec
[
https://issues.apache.org/jira/browse/HADOOP-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1707:
-
Attachment: DataTransferProtocol.html
The Data transfer Protocll document in html format
[
https://issues.apache.org/jira/browse/HADOOP-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lohit vijayarenu updated HADOOP-2190:
-
Attachment: HADOOP-2190-1.patch
Attached patch throws out error for ls, lsr, du, dus co
[
https://issues.apache.org/jira/browse/HADOOP-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542906
]
Hadoop QA commented on HADOOP-2113:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-2212:
--
Status: Patch Available (was: Open)
Here is a patch that applies against the 0.15.0 r
[
https://issues.apache.org/jira/browse/HADOOP-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-2212:
--
Attachment: hadoop-2212.patch
> java.lang.ArithmeticException: / by zero in ChecksumFi
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542896
]
Runping Qi commented on HADOOP-2141:
I don't think this Jira is that urgent and we have to have a quick patch
[
https://issues.apache.org/jira/browse/HADOOP-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542890
]
Hadoop QA commented on HADOOP-2207:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542835
]
Arun C Murthy commented on HADOOP-2141:
---
Do we know why the maps got stuck?
I'm sure speculation will help,
[
https://issues.apache.org/jira/browse/HADOOP-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542898
]
Milind Bhandarkar commented on HADOOP-2211:
---
I was just thinking about this in the context of HADOOP-2141.
The default task timeout for streaming should be large, but finite
--
Key: HADOOP-2211
URL: https://issues.apache.org/jira/browse/HADOOP-2211
Project: Hadoop
Issue Type: Bug
WebUI should also list current time
---
Key: HADOOP-2210
URL: https://issues.apache.org/jira/browse/HADOOP-2210
Project: Hadoop
Issue Type: Bug
Reporter: lohit vijayarenu
Priority: Mino
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542895
]
Owen O'Malley commented on HADOOP-2141:
---
{quote}
There are always going to be such corner cases, and proper sp
[
https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542893
]
Chad Walters commented on HADOOP-2206:
--
+1 for Jeff's suggestion
+1 for Arun's enthusiasm for reuse
> Design
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542869
]
Arun C Murthy commented on HADOOP-2141:
---
Thanks for your comments Runping, some thoughts of my own...
b
I believe its already invoked as part of nightlies. Its called along
the way making the tarball.
Perhaps my JIRA description should have been better? The 'package'
target already exists in main build.xml. This patch just 'forwards'
responsibility for packaging contribs down to the contribs
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542836
]
Owen O'Malley commented on HADOOP-2141:
---
This jira as stated is *not* a blocker. The blocker is why the maps a
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542848
]
Milind Bhandarkar commented on HADOOP-2141:
---
As I mentioned earlier, we have been seeing this problem more
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542861
]
Runping Qi commented on HADOOP-2141:
The above proposal sounds reasonable.
Here are some points to consider:
1
[
https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542859
]
stack commented on HADOOP-2040:
---
Committed patch to TestHRegion, the second commit on this JIRA.
> [hbase] Hudson han
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542852
]
Milind Bhandarkar commented on HADOOP-2141:
---
In my past life, using 2x the average to determine outliers h
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542850
]
Arun C Murthy commented on HADOOP-2141:
---
Here are some thoughts about how to go about it:
I propose we track
[
https://issues.apache.org/jira/browse/HADOOP-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542849
]
dhruba borthakur commented on HADOOP-2113:
--
+1. Code looks good.
> Add "-text" command to FsShell to decod
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HADOOP-2141:
--
Fix Version/s: (was: 0.15.1)
0.16.0
Priority: Major (was: Bloc
[
https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542842
]
Hadoop QA commented on HADOOP-2040:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542835
]
acmurthy edited comment on HADOOP-2141 at 11/15/07 10:24 AM:
--
Do we know why the ta
[
https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542840
]
Arun C Murthy commented on HADOOP-2141:
---
More importantly I'd like to make sure that the original blocker (if
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542791
]
stack commented on HADOOP-2171:
---
No. This feature is an option that will, IMO, be used infrequently. The hbase
star
[
https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542828
]
Arun C Murthy commented on HADOOP-2206:
---
Woah! That's very interesting to hear! We'd definitely be interested
[
https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542823
]
Sanjay Radia commented on HADOOP-1989:
--
I am seeing no merge conflicts with DataChecksum.java. (Just did an upd
Hello,
I managed to compile the wordcount-simple program and it seems to work fine.
I am trying to figure out if conceptually I could do the following:
My C++ program runs a function A that calls several times B. B, in turn, can
be parallelized, because right now it looks something like:
for (i =
Hi stack,
I imagine this target should be added to our Hudson builds. Please
ping me once this gets committed and I'll add it.
Cheers,
Nige
On Nov 14, 2007, at 4:36 PM, stack (JIRA) wrote:
[ https://issues.apache.org/jira/browse/HADOOP-2207?
page=com.atlassian.jira.plugin.system.is
[
https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542804
]
Owen O'Malley commented on HADOOP-1900:
---
Devaraj, it does address job tracker business because it assumes that
Thank you Konstantin,
The fact that we indeed added a new empty disk to the machine and set
the configuration appropriately indicates that we may be hitting the bug
you said. I have checked the storageid of the datanode, but I could not
obtain the previous storageid. Do you remember the Jira i
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542811
]
stack commented on HADOOP-2171:
---
Edward: Have you considered having your clients making HTTP requests against
the HQL
http://www.nytimes.com/reuters/technology/tech-ibm-cloud.html?_r=1&oref=slogin
(May require login)
[
https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542797
]
Owen O'Malley commented on HADOOP-2184:
---
Actually, a valid point is that we probably can't keep using a shared
[
https://issues.apache.org/jira/browse/HADOOP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542794
]
Owen O'Malley commented on HADOOP-1984:
---
Runping, it doesn't get to 10 minutes until it has failed 5 times. An
[
https://issues.apache.org/jira/browse/HADOOP-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542795
]
Hadoop QA commented on HADOOP-2207:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542737
]
Amareshwari Sri Ramadasu commented on HADOOP-1900:
--
Now considering only cluster size for varying h
[
https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542775
]
Jeff Hammerbacher commented on HADOOP-2206:
---
Hey, we have a Thrift service here at Facebook called Scribe
[
https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542777
]
Jeff Hammerbacher commented on HADOOP-2206:
---
I should also mention we're pretty far along with the "facili
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542778
]
Owen O'Malley commented on HADOOP-2208:
---
Actually, I would also cap sending the counters to once every 10 seco
See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/304/changes
Changes:
[acmurthy] HADOOP-2205. Regenerate the Hadoop website since some of the
changes made by HADOOP-1917 weren't correctly copied over to the trunk/docs
directory. Also fixed a couple of minor typos and broken li
[
https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542773
]
Hudson commented on HADOOP-2205:
Integrated in Hadoop-Nightly #304 (See
[http://lucene.zones.apache.org:8080/hudson
See
https://issues.apache.org/jira/secure/attachment/12345251/Rack_aware_HDFS_pr
oposal.pdf for an overview of the Network Topology in hadoop. The distance
between two nodes is calculated by summing up their distances to their
closest common ancestor.
For the management of the location of a node,
[
https://issues.apache.org/jira/browse/HADOOP-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542752
]
Hadoop QA commented on HADOOP-2196:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542748
]
acmurthy edited comment on HADOOP-2208 at 11/15/07 4:15 AM:
-
bq. One really simple o
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542747
]
Arun C Murthy commented on HADOOP-2208:
---
One really simple option is to to add a {{Counters.clear}} method and
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542741
]
Edward Yoon commented on HADOOP-2171:
-
I want to develop the linux shell script for server start.
Shoul it be pu
[
https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Yoon updated HADOOP-2171:
Attachment: patch_v02.txt
see : http://wiki.apache.org/lucene-hadoop/Hbase/HbaseShell/PHP
> [Hbas
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542748
]
Arun C Murthy commented on HADOOP-2208:
---
bq. One really simple option is to to add a Counters.clear method and
[
https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542723
]
Enis Soztutar commented on HADOOP-2206:
---
Some ideas :
* the logs should have associated log type attribute.
[
https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542737
]
amareshwari edited comment on HADOOP-1900 at 11/15/07 3:20 AM:
Now consi
[
https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542735
]
Hadoop QA commented on HADOOP-2205:
---
+1 overall. Here are the results of testing the latest attachment
http://is
[
https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542695
]
Enis Soztutar commented on HADOOP-2205:
---
+1 for the patch, and +1 for deploying other pages.
> Regenerate en
[
https://issues.apache.org/jira/browse/HADOOP-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-2113:
--
Status: Patch Available (was: Open)
> Add "-text" command to FsShell to decode SequenceFile t
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amareshwari Sri Ramadasu reassigned HADOOP-2208:
Assignee: Amareshwari Sri Ramadasu (was: Rajagopal Natarajan)
> R
[
https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-2205:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
Thanks for the review Enis.
[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajagopal Natarajan reassigned HADOOP-2208:
---
Assignee: Rajagopal Natarajan
> Reduce frequency of Counter updates in the t
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: Appends.doc
This version has description about how appends will work with Bl
[
https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1700:
-
Attachment: (was: Appends.doc)
> Append to files in HDFS
> ---
>
[
https://issues.apache.org/jira/browse/HADOOP-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-2209:
-
Attachment: secondaryExit.patch
Terminate the SecondaryNamenode if it encounters a runti
[
https://issues.apache.org/jira/browse/HADOOP-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur reassigned HADOOP-2209:
Assignee: dhruba borthakur
> SecondaryNamenode process should exit if it encounter
[
https://issues.apache.org/jira/browse/HADOOP-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-2113:
--
Attachment: 2113-1.patch
Added a test case
> Add "-text" command to FsShell to decode Sequenc
SecondaryNamenode process should exit if it encounters Runtime exceptions
-
Key: HADOOP-2209
URL: https://issues.apache.org/jira/browse/HADOOP-2209
Project: Hadoop
Issue
89 matches
Mail list logo
