[jira] [Updated] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3243: - Attachment: HDFS-3243.0.patch Turns out I left N_ITERATIONS as 4096 in HDFS-2834, not 1024 as it u

[jira] [Updated] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3243: - Status: Patch Available (was: Open) > TestParallelRead timing out on jenkins > --

[jira] [Updated] (HDFS-3235) MiniDFSClusterManager doesn't correctly support -format option

2012-04-09 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3235: - Status: Patch Available (was: Open) > MiniDFSClusterManager doesn't correctly support -format

[jira] [Updated] (HDFS-3235) MiniDFSClusterManager doesn't correctly support -format option

2012-04-09 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3235: - Attachment: HDFS-3235.0.patch Patch against trunk > MiniDFSClusterManager doesn't

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-04 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.5.patch You're right - my original thinking was that checking errno != 0 let

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.4.patch Patch addresses Todd's latest comments. > libhdfs i

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.3.patch New patch that's actually a diff vs trunk this time :/ I incorporat

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.2.patch Patch addressing Todd's concerns. I added a 'flags' field to hdfsFi

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-01 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.1.patch Here's a patch with a simple smoke test. I have also reworked test-l

[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster

2012-03-30 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3167: - Attachment: HDFS-3167.1.patch Removed unused 'stop', and unused default for nn port, also moved al

[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster

2012-03-30 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3167: - Attachment: HDFS-3167.patch Patch for trunk. Example invocation instructions in the class Javadoc.

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-03-22 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.0.patch Patch against trunk taking into account Todd's comments when this wa

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-03-22 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Status: Patch Available (was: Open) > libhdfs implementation of direct read API > ---

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-20 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.11.patch The curious case of the magic disappearing TestParallelReadUtil.jav

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-20 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.10.patch Review comments. > ByteBuffer-based read API for D

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-03-16 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Component/s: libhdfs > libhdfs implementation of direct read API > ---

[jira] [Updated] (HDFS-3067) NPE in DFSInputStream.readBuffer if read is repeated on corrupted block

2012-03-14 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3067: - Status: Open (was: Patch Available) Kicking Hudson, which seems to have forgotten about me :(

[jira] [Updated] (HDFS-3067) NPE in DFSInputStream.readBuffer if read is repeated on corrupted block

2012-03-14 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3067: - Status: Patch Available (was: Open) > NPE in DFSInputStream.readBuffer if read is repeated on

[jira] [Updated] (HDFS-3067) NPE in DFSInputStream.readBuffer if read is repeated on corrupted block

2012-03-11 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3067: - Attachment: HDFS-3067.1.patch Patch addresses review comments. > NPE in DFSInput

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-08 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.9.patch New patch addressing review comments. Note - I've left out the libhd

[jira] [Updated] (HDFS-3067) NPE in DFSInputStream.readBuffer if read is repeated on corrupted block

2012-03-08 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3067: - Summary: NPE in DFSInputStream.readBuffer if read is repeated on corrupted block (was: Null point

[jira] [Updated] (HDFS-3067) Null pointer in DFSInputStream.readBuffer if read is repeated on singly-replicated corrupted block

2012-03-08 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3067: - Attachment: HDFS-3607.patch Patch + test. The problem was that the failing first read leaves cur

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-06 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.8.patch This patch should fix the findbugs warning, plus removes some debugg

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-06 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.7.patch Patch with review comments addressed. I'm running a soak test over

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-05 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: hdfs-2834-libhdfs-benchmark.png > ByteBuffer-based read API for DFSInputStream > -

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.6.patch Patch with findbugs warnings hopefully fixed. > By

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.5.patch Turns out a conditional around an assert was accidentally removed. T

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.4.patch Resubmitting the patch now that HADOOP-8135 has been committed, so t

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-02 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.3.patch Here's a patch rebased after the HA merge. > ByteBu

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-02 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834-no-common.patch Thanks Aaron! Should have known to keep common and hdfs patc

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-01 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Status: Patch Available (was: Open) > ByteBuffer-based read API for DFSInputStream >

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-01 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.patch Patch without the duplicate ByteBufferReadable interface, and with les

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-03-01 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Attachment: HDFS-2834.patch Here's a patch against trunk for this ticket. Tests (including new one

[jira] [Updated] (HDFS-2834) ByteBuffer-based read API for DFSInputStream

2012-01-24 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-2834: - Description: The {{DFSInputStream}} read-path always copies bytes into a JVM-allocated {{byte[]}}