[jira] [Created] (HDFS-7105) Fix TestJournalNode#testFailToStartWithBadConfig to match log output change

2014-09-19 Thread Ray Chiang (JIRA)
Ray Chiang created HDFS-7105: Summary: Fix TestJournalNode#testFailToStartWithBadConfig to match log output change Key: HDFS-7105 URL: https://issues.apache.org/jira/browse/HDFS-7105 Project: Hadoop HDFS

[jira] [Created] (HDFS-7104) Fix and clarify getter functions in INodesInPath

2014-09-19 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7104: --- Summary: Fix and clarify getter functions in INodesInPath Key: HDFS-7104 URL: https://issues.apache.org/jira/browse/HDFS-7104 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7103) TestStorageMover sometimes fails in trunk

2014-09-19 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7103: Summary: TestStorageMover sometimes fails in trunk Key: HDFS-7103 URL: https://issues.apache.org/jira/browse/HDFS-7103 Project: Hadoop HDFS Issue Type: Test Repo

[jira] [Created] (HDFS-7102) Null dereference in PacketReceiver#receiveNextPacket()

2014-09-19 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7102: Summary: Null dereference in PacketReceiver#receiveNextPacket() Key: HDFS-7102 URL: https://issues.apache.org/jira/browse/HDFS-7102 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7101) Potential null dereference in DFSck#doWork()

2014-09-19 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7101: Summary: Potential null dereference in DFSck#doWork() Key: HDFS-7101 URL: https://issues.apache.org/jira/browse/HDFS-7101 Project: Hadoop HDFS Issue Type: Bug Re

Re: [DISCUSS] Allow continue reading from being-written file using same stream

2014-09-19 Thread Stack
On Thu, Sep 18, 2014 at 12:48 AM, Vinayakumar B wrote: > Hi all, > > Currently *DFSInputStream *doen't allow reading a write-inprogress file, > once all written bytes, by the time of opening an input stream, are read. > > To read further update on the same file, needs to be read by opening > anot

[jira] [Resolved] (HDFS-7094) [ HDFS NFS ] TYPO in NFS configurations from documentation.

2014-09-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-7094. -- Resolution: Not a Problem > [ HDFS NFS ] TYPO in NFS configurations from documentation. > ---

[jira] [Resolved] (HDFS-7099) Support polling for more data from a write-in-progress file using same DFSInputStream

2014-09-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-7099. - Resolution: Duplicate Same discussion going on in HDFS-6633. So duplicating it. > Support polling

[jira] [Created] (HDFS-7100) Make eviction scheme pluggable

2014-09-19 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7100: --- Summary: Make eviction scheme pluggable Key: HDFS-7100 URL: https://issues.apache.org/jira/browse/HDFS-7100 Project: Hadoop HDFS Issue Type: Sub-task

Re: [DISCUSS] Allow continue reading from being-written file using same stream

2014-09-19 Thread Vinayakumar B
On Fri, Sep 19, 2014 at 10:32 PM, Colin McCabe wrote: > > On Fri, Sep 19, 2014 at 9:41 AM, Vinayakumar B > wrote: > > Thanks Colin for the detailed explanation. > > > > On Fri, Sep 19, 2014 at 9:38 PM, Colin McCabe > > wrote: > >> > >> On Thu, Sep 18, 2014 at 11:06 AM, Vinayakumar B > > wrote:

Re: [DISCUSS] Allow continue reading from being-written file using same stream

2014-09-19 Thread Colin McCabe
On Fri, Sep 19, 2014 at 9:41 AM, Vinayakumar B wrote: > Thanks Colin for the detailed explanation. > > On Fri, Sep 19, 2014 at 9:38 PM, Colin McCabe > wrote: >> >> On Thu, Sep 18, 2014 at 11:06 AM, Vinayakumar B > wrote: >> > bq. I don't know about the merits of this, but I do know that native >

[jira] [Resolved] (HDFS-7098) Support polling for more data from a write-in-progress file using same DFSInputStream

2014-09-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-7098. - Resolution: Duplicate Duplicate created due to slow internet > Support polling for more data from

Re: [DISCUSS] Allow continue reading from being-written file using same stream

2014-09-19 Thread Vinayakumar B
Thanks Colin for the detailed explanation. On Fri, Sep 19, 2014 at 9:38 PM, Colin McCabe wrote: > > On Thu, Sep 18, 2014 at 11:06 AM, Vinayakumar B wrote: > > bq. I don't know about the merits of this, but I do know that native > > filesystems > > implement this by not raising the EOF exception

[jira] [Created] (HDFS-7099) Support polling for more data from a write-in-progress file using same DFSInputStream

2014-09-19 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7099: --- Summary: Support polling for more data from a write-in-progress file using same DFSInputStream Key: HDFS-7099 URL: https://issues.apache.org/jira/browse/HDFS-7099 Proje

[jira] [Created] (HDFS-7098) Support polling for more data from a write-in-progress file using same DFSInputStream

2014-09-19 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7098: --- Summary: Support polling for more data from a write-in-progress file using same DFSInputStream Key: HDFS-7098 URL: https://issues.apache.org/jira/browse/HDFS-7098 Proje

Re: [DISCUSS] Allow continue reading from being-written file using same stream

2014-09-19 Thread Colin McCabe
On Thu, Sep 18, 2014 at 11:06 AM, Vinayakumar B wrote: > bq. I don't know about the merits of this, but I do know that native > filesystems > implement this by not raising the EOF exception on the seek() but only on > the read ... some of the non-HDFS filesystems Hadoop support work this way. Pre

[jira] [Created] (HDFS-7097) Allow block reports to be processed during checkpointing on standby name node

2014-09-19 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7097: Summary: Allow block reports to be processed during checkpointing on standby name node Key: HDFS-7097 URL: https://issues.apache.org/jira/browse/HDFS-7097 Project: Hadoop HDF

[jira] [Created] (HDFS-7096) Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI

2014-09-19 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7096: -- Summary: Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI Key: HDFS-7096 URL: https://issues.apache.org/jira/browse/HDFS-7096 Project: Hadoop HDFS

Re: [VOTE] Merge HDFS-6584 Archival Storage to trunk

2014-09-19 Thread Tsz Wo Sze
Hi HDFS dev, The HDFS-6584 branch has been merged to trunk. We will finish the following two items before merging it to branch-2. - HDFS-7081 Add new DistributedFileSystem API for getting all the existing storage policies - HDFS-7095 TestStorageMover often fails in Jenkins Thanks for all th

[jira] [Created] (HDFS-7095) TestStorageMover often fails in Jenkins

2014-09-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7095: - Summary: TestStorageMover often fails in Jenkins Key: HDFS-7095 URL: https://issues.apache.org/jira/browse/HDFS-7095 Project: Hadoop HDFS Issue Typ

Hadoop-Hdfs-trunk - Build # 1876 - Still Failing

2014-09-19 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1876/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6092 lines...] Build step 'Execute shell' marked build as

Build failed in Jenkins: Hadoop-Hdfs-trunk #1876

2014-09-19 Thread Apache Jenkins Server
See Changes: [szetszwo] HDFS-6677. Change INodeFile and FSImage to support storage policy ID. [szetszwo] HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies. [szetszwo] HDFS-6671. Change BlockPlacem

Re: Restarting HDFS datanode process

2014-09-19 Thread Biju N
Thanks Ted. On Thu, Sep 18, 2014 at 3:34 PM, Ted Yu wrote: > DFSClient would resume reading from where it stops from the next data node. > > Cheers > > On Thu, Sep 18, 2014 at 11:53 AM, Biju N wrote: > > > It is for the duration of the restart. The concern is what will happen to > > any reads w

[jira] [Created] (HDFS-7094) [ HDFS NFS ] TYPO in NFS configurations from documentation.

2014-09-19 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-7094: -- Summary: [ HDFS NFS ] TYPO in NFS configurations from documentation. Key: HDFS-7094 URL: https://issues.apache.org/jira/browse/HDFS-7094 Project: Hadoop H