Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

2023-03-29 Thread Nick Dimiduk
On Tue, Mar 28, 2023 at 1:56 PM Steve Loughran wrote: > Now that hadoop 3.3.5 is out, i want to propose something new > > we switch branch-3.3 and trunk to being java11 only > I agree that maintaining support for Java8 is becoming burdensome. Over in HBase, we maintain support for both Java8

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

2023-03-28 Thread Nick Dimiduk
On Mon, Mar 27, 2023 at 20:29 Wei-Chiu Chuang wrote: > For complex applications such as > HBase it is almost impossible to achieve true FS agnosticity without proper > contract tests, as now I am starting to realize. > This is absolutely true. HBase jumps through all sorts of painful reflective

[jira] [Resolved] (HDFS-14981) BlockStateChange logging is exceedingly verbose

2019-11-12 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk resolved HDFS-14981. - Resolution: Duplicate Yep, I think you're right. Thanks for the pointer [~weichiu

[jira] [Created] (HDFS-14981) BlockStateChange logging is exceedingly verbose

2019-11-12 Thread Nick Dimiduk (Jira)
Nick Dimiduk created HDFS-14981: --- Summary: BlockStateChange logging is exceedingly verbose Key: HDFS-14981 URL: https://issues.apache.org/jira/browse/HDFS-14981 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9803) Proactively refresh ShortCircuitCache entries to avoid latency spikes

2016-02-12 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created HDFS-9803: -- Summary: Proactively refresh ShortCircuitCache entries to avoid latency spikes Key: HDFS-9803 URL: https://issues.apache.org/jira/browse/HDFS-9803 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.6.1 RC0

2015-09-16 Thread Nick Dimiduk
Hi folks, I ran a modified version [0] of the compatibility checking tool we use in HBase over this release. There's one source-related issue [1] in YARN API that may need to be addressed in the next candidate. Otherwise, it's looking pretty clean for a patch release. Nice job! [0]:

Re: Controlling the block placement and the file placement in HDFS writes

2014-12-18 Thread Nick Dimiduk
HBase would enjoy a similar functionality. In our case, we'd like all replicas for all files in a given HDFS path to land on the same set of machines. That way, in the event of a failover, regions can be assigned to one of these other machines that has local access to all blocks for all region

[jira] [Created] (HDFS-5292) clean up output of `dfs -du -s`

2013-10-02 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created HDFS-5292: -- Summary: clean up output of `dfs -du -s` Key: HDFS-5292 URL: https://issues.apache.org/jira/browse/HDFS-5292 Project: Hadoop HDFS Issue Type: Improvement