Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

2023-03-28 Thread Igor Dvorzhak
+1 to re-focusing on 3.4 branch and upgrading it to Java 11/17, instead of making potentially breaking changes to 3.3. On Tue, Mar 28, 2023 at 11:17 AM Chris Nauroth wrote: > In theory, I like the idea of setting aside Java 8. Unfortunately, I don't > know that upgrading within the 3.3 line adhe

Re: Increased DN heap usage during Hadoop 3 upgrade

2020-10-05 Thread Igor Dvorzhak
What Hadoop 3 version do you use? On Mon, Oct 5, 2020 at 10:03 AM Wei-Chiu Chuang wrote: > I have anecdotally learned of multiple data points where during the > upgrading from Hadoop 2 to Hadoop 3, DN heap usage increases to the point > where it goes OOM. > > Don't have much logs for this issue,

Re: [DISCUSS] Shade guava into hadoop-thirdparty

2020-04-04 Thread Igor Dvorzhak
How this proposal will impact public APIs? I.e does Hadoop expose any Guava classes in the client APIs that will require recompiling all client applications because they need to use shaded Guava classes? On Sat, Apr 4, 2020 at 12:13 PM Wei-Chiu Chuang wrote: > Hi Hadoop devs, > > I spent a good

Re: [DISCUSS] Accelerate Hadoop dependency updates

2020-03-12 Thread Igor Dvorzhak
minor releases are at best > 1 per year. That is too slow to respond to a critical vulnerability. > > On Wed, Mar 11, 2020 at 5:02 PM Igor Dvorzhak > wrote: > > > Generally I'm for updating dependencies, but I think that Hadoop should > > stick with semantic versio

Re: [DISCUSS] Accelerate Hadoop dependency updates

2020-03-11 Thread Igor Dvorzhak
Generally I'm for updating dependencies, but I think that Hadoop should stick with semantic versioning and do not make major and minor dependency updates in subminor releases. For example, Hadoop 3.2.1 updated Guava to 27.0-jre, and because of this Spark 3.0 stuck with Hadoop 3.2.0 - they use Hiv

Re: HADOOP-15124 review

2018-06-26 Thread Igor Dvorzhak
; mailing list is mainly used for discussing and answering user’s questions. > You can ask for the review under specific JIRA, that will be seen by > committers or others. If they have time, they will help take the review. > > Yiqun > Thanks > > 发件人: Igor Dvorzhak [mailto:i...@

Re: HADOOP-15124 review

2018-06-26 Thread Igor Dvorzhak
+common-...@hadoop.apache.org On Tue, Jun 26, 2018 at 8:49 AM Igor Dvorzhak wrote: > Hello, > > I have a patch <https://issues.apache.org/jira/browse/HADOOP-15124> that > improves FileSystem.Statistics implementation and I would like to commit it. > > May somebody rev

HADOOP-15124 review

2018-06-26 Thread Igor Dvorzhak
Hello, I have a patch <https://issues.apache.org/jira/browse/HADOOP-15124> that improves FileSystem.Statistics implementation and I would like to commit it. May somebody review it? Best regards, Igor Dvorzhak smime.p7s Description: S/MIME Cryptographic Signature