Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

2024-07-26 Thread Mukund Madhav Thakur
PR [1], if it has anything relevant missing on trunk > > -Ayush > > [1] https://github.com/apache/hadoop/pull/4953 > > On Fri, 26 Jul 2024 at 03:46, Mukund Madhav Thakur > wrote: > > > > Hi Everyone, > > I am trying to create arm64 binaries for RC 3.4.1 in my local M

Need help with gpg signing while creating 3.4.1 release using MacOS M3

2024-07-25 Thread Mukund Madhav Thakur
Hi Everyone, I am trying to create arm64 binaries for RC 3.4.1 in my local MacOS but it is failing with below gpg signing error inside docker. Same command runs perfectly fine outside docker on my mac. Please advise of any solution/workaround if any of you have seen this before. Thanks starting

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Mukund Madhav Thakur
+1 (binding) Thanks for driving the release, Shilun Fan. - Verified checksums and signatures. - Build the source on macOS and Java 8. - Ran AWS and Azure tests ( some known failures, created Jira's HADOOP-19106 it is a test side issue only mostly related to test configs, also as

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

2024-02-15 Thread Mukund Madhav Thakur
Thanks, Shilun for putting this together. Tried the below things and everything worked for me. validated checksum and gpg signature. compiled from source. Ran AWS integration tests. untar the binaries and able to access objects in S3 via hadoop fs commands. compiled gcs-connector successfully

Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-03 Thread Mukund Madhav Thakur
+1 from me. It will include the new AWS V2 SDK upgrade as well. On Wed, Jan 3, 2024 at 6:35 AM Xiaoqiao He wrote: > > > > I think the release discussion can be in public ML? > > Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. > > Best Regards, > - He Xiaoqiao > > On Tue, Jan 2,

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Mukund Madhav Thakur
Hi Wei-Chiu, Thanks for driving the release. +1 (binding) Verified checksum and signature. Built from source successfully. Ran aws Itests Ran azure Itests Compiled hadoop-api-shim Compiled google cloud storage. I see two two test failures in GCS connector as seen by you. Created issue.

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-20 Thread Mukund Madhav Thakur
Hi Wei-Chiu, Thanks for driving the release. +1 (binding) Verified checksum and signature. Built from source successfully. Ran aws Itests Ran azure Itests Compiled hadoop-api-shim Compiled google cloud storage. I did see the two test failures in GCS connector as well but those are harmless.

Re: [ANNOUNCE] New Hadoop PMC member - Mukund Thakur

2023-02-08 Thread Mukund Madhav Thakur
Thanks Everyone :) On Wed, Feb 8, 2023 at 4:28 PM Sunil Govindan wrote: > Congratulations Mukund!!! > > Thanks > Sunil > > On Wed, Feb 8, 2023 at 1:48 AM Vinayakumar B > wrote: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Mukund > > Thakur (mthakur) has accepted the

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-09 Thread Mukund Madhav Thakur
> > > Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it > mentioned anywhere in change log or release notes. Are they actually > up-to-date? > > I think it is because of what Ayush said. They are marked as done but not fixed. Also, some were marked with wrong fix versions,

[DISCUSS] Kicking off 3.3.5 RC0

2022-12-16 Thread Mukund Madhav Thakur
Hi Everyone, Steve and I are just kicking off the Hadoop-3.3.5-RC0 build from branch https://github.com/apache/hadoop/commits/branch-3.3.5 and will post the artifacts soon once they are published. We know it is the holiday season but it would be nice if folks can try the release. Thanks, Mukund

Merged HADOOP-18103 (Vectored IO) with a merge commit in trunk.

2022-06-22 Thread Mukund Madhav Thakur
Hi Everyone, Today we merged Vectored IO feature ( https://issues.apache.org/jira/browse/HADOOP-18103) from https://github.com/apache/hadoop/tree/feature-vectored-io feature branch into apache trunk and included a merge commit to the top containing all the details of child commits. We will be

Re: [VOTE] Release Apache Hadoop 3.3.3

2022-05-05 Thread Mukund Madhav Thakur
+1 (binding) Built tar from source in mac os and 1.8.0_161. good mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true Able to access cloud s3 and abfs storage through command line. Ran S3 and Abfs integration tests. All good. On Tue, May 3, 2022 at 6:24 AM Steve Loughran

Re: ElasticByteBufferPool is ever growing thus can cause memory leak.

2022-02-04 Thread Mukund Madhav Thakur
eap or off-heap buffers and > > internally calls either allocate or allocateDirect. Do you intend to > > preserve that functionality too in a single merged class? > > > > Chris Nauroth > > > > > > On Wed, Jan 12, 2022 at 1:25 AM Mukund Madhav Thak

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

2022-01-27 Thread Mukund Madhav Thakur
* +1 binding * Checked out the RC tag and compiled successfully. ( mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true) Ran abfs and azure integration tests. All good. Compiled gcs with 3.3.2 hadoop from staging successful. Tested list, get, put , delete operation on s3, gcs

Re: Yetus getting aborted after running for more thatn24 hours.

2022-01-26 Thread Mukund Madhav Thakur
gt; > > https://github.com/apache/hadoop/blame/6136d630a351fa1a5dd668c318b20437e6aaa35b/dev-support/Jenkinsfile#L50 > > Sent from my iPhone > > > On 27-Jan-2022, at 11:53 AM, Mukund Madhav Thakur > wrote: > > > > Hi Everyone, > > Yetus run is getting abor

Yetus getting aborted after running for more thatn24 hours.

2022-01-26 Thread Mukund Madhav Thakur
Hi Everyone, Yetus run is getting aborted after running for more than 24 hours https://ci-hadoop.apache.org/blue/organizations/jenkins/hadoop-multibranch/detail/PR-3904/4/artifacts/ for my Vectored IO PR https://github.com/apache/hadoop/pull/3904 What can I do to fix this? Any help is much

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC2

2022-01-24 Thread Mukund Madhav Thakur
Hi Chao, I was using the command "mvn package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true" on commit id *6da346a358c. * It is working for me today. So maybe it was an intermittent issue in my local last time when I was trying this. So we can ignore this. Thanks On Tue, Jan 25, 2022 at

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC2

2022-01-21 Thread Mukund Madhav Thakur
Checked out the release tag. commit *6da346a358c * Seeing below error while compiling : Duplicate classes found: Found in: org.apache.hadoop:hadoop-client-api:jar:3.3.2:compile org.apache.hadoop:hadoop-client-minicluster:jar:3.3.2:compile Duplicate classes:

ElasticByteBufferPool is ever growing thus can cause memory leak.

2022-01-12 Thread Mukund Madhav Thakur
Hello Everyone, I was just browsing through the code while doing my Vectored IO stuff. It seems like ElasticByteBufferPool is an ever growing pool and memory is not getting released as there is no WeakReference being maintained in the pool. This can cause memory leaks in the production

Re: [ANNOUNCE] Mukund Thakur is a new Apache Hadoop Committer

2021-02-03 Thread Mukund Madhav Thakur
Thanks everyone :) On Wed, Feb 3, 2021 at 8:14 PM Steve Loughran wrote: > Many congratulations Mukund! > I look forward to you vetoing my PRs on the basis of quality and test > coverage. > > -steve > > On Wed, 3 Feb 2021 at 11:39, hemanth boyina > wrote: > > > Congratulations Mukund !! > > > >

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-07-28 Thread Mukund Madhav Thakur
+1 - Built from source using mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true -DskipShade on mac os with jdk 1.8. - Ran some hadoop fs commands to s3 store from the packaged distribution. - Ran s3a integration tests. On Tue, Jul 28, 2020 at 12:56 AM Dinesh Chitlangia wrote: > +1 > > -

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-01 Thread Mukund Madhav Thakur
Compile the distribution using mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true -DskipShade and run some hadoop fs commands. All good there. Then I ran the hadoop-aws tests and saw following failures: [*ERROR*] *Failures: * [*ERROR*] *

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-13 Thread Mukund Madhav Thakur
e abfs tests but all tests are getting skipped > > even if I think I have right auth-keys.xml. I will debug this and update. > > hadoop-azure expects azure-auth-keys.xml instead of auth-keys.xml? > I think it should be consistent with other FS modules.. > > Masatake Iwasaki >

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-12 Thread Mukund Madhav Thakur
I compiled and ran s3 tests using mvn clean verify -Ds3guard -Ddynamo -Dauth. I see some failures. I ran these separately as well but it still fails for me. Also I am trying to run the abfs tests but all tests are getting skipped even if I think I have right auth-keys.xml. I will debug this and