[jira] [Resolved] (HDFS-17571) TestDatanodeManager#testGetBlockLocationConsiderStorageType is flaky

2024-07-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17571. - Resolution: Duplicate > TestDatanodeManager#testGetBlockLocationConsiderStorageType is fl

[jira] [Resolved] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17557. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix

[jira] [Created] (HDFS-17572) TestRouterSecurityManager#testDelegationTokens is flaky

2024-07-05 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-17572: --- Summary: TestRouterSecurityManager#testDelegationTokens is flaky Key: HDFS-17572 URL: https://issues.apache.org/jira/browse/HDFS-17572 Project: Hadoop HDFS

[jira] [Created] (HDFS-17571) TestDatanodeManager#testGetBlockLocationConsiderStorageType is flaky

2024-07-05 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-17571: --- Summary: TestDatanodeManager#testGetBlockLocationConsiderStorageType is flaky Key: HDFS-17571 URL: https://issues.apache.org/jira/browse/HDFS-17571 Project: Hadoop

[jira] [Resolved] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17551. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix unit t

Re: [DISCUSS] lots of yetus failures in hdfs

2024-06-08 Thread Ayush Saxena
5d3d2c902407fbf9bceddec/dev-support/docker/Dockerfile#L77 >> [3] https://lists.apache.org/thread/hmzl61ow0sbs10p0hky17xxhsggbhc3g >> [4] https://github.com/apache/hadoop/pull/6664#issuecomment-2082356393 >> >> On Fri, 7 Jun 2024 at 08:04, Xiaoqiao He wrote: >> > >&g

Re: [DISCUSS] lots of yetus failures in hdfs

2024-06-06 Thread Ayush Saxena
Steve. Try to trigger CI manually and let's wait what it will say. > BTW, the flaky tests seem not related to UT logic itself, but most of them > throw OOM. Not sure if @Ayush Saxena knows how to re-config or tune > the memory of Yetus? > > Best Regards, > - He Xiaoqiao > > On

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

2024-05-29 Thread Ayush Saxena
+1 for the proposal, the first thing might be to just drop the unnecessary branches which are either from dependabot or someone accidentally created a branch in the main repo rather than in their fork, there are many, I don't think we need them in the archived repo either Regarding (3) If you

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-28 Thread Ayush Saxena
turn standby exception to allow the client to retry other routers > (RouterRpcFairnessPolicyController mechanism). > > Thank you again! > zhangjian > >> 2024年5月29日 07:05,Ayush Saxena 写道: >> Thanx folks, I had a very quick pass on the PDF and it looks good. >> Ma

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-28 Thread Ayush Saxena
the synchronous router. >>> 2. Asynchronous router can apply pressure downstream to better utilize the >>> performance of downstream ns, and can almost fill the call queue of >>> downstream ns. >>> >>> Due to the large size of the test result

Re: Router using Key-Value Store for Mount table

2024-05-10 Thread Ayush Saxena
Hi Fengnan, Not sure if I am catching you right, but did you explore: HDFS-16943 There are other impl I believe as well as mentioned over here [1], can explore that. or did I catch the question wrong -Ayush [1]

Re: Discussion about NameNode Fine-grained locking

2024-04-28 Thread Ayush Saxena
Thanx Everyone for chasing this, Great to see some momentum around FGL, that should be a great improvement. I have some two broad categories: ** About the process:* I think in the above mails, there are mentions that phase one is complete in a feature branch & we are gonna merge that to trunk. If

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

2024-04-21 Thread Ayush Saxena
Congratulations Haiyang!!! -Ayush > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > I am pleased to announce that Haiyang Hu has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Haiyang's work, and look forward to her/his continued contributions. > >

[jira] [Resolved] (HDFS-17449) Fix ill-formed decommission host name and port pair triggers IndexOutOfBound error

2024-04-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17449. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix ill-for

[jira] [Resolved] (HDFS-17450) Add explicit dependency on httpclient jar

2024-03-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17450. - Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HDFS-17448) Enhance the stability of the unit test TestDiskBalancerCommand

2024-03-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17448. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Enha

[jira] [Resolved] (HDFS-17103) Fix file system cleanup in TestNameEditsConfigs

2024-03-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17103. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix file sys

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-13 Thread Ayush Saxena
> Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Just on the process: The release manager needs to "explicitly" vote like any other before counting their own vote, there has been a lot of discussions around that

Re: HDFS test builds always fails

2024-03-12 Thread Ayush Saxena
We are sorted now: the daily build from yesterday [1] shows 0 test failures [1] https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-qbt-trunk-java8-linux-x86_64/1525/ -Ayush On Tue, 5 Mar 2024 at 17:03, Ayush Saxena wrote: > Hi, > We have a PR [1] which is gonna fix those tests r

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

2024-03-12 Thread Ayush Saxena
, because > 2.2.x > > is also very old and EOL. 2.5.x is the currently maintained release for > > hbase2, with 2.5.7 being the latest. We’re soon going to release 2.6.0 as > > well. > > > > On Tue, Mar 5, 2024 at 6:56 AM Ayush Saxena wrote: > > > > > Hi Folks,

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-07 Thread Ayush Saxena
oon I will abstain -Ayush On Thu, 7 Mar 2024 at 08:33, Xiaoqiao He wrote: > cc @Chao Sun @zhang...@apache.org > @Ayush Saxena > Would you mind helping to check the upstream systems(Spark, HBase, Hive) > dependency with > the new hadoop release version if necessary? Thanks. >

[DISCUSS] Support/Fate of HBase v1 in Hadoop

2024-03-05 Thread Ayush Saxena
Hi Folks, As of now we have two profiles for HBase: one for HBase v1(1.7.1) & other for v2(2.2.4). The versions are specified over here: [1], how to build is mentioned over here: [2] As of now we by default run our Jenkins "only" for HBase v1, so we have seen HBase v2 profile silently breaking a

Re: HDFS test builds always fails

2024-03-05 Thread Ayush Saxena
Hi, We have a PR [1] which is gonna fix those tests related to those java ByteBuffer, I will follow up on that & get it merged. -Ayush [1] https://github.com/apache/hadoop/pull/6593 On Tue, 5 Mar 2024 at 12:59, 王磊 wrote: > Hi, I found some tests always fails in some pull requests such as >

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-06 Thread Ayush Saxena
n install > -DskipTests` using the thirdparty 1.2.0-RC1 > * There are not any diffs between tag and src > > Regards, > - Takanobu Asanuma > > 2024年2月6日(火) 11:03 Xiaoqiao He : > > > cc @PJ Fanning @Ayush Saxena > @Steve > > Loughran @Takanobu Asanuma > @Shuyan &g

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-02-01 Thread Ayush Saxena
k, * Built from source * Verified Checksums * Verified Signatures * Validated files have ASF header Not sure if having diff b/w the git tag & src tar is ok, this doesn't look like core code change though, can anybody check & confirm? -Ayush On Thu, 1 Feb 2024 at 13:39, Xiaoqiao He wro

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-12 Thread Ayush Saxena
We should consider including https://issues.apache.org/jira/browse/HDFS-17129 Which looks like inducing some misorder between IBR & FBR which can potentially lead to strange issues, if that can’t be merged, should revert the one which causes that. I think we should check for any ticket which has

Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR

2024-01-08 Thread Ayush Saxena
ally solves the problem, but my > >> change in addition allows to run different operations in different subdirs > >> in parallel (as you said). Also I see that I’ve forgotten to update md > >> file. > >> > >> Will update my PR tomorrow and dro

[jira] [Resolved] (HDFS-17317) DebugAdmin metaOut not need multiple close

2024-01-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17317. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > DebugAdmin meta

Re: Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-05 Thread Ayush Saxena
think the release discussion can be in public ML? > > > > Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. > > > > Best Regards, > > - He Xiaoqiao > > > > On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > > > > > +1 from me a

[jira] [Resolved] (HDFS-17215) RBF: Fix some method annotations about @throws

2023-12-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17215. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Fix some met

[jira] [Resolved] (HDFS-17056) EC: Fix verifyClusterSetup output in case of an invalid param.

2023-12-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17056. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC:

[jira] [Resolved] (HDFS-16904) Close webhdfs during the teardown

2023-12-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16904. - Hadoop Flags: Reviewed Resolution: Fixed > Close webhdfs during the teard

[jira] [Resolved] (HDFS-17034) java.io.FileNotFoundException: File does not exist

2023-12-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17034. - Resolution: Cannot Reproduce this is some cluster issue, reach out to user ML with all details

[jira] [Resolved] (HDFS-17238) Setting the value of "dfs.blocksize" too large will cause HDFS to be unable to write to files

2023-12-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17238. - Resolution: Won't Fix this is a misconfiguration, can't help it nor we can handle all

[jira] [Resolved] (HDFS-17240) Fix a typo in DataStorage.java

2023-12-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17240. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix a t

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-12-21 Thread Ayush Saxena
> > I am also concerned that it will involve more hard work to release and > > version match, > > especially for one who is not familiar with C or Rust. > > Moreover, I am not aware the difference between `accept hdfs-sys as part of > > hadoop > > project` and `

Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR

2023-12-19 Thread Ayush Saxena
Hi Alex, I haven't gone through the PR, I can check that over the weekend or next week, if nobody volunteers till then... I just had a quick pass, I don't think there is any need to mention RBF or something like that in the core HDFS code, if something is specific to RBF, that goes to RBF module,

[jira] [Resolved] (HDFS-17282) Reconfig 'SlowIoWarningThreshold' parameters for datanode.

2023-12-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17282. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Recon

[jira] [Resolved] (HDFS-17278) Detect order dependent flakiness in TestViewfsWithNfs3.java under hadoop-hdfs-nfs module

2023-12-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17278. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Detect or

[jira] [Resolved] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17279. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Fix l

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-05 Thread Ayush Saxena
+1 -Ayush > On 06-Dec-2023, at 9:40 AM, Xiaoqiao He wrote: > > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no

Re: [DISCUSS] Make some release lines EOL

2023-12-04 Thread Ayush Saxena
Thanx He Xiaoqiao for starting the thread. +1 to mark 3.2 EOL. I am not sure about branch-2 stuff, I think a bunch of folks are still using Hadoop 2.x, but we hardly push anything over there & I am not sure if anyone is interested in releasing that or not. > Hadoop 3.3 Release (release-3.3.5 at

[jira] [Resolved] (HDFS-17260) Fix the logic for reconfigure slow peer enable for Namenode.

2023-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17260. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the lo

[jira] [Resolved] (HDFS-17233) The conf dfs.datanode.lifeline.interval.seconds is not considering time unit seconds

2023-12-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17233. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > The c

[jira] [Resolved] (HDFS-17271) Web UI DN report shows random order when sorting with dead DNs

2023-12-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17271. - Resolution: Fixed > Web UI DN report shows random order when sorting with dead

Re: [DISCUSS] Hadoop 3.4.0 release

2023-12-01 Thread Ayush Saxena
Hi Ahmar, Makes sense to have a 3.4.0 rather than a 3.3.x if there are major changes. Few things on the process: * trunk should now point to 3.5.0-SNAPSHOT * Fix Versions of all the tickets merged to trunk would be 3.4.0 as of now, you need to move it to 3.5.0, else while chasing the release,

[jira] [Resolved] (HDFS-17261) RBF: Fix getFileInfo return wrong path when get mountTable path which multi-level

2023-12-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17261. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Fix getFileI

[jira] [Resolved] (HDFS-17259) Fix typo in TestFsDatasetImpl Class.

2023-11-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17259. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix t

Re: How to restart build pipeline or mark Yetus check passed

2023-11-13 Thread Ayush Saxena
Just push an empty commit & it will trigger the build again. It anyway has checkstyle issues, fix them & push a new commit https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6230/1/artifact/out/results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt -Ayush > On 13-Nov-2023, at 3:16 PM,

Re: Review request for https://issues.apache.org/jira/browse/HDFS-15413

2023-11-03 Thread Ayush Saxena
I just had a quick pass, In general the logic looks good. But there is no test added, We should add some tests around this & cover all possible scenarios, EC is pretty complex & quite prone to Data corruption, so we should have proper test coverage around it. Xiaoqiao He has also invited folks

Re: [ANNOUNCE] New Hadoop PMC Member - Shilun Fan

2023-10-31 Thread Ayush Saxena
Congratulations!!! -Ayush > On 31-Oct-2023, at 6:15 PM, Samrat Deb wrote: > > Congratulations Shilun Fan > > Bests, > Samrat > >> On Tue, Oct 31, 2023 at 6:07 PM Tao Li wrote: >> >> Congratulations!!! >> >> Xiaoqiao He 于2023年10月31日周二 20:19写道: >> >>> On behalf of the Apache Hadoop PMC,

[jira] [Resolved] (HDFS-17235) Fix javadoc errors in BlockManager

2023-10-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17235. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix javadoc err

[jira] [Resolved] (HDFS-17228) Improve documentation related to BlockManager

2023-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17228. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Impr

Re: MODERATE for hdfs-iss...@hadoop.apache.org

2023-10-17 Thread Ayush Saxena
+ user@hadoop This sounds pretty strange, do you have any background job in your cluster running, like for compaction kind of stuff, which plays with the files? Any traces in the Namenode Logs, what happens to the blocks associated with those files, If they get deleted before a FBR, that ain't a

Re: [jira] [Created] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-16 Thread Ayush Saxena
POM change only & it has no test failing, so good from my side(HDFS) -Ayusg > On 16-Oct-2023, at 4:48 PM, Steve Loughran > wrote: > > Can anyone from yarn or hdfs review this before i just upvote it hoping all > will be well. thanks > > -- Forwarded message - > From: PJ

[jira] [Created] (HDFS-17225) Fix TestNameNodeMXBean#testDecommissioningNodes

2023-10-14 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-17225: --- Summary: Fix TestNameNodeMXBean#testDecommissioningNodes Key: HDFS-17225 URL: https://issues.apache.org/jira/browse/HDFS-17225 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-17200) Add some datanode related metrics to Metrics.md

2023-10-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17200. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add some datan

[jira] [Resolved] (HDFS-17205) HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be configurable

2023-10-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17205. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

2023-10-03 Thread Ayush Saxena
Congratulations!!! -Ayush > On 03-Oct-2023, at 5:42 AM, Erik Krogen wrote: > > Congratulations Simba! Thanks for the great work you've done on making HDFS > more scalable! > >> On Mon, Oct 2, 2023 at 4:31 PM Iñigo Goiri wrote: >> >> I am pleased to announce that Simbarashe Dzinamarira has

[jira] [Resolved] (HDFS-17209) Correct comments to align with the code

2023-10-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17209. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Correct comme

[jira] [Resolved] (HDFS-17133) TestFsDatasetImpl missing null check when cleaning up

2023-09-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17133. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > TestFsDatasetI

[jira] [Resolved] (HDFS-17211) Fix comments in the RemoteParam class

2023-09-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17211. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix comme

Re: [ANNOUNCE] New Hadoop Committer - Shuyan Zhang

2023-09-26 Thread Ayush Saxena
Congratulations!!! Sent from my iPhone > On 27-Sep-2023, at 9:56 AM, Xiaoqiao He wrote: > > I am pleased to announce that Shuyan Zhang has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Shuyan's work, and look forward to her/his continued contributions. >

Re: HADOOP-18207 hadoop-logging module about to land

2023-07-28 Thread Ayush Saxena
wed the tasks so far, > I am not expecting reviewers to be able to provide their reviews as quickly > as possible, this particular sub-task has been dev and test ready for the > last 4 months, and it is absolutely okay to wait longer, but what really > hurts a bit is the fact that despite the whole dis

Re: HADOOP-18207 hadoop-logging module about to land

2023-07-27 Thread Ayush Saxena
Hi Wei-Chiu, I am glad this activity finally made it to the dev mailing list. Just sharing the context being the guy who actually reverted this last time it was in: It had a test failure on the PR itself and it went in, that had nothing to do with the nature of the PR, generic for all PR and all

[jira] [Resolved] (HDFS-17115) HttpFS Add Support getErasureCodeCodecs API

2023-07-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17115. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > HttpFS Add Supp

[jira] [Resolved] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

2023-07-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17111. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Optimize ms

Re: Signing releases using automated release infra

2023-07-25 Thread Ayush Saxena
ue, 18 Jul 2023 at 21:05, Ayush Saxena wrote: >> >> Something we can explore as well!! >> >> -Ayush >> >> Begin forwarded message: >> >> > From: Volkan Yazıcı >> > Date: 19 July 2023 at 1:24:49 AM IST >> > To: d...@communit

[jira] [Resolved] (HDFS-17119) RBF: Logger fix for StateStoreMySQLImpl

2023-07-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17119. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Logger

[jira] [Resolved] (HDFS-17074) Remove incorrect comment in TestRedudantBlocks#setup

2023-07-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17074. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove incorr

Fwd: Signing releases using automated release infra

2023-07-18 Thread Ayush Saxena
Something we can explore as well!! -Ayush Begin forwarded message: > From: Volkan Yazıcı > Date: 19 July 2023 at 1:24:49 AM IST > To: d...@community.apache.org > Subject: Signing releases using automated release infra > Reply-To: d...@community.apache.org > > Abstract: Signing release

[jira] [Resolved] (HDFS-17075) Reconfig disk balancer parameters for datanode

2023-07-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17075. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Reconfig d

RE: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-07-15 Thread Ayush Saxena
Forwarding from dev@hadoop to relevant ML Original mail: https://lists.apache.org/thread/r5rcmc7lwwvkysj0320myxltsyokp9kq -Ayush On 2023/07/15 09:18:42 Xuanwo wrote: > Hello, everyone. > > I'm the maintainer of [hdfs-sys]: A binding to HDFS Native C API for Rust. I > want to know is it a good

[jira] [Resolved] (HDFS-17086) Fix the parameter settings in TestDiskspaceQuotaUpdate#updateCountForQuota.

2023-07-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17086. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the parame

[jira] [Resolved] (HDFS-17069) The documentation and implementation of "dfs.blocksize" are inconsistent.

2023-07-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17069. - Resolution: Not A Problem > The documentation and implementation of "dfs.b

[jira] [Resolved] (HDFS-17068) Datanode should record last directory scan time.

2023-07-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17068. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Datanode sho

[jira] [Resolved] (HDFS-17081) EC: Add logic for striped blocks in isSufficientlyReplicated

2023-07-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17081. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Add lo

[jira] [Resolved] (HDFS-17083) Support getErasureCodeCodecs API in WebHDFS

2023-07-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17083. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Supp

[jira] [Resolved] (HDFS-17082) Add documentation for provisionSnapshotTrash command to HDFSCommands.md and HdfsSnapshots.md

2023-07-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17082. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add documentat

[jira] [Resolved] (HDFS-17076) Remove the unused method isSlownodeByNameserviceId in DataNode

2023-07-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17076. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove the unu

[jira] [Resolved] (HDFS-17064) Document the usage of the new Balancer "sortTopNodes" and "hotBlockTimeInterval" parameter

2023-07-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17064. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Document the us

[jira] [Resolved] (HDFS-17070) Remove unused import in DataNodeMetricHelper.java.

2023-07-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17070. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove unused imp

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-24 Thread Ayush Saxena
+1 (Binding) * Built from source (x86 & Arm) * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm) * Verified Checksums (x86 & Arm) * Verified Signatures (x86 & Arm) * Successful RAT check (x86 & Arm) * Verified the diff b/w the tag & the source tar * Built Ozone with 3.3.6, green

[jira] [Created] (HDFS-17056) EC: Fix verifyClusterSetup output in case of an invalid param

2023-06-22 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-17056: --- Summary: EC: Fix verifyClusterSetup output in case of an invalid param Key: HDFS-17056 URL: https://issues.apache.org/jira/browse/HDFS-17056 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-20 Thread Ayush Saxena
Folks you had put your vote on the wrong thread, this is the RC0 thead, you need to put on the RC1, https://lists.apache.org/thread/022p4rml5tvsx9xpq6t7b3n1td8lzz1d -Ayush Sent from my iPhone > On 20-Jun-2023, at 10:03 PM, Ashutosh Gupta > wrote: > > Hi > > Thanks Wei-Chiu for driving the

[jira] [Resolved] (HDFS-17053) Optimize method BlockInfoStriped#findSlot to reduce time complexity.

2023-06-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17053. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Optimize met

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-18 Thread Ayush Saxena
Hi Masatake, That ticket is just a backport of: https://issues.apache.org/jira/browse/HADOOP-17612 and the only java code change is in test [1], which is causing issues for you. That ticket isn't marked incompatible either, so maybe that is why it got pulled back. btw. the original PR does

[jira] [Resolved] (HDFS-17043) HttpFS implementation for getAllErasureCodingPolicies

2023-06-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17043. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Htt

[jira] [Resolved] (HDFS-17047) BlockManager#addStoredBlock should log storage id when AddBlockResult is REPLACED

2023-06-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17047. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > BlockMana

[jira] [Resolved] (HDFS-16946) RBF: top real owners metrics can't been parsed json string

2023-06-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16946. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: top real own

[jira] [Resolved] (HDFS-17035) FsVolumeImpl#getActualNonDfsUsed may return negative value

2023-06-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17035. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > FsVolumeI

Fwd: Call for Presentations, Community Over Code Asia 2023

2023-06-05 Thread Ayush Saxena
Forwarding from dev@hadoop to the ML we use. Original Mail: https://lists.apache.org/thread/3c16xyvmdyvg4slmtfywcwjbck1b4x02 -Ayush -- Forwarded message - From: Rich Bowen Date: Mon, 5 Jun 2023 at 21:43 Subject: Call for Presentations, Community Over Code Asia 2023 To:

[jira] [Resolved] (HDFS-17029) Support getECPolices API in WebHDFS

2023-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17029. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Support getECPoli

[jira] [Resolved] (HDFS-17028) RBF: Optimize debug logs of class ConnectionPool and other related class.

2023-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17028. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Optimize de

[jira] [Created] (HDFS-17038) TestDirectoryScanner.testThrottle() is still a little flaky

2023-06-04 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-17038: --- Summary: TestDirectoryScanner.testThrottle() is still a little flaky Key: HDFS-17038 URL: https://issues.apache.org/jira/browse/HDFS-17038 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-17031) RBF: Reduce repeated code in RouterRpcServer

2023-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17031. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Reduce repea

[jira] [Resolved] (HDFS-16996) Fix flaky testFsCloseAfterClusterShutdown in TestFileCreation

2023-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16996. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix fl

[jira] [Resolved] (HDFS-17000) Potential infinite loop in TestDFSStripedOutputStreamUpdatePipeline.testDFSStripedOutputStreamUpdatePipeline

2023-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17000. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Potential infin

[jira] [Resolved] (HDFS-16908) Fix javadoc of field IncrementalBlockReportManager#readyToSend.

2023-05-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16908. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix javadoc of fi

[jira] [Resolved] (HDFS-16994) NumTimedOutPendingReconstructions metrics should not be accumulated

2023-05-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16994. - Resolution: Not A Problem > NumTimedOutPendingReconstructions metrics should not be accumula

  1   2   3   4   5   >