[jira] [Resolved] (HADOOP-19325) hadoop-rumen is vulnerable to Sonatype CWE611

2024-11-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19325. - Resolution: Later > hadoop-rumen is vulnerable to Sonatype CWE

[jira] [Resolved] (HADOOP-19325) hadoop-rumen is vulnerable to Sonatype CWE611

2024-11-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19325. - Resolution: Not A Problem > hadoop-rumen is vulnerable to Sonatype CWE

[jira] [Reopened] (HADOOP-19325) hadoop-rumen is vulnerable to Sonatype CWE611

2024-11-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-19325: - > hadoop-rumen is vulnerable to Sonatype CWE

[jira] [Resolved] (HADOOP-18583) hadoop checknative fails to load openssl 3.x

2024-11-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18583. - Fix Version/s: 3.5.0 Assignee: Sebastian Klemke Resolution: Fixed

Re: [ANNOUNCE] Apache Hadoop 3.4.1 release

2024-10-25 Thread Steve Loughran
I thought we'd done that. Mukund is away this week; it'll be something we can fix next week. On Thu, 24 Oct 2024 at 07:06, Takanobu Asanuma wrote: > Thank you for your hard work in releasing 3.4.1! > > Could you also create the release documents on the Hadoop site? > - https://hadoop.apache.org

[jira] [Resolved] (HADOOP-19309) S3A CopyFromLocalFile operation fails when the source file does not contain file scheme.

2024-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19309. - Fix Version/s: 3.5.0 Resolution: Fixed > S3A CopyFromLocalFile operation fa

[jira] [Created] (HADOOP-19317) S3A: export all http connection settings as configuration options

2024-10-24 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19317: --- Summary: S3A: export all http connection settings as configuration options Key: HADOOP-19317 URL: https://issues.apache.org/jira/browse/HADOOP-19317 Project

[jira] [Created] (HADOOP-19314) upgrade AWS v1 SDK on branch-3.3.x

2024-10-21 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19314: --- Summary: upgrade AWS v1 SDK on branch-3.3.x Key: HADOOP-19314 URL: https://issues.apache.org/jira/browse/HADOOP-19314 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-19313) AWS V1 SDK now tells users of for using aa deprecated SDK

2024-10-21 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19313: --- Summary: AWS V1 SDK now tells users of for using aa deprecated SDK Key: HADOOP-19313 URL: https://issues.apache.org/jira/browse/HADOOP-19313 Project: Hadoop

[jira] [Resolved] (HADOOP-19312) Use spotbugs instead of findbugs

2024-10-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19312. - Resolution: Duplicate > Use spotbugs instead of findb

reminder: Hadoop 3.4.1 RC3 is up for testing and voting

2024-10-17 Thread Steve Loughran
Can as many people who have not yet tested and voted on the latest RC please put some time aside for this. We are short of a binding vote, and need as much testing in different deployments as possible -from everyone. Remember; this is your last chance to have any regressions you find to be fixed

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-16 Thread Steve Loughran
thanks. before the vote is done: can everyone with a pgp key sign the new keys and push to github. Even after 24h my trust signature doesn't seem to be there yet. You've all just been running code he compiled on your machines, so your trust must be fairly high unless you did it in an isolated cont

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-15 Thread Steve Loughran
+1 binding *Testing:* *mac arm64:* the hadoop-release-support validation workflow including building spark, cloudstore, key validation etc. All good, except for gcs, which was complaining about hadoop-client stuff. I'm not worrying about that as it is a fussy little library. I did verify that t

[jira] [Reopened] (HADOOP-19295) S3A: fs.s3a.connection.request.timeout too low for large uploads over slow links

2024-10-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-19295: - still seeing failures on large uploads. It is *not* a blocker for the 3.4.1 release and I

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-10 Thread Steve Loughran
Hney, you did the -lean one too! nice Anyway, yes I'll test. I will try not to find new problems On Thu, 10 Oct 2024 at 12:18, Mukund Madhav Thakur wrote: > Apache Hadoop 3.4.1 > > > With help of Steve, I have put together a release candidate (RC3) for > Hadoop 3.4.1. > > > What we would like

[jira] [Resolved] (HADOOP-19295) S3A: fs.s3a.connection.request.timeout too low for large uploads over slow links

2024-10-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19295. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed >

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

2024-10-08 Thread Steve Loughran
; > 1144 > < > https://github.com/jojochuang/ozone/actions/runs/11169844919/job/31094862369#step:5:1145 > > > at > > org.apache.hadoop.util.SemaphoredDelegatingExecutor$RunnableWithPermitRelease.run(SemaphoredDelegatingExecutor.java:225) > > 1145 > <

[jira] [Resolved] (HADOOP-19083) provide hadoop binary tarball without aws v2 sdk

2024-10-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19083. - Fix Version/s: 3.4.1 Resolution: Fixed > provide hadoop binary tarball with

[jira] [Reopened] (HADOOP-19229) Vector IO on cloud storage: experiment to see what a good minimum seek size should be

2024-10-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-19229: - > Vector IO on cloud storage: experiment to see what a good minimum seek size > sho

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

2024-10-08 Thread Steve Loughran
elegatingExecutor$RunnableWithPermitRelease.run(SemaphoredDelegatingExecutor.java:225) > > 1145 > < > https://github.com/jojochuang/ozone/actions/runs/11169844919/job/31094862369#step:5:1146 > > > at > > org.apache.hadoop.util.SemaphoredDelegatingExecutor$RunnableWithPe

[jira] [Resolved] (HADOOP-19229) Vector IO: have a max distance between ranges to read

2024-10-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19229. - Release Note: This is exactly what `"fs.s3a.vectored.read.min.seek.size" do

[jira] [Created] (HADOOP-19303) VectorIO API to take a ByteBufferPool rather than just an allocator method

2024-10-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19303: --- Summary: VectorIO API to take a ByteBufferPool rather than just an allocator method Key: HADOOP-19303 URL: https://issues.apache.org/jira/browse/HADOOP-19303

[jira] [Resolved] (HADOOP-19299) ConcurrentModificationException in HttpReferrerAuditHeader

2024-10-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19299. - Fix Version/s: 3.4.1 Assignee: Steve Loughran Resolution: Fixed

[jira] [Resolved] (HADOOP-19286) Support S3A cross region access when S3 region/endpoint is set

2024-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19286. - Resolution: Fixed > Support S3A cross region access when S3 region/endpoint is

[jira] [Reopened] (HADOOP-19286) Support S3A cross region access when S3 region/endpoint is set

2024-10-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-19286: - new tests fails for me; i have a bucket specific region {code} [ERROR

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

2024-10-02 Thread Steve Loughran
idden by subclasses. > at > org.apache.hadoop.thirdparty.protobuf.GeneratedMessageV3.getUnknownFields(GeneratedMessageV3.java:280) > at > org.apache.hadoop.ipc.protobuf.RpcHeaderProtos$RpcRequestHeaderProto.getSerializedSize(RpcHeaderProtos.java:2381) > at > org.apache.hadoop.thirdparty.protobuf.AbstractMessag

[jira] [Created] (HADOOP-19299) ConcurrentModificationException in HttpReferrerAuditHeader

2024-10-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19299: --- Summary: ConcurrentModificationException in HttpReferrerAuditHeader Key: HADOOP-19299 URL: https://issues.apache.org/jira/browse/HADOOP-19299 Project: Hadoop

[jira] [Resolved] (HADOOP-19293) Avoid Subject.getSubject method on newer JVMs

2024-10-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19293. - Resolution: Duplicate see discussion on HADOOP-19212 > Avoid Subject.getSubj

Re: Re [DISCUSS] Hadoop 3.3.7?

2024-10-02 Thread Steve Loughran
If you're volunteering -go for it! 1. the hadoop-release-support project has been used to do a 3.3.x release, so go with that 2. the wiki on releasing is out of date, as people.apache.org is out of date. you should copy it to the svn path https://dist.apache.org/repos/dist/dev/hadoop

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

2024-10-02 Thread Steve Loughran
rying out the RC > and > > finding out this bug. This has to be fixed. > > It would be great if others can give the RC a try such that we know of > any > > issues earlier. > > > > Thanks > > Mukund > > > > On Tue, Oct 1, 2024 at 2

[jira] [Resolved] (HADOOP-19286) Support S3A cross region access when S3 region/endpoint is set

2024-10-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19286. - Fix Version/s: 3.5.0 Resolution: Fixed > Support S3A cross region access w

[jira] [Resolved] (HADOOP-19288) hadoop-client-runtime exclude dnsjava InetAddressResolverProvider

2024-10-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19288. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > hadoop-cli

[jira] [Resolved] (HADOOP-19294) NPE on maven enforcer with -Pnative on arm mac

2024-10-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19294. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > NPE on ma

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

2024-09-30 Thread Steve Loughran
ok, we will have to consider that a -1 Interestingly we haven't seen that on any of our internal QE, maybe none of the requests weren't overlapping. I was just looking towards an =0 because of https://issues.apache.org/jira/browse/HADOOP-19295 *Unlike the v1 sdk, PUT/POST of data now shares the

[jira] [Created] (HADOOP-19295) S3A: fs.s3a.connection.request.timeout too low for large uploads over slow links

2024-09-30 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19295: --- Summary: S3A: fs.s3a.connection.request.timeout too low for large uploads over slow links Key: HADOOP-19295 URL: https://issues.apache.org/jira/browse/HADOOP-19295

[jira] [Created] (HADOOP-19294) NPE on maven enforcer with -Pnative on arm mac

2024-09-30 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19294: --- Summary: NPE on maven enforcer with -Pnative on arm mac Key: HADOOP-19294 URL: https://issues.apache.org/jira/browse/HADOOP-19294 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19280) ABFS: Initialize ABFS client timer only when metric collection is enabled

2024-09-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19280. - Fix Version/s: 3.5.0 Resolution: Fixed > ABFS: Initialize ABFS client ti

[jira] [Resolved] (HADOOP-19281) MetricsSystemImpl should not print INFO message in CLI

2024-09-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19281. - Resolution: Fixed > MetricsSystemImpl should not print INFO message in

Re: [VOTE] Release Apache Hadoop 3.4.1

2024-09-25 Thread Steve Loughran
ule to resume Apache Hadoop 3.4.1 release? > > Dongjoon. > > On 2024/08/16 15:17:28 Steve Loughran wrote: > > Afraid I have to say -1 to this iteration, but I promise I'll help > address > > the issues > > > > First, I've cherrypicked a few fi

[jira] [Created] (HADOOP-19285) Restore ETAGS_AVAILABLE to abfs patch capabilitiees

2024-09-23 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19285: --- Summary: Restore ETAGS_AVAILABLE to abfs patch capabilitiees Key: HADOOP-19285 URL: https://issues.apache.org/jira/browse/HADOOP-19285 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19272) S3A: AWS SDK 2.25.53 warnings logged about transfer manager not using CRT client

2024-09-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19272. - Resolution: Fixed > S3A: AWS SDK 2.25.53 warnings logged about transfer manager

[jira] [Created] (HADOOP-19278) S3A: remove option to deletel directory markers

2024-09-17 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19278: --- Summary: S3A: remove option to deletel directory markers Key: HADOOP-19278 URL: https://issues.apache.org/jira/browse/HADOOP-19278 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19221) S3A: Unable to recover from failure of multipart block upload attempt "Status Code: 400; Error Code: RequestTimeout"

2024-09-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19221. - Fix Version/s: 3.4.2 Resolution: Fixed > S3A: Unable to recover from failure

[jira] [Created] (HADOOP-19274) S3A: new test failures on branch-3.4.1

2024-09-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19274: --- Summary: S3A: new test failures on branch-3.4.1 Key: HADOOP-19274 URL: https://issues.apache.org/jira/browse/HADOOP-19274 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-19273) S3A: Commiter ITests failing unless job.id set

2024-09-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19273: --- Summary: S3A: Commiter ITests failing unless job.id set Key: HADOOP-19273 URL: https://issues.apache.org/jira/browse/HADOOP-19273 Project: Hadoop Common

[jira] [Created] (HADOOP-19272) S3A: warnings logged about transfer manager not using Crt client

2024-09-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19272: --- Summary: S3A: warnings logged about transfer manager not using Crt client Key: HADOOP-19272 URL: https://issues.apache.org/jira/browse/HADOOP-19272 Project

[jira] [Resolved] (HADOOP-19189) ITestS3ACommitterFactory failing

2024-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19189. - Resolution: Fixed thanks. I'd probably kept it open for the backport and forg

[jira] [Resolved] (HADOOP-19201) S3A: Support external id in assume role

2024-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19201. - Fix Version/s: 3.5.0 3.4.2 Resolution: Fixed > S3A: Supp

[jira] [Resolved] (HADOOP-19252) Release Hadoop Third-Party 1.3.0

2024-09-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19252. - Fix Version/s: 3.4.1 thirdparty-1.3.0 Resolution: Fixed

[jira] [Resolved] (HADOOP-19269) Upgrade maven-shade-plugin to 3.6.0

2024-09-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19269. - Fix Version/s: 3.5.0 Assignee: PJ Fanning Resolution: Fixed > Upgr

[jira] [Resolved] (HADOOP-16928) [JDK13] Support HTML5 Javadoc

2024-09-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16928. - Fix Version/s: 3.5.0 Assignee: Cheng Pan Resolution: Fixed > [JD

[jira] [Resolved] (HADOOP-19257) S3A: ITestAssumeRole.testAssumeRoleBadInnerAuth failure

2024-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19257. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed >

[jira] [Created] (HADOOP-19262) wildfly-openssl:1.1.3.Final seems to be incompatible with jdk17

2024-09-03 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19262: --- Summary: wildfly-openssl:1.1.3.Final seems to be incompatible with jdk17 Key: HADOOP-19262 URL: https://issues.apache.org/jira/browse/HADOOP-19262 Project

[jira] [Created] (HADOOP-19260) removal of gcm TLS cyphers blocking abfs access "No negotiable cipher suite"

2024-09-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19260: --- Summary: removal of gcm TLS cyphers blocking abfs access "No negotiable cipher suite" Key: HADOOP-19260 URL: https://issues.apache.org/jira/browse/HA

[jira] [Resolved] (HADOOP-19250) Fix test TestServiceInterruptHandling.testRegisterAndRaise

2024-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19250. - Fix Version/s: 3.5.0 Resolution: Fixed > Fix t

[jira] [Resolved] (HADOOP-19248) Protobuf code generate and replace should happen together

2024-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19248. - Resolution: Fixed > Protobuf code generate and replace should happen toget

[jira] [Created] (HADOOP-19257) S3A: ITestAssumeRole.testAssumeRoleBadInnerAuth failure

2024-08-29 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19257: --- Summary: S3A: ITestAssumeRole.testAssumeRoleBadInnerAuth failure Key: HADOOP-19257 URL: https://issues.apache.org/jira/browse/HADOOP-19257 Project: Hadoop

[jira] [Resolved] (HADOOP-18487) Make protobuf 2.5 an optional runtime dependency.

2024-08-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18487. - Fix Version/s: 3.4.1 3.4.0 Release Note: hadoop modules no

[RESULT] [VOTE] Release Apache Hadoop Thirdparty 1.3.0

2024-08-27 Thread Steve Loughran
With 5 binding +1 votes and 0 negative votes, the hadoop-thirdparty release vote was successful I'm going to complete the release today, after which mukund can do another RC of the 3.4.1 release Thanks to everyone who tested it! -steve

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

2024-08-22 Thread Steve Loughran
utions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn -rf :hadoop-shaded-protobuf_3_25 &

[jira] [Resolved] (HADOOP-19131) WrappedIO to export modern filesystem/statistics APIs in a reflection friendly form

2024-08-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19131. - Resolution: Fixed > WrappedIO to export modern filesystem/statistics APIs i

[jira] [Resolved] (HADOOP-18542) Azure Token provider requires tenant and client IDs despite being optional

2024-08-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18542. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Azure To

[jira] [Resolved] (HADOOP-19187) ABFS: [FnsOverBlob]Making AbfsClient Abstract for supporting both DFS and Blob Endpoint

2024-08-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19187. - Fix Version/s: 3.5.0 Resolution: Fixed > ABFS: [FnsOverBlob]Making AbfsCli

[jira] [Resolved] (HADOOP-18965) ITestS3AHugeFilesEncryption failure

2024-08-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18965. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed

[VOTE] Release Apache Hadoop Thirdparty 1.3.0

2024-08-20 Thread Steve Loughran
Mukund and I have built a release candidate (RC1) for Hadoop-Thirdparty 1.3.0. The RC is available at: https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.3.0-RC1/ The git tag is release-1.3.0-RC1, commit 0fd62903b071b5186f31b7030ce42e1c00f6bb6a The maven artifacts are staged at ht

[jira] [Resolved] (HADOOP-19249) Getting NullPointerException when the unauthorised user tries to perform the key operation

2024-08-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19249. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Gett

[jira] [Resolved] (HADOOP-19253) Google GCS changes fail due to VectorIO changes

2024-08-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19253. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Google

[jira] [Created] (HADOOP-19253) Google GCS changes fail due to VectorIO changes

2024-08-16 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19253: --- Summary: Google GCS changes fail due to VectorIO changes Key: HADOOP-19253 URL: https://issues.apache.org/jira/browse/HADOOP-19253 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19136) Upgrade commons-io to 2.16.1

2024-08-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19136. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Upgr

Re: FYI: HADOOP-19252. Release Hadoop Third-Party 1.3.0

2024-08-16 Thread Steve Loughran
update: I've just rolled back the thirdparty/trunk commit: it is still publishing at 1.3.0-SNAPSHOT once the new release is out, it can be updated On Fri, 16 Aug 2024 at 17:30, Steve Loughran wrote: > > I'm starting to do the build of the new 1.3.0 release. so trunk version is

FYI: HADOOP-19252. Release Hadoop Third-Party 1.3.0

2024-08-16 Thread Steve Loughran
I'm starting to do the build of the new 1.3.0 release. so trunk version is 1.4.0-SNAPSHOT I've just realised this will cause problems with hadoop trunk. won't it? I'll do a PR with hadoop-trunk that'll be critical for builds working on saturday -but it won't work until then. As for the 1.3.0 rel

Re: [VOTE] Release Apache Hadoop 3.4.1

2024-08-16 Thread Steve Loughran
Afraid I have to say -1 to this iteration, but I promise I'll help address the issues First, I've cherrypicked a few final changes from branch-3.4 in, including this major one HADOOP-19153. hadoop-common exports logback as a transitive dependency (#6999) This broke parquet hadoop-test runs withou

[jira] [Created] (HADOOP-19252) Release Hadoop Third-Party 1.3.0

2024-08-16 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19252: --- Summary: Release Hadoop Third-Party 1.3.0 Key: HADOOP-19252 URL: https://issues.apache.org/jira/browse/HADOOP-19252 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-19153) hadoop-common still exports logback as a transitive dependency

2024-08-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19153. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > hadoop-com

Re: need help one champion who is interested to bring Solidigm CSAL cloud storage acceleration Layer into Apache Open Source SW family

2024-08-07 Thread Steve Loughran
Not in a position to help. the active amazon and microsoft engineers are busy in their relevant codebases, leaving: cloudera engineers (4 of us), and the people working on hadoop-cos and hadoop-huaweicloud In "HADOOP-19236 Integration of Volcano Engine TOS in Hadoop" jinglun is going to work on th

[jira] [Resolved] (HADOOP-19245) S3ABlockOutputStream no longer sends progress events in close()

2024-08-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19245. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed

[jira] [Created] (HADOOP-19245) S3ABlockOutputStream no longer sends progress events in close()

2024-08-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19245: --- Summary: S3ABlockOutputStream no longer sends progress events in close() Key: HADOOP-19245 URL: https://issues.apache.org/jira/browse/HADOOP-19245 Project

Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

2024-07-29 Thread Steve Loughran
f the docker image https://github.com/apache/hadoop-release-support On Mon, 29 Jul 2024 at 19:57, Steve Loughran wrote: > > > > On Fri, 26 Jul 2024 at 23:08, Mukund Madhav Thakur > wrote: > >> Omg Steve already found and fixed the JAVA_HOME issue in create-release >

[DISCUSS] what needs to be done to switch to java17

2024-07-29 Thread Steve Loughran
A lot of projects are moving off java8. making java17 the new baseline what do we need to there that is blocker rather than just "nice"'?

Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

2024-07-29 Thread Steve Loughran
On Fri, 26 Jul 2024 at 23:08, Mukund Madhav Thakur wrote: > Omg Steve already found and fixed the JAVA_HOME issue in create-release > for arm64 which I had to spend some time recently. > https://github.com/apache/hadoop/pull/6962 > i really don't remember that. Why did you have to repeat it...di

[jira] [Resolved] (HADOOP-19161) S3A: option "fs.s3a.performance.flags" to take list of performance flags

2024-07-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19161. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > S3A: opt

[jira] [Created] (HADOOP-19229) Vector IO: have a max distance between ranges to range

2024-07-17 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19229: --- Summary: Vector IO: have a max distance between ranges to range Key: HADOOP-19229 URL: https://issues.apache.org/jira/browse/HADOOP-19229 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19220) S3A : S3AInputStream positioned readFully Expectation

2024-07-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19220. - Resolution: Works for Me it works for me and for the people who support calls would

[jira] [Created] (HADOOP-19221) S3a: retry on 400 +ErrorCode RequestTimeout

2024-07-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19221: --- Summary: S3a: retry on 400 +ErrorCode RequestTimeout Key: HADOOP-19221 URL: https://issues.apache.org/jira/browse/HADOOP-19221 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19195) Upgrade aws sdk v2 to 2.25.53

2024-07-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19195. - Fix Version/s: 3.4.1 Resolution: Fixed merged to 3.4 and trunk branches

[jira] [Resolved] (HADOOP-19205) S3A initialization/close slower than with v1 SDK

2024-07-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19205. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed >

[jira] [Resolved] (HADOOP-19210) s3a: TestS3AAWSCredentialsProvider and TestS3AInputStreamRetry really slow

2024-07-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19210. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed >

[jira] [Created] (HADOOP-19210) s3a: TestS3AAWSCredentialsProvider and TestS3AInputStreamRetry really slow

2024-06-26 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19210: --- Summary: s3a: TestS3AAWSCredentialsProvider and TestS3AInputStreamRetry really slow Key: HADOOP-19210 URL: https://issues.apache.org/jira/browse/HADOOP-19210

[jira] [Resolved] (HADOOP-19194) Add test to find unshaded dependencies in the aws sdk

2024-06-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19194. - Fix Version/s: 3.4.1 Resolution: Fixed This highlights how many unshaded

[jira] [Resolved] (HADOOP-19204) VectorIO regression: empty ranges are now rejected

2024-06-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19204. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Vecto

[jira] [Resolved] (HADOOP-19203) WrappedIO BulkDelete API to raise IOEs as UncheckedIOExceptions

2024-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19203. - Fix Version/s: 3.4.1 Resolution: Fixed > WrappedIO BulkDelete API to raise I

[jira] [Resolved] (HADOOP-18508) support multiple s3a integration test runs on same bucket in parallel

2024-06-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18508. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > supp

[jira] [Resolved] (HADOOP-18931) FileSystem.getFileSystemClass() to log at debug the jar the .class came from

2024-06-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18931. - Fix Version/s: 3.5.0 3.4.1 Assignee: Viraj Jasani

[jira] [Resolved] (HADOOP-19192) Log level is WARN when fail to load native hadoop libs

2024-06-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19192. - Fix Version/s: 3.5.0 3.4.1 Assignee: Cheng Pan

[jira] [Created] (HADOOP-19205) S3A initialization/close slower than with v1 SDK

2024-06-14 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19205: --- Summary: S3A initialization/close slower than with v1 SDK Key: HADOOP-19205 URL: https://issues.apache.org/jira/browse/HADOOP-19205 Project: Hadoop Common

[jira] [Created] (HADOOP-19204) VectorIO regression: empty ranges are now rejected

2024-06-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19204: --- Summary: VectorIO regression: empty ranges are now rejected Key: HADOOP-19204 URL: https://issues.apache.org/jira/browse/HADOOP-19204 Project: Hadoop Common

[jira] [Created] (HADOOP-19203) WrappedIO BulkDelete API to raise iOEs as UncheckediOExceptions

2024-06-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19203: --- Summary: WrappedIO BulkDelete API to raise iOEs as UncheckediOExceptions Key: HADOOP-19203 URL: https://issues.apache.org/jira/browse/HADOOP-19203 Project

[jira] [Resolved] (HADOOP-19199) Include FileStatus when opening a file from FileSystem

2024-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19199. - Resolution: Duplicate Closing as a duplicate of HADOOP-15229. I absolutely agree the

[jira] [Resolved] (HADOOP-19200) Reduce the number of headObject when opening a file with the s3 file system

2024-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19200. - Resolution: Duplicate > Reduce the number of headObject when opening a file with

[jira] [Resolved] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18516. - Fix Version/s: 3.4.1 Resolution: Fixed > [ABFS]: Support fixed SAS token con

  1   2   3   4   5   6   7   8   9   10   >