[
https://issues.apache.org/jira/browse/HDFS-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16112.
Resolution: Duplicate
closed it for you. You are already granted contributor privilege
[
https://issues.apache.org/jira/browse/HDFS-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16177.
Fix Version/s: 3.3.2
3.2.3
3.4.0
Resolution
[
https://issues.apache.org/jira/browse/HDFS-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-14477.
Resolution: Duplicate
> No enum constant Operation.GET_BLOCK_LOCATI
[
https://issues.apache.org/jira/browse/HDFS-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16162.
Fix Version/s: 3.4.0
Resolution: Fixed
> Improve DFSUtil#checkProtectedDescenda
[
https://issues.apache.org/jira/browse/HDFS-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16161.
Resolution: Duplicate
Turns out it was fixed by HDFS-14706
> Corrupt block check
Wei-Chiu Chuang created HDFS-16161:
--
Summary: Corrupt block checksum is not reported to NameNode
Key: HDFS-16161
URL: https://issues.apache.org/jira/browse/HDFS-16161
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16154.
Fix Version/s: 3.3.2
3.2.3
3.4.0
Resolution
[
https://issues.apache.org/jira/browse/HDFS-16149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16149.
Fix Version/s: 3.4.0
Resolution: Fixed
> Improve the parameter annotat
[
https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-14529.
Fix Version/s: 3.4.0
Resolution: Fixed
> SetTimes to throw FileNotFoundExcept
[
https://issues.apache.org/jira/browse/HDFS-15936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15936.
Fix Version/s: 3.3.2
3.4.0
Resolution: Fixed
Thanks!
> So
[
https://issues.apache.org/jira/browse/HDFS-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16137.
Fix Version/s: 3.4.0
Resolution: Fixed
> Improve the comments rela
[
https://issues.apache.org/jira/browse/HDFS-16111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16111.
Fix Version/s: 3.4.0
Resolution: Fixed
Thanks!
> Add a configurat
Wei-Chiu Chuang created HDFS-16136:
--
Summary: Handle all occurrence of InvalidEncryptionKeyException
Key: HDFS-16136
URL: https://issues.apache.org/jira/browse/HDFS-16136
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15650.
Fix Version/s: 3.3.2
3.2.3
3.4.0
Resolution
ves
> > costs to configure and debug the precommit jobs.
> > https://issues.apache.org/jira/browse/HADOOP-17798
> > 2. Improve the pull request template for the contributors
> > https://issues.apache.org/jira/browse/HADOOP-17799
> >
> > Regards,
> > Akira
>
One more idea that I forgot to mention:
We can have the Dependabot to automatically create a pull request whenever
a vulnerability is discovered.
On Wed, Jul 14, 2021 at 8:42 AM Wei-Chiu Chuang
wrote:
> So this is just up for discussion and welcome more brainstorming. I'm not
> saying I
ebhooks?
> - Just for discussion: is Integrating SonarQube worth the effort of
> supporting the GitHub webhooks. SonarQube
>is a double edge weapon and it needs dedicated man hours to weed out
> the way through the reports.
>
> On Mon, Jul 12, 2021 at 11:18 PM Wei-Chiu Chuang
&g
Here's another one:
We can update the JIRA workflow and add more state. For example, Cassandra
has "Review in Progress" and "Need Reviewer" states. INFRA-22049
<https://issues.apache.org/jira/browse/INFRA-22049>
On Tue, Jul 13, 2021 at 11:34 AM Wei-Chiu Chuang wr
I work on multiple projects and learned a bunch from those projects.There
are nice add-ons that help with productivity. There are things we can do to
help us manage the project better.
1. Add new issue types.
We can add "Epic" jira type to organize a set of related jiras. This could
be easier to
For your information,
While drafting the upcoming quarterly report, I found there are three talks
that are directly related to Hadoop in this year's ApacheCon Asia.
https://apachecon.com/acasia2021/tracks/bigdata.html
Bigtop 3.0: Rerising community driven Hadoop distribution
Our friends at LinkedIn published an awesome blog post on the HDFS
scalability.
Check it out here:
https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr
Thanks,
Wei-Chiu
[
https://issues.apache.org/jira/browse/HDFS-16110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16110.
Fix Version/s: 3.4.0
Resolution: Fixed
Thanks [~tomscut] and [~tasanuma
[
https://issues.apache.org/jira/browse/HDFS-11528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-11528.
Resolution: Duplicate
I'll resolve this one and use HDFS-14529 for further discussion
[
https://issues.apache.org/jira/browse/HDFS-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16086.
Fix Version/s: 3.4.0
Resolution: Fixed
> Add volume information to datanode
[
https://issues.apache.org/jira/browse/HDFS-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16096.
Resolution: Fixed
Merged the PR.
Thanks [~zhuxiangyi] and [~vjasani] for the review
[
https://issues.apache.org/jira/browse/HDFS-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16089.
Fix Version/s: 3.3.2
3.4.0
Resolution: Fixed
> EC: Add met
[
https://issues.apache.org/jira/browse/HDFS-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16074.
Fix Version/s: 3.3.2
3.2.3
3.4.0
Resolution
Wei-Chiu Chuang created HDFS-16074:
--
Summary: Remove an expensive debug string concatenation
Key: HDFS-16074
URL: https://issues.apache.org/jira/browse/HDFS-16074
Project: Hadoop HDFS
Issue
olks who continued helps for this
release process.
Best Regards,
Wei-Chiu Chuang
Dropped 3.1.4 from website.
Removed from https://dist.apache.org/repos/dist/release/hadoop/common/
On Thu, Jun 10, 2021 at 3:42 PM Akira Ajisaka wrote:
> This vote has passed with 18 binding +1. I'll update the JIRA and the wiki.
>
> Thanks all for your participation.
>
> On Tue, Jun 8, 2021 at
> > > +1,
>> > > Built from Source.
>> > > Successful Native Build on Ubuntu 20.04
>> > > Verified Checksums
>> > > Ran basic hdfs shell commands.
>> > > Ran simple MR jobs.
>> > > Browsed NN,DN,RM and NM UI.
>&g
Hello,
Just want to make sure everyone interested in HDFS dev is aware
that HDFS-13671 (Namenode deletes large dir slowly caused by
FoldedTreeSet#removeAndGet) will soon to be merged.
The folded tree set data structure introduced in Hadoop 3 has big
performance regression when delete files.
ht.
>> Created https://issues.apache.org/jira/browse/HADOOP-17746.
>>
>> This is *not a blocker*
>>
>> I can prepare a fix and we can have it in so that if any other changes
>> come
>> in the page will look OK.
>>
>>
>>
>>
>
e release is a
> big release, but I get that it’s the current state of the project.
>
> > On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote:
> >
> > Hello,
> > do we want to extend the release vote? I understand a big release like
> this
> > takes time to
is faster by 20%
over Hadoop 3.2 library.
Looks like we may need some more time to test. How about extending it by a
week?
On Tue, Jun 1, 2021 at 6:29 PM Wei-Chiu Chuang wrote:
> Hi community,
>
> This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker
> issu
+1
On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka wrote:
> Dear Hadoop developers,
>
> Given the feedback from the discussion thread [1], I'd like to start
> an official vote
> thread for the community to vote and start the 3.1 EOL process.
>
> What this entails:
>
> (1) an official announcement
I'm curious about the GitHub PR conventions we use today... say I want to
backport a commit from trunk to branch-3.3, and there's a small code
conflict so I push a PR against branch-3.3 using GitHub to go through the
precommit check.
Do I need explicit approval from another committer to merge the
Cancelling RC2.
@Ayush Saxena found an issue HADOOP-16878
<https://issues.apache.org/jira/browse/HADOOP-16878> which we need to
revert.
I'll work on the RC3 asap.
On Tue, Jun 1, 2021 at 3:23 PM Wei-Chiu Chuang wrote:
> Hi community,
>
> This is the release candidate RC2 of Apac
Hi community,
This is the release candidate RC2 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved [1] again.
There are 4 issues resolved for RC2:
* HADOOP-17666. Update LICENSE for 3.3.1
* MAPREDUCE-7348. TestFrameworkUploader#testNativeIO fails. (#3053)
* Revert "HADOOP-17563.
iled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1.
>>
>> -Akira
>>
>> On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang
>> wrote:
>> >
>> > Hi folks,
>> >
>> > I have put together a release candidate (RC0) for Hadoo
documents
>> - Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1.
>>
>> -Akira
>>
>> On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang
>> wrote:
>> >
>> > Hi folks,
>> >
>> > I have put together a release candidate
irdparty 1.1.1 RC0 and cast a vote. Thanks!
On Wed, May 26, 2021 at 9:39 AM Wei-Chiu Chuang wrote:
>
> Found a few issues building downstreams
>
> Ozone: HADOOP-17730 <https://issues.apache.org/jira/browse/HADOOP-17730> --
> we may have to make an hadoop-thirdpar
Hi folks,
I have put together a release candidate (RC0) for Hadoop Thirdparty
1.1.1 which will be consumed by Hadoop 3.3.1 RC2.
The RC is available at:
https://people.apache.org/~weichiu/hadoop-thirdparty-1.1.1-RC0/
The RC tag in svn is
nError: expected null, but was:<1000>
at
org.apache.hadoop.hbase.TestHBaseConfiguration.testDeprecatedConfigurations(TestHBaseConfiguration.java:150)
On Mon, May 24, 2021 at 10:36 PM Wei-Chiu Chuang wrote:
> Hi community,
>
> This is the release candidate RC1 of Apache Had
Hi community,
This is the release candidate RC1 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved.
It contains 697 fixed jira issues [2] since 3.3.0 which include a lot of
features and improvements(read the full set of release notes).
Below feature additions are the highlights
[
https://issues.apache.org/jira/browse/HDFS-15790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15790.
Fix Version/s: 3.4.0
3.3.1
Resolution: Fixed
> M
Sean,
For reasons I don't understand, I never received emails from your new
address in the mailing list. Only Akira's response.
I was just able to start a thread like this.
I am +1 to EOL 3.1.5.
Reason? Spark is already on Hadoop 3.2. Hive and Tez are actively working
to support Hadoop 3.3.
Hi community,
This is the preview bits of the first release candidate of Apache
Hadoop 3.3.1 line. It takes tremendous amount of effort to produce a Hadoop
RC
and we still have a number of unresolved issues [1]. Meanwhile, I'd like to
publish
preview bits so you guys can check out earlier than
Hi I created a branch-3.3.1. The branch-3.3. now tracks 3.3.2-SNAPSHOT.
Please use Fix version 3.3.2 when cherrypicking your commits to branch-3.3.
Regards,
Wei-Chiu
Hello,
I'm trying to understand Hadoop's create-release script. Looks like it's
missing a number of options and profiles that the regular precommit script
does:
https://github.com/apache/hadoop/blob/trunk/dev-support/bin/create-release#L133
ys can quickly check out.
The first RC will probably not have the aarch64 binary. I don't have much
experience with that.
Cheers,
Wei-Chiu
On Thu, May 13, 2021 at 9:04 AM Wei-Chiu Chuang
wrote:
> Hello it's me again.
>
> While working on the hadoop-thirdparty release, I would like to
-DskipTests
> > - mvn clean install -DskipTests -Psrc
> > * Built Hadoop trunk againt hadoop-thirdparty 1.1.0: ok
> >
> >
> > On Thu, May 13, 2021 at 5:25 PM Wei-Chiu Chuang
> > wrote:
> >
> > > Hello my fellow Hadoop developers,
> > >
> &g
[
https://issues.apache.org/jira/browse/HDFS-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-16027.
Fix Version/s: 3.3.1
Resolution: Fixed
Thanks [~ayushtkn]!
> HDFS-15245 bre
Wei-Chiu Chuang created HDFS-16027:
--
Summary: HDFS-15245 breaks source code compatibility between
3.3.0 and 3.3.1.
Key: HDFS-16027
URL: https://issues.apache.org/jira/browse/HDFS-16027
Project
Hi,
I found hundreds of discrepancies between Apache JIRA and git history, and
updated the jira fix versions according to git history.
Some of the noticeable updates:
(1)
HADOOP-16730 ABFS: Support for Shared Access Signatures (SAS) -->
originally a new feature in 3.3.1, is actually in 3.3.0.
[
https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-13934.
Resolution: Fixed
> Multipart uploaders to be created through API call to FileSys
Hello my fellow Hadoop developers,
I am putting together the first release candidate (RC0) for
Hadoop-thirdparty 1.1.0. This is going to be consumed by the upcoming
Hadoop 3.3.1 release.
The RC is available at:
https://people.apache.org/~weichiu/hadoop-thirdparty-1.1.0-RC0/
The RC tag in github
the remaining jiras and push out those that don't have
much progress today.
Thanks all!
Weichiu
On Tue, Apr 20, 2021 at 12:57 PM Wei-Chiu Chuang
wrote:
> Billie and Viraj,
>
> As of today we are at 657 resolved jiras in 3.3.1
> https://issues.apache.org/jira/issues/?filter=-1=project%20in%
with this change so please help review.
Thanks!
On Tue, Apr 27, 2021 at 2:59 PM Wei-Chiu Chuang wrote:
> I'll start preparing the release vote for third-party 1.1.0. Thanks all
> for help!
>
> On Mon, Apr 26, 2021 at 7:20 PM Wei-Chiu Chuang
> wrote:
>
>> Thanks. I created
[
https://issues.apache.org/jira/browse/HDFS-15995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15995.
Fix Version/s: 3.4.0
Resolution: Done
> Rework HDFS-15624
recall the number though.
> >> >
> >> > TestJournalNode is broken by HADOOP-16254
> >> >
> >> > Other seems failing once in a while.
> >> > Let me know if there is some blocking stuff from HDFS side, I will
> attempt
> >> > fixing.
[
https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15624.
Resolution: Fixed
The updated patch was committed. Thanks Ayush for the help!
>
Hello,
There are a number of bad tests currently.
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/490/testReport/
Most are HDFS UTs and are almostly failing consistently.
For example, Dynamometer test are failing because it fetches from a mirror
that no longer exists.
I am
Wei-Chiu Chuang created HDFS-16002:
--
Summary: TestJournalNodeRespectsBindHostKeys#testHttpsBindHostKey
very flaky
Key: HDFS-16002
URL: https://issues.apache.org/jira/browse/HDFS-16002
Project
I'll start preparing the release vote for third-party 1.1.0. Thanks all for
help!
On Mon, Apr 26, 2021 at 7:20 PM Wei-Chiu Chuang
wrote:
> Thanks. I created a Jenkins job to upload the SNAPSHOT to Apache nexus
> repository.
>
> https://ci-hadoop.apache.org/view/Hadoop/job/Hadoo
Ayush Saxena wrote:
> Yep, you have to do it manually
>
> -Ayush
>
> On 26-Apr-2021, at 3:23 PM, Wei-Chiu Chuang wrote:
>
>
> Does anyone know how we publish hadoop-thirdparty SNAPSHOT artifacts?
>
> The main Hadoop arifacts are published by this job
> https:/
apshot, the hadoop code would pick
> that up, and watch out everything is safe and clean before release. Unless
> you have a better way to verify or already verified!!!
>
> -Ayush
>
> > On 23-Apr-2021, at 3:16 PM, Wei-Chiu Chuang
> wrote:
> >
> > Another suggestion: look
If you are seeing precommit failures, like this:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile
(default-compile) on project hadoop-annotations: Compilation failure
[ERROR] javac: invalid flag: -Xmaxwarns=
[ERROR] Usage: javac
[ERROR] use -help for
releases. However, HDFS-15566 is a serious issue. Therefore I
> think we can bump the layout version even in the bugfix release if the
> new layout version is required to fix the issue.
>
> Thanks,
> Akira
>
> On Fri, Apr 23, 2021 at 12:40 PM Wei-Chiu Chuang
> wrote:
> >
Wei-Chiu Chuang created HDFS-15995:
--
Summary: Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem
after updating hadoop
Key: HDFS-15995
URL: https://issues.apache.org/jira/browse/HDFS-15995
. The version used is too old.
On Fri, Apr 23, 2021 at 10:55 AM Wei-Chiu Chuang wrote:
> Hi community,
>
> In preparation of the Hadoop 3.3.1 release, I am starting a thread to
> discuss its prerequisite: the release of hadoop-thirdparty 1.1.0.
>
> My plan:
> update guava
[
https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang reopened HDFS-15624:
> Fix the SetQuotaByStorageTypeOp problem after updating had
Hello I want to discuss this with the wider community.
In HDFS-15624 (fix the function of setting quota by storage type), A new
layout version was added
NVDIMM_SUPPORT(-66, -61, "Support NVDIMM storage type");
This was added for 3.4.0 (trunk)
However, there's another jira
HDFS-15566 (NN restart
Hi community,
In preparation of the Hadoop 3.3.1 release, I am starting a thread to
discuss its prerequisite: the release of hadoop-thirdparty 1.1.0.
My plan:
update guava to 30.1.1 (latest). I have the PR ready to merge.
Do we want to update protobuf and jaeger? Anything else?
I suppose we
the jira with the label 'release-blocker'.
On Tue, Apr 20, 2021 at 2:44 AM Billie Rinaldi wrote:
> I was thinking of backporting HADOOP-16948 for 3.3.1.
>
> Billie
>
> On Mon, Apr 19, 2021 at 1:33 AM Wei-Chiu Chuang
> wrote:
>
> > Hello, reviving this thread.
> >
>
; >>
> > > > > >> >> I will come up with a plan.. Please let me know if anybody
> has
> > > some
> > > > > >> >> features/improvements/bugs that need to be included.
> > > > > >> >>
>
Hello,
I spent the past few days on this PR
https://github.com/apache/hadoop/pull/2832 to migrate our NFS gateway from
Netty3 to Netty4. We're way overdue for this work.
Anyone who has touched Netty knows how painful it is to move from Netty3 to
4. This PR passed unit tests but I honestly don't
Hello,
Now that we're gradually switching to github PRs for code review, there
appears to be a tendency to leave the commits in the trunk.
I am sweeping through the commits in trunk and found a lot of goodies can
be cherry picked without conflicts to branch-3.3.
Unless it's something
gt; >> > Sunil
> > >> >> >
> > >> >> > On Mon, Feb 8, 2021 at 11:56 PM Stack wrote:
> > >> >> >
> > >> >> > > On Wed, Feb 3, 2021 at 6:41 AM Steve Loughran
> > >> >> > > >>
[
https://issues.apache.org/jira/browse/HDFS-15734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15734.
Fix Version/s: 3.40
Resolution: Fixed
> [READ] DirectoryScanner#scan need not ch
[
https://issues.apache.org/jira/browse/HDFS-15826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15826.
Fix Version/s: 3.2.3
3.1.5
3.4.0
[
https://issues.apache.org/jira/browse/HDFS-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15801.
Fix Version/s: 2.10.2
Resolution: Fixed
Thanks. This is merged.
> Backport H
[
https://issues.apache.org/jira/browse/HDFS-15791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15791.
Fix Version/s: 3.4.0
Resolution: Fixed
> Possible Resource L
Hi all,
Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated
more than 400 changes in the branch-3.3. A number of downstreamers are
eagerly waiting for 3.3.1 which addresses the guava version conflict issue.
[
https://issues.apache.org/jira/browse/HDFS-15777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15777.
Resolution: Invalid
> Hadoop
> --
>
> Key
+1 (binding)
On Mon, Jan 4, 2021 at 11:11 PM Akira Ajisaka wrote:
> +1 (binding)
>
> - Verified the checksums and signatures
> - Verified the source is the same as the RC5 tag
> - Built from source with CentOS 7.9 and Java 1.8.0_275
> - Setup pseudo cluster and ran some FsShell commands
>
>
[
https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15719.
Fix Version/s: 3.2.3
3.1.5
3.4.0
We should target
3.4.0,
3.3.1
3.2.3 (or 3.2.2)
I updated and set 3.3.0 released in YARN.
Time to clean up some of the old releases. I'll do that.
On Mon, Dec 21, 2020 at 4:04 PM Eric Badger
wrote:
> I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao,
> feel free to
Forgot to mention I am +1 (binding) too based on the fact there are no
blocker issues and RC3 and RC4 diff.
On Mon, Dec 14, 2020 at 1:42 PM Wei-Chiu Chuang wrote:
> Diff between RC3 and RC4:
>
> MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136)
> HDFS-134
Diff between RC3 and RC4:
MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136)
HDFS-13404. Addendum: RBF:
TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail.
Contributed by Takanobu Asanuma.
HADOOP-16080. hadoop-aws does not work with hadoop-client-api
[
https://issues.apache.org/jira/browse/HDFS-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15720.
Fix Version/s: 3.2.3
3.1.5
3.3.1
Resolution
Wei-Chiu Chuang wrote:
> Hello just a re minder this event will happen in less than an hour!
>
> Join Zoom Meeting
>
> https://cloudera.zoom.us/j/880548968
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Down
cation
+1 646 558 8656 US (New York)
+1 720 707 2699 US
877 853 5257 US Toll-free
888 475 4499 US Toll-free
Meeting ID: 880 548 968
Find your local number: https://zoom.us/u/acaGRDfMVl
On Mon, Dec 7, 2020 at 9:35 AM Wei-Chiu Chuang wrote:
> Hello!
>
Wei-Chiu Chuang created HDFS-15719:
--
Summary: [Hadoop 3] Both NameNodes can crash simultaneously due to
the short JN socket timeout
Key: HDFS-15719
URL: https://issues.apache.org/jira/browse/HDFS-15719
fers implements
> Connector
> {
>
> protected int _maxIdleTime=20;
>
> }
>
> Thanks,
> Jason
>
> On 12/7/20, 9:51 PM, "Wei-Chiu Chuang" wrote:
>
> Hi community,
>
> I want to share with you this observation.
>
>
Hi community,
I want to share with you this observation.
We received several case reports that users sometimes experience
JournalNode timeout when NN requests edits from JN. The end result is
(both!) NN crash after the timeout (10 seconds).
It seems to only happen to Hadoop 3 users (CDH6 and
[
https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15709.
Fix Version/s: 3.2.3
3.1.5
3.4.0
Hello!
As we move into December, some of you may start to feel like in vacation
mode. I'm also looking forward to vacations! But before that, I invited
Twitter's developer, Zhenzhao, to discuss Hadoop on Google Cloud Storage
(GCS).
Twitter's moving into GCP and has lots of experience with GCS.
[
https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDFS-15706.
Fix Version/s: 3.2.3
3.1.5
3.4.0
Possibly snapshots.
Also possible if each of your files has lots of xattr or ACLs.
On Tue, Dec 1, 2020 at 3:52 PM Jason Wen
wrote:
> Hi,
>
> We are encountering some odd FSImage size issue in one of our Hadoop
> clusters. The Namenode only has about 3M files/blocks, but the FSImage size
> is
101 - 200 of 735 matches
Mail list logo
