Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-25 Thread Weiwei Yang
+1 Weiwei On Friday, September 25, 2020, Dinesh Chitlangia wrote: > +1 > > Thanks, > Dinesh > > On Fri, Sep 25, 2020 at 2:00 AM Elek, Marton wrote: > > > Hi all, > > > > Thank you for all the feedback and requests, > > > > As we discussed in the previous thread(s) [1], Ozone is proposed to be

Re: [ANNOUNCE] New Apache Hadoop Committer - He Xiaoqiao

2020-06-11 Thread Weiwei Yang
Congratulations Xiaoqiao! On Thu, Jun 11, 2020 at 11:20 AM Sree Vaddi wrote: > Congratulations, He Xiaoqiao. > > Thank you./Sree > > > > On Thursday, June 11, 2020, 9:54:32 AM PDT, Chao Sun < > sunc...@apache.org> wrote: > > Congrats Xiaoqiao! > > On Thu, Jun 11, 2020 at 9:36 AM Ayush Saxen

Re: [DISCUSS] making Ozone a separate Apache project

2020-05-13 Thread Weiwei Yang
+1 Thanks, Marton for starting the discussion. One question, for the committers who contributed to Ozone before and got the committer-role in the past (like me), will they carry the committer-role to the new repo? On Wed, May 13, 2020 at 9:07 AM Dinesh Chitlangia wrote: > +1 > Thank you Marton f

Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0

2019-12-09 Thread Weiwei Yang
Awesome! You guys rock!! Any plan to upgrade YARN to latest version too? -- Weiwei On Dec 9, 2019, 5:20 PM -0800, Hui Fei , wrote: > Hi Eric, > > It's Rolling Upgrade without downtime. We have a cluster with thousands of > nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading > Serv

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-19 Thread Weiwei Yang
+1 (binding) - Downloaded source, setup a single node cluster - Verified basic HDFS operations, put/get/cat etc - Verified basic YARN restful apis, cluster/nodes/scheduler, all seem good - Run several distributed shell job Thanks Weiwei On Sep 19, 2019, 4:28 PM +0800, Sunil Govindan , wrote: > +1

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-18 Thread Weiwei Yang
+1 (binding) Downloaded tarball, setup a pseudo cluster manually Verified basic HDFS operations, copy/view files Verified basic YARN operations, run sample DS jobs Verified basic YARN restful APIs, e.g cluster/nodes info etc Set and verified YARN node-attributes, including CLI Thanks Weiwei On Se

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Wed, Sep 18, 2019 at 6:35 AM Wangda Tan wrote: > +1 (binding). > > From my experiences of Submarine project, I think moving to a separate repo > helps. > > - Wangda > > On Tue, Sep 17, 2019 at 11:41 AM Subru Krishnan wrote: > > > +1 (binding). > > > > IIUC, there

Re: [VOTE] Move Submarine source code, documentation, etc. to a separate Apache Git repo

2019-08-26 Thread Weiwei Yang
+1 Thanks Weiwei On Aug 27, 2019, 9:40 AM +0800, Xun Liu , wrote: > +1 (non-binding) > This is the best news. > > Peter Bacsko 于2019年8月27日周二 上午4:59写道: > > > +1 (non-binding) > > > > On Sat, Aug 24, 2019 at 4:06 AM Wangda Tan wrote: > > > > > Hi devs, > > > > > > This is a voting thread to move S

Re: Aug Hadoop Community Meetup in China

2019-07-23 Thread Weiwei Yang
Hi Junping Thanks. I would like to get a slot to talk about our new open source project: YuniKorn. Thanks Weiwei On Jul 23, 2019, 5:08 PM +0800, 俊平堵 , wrote: > Thanks for these positive feedbacks! The local community has voted the date > and location to be 8/10, Beijing. So please book your tim

Re: Aug Hadoop Community Meetup in China

2019-07-18 Thread Weiwei Yang
Hi Junping Thanks for organizing this event ! Just finished the survey, looking forward to meet folks in the coming meet up. Thanks Weiwei On Jul 18, 2019, 3:28 PM +0800, 俊平堵 , wrote: > Hi, all! > > I am glad to let you know that we are organizing > Hadoop Contributors Meetup in China on Aug. > >

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

2019-07-16 Thread Weiwei Yang
Thanks Marton, +1 on this. Weiwei On Jul 17, 2019, 2:07 PM +0800, Elek, Marton , wrote: > Hi, > > Github UI (ui!) helps to merge Pull Requests to the proposed branch. > There are three different ways to do it [1]: > > 1. Keep all the different commits from the PR branch and create one > additiona

[ANNOUNCE] New Apache Hadoop Committer - Tao Yang

2019-07-15 Thread Weiwei Yang
Hi Dear Apache Hadoop Community It's my pleasure to announce that Tao Yang has been elected as an Apache Hadoop committer, this is to recognize his contributions to Apache Hadoop YARN project. Congratulations and welcome on board! Weiwei (On behalf of the Apache Hadoop PMC)

[jira] [Reopened] (HDFS-12748) NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

2019-07-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-12748: > NameNode memory leak when accessing webhdfs GETHOMEDIRECT

Re: Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

2019-06-25 Thread Weiwei Yang
Thanks Wangda. Will this event be recorded? It will be extremely helpful for people who are unable to join to catch up. Thanks Weiwei On Jun 26, 2019, 4:12 AM +0800, Wangda Tan , wrote: A friendly reminder, The meetup will take place tomorrow at 9:00 AM PDT to 4:00 PM PDT. The address is: 395 P

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-21 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Jun 21, 2019, 5:33 AM +0800, Wangda Tan , wrote: +1 Binding. Tested in local cluster and reviewed docs. Thanks! On Wed, Jun 19, 2019 at 3:20 AM Sunil Govindan wrote: +1 binding - tested in local cluster. - tried tony run time as well - doc seems fine now. - Suni

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

2019-02-04 Thread Weiwei Yang
+1 Weiwei -- Weiwei On Feb 5, 2019, 2:11 AM +0800, Steve Loughran , wrote: > +1, binding > > > On 1 Feb 2019, at 22:15, Wangda Tan wrote: > > > > Hi all, > > > > According to positive feedbacks from the thread [1] > > > > This is vote thread to start a new subproject named "hadoop-submarine" > >

Re: [DISCUSS] Making submarine to different release model like Ozone

2019-01-31 Thread Weiwei Yang
Thanks for proposing this Wangda, my +1 as well. It is amazing to see the progress made in Submarine last year, the community grows fast and quiet collaborative. I can see the reasons to get it release faster in its own cycle. And at the same time, the Ozone way works very well. — Weiwei On Feb

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-10 Thread Weiwei Yang
ve done few testing with my pseudo cluster. My +1 to start. > > > > > > > > Regards, > > > > Sunil > > > > > > > > [1] > > > > > https://lists.apache.org/thread.html/68c1745dcb65602aecce6f7e6b7f0af3d974b1bf0048e7823e58b06f@%3Cyarn-dev.hadoop.apache.org%3E > > > > [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.2.0) > > AND fixVersion not in (3.1.0, 3.0.0, 3.0.0-beta1) AND status = Resolved > > ORDER BY fixVersion ASC > > > Wilfred Spiegelenburg | Software Engineer > cloudera.com <https://www.cloudera.com/> > > > > > > > > -- Weiwei Yang

Re: [DISCUSS] Move to gitbox

2018-12-10 Thread Weiwei Yang
; To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > > > --------- > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > -- Weiwei Yang

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-09 Thread Weiwei Yang
est from AM. > > >> Manager implementation will help to store and recover Node Attributes. > > >> This > > >> works with existing placement constraints. > > >> > > >> *Regarding to API stability:* > > >> > > >> All newl

Re: [Discuss] Merge discussion for Node attribute support feature YARN-3409

2018-09-04 Thread Weiwei Yang
nfiguration > details. This feature works from end-to-end and we tested this in our local > cluster. Branch code is run against trunk and tracked via [4]. > > We would love to get your thoughts before opening a voting thread. > > Special thanks to a team of folks who worked hard and

Re: HADOOP-14163 proposal for new hadoop.apache.org

2018-09-02 Thread Weiwei Yang
> > > >>> I got multiple valuable feedback and I improved the proposed site > > >>> according to the comments. Allen had some concerns about the used > > >>> technologies (hugo vs. mvn-site) and I answered all the questions > > why > > >>> I think mvn-site is the best for documentation and hugo is best > > for > > >>> generating site. > > >>> > > >>> > > >>> I would like to finish this effort/jira: I would like to start a > > >>> discussion about using this proposed version and approach as a > new > > >>> site of Apache Hadoop. Please let me know what you think. > > >>> > > >>> > > >>> Thanks a lot, > > >>> Marton > > >>> > > >>> > > - > > >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >>> For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > >>> > > >> > > >> > > >> > > - > > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >> For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > >> > > > > > > > - > > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > > > > > > -- Weiwei Yang

Re: Apache Hadoop 3.1.1 release plan

2018-05-10 Thread Weiwei Yang
Hi Wangda I would propose to have https://issues.apache.org/jira/browse/YARN-8015 included in 3.1.1. Once this is done, we get both intra and inter placement constraint covered so users could start to explore this feature. Otherwise the functionality is pretty limited. It has been Patch Availa

Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-16 Thread Weiwei Yang
+1 -- Weiwei On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , wrote: dopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge.

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-01 Thread Weiwei Yang
Hi Wangda +1 (non-binding) - Smoke tests with teragen/terasort/DS jobs - Various of metrics, UI displays validation, compatible tests - Tested GPU resource-type - Verified RM fail-over, app-recovery - Verified 2 threads async-scheduling - Enabled placement constraints, tested affinity/anti-affini

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Weiwei Yang
Hi Wangda While testing the build, we found a bug https://issues.apache.org/jira/browse/YARN-8085, it might cause NPE during RM fail-over. I think that needs to be included in 3.1.0. We have run some other tests, and they look good so far. This includes - Some basic teragen/terasort/DS jobs - V

[jira] [Created] (HDFS-13351) Revert HDFS-11156 from branch-2

2018-03-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-13351: -- Summary: Revert HDFS-11156 from branch-2 Key: HDFS-13351 URL: https://issues.apache.org/jira/browse/HDFS-13351 Project: Hadoop HDFS Issue Type: Task

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

2018-03-20 Thread Weiwei Yang
+1 (non-binding) I really like this proposal and thanks for all the discussions. -- Weiwei On 21 Mar 2018, 8:39 AM +0800, Arpit Agarwal , wrote: +1 (binding) Arpit On 3/20/18, 11:21 AM, "Owen O'Malley" wrote: All, Following our discussions on the previous thread (Merging branch HDFS-7240 to

Re: [NOTICE] branch-3.1 created. 3.1.0 code freeze started.

2018-02-10 Thread Weiwei Yang
Hi Wangda I am a bit confused about the branches, I am expecting something like following  branch-3.1.0: 3.1.0  branch-3.1: 3.1.x  trunk: 3.2.x Code freezes in branch-3.1.0 which only allows blocks. However, did you mean you created branch-3.1 for 3.1.0? In this case, what branch should be used

Re: [VOTE] Merge YARN-6592 feature branch to trunk

2018-01-26 Thread Weiwei Yang
+1 We are also looking forward to this : ) -- Weiwei On 27 Jan 2018, 9:16 AM +0800, Wangda Tan , wrote: +1 On Sat, Jan 27, 2018 at 2:05 AM, Chris Douglas mailto:cdoug...@apache.org>> wrote: +1 Looking forward to this. -C On Fri, Jan 26, 2018 at 7:28 AM, Arun Suresh mailto:asur...@apache.org>>

Re: [DISCUSS] Merge YARN-6592 to trunk

2018-01-25 Thread Weiwei Yang
+1, thanks for getting to this milestone Arun. I’ve done some basic validations on a 4 nodes cluster, with some general affinity/anti-affinty/cardinality constraints, it worked. I’ve also reviewed the doc, it’s in good shape and very illustrative. Thanks. -- Weiwei On 26 Jan 2018, 10:44 AM +08

[jira] [Resolved] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12936. Resolution: Not A Bug > java.lang.OutOfMemoryError: unable to create new native thr

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-14 Thread Weiwei Yang
Hi Andrew Congratulations on the 3.0 GA, another mile stone of Hadoop history. Thanks for driving this release, excellent work! Took a look at the release notes, also seems nice. But one question, who is maintaining https://wiki.apache.org/hadoop/PoweredBy? Some of info is quite out of date, wo

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-12-04 Thread Weiwei Yang
+1 (non-binding) Thanks for getting this done Sunil. -- Weiwei On 5 Dec 2017, 4:06 AM +0800, Eric Payne , wrote: +1. Thanks Sunil for the work on this branch. Eric From: Sunil G ; Hdfs-dev ; Hadoop Common ; "mapreduce-...@hadoop.apache.org" http://mail-archives.apache.org/mod_mbox/hadoop-yarn

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Weiwei Yang
Hi Sunil +1 from my side. Actually we have applied some of these patches to our production cluster since Sep this year, on over 2000+ nodes and it works nicely. +1 for the merge. I am pretty sure this feature will help a lot of users, especially those on cloud. Thanks for getting this done, gre

Re: Apache Hadoop 2.8.3 Release Plan

2017-11-21 Thread Weiwei Yang
Agree with Konstantin. This two issues has been opened for a while but could not reach a consensus on the fix, hope this gets enough attention from the community and get them resolved. Thanks -- Weiwei On 22 Nov 2017, 11:18 AM +0800, Konstantin Shvachko , wrote: I would consider these two blo

[jira] [Created] (HDFS-12770) Add doc about how to disable client socket cache

2017-11-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12770: -- Summary: Add doc about how to disable client socket cache Key: HDFS-12770 URL: https://issues.apache.org/jira/browse/HDFS-12770 Project: Hadoop HDFS Issue Type

Improvement on DN HB lock

2017-11-02 Thread Weiwei Yang
Hi everyone Here is a JIRA discussing about improving DN HB lock https://issues.apache.org/jira/browse/HDFS-7060 , it seems folks who participated the discussion both agreed on reducing the use of dataset log but the ticket goes to stale for a while. Recently we hit the issue in a 450 nodes cl

[jira] [Resolved] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12757. Resolution: Duplicate > DeadLock Happened Between DFSOutputStream and LeaseRenewer w

[jira] [Created] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12744: -- Summary: More logs when short-circuit read is failed and disabled Key: HDFS-12744 URL: https://issues.apache.org/jira/browse/HDFS-12744 Project: Hadoop HDFS

[jira] [Created] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12701: -- Summary: More fine-grained locks in ShortCircuitCache Key: HDFS-12701 URL: https://issues.apache.org/jira/browse/HDFS-12701 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12684) Ozone: SCM metrics NodeCount is overlapping with node manager metrics

2017-10-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12684: -- Summary: Ozone: SCM metrics NodeCount is overlapping with node manager metrics Key: HDFS-12684 URL: https://issues.apache.org/jira/browse/HDFS-12684 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12401) Ozone: TestBlockDeletingService#testBlockDeletionTimeout sometimes timeout

2017-10-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12401. Resolution: Cannot Reproduce > Ozone: TestBlockDeletingService#testBlockDeletionTimeout someti

[jira] [Created] (HDFS-12546) Ozone: DB listing operation performance improvement

2017-09-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12546: -- Summary: Ozone: DB listing operation performance improvement Key: HDFS-12546 URL: https://issues.apache.org/jira/browse/HDFS-12546 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12540) Ozone: node status text reported by SCM is a confusing

2017-09-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12540: -- Summary: Ozone: node status text reported by SCM is a confusing Key: HDFS-12540 URL: https://issues.apache.org/jira/browse/HDFS-12540 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12539) Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable

2017-09-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12539: -- Summary: Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable Key: HDFS-12539 URL: https://issues.apache.org/jira/browse/HDFS-12539

[jira] [Reopened] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-09-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-12415: > Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fa

[jira] [Created] (HDFS-12524) Ozone: Record number of keys scanned and hinted for getRangeKVs call

2017-09-21 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12524: -- Summary: Ozone: Record number of keys scanned and hinted for getRangeKVs call Key: HDFS-12524 URL: https://issues.apache.org/jira/browse/HDFS-12524 Project: Hadoop HDFS

[jira] [Created] (HDFS-12506) Ozone: ListBucket is too slow

2017-09-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12506: -- Summary: Ozone: ListBucket is too slow Key: HDFS-12506 URL: https://issues.apache.org/jira/browse/HDFS-12506 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12504: -- Summary: Ozone: Improve SQLCLI performance Key: HDFS-12504 URL: https://issues.apache.org/jira/browse/HDFS-12504 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12503) Ozone: some UX improvements to oz_debug

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12503: -- Summary: Ozone: some UX improvements to oz_debug Key: HDFS-12503 URL: https://issues.apache.org/jira/browse/HDFS-12503 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12500: -- Summary: Ozone: add logger for oz shell commands and move error stack traces to DEBUG level Key: HDFS-12500 URL: https://issues.apache.org/jira/browse/HDFS-12500 Project

[jira] [Created] (HDFS-12492) Ozone: ListVolume output misses some attributes

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12492: -- Summary: Ozone: ListVolume output misses some attributes Key: HDFS-12492 URL: https://issues.apache.org/jira/browse/HDFS-12492 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12489: -- Summary: Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures Key: HDFS-12489 URL: https://issues.apache.org/jira/browse/HDFS-12489

[jira] [Created] (HDFS-12488) Ozone: OzoneRestClient has no notion of configuration

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12488: -- Summary: Ozone: OzoneRestClient has no notion of configuration Key: HDFS-12488 URL: https://issues.apache.org/jira/browse/HDFS-12488 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12477) Ozone: Some minor text improvement in SCM web UI

2017-09-17 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12477: -- Summary: Ozone: Some minor text improvement in SCM web UI Key: HDFS-12477 URL: https://issues.apache.org/jira/browse/HDFS-12477 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12461. Resolution: Not A Problem Assignee: Weiwei Yang Fix Version/s: HDFS-7240 > Oz

[jira] [Created] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12463: -- Summary: Ozone: Fix TestXceiverClientMetrics#testMetrics Key: HDFS-12463 URL: https://issues.apache.org/jira/browse/HDFS-12463 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12459: -- Summary: Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API Key: HDFS-12459 URL: https://issues.apache.org/jira/browse/HDFS-12459 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-11156: > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST

[jira] [Created] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-09-13 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12443: -- Summary: Ozone: Improve SCM block deletion throttling algorithm Key: HDFS-12443 URL: https://issues.apache.org/jira/browse/HDFS-12443 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12440) Ozone: TestAllocateContainer fails on jenkins

2017-09-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12440. Resolution: Duplicate Fix Version/s: HDFS-7240 > Ozone: TestAllocateContainer fails

[jira] [Created] (HDFS-12440) Ozone: TestAllocateContainer fails on jenkins

2017-09-12 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12440: -- Summary: Ozone: TestAllocateContainer fails on jenkins Key: HDFS-12440 URL: https://issues.apache.org/jira/browse/HDFS-12440 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12415: -- Summary: Ozone: TestXceiverClientManager occasionally fails Key: HDFS-12415 URL: https://issues.apache.org/jira/browse/HDFS-12415 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11922. Resolution: Done Fix Version/s: HDFS-7240 Target Version/s: HDFS-7240 > Ozone:

[jira] [Created] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-04 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12391: -- Summary: Ozone: TestKSMSQLCli is not working as expected Key: HDFS-12391 URL: https://issues.apache.org/jira/browse/HDFS-12391 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12367) Ozone: Too many open files error while running corona

2017-09-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12367. Resolution: Duplicate I think this issue no longer happens to me, closing it as a dup to HDFS-12382

[jira] [Created] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12389: -- Summary: Ozone: oz commandline list calls should return valid JSON format output Key: HDFS-12389 URL: https://issues.apache.org/jira/browse/HDFS-12389 Project: Hadoop

[jira] [Created] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12367: -- Summary: Ozone: Too many open files error while running corona Key: HDFS-12367 URL: https://issues.apache.org/jira/browse/HDFS-12367 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12366: -- Summary: Ozone: Refactor KSM metadata class names to avoid confusion Key: HDFS-12366 URL: https://issues.apache.org/jira/browse/HDFS-12366 Project: Hadoop HDFS

[jira] [Created] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12365: -- Summary: Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient Key: HDFS-12365 URL: https://issues.apache.org/jira/browse/HDFS-12365

[jira] [Created] (HDFS-12362) Ozone: write deleted block to RAFT log for consensus on datanodes

2017-08-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12362: -- Summary: Ozone: write deleted block to RAFT log for consensus on datanodes Key: HDFS-12362 URL: https://issues.apache.org/jira/browse/HDFS-12362 Project: Hadoop HDFS

[jira] [Created] (HDFS-12361) Ozone: SCM failed to start when a container metadata is empty

2017-08-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12361: -- Summary: Ozone: SCM failed to start when a container metadata is empty Key: HDFS-12361 URL: https://issues.apache.org/jira/browse/HDFS-12361 Project: Hadoop HDFS

[jira] [Created] (HDFS-12354) Improve the throttle algorithm in Datanode BlockDeletingService

2017-08-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12354: -- Summary: Improve the throttle algorithm in Datanode BlockDeletingService Key: HDFS-12354 URL: https://issues.apache.org/jira/browse/HDFS-12354 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12039) Ozone: Implement update volume owner in ozone shell

2017-08-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12039. Resolution: Fixed Fix Version/s: HDFS-7240 > Ozone: Implement update volume owner in oz

[jira] [Resolved] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12307. Resolution: Duplicate Assignee: Weiwei Yang > Ozone: TestKeys#testPutAndGetKeyWithDnRest

[jira] [Created] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-15 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12307: -- Summary: Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails Key: HDFS-12307 URL: https://issues.apache.org/jira/browse/HDFS-12307 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12283: -- Summary: Ozone: DeleteKey-5: Implement SCM DeletedBlockLog Key: HDFS-12283 URL: https://issues.apache.org/jira/browse/HDFS-12283 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12282) Ozone: DeleteKey-4: SCM periodically sends block deletion message to datanode via HB and handles response

2017-08-08 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12282: -- Summary: Ozone: DeleteKey-4: SCM periodically sends block deletion message to datanode via HB and handles response Key: HDFS-12282 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12246: -- Summary: Ozone: potential thread leaks Key: HDFS-12246 URL: https://issues.apache.org/jira/browse/HDFS-12246 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-07-31 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12235: -- Summary: Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions Key: HDFS-12235 URL: https://issues.apache.org/jira/browse/HDFS-12235 Project: Hadoop

[jira] [Created] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12196: -- Summary: Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background Key: HDFS-12196 URL: https://issues.apache.org/jira/browse/HDFS-12196

[jira] [Created] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12195: -- Summary: Ozone: DeleteKey-1: KSM replies delete key request asynchronously Key: HDFS-12195 URL: https://issues.apache.org/jira/browse/HDFS-12195 Project: Hadoop HDFS

[jira] [Created] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

2017-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12167: -- Summary: Ozone: Intermittent failure TestContainerPersistence#testListKey Key: HDFS-12167 URL: https://issues.apache.org/jira/browse/HDFS-12167 Project: Hadoop HDFS

[jira] [Created] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

2017-07-15 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12149: -- Summary: Ozone: RocksDB implementation of ozone metadata store Key: HDFS-12149 URL: https://issues.apache.org/jira/browse/HDFS-12149 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

2017-07-15 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12148: -- Summary: Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties Key: HDFS-12148 URL: https://issues.apache.org/jira/browse/HDFS-12148

[jira] [Created] (HDFS-12129) Ozone

2017-07-12 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12129: -- Summary: Ozone Key: HDFS-12129 URL: https://issues.apache.org/jira/browse/HDFS-12129 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Weiwei Yang

[jira] [Created] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-07 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12098: -- Summary: Ozone: Datanode is unable to register with scm if scm starts later Key: HDFS-12098 URL: https://issues.apache.org/jira/browse/HDFS-12098 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12096) Ozone: Bucket versioning design document

2017-07-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12096. Resolution: Duplicate > Ozone: Bucket versioning design docum

[jira] [Created] (HDFS-12096) Ozone: Bucket versioning design document

2017-07-06 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12096: -- Summary: Ozone: Bucket versioning design document Key: HDFS-12096 URL: https://issues.apache.org/jira/browse/HDFS-12096 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-12085) Reconfigure namenode interval fails if the interval was set with time unit

2017-07-04 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12085: -- Summary: Reconfigure namenode interval fails if the interval was set with time unit Key: HDFS-12085 URL: https://issues.apache.org/jira/browse/HDFS-12085 Project: Hadoop

[jira] [Created] (HDFS-12082) BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured

2017-07-04 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12082: -- Summary: BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured Key: HDFS-12082 URL: https://issues.apache.org/jira/browse/HDFS-12082

[jira] [Created] (HDFS-12081) Ozone: Add infoKey REST API document

2017-07-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12081: -- Summary: Ozone: Add infoKey REST API document Key: HDFS-12081 URL: https://issues.apache.org/jira/browse/HDFS-12081 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12080) Ozone: Fix UT failure in TestOzoneConfigurationFields

2017-07-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12080: -- Summary: Ozone: Fix UT failure in TestOzoneConfigurationFields Key: HDFS-12080 URL: https://issues.apache.org/jira/browse/HDFS-12080 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12079) Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml

2017-07-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12079: -- Summary: Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml Key: HDFS-12079 URL: https://issues.apache.org/jira/browse/HDFS-12079 Project: Hadoop

[jira] [Created] (HDFS-12078) Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml

2017-07-02 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12078: -- Summary: Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml Key: HDFS-12078 URL: https://issues.apache.org/jira/browse/HDFS-12078

[jira] [Created] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-06-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12069: -- Summary: Ozone: Create a general abstraction for metadata store Key: HDFS-12069 URL: https://issues.apache.org/jira/browse/HDFS-12069 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12053: -- Summary: Ozone: ozone server should create missing metadata directory if it has permission to Key: HDFS-12053 URL: https://issues.apache.org/jira/browse/HDFS-12053

[jira] [Created] (HDFS-12047) Ozone: Add REST API documentation

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12047: -- Summary: Ozone: Add REST API documentation Key: HDFS-12047 URL: https://issues.apache.org/jira/browse/HDFS-12047 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12039) Ozone: Implement update volume owner in ozone shell

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12039: -- Summary: Ozone: Implement update volume owner in ozone shell Key: HDFS-12039 URL: https://issues.apache.org/jira/browse/HDFS-12039 Project: Hadoop HDFS Issue

  1   2   >