Re: HDFS Scalability Limit?

2019-06-18 Thread Konstantin Shvachko
Hi Wei-Chiu, We run similar Hadoop installations as Kihwal describes. Thanks for sharing Kihwal. Our clusters are also not Federated. So far the growth rate is the same as we reported in our talk last year (slide #5) 2x per year: https://www.slideshare.net/Hadoop_Summit/scaling-hadoop-at-linkedin-

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-18 Thread Xun Liu
+1 (non-binding) > On Jun 17, 2019, at 10:31 PM, Wanqiang Ji wrote: > > +1 (non-binding) > > On Mon, Jun 17, 2019 at 3:51 PM runlin zhang wrote: > >> +1 , I'm looking forward to it ~ >> >>> 在 2019年6月6日,下午9:23,Zhankun Tang 写道: >>> >>> Hi folks, >>> >>> Thanks to all of you who have contri

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wangda Tan
Thanks @Wei-Chiu Chuang . updated gdoc On Tue, Jun 18, 2019 at 7:35 PM Wei-Chiu Chuang wrote: > Thanks Wangda, > > I just like to make a correction -- the .ics calendar file says the first > Wednesday for HDFS/cloud connector is in Mandarin whereas on the gdoc is to > host it on the third Wedne

[jira] [Created] (HDFS-14583) FileStatus#toString() will throw IllegalArgumentException

2019-06-18 Thread xuzq (JIRA)
xuzq created HDFS-14583: --- Summary: FileStatus#toString() will throw IllegalArgumentException Key: HDFS-14583 URL: https://issues.apache.org/jira/browse/HDFS-14583 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wei-Chiu Chuang
Thanks Wangda, I just like to make a correction -- the .ics calendar file says the first Wednesday for HDFS/cloud connector is in Mandarin whereas on the gdoc is to host it on the third Wednesday. On Tue, Jun 18, 2019 at 5:29 PM Wangda Tan wrote: > Hi Folks, > > I just updated doc: > > https://

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wangda Tan
Hi Folks, I just updated doc: https://docs.google.com/document/d/1GfNpYKhNUERAEH7m3yx6OfleoF3MqoQk3nJ7xqHD9nY/edit# with dial-in information, notes, etc. Here's a calendar to subscribe: https://calendar.google.com/calendar/ical/hadoop.community.sync.up%40gmail.com/public/basic.ics I'm thinking t

[jira] [Created] (HDDS-1705) Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints

2019-06-18 Thread Vivek Ratnavel Subramanian (JIRA)
Vivek Ratnavel Subramanian created HDDS-1705: Summary: Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints Key: HDDS-1705 URL: https://issues.apache.org/jira/brow

[jira] [Resolved] (HDDS-1702) Optimize Ozone Recon build time

2019-06-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1702. Resolution: Fixed Fix Version/s: 0.4.1 Thanks for the contribution. I have committed the patc

Re: [ANNOUNCE] Aaron Fabbri as Hadoop PMC

2019-06-18 Thread Aaron Fabbri
Thank you everybody. Appreciate it. On Mon, Jun 17, 2019 at 8:43 PM Sree V wrote: > Congratulations, Aaron. > > > > Thank you./Sree > > > > On Monday, June 17, 2019, 7:31:47 PM PDT, Dinesh Chitlangia < > dchitlan...@cloudera.com.INVALID> wrote: > > Congratulations Aaron! > > -Dinesh > > > O

[jira] [Resolved] (HDDS-1699) Update RocksDB version to 6.0.1.

2019-06-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-1699. -- Resolution: Fixed Fix Version/s: (was: 0.5.0) 0.4.1 > Upda

[jira] [Created] (HDDS-1704) Exercise Ozone tests in maven build

2019-06-18 Thread Eric Yang (JIRA)
Eric Yang created HDDS-1704: --- Summary: Exercise Ozone tests in maven build Key: HDDS-1704 URL: https://issues.apache.org/jira/browse/HDDS-1704 Project: Hadoop Distributed Data Store Issue Type: Imp

[jira] [Resolved] (HDFS-14487) Missing Space in Client Error Message

2019-06-18 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved HDFS-14487. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Thanks for the

[jira] [Resolved] (HDFS-13841) RBF: After Click on another Tab in Router Federation UI page it's not redirecting to new tab

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-13841. Resolution: Duplicate > RBF: After Click on another Tab in Router Federation UI page it's not > re

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/356/ [Jun 17, 2019 2:22:01 PM] (weichiu) HDFS-14535. The default 8KB buffer in [Jun 18, 2019 12:04:38 AM] (weichiu) HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira -1 overall The f

[jira] [Created] (HDFS-14582) Failed to start DN with ArithmeticException when NULL checksum used

2019-06-18 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-14582: - Summary: Failed to start DN with ArithmeticException when NULL checksum used Key: HDFS-14582 URL: https://issues.apache.org/jira/browse/HDFS-14582 P

[jira] [Resolved] (HDFS-14580) RBF: LS command for paths shows wrong owner and permission information

2019-06-18 Thread xuzq (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuzq resolved HDFS-14580. - Resolution: Abandoned > RBF: LS command for paths shows wrong owner and permission information >

[jira] [Created] (HDFS-14581) EC: Append validation should be done before getting lease on file

2019-06-18 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-14581: - Summary: EC: Append validation should be done before getting lease on file Key: HDFS-14581 URL: https://issues.apache.org/jira/browse/HDFS-14581 Pro

[jira] [Created] (HDFS-14580) LS command for paths shows wrong owner and permission information

2019-06-18 Thread xuzq (JIRA)
xuzq created HDFS-14580: --- Summary: LS command for paths shows wrong owner and permission information Key: HDFS-14580 URL: https://issues.apache.org/jira/browse/HDFS-14580 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-14579) In refreshNodes, avoid performing a DNS lookup while holding the write lock

2019-06-18 Thread Stephen O'Donnell (JIRA)
Stephen O'Donnell created HDFS-14579: Summary: In refreshNodes, avoid performing a DNS lookup while holding the write lock Key: HDFS-14579 URL: https://issues.apache.org/jira/browse/HDFS-14579 Pro

[jira] [Created] (HDDS-1703) Freon uses wait/notify instead of polling to eliminate the test result error.

2019-06-18 Thread Xudong Cao (JIRA)
Xudong Cao created HDDS-1703: Summary: Freon uses wait/notify instead of polling to eliminate the test result error. Key: HDDS-1703 URL: https://issues.apache.org/jira/browse/HDDS-1703 Project: Hadoop Dis