Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wangda Tan
Thanks @Wei-Chiu Chuang . updated gdoc On Tue, Jun 18, 2019 at 7:35 PM Wei-Chiu Chuang wrote: > Thanks Wangda, > > I just like to make a correction -- the .ics calendar file says the first > Wednesday for HDFS/cloud connector is in Mandarin whereas on the gdoc is to > host it on the third Wedne

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wei-Chiu Chuang
Thanks Wangda, I just like to make a correction -- the .ics calendar file says the first Wednesday for HDFS/cloud connector is in Mandarin whereas on the gdoc is to host it on the third Wednesday. On Tue, Jun 18, 2019 at 5:29 PM Wangda Tan wrote: > Hi Folks, > > I just updated doc: > > https://

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

2019-06-18 Thread Wangda Tan
Hi Folks, I just updated doc: https://docs.google.com/document/d/1GfNpYKhNUERAEH7m3yx6OfleoF3MqoQk3nJ7xqHD9nY/edit# with dial-in information, notes, etc. Here's a calendar to subscribe: https://calendar.google.com/calendar/ical/hadoop.community.sync.up%40gmail.com/public/basic.ics I'm thinking t

Re: Mapreduce to and from public clouds

2019-06-18 Thread Steve Loughran
You can use all the cloud stores as the destination of work; just get them on the classpath and use: s3a://, gs://, wasb:/ To use s3 as a destination with performance and consistency, you need the S3A committers (see the hadoop-aws docs), and to safely chain work, the S3Guard consistency tool. To

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/356/ [Jun 17, 2019 2:22:01 PM] (weichiu) HDFS-14535. The default 8KB buffer in [Jun 18, 2019 12:04:38 AM] (weichiu) HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira -1 overall The f