[jira] [Created] (HADOOP-15221) Swift driver should not fail if JSONUtils reports UnknowPropertyException

2018-02-12 Thread Chen He (JIRA)
Chen He created HADOOP-15221: Summary: Swift driver should not fail if JSONUtils reports UnknowPropertyException Key: HADOOP-15221 URL: https://issues.apache.org/jira/browse/HADOOP-15221 Project: Hadoop

[jira] [Created] (HADOOP-14716) SwiftNativeFileSystem should not eat the exception when rename

2017-08-01 Thread Chen He (JIRA)
Chen He created HADOOP-14716: Summary: SwiftNativeFileSystem should not eat the exception when rename Key: HADOOP-14716 URL: https://issues.apache.org/jira/browse/HADOOP-14716 Project: Hadoop Common

[jira] [Created] (HADOOP-14641) hadoop-openstack driver reports input stream leaking

2017-07-10 Thread Chen He (JIRA)
Chen He created HADOOP-14641: Summary: hadoop-openstack driver reports input stream leaking Key: HADOOP-14641 URL: https://issues.apache.org/jira/browse/HADOOP-14641 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Chen He
+1 non-binding download source and build successfully; deploy to single node cluster; run wordcount and loadgen passed; Verified that MR-6336 is there and FileOutputCommitter is using algorithm 2 by default. Best Regards! Chen On Wed, Aug 31, 2016 at 9:25 PM, Rakesh Radhakrishnan wrote: > Th

[jira] [Resolved] (HADOOP-13570) Hadoop Swift driver should use new Apache httpclient

2016-09-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HADOOP-13570. -- Resolution: Duplicate Dup to HADOOP-11614, close it. > Hadoop Swift driver should use new Apa

[jira] [Created] (HADOOP-13570) Hadoop swift Driver should use new Apache httpclient

2016-08-31 Thread Chen He (JIRA)
Chen He created HADOOP-13570: Summary: Hadoop swift Driver should use new Apache httpclient Key: HADOOP-13570 URL: https://issues.apache.org/jira/browse/HADOOP-13570 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13211) Swift driver should have a configurable retry feature when ecounter 5xx error

2016-05-26 Thread Chen He (JIRA)
Chen He created HADOOP-13211: Summary: Swift driver should have a configurable retry feature when ecounter 5xx error Key: HADOOP-13211 URL: https://issues.apache.org/jira/browse/HADOOP-13211 Project

[jira] [Created] (HADOOP-13021) Hadoop swift driver unit test should use unique directory each run

2016-04-12 Thread Chen He (JIRA)
Chen He created HADOOP-13021: Summary: Hadoop swift driver unit test should use unique directory each run Key: HADOOP-13021 URL: https://issues.apache.org/jira/browse/HADOOP-13021 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Chen He
Thank you Junping for the release work. +1 non-binding - built from source code using Java7 and deploy to a two-node cluster; - run WC and loadgen, passed; Regards! Chen On Mon, Feb 8, 2016 at 6:11 PM, Mit Desai wrote: > +1 (non-binding) > - verified signatures > - built from source and depl

Re: Yarn / mapreduce scheduling

2016-01-26 Thread Chen He
Hi Brad IMHO, here is how hadoop scheduler works For Hadoop 1.x In one heartbeat interval, Fifo Scheduler keep strict FIFO order and assign a node as many as possible local task and only one remote task. For Fair scheduler, if you turn on delay algorithm, it also assign local task as many as pos

Re: Yarn / mapreduce scheduling

2016-01-26 Thread Chen He
Hi Sandy Ryza I searched the MRAppMaster.java but did not find exactly where it saves the locality information. Would you mind provide a more detail information about which object is used for keeping those locality info? Regards! Chen On Thu, Apr 3, 2014 at 1:30 PM, Sandy Ryza wrote: > The Ma

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-20 Thread Chen He
+1 (non-binding) -download source code and build in local machine -deploy to a single node -run wc and other 2 examples, passed. Regards! Chen On Wed, Jan 20, 2016 at 12:15 PM, Tsuyoshi Ozawa wrote: > +1 (binding) > > - Verified checksum. > - Built from source code. > - Ran some tests and mr

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He
I see, thank you for the reply, Mr. Tsuyoshi Ozawa Regards Chen Chen He@Oracle from Samsung Mega On Dec 21, 2015 7:35 PM, "Tsuyoshi Ozawa" wrote: > Hi Chen, > > > Kindly ask a silly question, why we separate 2.6.x from 2.7.x? > > 2.6.x is the last release whi

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He
+1 (non-binding) deploy to a 2-node cluster run loadgen and wc without problem Kindly ask a silly question, why we separate 2.6.x from 2.7.x? On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan wrote: > +1 (binding) > > - Build & deploy single-node Hadoop from source code > - Add/Remove node labels

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-15 Thread Chen He
+1 non-binding compile downloaded code and deploy in a single node, run loadgen and wc successfully Thank Junping for the work. Chen On Tue, Dec 15, 2015 at 10:41 PM, Akira AJISAKA wrote: > Thanks Junping for starting release process. > I noticed there are duplicated tags: > > * release-2.6.3

[jira] [Created] (HADOOP-12623) Swift should support more flexible container name than RFC952

2015-12-07 Thread Chen He (JIRA)
Chen He created HADOOP-12623: Summary: Swift should support more flexible container name than RFC952 Key: HADOOP-12623 URL: https://issues.apache.org/jira/browse/HADOOP-12623 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.2

2015-10-26 Thread Chen He
download and build successfully on may macOS; deploy on two nodes cluster; run wordcount and loadgen passed; +1 (non-binding) Regards! Chen He On Mon, Oct 26, 2015 at 10:08 AM, Sangjin Lee wrote: > Thanks Akira! > > A friendly reminder to the community that the vote closes tom

[jira] [Created] (HADOOP-12501) Enable SwiftNativeFileSystem to preserve user, group, permission

2015-10-21 Thread Chen He (JIRA)
Chen He created HADOOP-12501: Summary: Enable SwiftNativeFileSystem to preserve user, group, permission Key: HADOOP-12501 URL: https://issues.apache.org/jira/browse/HADOOP-12501 Project: Hadoop Common

Re: [DISCUSS] About the details of JDK-8 support

2015-10-13 Thread Chen He
On Tue, Oct 13, 2015 at 3:00 AM, Jean-Baptiste Note wrote: > Hi, > > As far as security is concerned we (Criteo) are using CDH5 with JDK8 in > production with security enabled. > We reported some gripes with some specific java versions: > https://issues.cloudera.org/browse/DISTRO-732 > > I would

[jira] [Created] (HADOOP-12471) Support Swift file (> 5GB) continuious uploading where there is a failure

2015-10-08 Thread Chen He (JIRA)
Chen He created HADOOP-12471: Summary: Support Swift file (> 5GB) continuious uploading where there is a failure Key: HADOOP-12471 URL: https://issues.apache.org/jira/browse/HADOOP-12471 Project: Had

[jira] [Created] (HADOOP-12461) Swift driver should have the ability to renew token if server has timeout

2015-10-06 Thread Chen He (JIRA)
Chen He created HADOOP-12461: Summary: Swift driver should have the ability to renew token if server has timeout Key: HADOOP-12461 URL: https://issues.apache.org/jira/browse/HADOOP-12461 Project: Hadoop

[jira] [Created] (HADOOP-12343) Error message of Swift driver should be more clear when there is mal-format of hostname and service

2015-08-19 Thread Chen He (JIRA)
Chen He created HADOOP-12343: Summary: Error message of Swift driver should be more clear when there is mal-format of hostname and service Key: HADOOP-12343 URL: https://issues.apache.org/jira/browse/HADOOP-12343

[jira] [Created] (HADOOP-12086) Swift driver reports NPE if user try to create a dir without name

2015-06-11 Thread Chen He (JIRA)
Chen He created HADOOP-12086: Summary: Swift driver reports NPE if user try to create a dir without name Key: HADOOP-12086 URL: https://issues.apache.org/jira/browse/HADOOP-12086 Project: Hadoop Common

[jira] [Created] (HADOOP-12046) Avoid creating "._COPYING_" temporary file when copying file to Swift file system

2015-05-31 Thread Chen He (JIRA)
Chen He created HADOOP-12046: Summary: Avoid creating "._COPYING_" temporary file when copying file to Swift file system Key: HADOOP-12046 URL: https://issues.apache.org/jira/browse/HADOOP-12046

[jira] [Created] (HADOOP-12038) SwiftNativeOutputStream should check whether a file exists or not before deleting

2015-05-27 Thread Chen He (JIRA)
Chen He created HADOOP-12038: Summary: SwiftNativeOutputStream should check whether a file exists or not before deleting Key: HADOOP-12038 URL: https://issues.apache.org/jira/browse/HADOOP-12038 Project

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Chen He
+1 non-binding build from source, deploy to a single node cluster, run wordcount, Terasort, etc. Also run Teragen using DockerContainerExecutor, works fine. Regards! Chen He On Mon, Apr 13, 2015 at 5:43 AM, Junping Du wrote: > +1. (Non-binding) > - Download and verify the checksum on s

[jira] [Created] (HADOOP-11811) Fix typos in hadoop-project/pom.xml

2015-04-07 Thread Chen He (JIRA)
Chen He created HADOOP-11811: Summary: Fix typos in hadoop-project/pom.xml Key: HADOOP-11811 URL: https://issues.apache.org/jira/browse/HADOOP-11811 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11786) Fix Javadoc typos in org.apache.hadoop.fs.FileSystem

2015-04-01 Thread Chen He (JIRA)
Chen He created HADOOP-11786: Summary: Fix Javadoc typos in org.apache.hadoop.fs.FileSystem Key: HADOOP-11786 URL: https://issues.apache.org/jira/browse/HADOOP-11786 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-11762) Enable swift distcp to secure HDFS

2015-03-26 Thread Chen He (JIRA)
Chen He created HADOOP-11762: Summary: Enable swift distcp to secure HDFS Key: HADOOP-11762 URL: https://issues.apache.org/jira/browse/HADOOP-11762 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-11760) Typo in DistCp.java

2015-03-26 Thread Chen He (JIRA)
Chen He created HADOOP-11760: Summary: Typo in DistCp.java Key: HADOOP-11760 URL: https://issues.apache.org/jira/browse/HADOOP-11760 Project: Hadoop Common Issue Type: Bug Affects Versions

[jira] [Created] (HADOOP-11759) TockenCache doc has minor problem

2015-03-26 Thread Chen He (JIRA)
Chen He created HADOOP-11759: Summary: TockenCache doc has minor problem Key: HADOOP-11759 URL: https://issues.apache.org/jira/browse/HADOOP-11759 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11750) distcp fails if we copy data from swift to secure HDFS

2015-03-25 Thread Chen He (JIRA)
Chen He created HADOOP-11750: Summary: distcp fails if we copy data from swift to secure HDFS Key: HADOOP-11750 URL: https://issues.apache.org/jira/browse/HADOOP-11750 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Chen He
+1 non-binding It is a nice to have hadoop 3.x release. My honor to help. Regards! Chen On Mon, Mar 2, 2015 at 4:58 PM, Zheng, Kai wrote: > Sorry for the bad. I thought it was sending to my colleagues. > > By the way, for the JDK8 support, we (Intel) would like to investigate > further and he

MRAppMaster running on a docker container failed to load openssl cipher.

2014-12-15 Thread Chen He
Try to run teragen based on hadoop 2.6.0 using docker and met following error: 2014-12-15 04:15:21,385 DEBUG [main] org.apache.hadoop.crypto.OpensslCipher: Failed to load OpenSSL Cipher. java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsOpenssl()Z at org.

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chen He
+1 non-binding download and compile source code; setup single node cluster; successfully run sleep job; Regards! Chen On Fri, Nov 14, 2014 at 1:44 AM, Akira AJISAKA wrote: > Thanks Arun for creating another rc! > > +1 (non-binding) > > - patched Tez 0.5.2 pom to compile against 2.6.0-rc1 > -

Re: Hadoop maven packaging does not work on JAVA 1.8?

2014-11-10 Thread Chen He
; JDK8, might be worth asking him before diving in yourself. > > On Mon, Nov 10, 2014 at 12:04 PM, Chen He wrote: > > > Thanks, Ted Yu. I will create a JIRA for it. I find a way to fix it. > > > > On Mon, Nov 10, 2014 at 11:50 AM, Ted Yu wrote: > > > > > I can

[jira] [Created] (HADOOP-11292) "mvm package" reports error when using Java 1.8

2014-11-10 Thread Chen He (JIRA)
Chen He created HADOOP-11292: Summary: "mvm package" reports error when using Java 1.8 Key: HADOOP-11292 URL: https://issues.apache.org/jira/browse/HADOOP-11292 Project: Hadoop Common

Re: Hadoop maven packaging does not work on JAVA 1.8?

2014-11-10 Thread Chen He
-are-incomplete > > Though it doesn't seem to work. > > On Mon, Nov 10, 2014 at 11:32 AM, Chen He wrote: > > > "mvn package -Pdist -Dtar -DskipTests" reports following error based on > >

Hadoop maven packaging does not work on JAVA 1.8?

2014-11-10 Thread Chen He
"mvn package -Pdist -Dtar -DskipTests" reports following error based on latest trunk: [INFO] BUILD FAILURE [INFO] [INFO] Total time: 11.010 s [INFO] Finished at: 2014-11-10T11:23:49-08:00 [INFO] Final Memory: 51M/555M [I

Re: [VOTE] Release Apache Hadoop 2.5.1 RC0

2014-09-15 Thread Chen He
+1 non-binding download source code, build from scratch, deploy to a single node, and run sleep job succeed. Regards! Chen On Thu, Sep 11, 2014 at 9:53 PM, Akira AJISAKA wrote: > Thanks Karthik for updating the wiki. Now I'm +1 (non-binding). > > Regards, > Akira > > > (2014/09/11 2:10), Kart

[jira] [Resolved] (HADOOP-11020) TestRefreshUserMappings fails

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HADOOP-11020. -- Resolution: Duplicate > TestRefreshUserMappings fa

[jira] [Created] (HADOOP-11020) TestRefreshUserMappings fails

2014-08-28 Thread Chen He (JIRA)
Chen He created HADOOP-11020: Summary: TestRefreshUserMappings fails Key: HADOOP-11020 URL: https://issues.apache.org/jira/browse/HADOOP-11020 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-10 Thread Chen He
+1 (non-binding) download source code and build from it (OS is Fedora); deploy to single server; run word count and sleep job succeed. On Sun, Aug 10, 2014 at 6:00 PM, Jason Lowe wrote: > +1 (binding) > > - verified signatures and digests > - built from source > - deployed a single-node clus

Re: [VOTE] Migration from subversion to git for version control

2014-08-10 Thread Chen He
+1 (non-binding) On Sun, Aug 10, 2014 at 3:44 PM, Jason Lowe wrote: > +1 > > Jason > > > On 08/08/2014 09:57 PM, Karthik Kambatla wrote: > >> I have put together this proposal based on recent discussion on this >> topic. >> >> Please vote on the proposal. The vote runs for 7 days. >> >> 1

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-22 Thread Chen He
+1 (non-binding) download source code build binary based on Fedora with Java 1.7 deploy mini cluster and successfully run sleep jobs Regards! Chen On Sun, Jun 22, 2014 at 9:44 PM, Xuan Gong wrote: > +1 (non-binding) > > Successfully build from resource code > > > On Sat, Jun 21, 2014 at 7:05

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-20 Thread Chen He
+1 (non binding) download source code. compile under Fedora 13 and run sleep job. It works fine Regards! Chen On Fri, Jun 20, 2014 at 9:43 AM, Jean-Baptiste Onofré wrote: > +1 (non binding) > > Tested with some jobs. > > Regards > JB > > > On 06/20/2014 04:41 PM, Kihwal Lee wrote: > >> Check

[jira] [Created] (HADOOP-10664) TestNetUtils.testNormalizeHostName failes

2014-06-04 Thread Chen He (JIRA)
Chen He created HADOOP-10664: Summary: TestNetUtils.testNormalizeHostName failes Key: HADOOP-10664 URL: https://issues.apache.org/jira/browse/HADOOP-10664 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-10 Thread Chen He
+1(non-binding) download source code compile successfully run wordcount and loadgen without problem On Tue, Apr 8, 2014 at 11:11 PM, Tsuyoshi OZAWA wrote: > Hi Arun, > > I apologize for the late response. > If the problems are recognized correctly, +1 for the release(non-binding). > > * Ran exam

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-02 Thread Chen He
+1 non-binding Chen On Wed, Apr 2, 2014 at 12:27 AM, Jean-Baptiste Onofré wrote: > +1 (non binding) > > Regards > JB > > > On 03/31/2014 11:22 AM, Arun C Murthy wrote: > >> Folks, >> >> I've created a release candidate (rc0) for hadoop-2.4.0 that I would like >> to get released. >> >> The RC is

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-11 Thread Chen He
+1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like > to get released. > > The RC is available at

Re: [VOTE] Merge YARN-321 Generic Application History Service to trunk

2014-01-17 Thread Chen He
As a cluster resource management platform, generic history service is necessary for job-tracing, troubleshooting, fault tolerance, and performance tuning. Like StarterLog in Condor, accounting logs in Torque, and so on. However, generic history service should avoid getting involved into too many de

Re: [VOTE] Merge HDFS-2832 Heterogeneous Storage Phase 1 to trunk

2013-12-06 Thread Chen He
+1 nice feature for HDFS On Fri, Dec 6, 2013 at 7:32 PM, Arpit Agarwal wrote: > Hi Andrew, > > Our plan as stated back in August was to do this work principally in two > phases. > https://issues.apache.org/jira/browse/HDFS-2832?focusedCommentId=13739041 > > For the second phase which includes AP

Re: [VOTE] Release Apache Hadoop 0.23.10

2013-12-06 Thread Chen He
+1 (non-binding) -source successfully build under Fedora 17 -deployed source build to single-node cluster -verified by running some example jobs - file a minor non-blocking bug HADOOP-10148 On Wed, Dec 4, 2013 at 1:05 PM, Jason Lowe wrote: > +1 (binding) > > - verified signatures and digests >

[jira] [Created] (HADOOP-10148) backport hadoop-10107 to branch-0.23

2013-12-06 Thread Chen He (JIRA)
Chen He created HADOOP-10148: Summary: backport hadoop-10107 to branch-0.23 Key: HADOOP-10148 URL: https://issues.apache.org/jira/browse/HADOOP-10148 Project: Hadoop Common Issue Type: Sub-task