Re: Cannot kill Pre-Commit jenkins builds

committer access to Jenkins, the committer > must be made a member of the hudson-jobadmin group. This is done using the > Whimsy Tool which all PMC Chairs can change." > > I've done this for Sunil & Wangda as they needed help for Submarine. > > Arun Suresh and other relea

Re: [DISCUSS] Making submarine to different release model like Ozone

Thanks for bringing this up Wangda. +1 Makes a lot of sense to have Submarine follow its own release cadence - for all the reasons you outlined. I would one up this proposal to ask why shouldn't we allow YARN to have its own releases as well - but that is for a separate thread :) Cheers -Arun On

Re: Cannot kill Pre-Commit jenkins builds

ate. > > Which specific job you are looking? I looked at > https://builds.apache.org/job/PreCommit-YARN-Build/ but can't seem to > find any user specific auth. > > +Vinod > > On Jan 22, 2019, at 10:00 AM, Arun Suresh wrote: > > Hey Vinod.. Ping! > > Cheers > -Aru

Re: Cannot kill Pre-Commit jenkins builds

Hey Vinod.. Ping! Cheers -Arun On Fri, Jan 18, 2019 at 9:46 AM Arun Suresh wrote: > Hi Vinod > > Can you please help with this: > https://issues.apache.org/jira/browse/INFRA-17673 ? > > Cheers > -Arun > > On Wed, Jan 16, 2019, 12:53 PM Arun Suresh >> Hi >

Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

+1 Cheers -Arun On Mon, Apr 16, 2018 at 7:09 PM, Weiwei Yang wrote: > +1 > > -- > Weiwei > > On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , > wrote: > > dopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code > merge. >

Re: [DISCUSS] 2.9+ stabilization branch

Hello folks We also think this bridging release opens up an opportunity to bump the java version in branch-2 to java 8. Would really love to hear thoughts on that. Cheers -Arun/Subru On Mon, Feb 26, 2018 at 5:18 PM, Jonathan Hung wrote: > Hi Subru, > > Thanks for

Re: Hadoop 3.1.0 release discussion

N. Features in trunk and works > >>> end-to-end. > >>> * (Jian) YARN-5079,YARN-4793,YARN-4757,YARN-6419 YARN native services. > >>> * (Steve Loughran): HADOOP-13786: S3Guard committer for zero-rename > >>> commits. > >>> * (Suma): YARN-71

Re: [VOTE] Merge YARN-6592 feature branch to trunk

> Weiwei > > On 27 Jan 2018, 9:16 AM +0800, Wangda Tan <wheele...@gmail.com>, wrote: > +1 > > On Sat, Jan 27, 2018 at 2:05 AM, Chris Douglas <cdoug...@apache.org > <mailto:cdoug...@apache.org>> wrote: > +1 Looking forward to this. -C > > On Fri,

***UNCHECKED*** Re: [DISCUSS] Merge YARN-6592 to trunk

org>, wrote: >>> +1. >>> >>> Thanks Arun. >>> >>> I did manual testing for check affinity and anti-affinity features with >>> placement allocator. Also checked SLS to see any performance regression, >>> and there are not much d

[VOTE] Merge YARN-6592 feature branch to trunk

Hello yarn-dev@ Based on the positive feedback from the DISCUSS thread [1], I'd like to start a formal vote to merge YARN-6592 [2] to trunk. The vote will run for 5 days, and will end Jan 31 7:30AM PDT. This feature adds support for placing containers in YARN using rich placement constraints.

[DISCUSS] Merge YARN-6592 to trunk

Hello yarn-dev@ We feel that the YARN-6592 dev branch mostly in shape to be merged into trunk. This branch adds support for placing containers in YARN using rich placement constraints. For example, this can be used by applications to co-locate containers on a node or rack (*affinity *constraint),

Re: Apache Hadoop 2.9.1 Release Plan

Hey Sammi, Looks like your filter is private. Cheers -Arun On Wed, Jan 10, 2018 at 12:28 AM, Chen, Sammi wrote: > Hi All, > > > > We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] with 30 > new features, 407 improvements, 790 bug fixes new fixed issues

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - Verified signatures of the source tarball. - built from source - using the docker build environment. - set up a pseudo-distributed test cluster. - ran basic HDFS commands - ran some basic MR jobs Cheers -Arun On Tue, Dec 12, 2017 at 1:52 PM, Andrew Wang

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

; > > > > o User limits are honored during In-queue preemption > > > > > > o Priorities are honored during In-queue preemption > > > > > > o Can kill applications from the command line > > > > > > o Users with different weights are assigned r

[ANNOUNCE] Apache Hadoop 2.9.0 has been released

Hi all, We are pleased to announce the release of Apache Hadoop 2.9.0. This is the first release of Hadoop 2.9 line and will be the starting release for Apache Hadoop 2.9.x line - it includes 30 New Features with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since 2.8.2. Please

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

are documented in BUILDING.txt > but the options do not exist in 2.x releases. > Filed HADOOP-15045 to fix this issue. > I think this issue doesn't block the release. > > Thanks and regards, > Akira > > On 2017/11/14 9:10, Arun Suresh wrote: > >> Hi Folks, &

[VOTE] Release Apache Hadoop 2.9.0 (RC3)

Hi Folks, Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the starting release for Apache Hadoop 2.9.x line - it includes 30 New Features with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since 2.8.2. More information about the 2.9.0 release plan can be

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC2)

Cancelling the RC2 to fix the LICENSE.txt issue. Will be rolling out an RC3 shortly. Given that the delta is just the LICENSE fix, we will be carrying over the votes from this thread as well. Cheers -Arun/Subru On Mon, Nov 13, 2017 at 2:59 PM, Arun Suresh <asur...@apache.org> wrote: >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC2)

confirm first? There may (or may not) be > other similar instances. > > -Xiao > > On Mon, Nov 13, 2017 at 2:34 PM, Arun Suresh <asur...@apache.org> wrote: > > > Thanks for notifying Anu, > > We've raised https://issues.apache.org/jira/browse/HADOOP-15036 to > add

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC2)

Thanks for notifying Anu, We've raised https://issues.apache.org/jira/browse/HADOOP-15036 to address this and have included a patch. Can you please take a look and possibly +1 if you are fine ? Cheers -Arun On Mon, Nov 13, 2017 at 2:19 PM, Anu Engineer wrote: > -1

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

t;> > org.apache.curator.framework.imps.CuratorTransactionImpl$2.c >> all(CuratorTransactionImpl.java:129) >> > at >> > >> > org.apache.curator.framework.imps.CuratorTransactionImpl$2.c >> all(CuratorTransactionImpl.java:125) >> >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Here is my +1 to start. - Setup a small 4 node cluster - Verified some basic HDFS commands - Ran Pi / sleep jobs (with some mix of Opportunistic containers - both distributed and centralized scheduling) Cheers -Arun On Fri, Nov 3, 2017 at 4:38 PM, Arun Suresh <asur...@apache.org> wrote:

Re: [DISCUSS] A final minor release off branch-2?

Thanks for starting this discussion VInod. I agree (C) is a bad idea. I would prefer (A) given that ATM, branch-2 is still very close to branch-2.9 - and it is a good time to make a collective decision to lock down commits to branch-2. I think we should also clearly define what the 'bridging'

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

stead of > the md files, for quicker perusal? > > Thanks > +Vinod > > On Nov 3, 2017, at 3:50 PM, Arun Suresh <asur...@apache.org> wrote: > > Hi folks, > > Apache Hadoop 2.9.0 is the first stable release of Hadoop 2.9 line and > will be the latest stable/pr

[VOTE] Release Apache Hadoop 2.9.0 (RC0)

Hi folks, Apache Hadoop 2.9.0 is the first stable release of Hadoop 2.9 line and will be the latest stable/production release for Apache Hadoop - it includes 30 New Features with 500+ subtasks, 407 Improvements, 787 Bug fixes new fixed issues since 2.8.2 . More information about the

Re: [VOTE] Merge yarn-native-services branch into trunk

+1 (binding) Cheers -Arun On Nov 3, 2017 11:44 AM, "Chandni Singh" wrote: > +1 > Thanks, > Chandni > > From: Jian He > Sent: Monday, October 30, 2017 1:49 PM > To: yarn-...@hadoop.apache.org; Hdfs-dev;

Re: Cutting branch-2.9

Quick update folks. We just cut branch-2.9.0, and set the mvn version to 2.9.0 We've also updated the version on branch-2.9 to 2.9.1-SNAPSHOT. Expect an RC in the next 24 hrs :) Cheers -Arun/Subru On Tue, Oct 31, 2017 at 5:24 PM, Arun Suresh <arun.sur...@gmail.com> wrote: > H

Re: Jdiff for 2.9.0 (was: Cutting branch-2.9)

the method/class in question has actually not been touched in years. @Junping, Kindly do take a look and let us know if something is amiss. Thanks -Arun/Subru On Tue, Oct 31, 2017 at 1:47 PM, Arun Suresh <asur...@apache.org> wrote: > Hi Junping / Wangda, > > We just ran jdiff on br

Re: Cutting branch-2.9

n to separate thread. > Sure. I will reply jdiff in separated thread. > > Thanks, > > Junping > > 2017-10-31 13:44 GMT-07:00 Arun Suresh <asur...@apache.org>: > >> Hello folks >> >> We just cut branch-2.9 since all the critical/blocker issues are

Jdiff for 2.9.0 (was: Cutting branch-2.9)

PM, Arun Suresh <asur...@apache.org> wrote: > Hello Jumping > > Thanks for chiming in.. Appreciate the offer to help. I did run jdiff on > branch-2 today.. did not find any red flags. Will post the report here > shortly for review. > > Cheers > -Arun > > On O

Re: Cutting branch-2.9

Hello folks We just cut branch-2.9 since all the critical/blocker issues are now resolved. We plan to perform some sanity checks for the rest of the week and cut branch-2.9.0 and push out an RC0 by the end of the week. Kindly refrain from committing to branch-2.9 without giving us a heads up.

Re: Cutting branch-2.9

now if you need any help > here. > > Thanks, > > Junping > > From: Subru Krishnan <su...@apache.org> > Sent: Monday, October 30, 2017 12:39 PM > To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; > hdfs-dev@h

Release 2.9.0 update

Hello Folks Thanks to everyone who chimed in in the discussion thread: https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg27104.html We have updated the roadmap wiki based on the feedback: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9 Given the explosion

Re: Permissions to edit Confluence Wiki

Thanks Akira Cheers -Arun On Fri, Sep 8, 2017 at 6:53 PM, Akira Ajisaka <aajis...@apache.org> wrote: > You can get the privilege by sending an e-mail to the dev ML. > I added it for you. > > Thanks, > Akira > > > On 2017/09/09 4:50, Arun Suresh wrote: > >&

Permissions to edit Confluence Wiki

Hi folks How do we get access to edit the confluence wiki; https://cwiki.apache.org/confluence/display/HADOOP ? We were hoping to update it with hadoop 2.9 release details. Cheers -Arun

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

Thanks for starting this Wangda. I would also like to add: - YARN-5972: Support Pausing/Freezing of opportunistic containers Cheers -Arun On Wed, Sep 6, 2017 at 1:49 PM, Steve Loughran wrote: > > > On 6 Sep 2017, at 19:13, Wangda Tan wrote: > > >

Re: [DISCUSS] Merge yarn-native-services branch into trunk

Thanks for all the work on this folks. I know the VOTE thread has started for this. But I did have a couple of questions: * Is there a branch-2 merge planned for this ? * I understand YARN-7126 has some introductory documentation, But I think we need to flesh it up a bit more before release, I

Re: [VOTE] Merge yarn-native-services branch into trunk

+1 (binding). Cheers -Arun On Fri, Sep 1, 2017 at 5:24 PM, Wangda Tan wrote: > +1 (Binding), I tried to use YARN service assembly before to run different > kinds of jobs (for example, distributed Tensorflow), it is really easy for > end user to run jobs on YARN. > > Thanks

Re: DISCUSS: Hadoop Compatability Guidelines

Thanks for starting this Daniel. I think we should also add a section for store compatibility (all state stores including RM, NM, Federation etc.). Essentially an explicit policy detailing when is it ok to change the major and minor versions and how it should relate to the hadoop release version.

Re: [VOTE] Merge YARN-3926 (resource profile) to trunk

application/server), > > we have setup a cluster with this feature turned on runs for several > weeks, > > we didn't see any issues by far. > > > > Merge JIRA: YARN-7013 (Jenkins gave +1 already). > > Documentation: YARN-7056 > > > > Special thanks to a team of folks wh

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

Hi I had the Apr-14 eve version of trunk on my local machine. I've pushed that. Don't know if anything was committed over the weekend though. Cheers -Arun On Mon, Apr 17, 2017 at 7:17 AM, Anu Engineer wrote: > Hi Allen, > >

Re: Hadoop QA fails with "Docker failed to build yetus/hadoop:a9ad5d6"

Yup, YARN Pre-Commit tests are having the same problem as well. Is there anything that can be done to fix this ? Ping Yetus folks (Allen / Sean) All seem to be failing with: <-- Compiling /tmp/pip_build_root/pylint/pylint/test/functional/abstract_class_instantiated_py3.py ...

Re: Problems compiling hadoop trunk on windows

It might be problem with maven repository, What's your maven repository > path..? > > May be you can change to shorter path and check. > > > > Regards > Brahma Reddy Battula > > -Original Message- > From: Arun Suresh [mailto:asur...@apache.org] > Sent: 29

Problems compiling hadoop trunk on windows

Hi I was wondering if folks who compile Hadoop trunk on windows regularly have hit this issue: [INFO] --- native-maven-plugin:1.0-alpha-8:javah (default) @ hadoop-common --- [INFO] cmd.exe /X /C ""C:\Program Files\Java\jdk1.8.0_121\bin\javah" -d

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

Thanks for all the work on this Andrew. I agree with Chris and Karthik. +1 (binding) from me as well - Ran a 9 node cluster HDFS and YARN cluster - Played with some hdfs commands - Ran some sleep jobs using YARN ReservationSytstem + Opportunistic Containers - Compiled REEF and Spark

Re: Is anyone seeing this during trunk build?

It looks like *org.apache.hadoop.hdfs.StripeReader* is using a Java 8 lambda expression which commons bcel is still not comfortable with. As per https://issues.apache.org/jira/browse/BCEL-173 It should be fixed in commons release 6.0 of bcel. or maybe replace with bcel-findbugs ? as suggested by :

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

+1 (binding). Thanks for driving this Andrew.. * Download and built from source. * Setup a 5 mode cluster. * Verified that MR works with opportunistic containers * Verified that the AMRMClient supports 'allocationRequestId' Cheers -Arun On Thu, Sep 1, 2016 at 4:31 PM, Aaron Fabbri

Re: Recent PreCommit Jenkins failures

Thanks for taking a look at this Allen.. Will check out the patch.. -Arun On Apr 27, 2016 9:16 PM, "Allen Wittenauer" <allenwittena...@yahoo.com.invalid> wrote: > > > On Apr 27, 2016, at 3:53 PM, Arun Suresh <asur...@apache.org> wrote: > > > > which

Recent PreCommit Jenkins failures

Hi Looks like the last couple of pre-commit jenkins builds are failing with the following error : http://hackage.haskell.org/packages/archive/00-index.tar.gz : ErrorMisc "Unsucessful HTTP code: 502"

Re: Retrieving keys via KMS from map/reduce phase.

You really do not need to talk to the KMS directly from the MR code.. The MR framework and the DFSClient will automatically decrypt for you when the mappers are reading a file (one of the reasons why this is called transparent data encryption). Similarly, files that are written to an output

Re: YARN replica selection

+yarn-dev@ Currently you can provide the scheduler hints as to the set of nodes / racks the task may be scheduled. But what you are probably looking for is the Node Labeling feature which is currently under development : https://issues.apache.org/jira/browse/YARN-2492 -Arun On Fri, Jun 19,

Re: Key Rotation in Data-at-Rest Encryption

. Where is the FileInfo object persisted? Is it in the NameNode? How is the KeyMaterial derived from the KeyAlias and where is the mapping between the two stored? Is it in the KMS? Thanks much for your help in this. Sitaraman On Sun, Jun 14, 2015 at 12:14 PM, Arun Suresh asur...@cloudera.com

Re: 2.7 status

Hey Vinod, I was wondering if you can include https://issues.apache.org/jira/browse/HDFS-8091 too.. Without it, i kinda makes https://issues.apache.org/jira/browse/HDFS-6826 incomplete.. Cheers -Arun Suresh On Thu, Apr 9, 2015 at 11:37 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote

Re: 2.7 status

, we can get it into 2.7.1 - Or 2.8. Thanks +Vinod On Apr 9, 2015, at 11:41 AM, Arun Suresh asur...@cloudera.com wrote: Hey Vinod, I was wondering if you can include https://issues.apache.org/jira/browse/HDFS-8091 too.. Without it, i kinda makes https://issues.apache.org/jira

[jira] [Created] (HDFS-8091) ACLStatus and XAttributes emitted by custom INodeAttributesProvider not being picked up correctly

Arun Suresh created HDFS-8091: - Summary: ACLStatus and XAttributes emitted by custom INodeAttributesProvider not being picked up correctly Key: HDFS-8091 URL: https://issues.apache.org/jira/browse/HDFS-8091

[jira] [Created] (HDFS-7970) KMSClientProvider addDelegationToken does not notify callers when Auth failure is due to Proxy User configuration a

Arun Suresh created HDFS-7970: - Summary: KMSClientProvider addDelegationToken does not notify callers when Auth failure is due to Proxy User configuration a Key: HDFS-7970 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HDFS-7935) Support multi-homed networks when Kerberos security is enabled

Arun Suresh created HDFS-7935: - Summary: Support multi-homed networks when Kerberos security is enabled Key: HDFS-7935 URL: https://issues.apache.org/jira/browse/HDFS-7935 Project: Hadoop HDFS

[jira] [Created] (HDFS-7931) Spurious Error message Could not find uri with key [dfs.encryption.key.provider.uri] to create a key appears even when Encryption is dissabled

Arun Suresh created HDFS-7931: - Summary: Spurious Error message Could not find uri with key [dfs.encryption.key.provider.uri] to create a key appears even when Encryption is dissabled Key: HDFS-7931 URL: https

[jira] [Created] (HDFS-7920) FIx WebHDFS AuthFilter to use DelegationTokenAuthenticationFilter

Arun Suresh created HDFS-7920: - Summary: FIx WebHDFS AuthFilter to use DelegationTokenAuthenticationFilter Key: HDFS-7920 URL: https://issues.apache.org/jira/browse/HDFS-7920 Project: Hadoop HDFS

[jira] [Created] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

Arun Suresh created HDFS-7858: - Summary: Improve HA Namenode Failover detection on the client using Zookeeper Key: HDFS-7858 URL: https://issues.apache.org/jira/browse/HDFS-7858 Project: Hadoop HDFS

[jira] [Created] (HDFS-5262) HDFS Datanode goes out of memory and HBase Regionserver hangs when dfs.client.socket-timeout=0

Arun Suresh created HDFS-5262: - Summary: HDFS Datanode goes out of memory and HBase Regionserver hangs when dfs.client.socket-timeout=0 Key: HDFS-5262 URL: https://issues.apache.org/jira/browse/HDFS-5262