mmitter access to Jenkins, the committer
> must be made a member of the hudson-jobadmin group. This is done using the
> Whimsy Tool which all PMC Chairs can change."
>
> I've done this for Sunil & Wangda as they needed help for Submarine.
>
> Arun Suresh and other
Thanks for bringing this up Wangda. +1
Makes a lot of sense to have Submarine follow its own release cadence - for
all the reasons you outlined.
I would one up this proposal to ask why shouldn't we allow YARN to have its
own releases as well - but that is for a separate thread :)
Cheers
-Arun
On
ate.
>
> Which specific job you are looking? I looked at
> https://builds.apache.org/job/PreCommit-YARN-Build/ but can't seem to
> find any user specific auth.
>
> +Vinod
>
> On Jan 22, 2019, at 10:00 AM, Arun Suresh wrote:
>
> Hey Vinod.. Ping!
>
> Cheers
>
Hey Vinod.. Ping!
Cheers
-Arun
On Fri, Jan 18, 2019 at 9:46 AM Arun Suresh wrote:
> Hi Vinod
>
> Can you please help with this:
> https://issues.apache.org/jira/browse/INFRA-17673 ?
>
> Cheers
> -Arun
>
> On Wed, Jan 16, 2019, 12:53 PM Arun Suresh
>> Hi
>
+1
Cheers
-Arun
On Mon, Apr 16, 2018 at 7:09 PM, Weiwei Yang wrote:
> +1
>
> --
> Weiwei
>
> On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey ,
> wrote:
>
> dopt
> HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code
> merge.
>
Hello folks
We also think this bridging release opens up an opportunity to bump the
java version in branch-2 to java 8.
Would really love to hear thoughts on that.
Cheers
-Arun/Subru
On Mon, Feb 26, 2018 at 5:18 PM, Jonathan Hung wrote:
> Hi Subru,
>
> Thanks for starting the discussion.
>
>
t; >>> end-to-end.
> >>> * (Jian) YARN-5079,YARN-4793,YARN-4757,YARN-6419 YARN native services.
> >>> * (Steve Loughran): HADOOP-13786: S3Guard committer for zero-rename
> >>> commits.
> >>> * (Suma): YARN-7117: Capacity Scheduler: Support Auto C
n 27 Jan 2018, 9:16 AM +0800, Wangda Tan , wrote:
> +1
>
> On Sat, Jan 27, 2018 at 2:05 AM, Chris Douglas <mailto:cdoug...@apache.org>> wrote:
> +1 Looking forward to this. -C
>
> On Fri, Jan 26, 2018 at 7:28 AM, Arun Suresh asur...@apache.org>> wrote:
> > Hel
y and anti-affinity features with
>>> placement allocator. Also checked SLS to see any performance regression,
>>> and there are not much difference as Arun mentioned.
>>>
>>> Thanks all the folks for working on this. Kudos!
>>>
>>> - Sunil
>
Hello yarn-dev@
Based on the positive feedback from the DISCUSS thread [1], I'd like to
start a formal vote to merge YARN-6592 [2] to trunk. The vote will run for
5 days, and will end Jan 31 7:30AM PDT.
This feature adds support for placing containers in YARN using rich
placement constraints. For
Hello yarn-dev@
We feel that the YARN-6592 dev branch mostly in shape to be merged into
trunk. This branch adds support for placing containers in YARN using rich
placement constraints. For example, this can be used by applications to
co-locate containers on a node or rack (*affinity *constraint),
Hey Sammi,
Looks like your filter is private.
Cheers
-Arun
On Wed, Jan 10, 2018 at 12:28 AM, Chen, Sammi wrote:
> Hi All,
>
>
>
> We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] with 30
> new features, 407 improvements, 790 bug fixes new fixed issues since
> 2.8.2. To fur
+1 (binding)
- Verified signatures of the source tarball.
- built from source - using the docker build environment.
- set up a pseudo-distributed test cluster.
- ran basic HDFS commands
- ran some basic MR jobs
Cheers
-Arun
On Tue, Dec 12, 2017 at 1:52 PM, Andrew Wang
wrote:
> Hi everyone,
>
>
during In-queue preemption
> > >
> > > o Priorities are honored during In-queue preemption
> > >
> > > o Can kill applications from the command line
> > >
> > > o Users with different weights are assigned resources proportional to
> > > their weights.
> > >
> >
Hi all,
We are pleased to announce the release of Apache Hadoop 2.9.0. This is the
first release of Hadoop 2.9 line and will be the starting release for
Apache Hadoop 2.9.x line - it includes 30 New Features with 500+ subtasks,
407 Improvements, 790 Bug fixes new fixed issues since 2.8.2.
Please
but the options do not exist in 2.x releases.
> Filed HADOOP-15045 to fix this issue.
> I think this issue doesn't block the release.
>
> Thanks and regards,
> Akira
>
> On 2017/11/14 9:10, Arun Suresh wrote:
>
>> Hi Folks,
>>
>> Apache Hadoop 2.9.0 is
Hi Folks,
Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.
More information about the 2.9.0 release plan can be
Cancelling the RC2 to fix the LICENSE.txt issue.
Will be rolling out an RC3 shortly. Given that the delta is just the
LICENSE fix, we will be carrying over the votes from this thread as well.
Cheers
-Arun/Subru
On Mon, Nov 13, 2017 at 2:59 PM, Arun Suresh wrote:
> Hi Xiao,
> What Anu p
to confirm first? There may (or may not) be
> other similar instances.
>
> -Xiao
>
> On Mon, Nov 13, 2017 at 2:34 PM, Arun Suresh wrote:
>
> > Thanks for notifying Anu,
> > We've raised https://issues.apache.org/jira/browse/HADOOP-15036 to
> address
> > this an
Thanks for notifying Anu,
We've raised https://issues.apache.org/jira/browse/HADOOP-15036 to address
this and have included a patch.
Can you please take a look and possibly +1 if you are fine ?
Cheers
-Arun
On Mon, Nov 13, 2017 at 2:19 PM, Anu Engineer
wrote:
> -1 (binding)
>
> Thank you for al
; > org.apache.curator.framework.imps.CuratorTransactionImpl.doO
>> peration(CuratorTransactionImpl.java:159)
>> > at
>> >
>> > org.apache.curator.framework.imps.CuratorTransactionImpl.acc
>> ess$200(CuratorTransactionImpl.java:44)
>> > at
>> >
>> > org.apache.curator.framework.
Here is my +1 to start.
- Setup a small 4 node cluster
- Verified some basic HDFS commands
- Ran Pi / sleep jobs (with some mix of Opportunistic containers - both
distributed and centralized scheduling)
Cheers
-Arun
On Fri, Nov 3, 2017 at 4:38 PM, Arun Suresh wrote:
> Hey Vinod,
>
Thanks for starting this discussion VInod.
I agree (C) is a bad idea.
I would prefer (A) given that ATM, branch-2 is still very close to
branch-2.9 - and it is a good time to make a collective decision to lock
down commits to branch-2.
I think we should also clearly define what the 'bridging' rel
e md files, for quicker perusal?
>
> Thanks
> +Vinod
>
> On Nov 3, 2017, at 3:50 PM, Arun Suresh wrote:
>
> Hi folks,
>
> Apache Hadoop 2.9.0 is the first stable release of Hadoop 2.9 line and
> will be the latest stable/production release for Apache Hadoop - it
Hi folks,
Apache Hadoop 2.9.0 is the first stable release of Hadoop 2.9 line and
will be the latest stable/production release for Apache Hadoop - it
includes 30 New Features with 500+ subtasks, 407 Improvements, 787 Bug
fixes new fixed issues since 2.8.2 .
More information about the 2.
+1 (binding)
Cheers
-Arun
On Nov 3, 2017 11:44 AM, "Chandni Singh" wrote:
> +1
> Thanks,
> Chandni
>
> From: Jian He
> Sent: Monday, October 30, 2017 1:49 PM
> To: yarn-...@hadoop.apache.org; Hdfs-dev; Hadoop Common;
> mapreduce-...@hadoop.apache.org
>
Quick update folks.
We just cut branch-2.9.0, and set the mvn version to 2.9.0
We've also updated the version on branch-2.9 to 2.9.1-SNAPSHOT.
Expect an RC in the next 24 hrs :)
Cheers
-Arun/Subru
On Tue, Oct 31, 2017 at 5:24 PM, Arun Suresh wrote:
> Hi Junping,
>
> >
the method/class in question has
actually not been touched in years.
@Junping, Kindly do take a look and let us know if something is amiss.
Thanks
-Arun/Subru
On Tue, Oct 31, 2017 at 1:47 PM, Arun Suresh wrote:
> Hi Junping / Wangda,
>
> We just ran jdiff on branch-2.9.
> I have
.
> Sure. I will reply jdiff in separated thread.
>
> Thanks,
>
> Junping
>
> 2017-10-31 13:44 GMT-07:00 Arun Suresh :
>
>> Hello folks
>>
>> We just cut branch-2.9 since all the critical/blocker issues are now
>> resolved.
>> We plan to perform some s
PM, Arun Suresh wrote:
> Hello Jumping
>
> Thanks for chiming in.. Appreciate the offer to help. I did run jdiff on
> branch-2 today.. did not find any red flags. Will post the report here
> shortly for review.
>
> Cheers
> -Arun
>
> On Oct 30, 2017 4:44 PM, "Ju
Hello folks
We just cut branch-2.9 since all the critical/blocker issues are now
resolved.
We plan to perform some sanity checks for the rest of the week and cut
branch-2.9.0 and push out an RC0 by the end of the week.
Kindly refrain from committing to branch-2.9 without giving us a heads up.
@J
y help
> here.
>
> Thanks,
>
> Junping
>
> From: Subru Krishnan
> Sent: Monday, October 30, 2017 12:39 PM
> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
> hdfs-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org
>
Hello Folks
Thanks to everyone who chimed in in the discussion thread:
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg27104.html
We have updated the roadmap wiki based on the feedback:
https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
Given the explosion o
Thanks Akira
Cheers
-Arun
On Fri, Sep 8, 2017 at 6:53 PM, Akira Ajisaka wrote:
> You can get the privilege by sending an e-mail to the dev ML.
> I added it for you.
>
> Thanks,
> Akira
>
>
> On 2017/09/09 4:50, Arun Suresh wrote:
>
>> Hi folks
>>
>>
Hi folks
How do we get access to edit the confluence wiki;
https://cwiki.apache.org/confluence/display/HADOOP ?
We were hoping to update it with hadoop 2.9 release details.
Cheers
-Arun
Thanks for starting this Wangda.
I would also like to add:
- YARN-5972: Support Pausing/Freezing of opportunistic containers
Cheers
-Arun
On Wed, Sep 6, 2017 at 1:49 PM, Steve Loughran
wrote:
>
> > On 6 Sep 2017, at 19:13, Wangda Tan wrote:
> >
> > Hi all,
> >
> > As we discussed on [1], ther
Thanks for all the work on this folks.
I know the VOTE thread has started for this.
But I did have a couple of questions:
* Is there a branch-2 merge planned for this ?
* I understand YARN-7126 has some introductory documentation, But I think
we need to flesh it up a bit more before release, I wou
+1 (binding).
Cheers
-Arun
On Fri, Sep 1, 2017 at 5:24 PM, Wangda Tan wrote:
> +1 (Binding), I tried to use YARN service assembly before to run different
> kinds of jobs (for example, distributed Tensorflow), it is really easy for
> end user to run jobs on YARN.
>
> Thanks to the whole team for
Thanks for starting this Daniel.
I think we should also add a section for store compatibility (all state
stores including RM, NM, Federation etc.). Essentially an explicit policy
detailing when is it ok to change the major and minor versions and how it
should relate to the hadoop release version.
cluster with this feature turned on runs for several
> weeks,
> > we didn't see any issues by far.
> >
> > Merge JIRA: YARN-7013 (Jenkins gave +1 already).
> > Documentation: YARN-7056
> >
> > Special thanks to a team of folks who worked hard and contributed
Hi
I had the Apr-14 eve version of trunk on my local machine. I've pushed that.
Don't know if anything was committed over the weekend though.
Cheers
-Arun
On Mon, Apr 17, 2017 at 7:17 AM, Anu Engineer
wrote:
> Hi Allen,
>
> https://issues.apache.org/jira/browse/INFRA-13902
>
> That happened wi
Thanks Allen..
On Apr 14, 2017 3:29 PM, "Allen Wittenauer"
wrote:
>
> > On Apr 13, 2017, at 11:13 PM, Arun Suresh wrote:
> >
> > Yup,
> >
> > YARN Pre-Commit tests are having the same problem as well.
> > Is there anything that can be done t
Yup,
YARN Pre-Commit tests are having the same problem as well.
Is there anything that can be done to fix this ? Ping Yetus folks (Allen /
Sean)
All seem to be failing with:
<--
Compiling
/tmp/pip_build_root/pylint/pylint/test/functional/abstract_class_instantiated_py3.py
...
might be problem with maven repository, What's your maven repository
> path..?
>
> May be you can change to shorter path and check.
>
>
>
> Regards
> Brahma Reddy Battula
>
> -----Original Message-
> From: Arun Suresh [mailto:asur...@apache.org]
> Sen
Hi
I was wondering if folks who compile Hadoop trunk on windows regularly have
hit this issue:
[INFO] --- native-maven-plugin:1.0-alpha-8:javah (default) @ hadoop-common
---
[INFO] cmd.exe /X /C ""C:\Program Files\Java\jdk1.8.0_121\bin\javah" -d
C:\Users\arsuresh\stuff\hadoop\hadoop-common-projec
Thanks for all the work on this Andrew. I agree with Chris and Karthik.
+1 (binding) from me as well
- Ran a 9 node cluster HDFS and YARN cluster
- Played with some hdfs commands
- Ran some sleep jobs using YARN ReservationSytstem + Opportunistic
Containers
- Compiled REEF and Spark agains
It looks like *org.apache.hadoop.hdfs.StripeReader* is using a Java 8
lambda expression which commons bcel is still not comfortable with.
As per https://issues.apache.org/jira/browse/BCEL-173 It should be fixed in
commons release 6.0 of bcel.
or maybe replace with bcel-findbugs ? as suggested by :
+1 (binding).
Thanks for driving this Andrew..
* Download and built from source.
* Setup a 5 mode cluster.
* Verified that MR works with opportunistic containers
* Verified that the AMRMClient supports 'allocationRequestId'
Cheers
-Arun
On Thu, Sep 1, 2016 at 4:31 PM, Aaron Fabbri wrote:
> +1
Thanks for taking a look at this Allen.. Will check out the patch..
-Arun
On Apr 27, 2016 9:16 PM, "Allen Wittenauer"
wrote:
>
> > On Apr 27, 2016, at 3:53 PM, Arun Suresh wrote:
> >
> > which I guess is due to the haskell site throwing a 502 and prior to
> t
Hi
Looks like the last couple of pre-commit jenkins builds are failing with
the following error :
http://hackage.haskell.org/packages[0m[91m/archive/[0m[91m00-index.tar.gz
: Err[0m[91morMisc
[0m[91m"Unsu[0m[91mcessful [0m[91mHTTP[0m[91m co[0m[91mde:
[0m[91m502"[0m[91m
[
+yarn-dev@
Currently you can provide the scheduler hints as to the set of nodes /
racks the task may be scheduled.
But what you are probably looking for is the Node Labeling feature which is
currently under development :
https://issues.apache.org/jira/browse/YARN-2492
-Arun
On Fri, Jun 19, 201
You really do not need to talk to the KMS directly from the MR code.. The
MR framework and the DFSClient will automatically decrypt for you when the
mappers are reading a file (one of the reasons why this is called
"transparent" data encryption). Similarly, files that are written to an
output direc
the EZKey Version not stored in the extended
> attributes too.
> Where is the FileInfo object persisted? Is it in the NameNode?
> How is the KeyMaterial derived from the KeyAlias and where is the mapping
> between the two stored? Is it in the KMS?
> Thanks much for your help in this.
&g
s like a
> small server side improvement, we can get it into 2.7.1
> - Or 2.8.
>
> Thanks
> +Vinod
>
> On Apr 9, 2015, at 11:41 AM, Arun Suresh wrote:
>
> > Hey Vinod,
> >
> > I was wondering if you can include
> > https://issues.apache.org/jira/browse/HD
Hey Vinod,
I was wondering if you can include
https://issues.apache.org/jira/browse/HDFS-8091 too.. Without it, i kinda
makes https://issues.apache.org/jira/browse/HDFS-6826 incomplete..
Cheers
-Arun Suresh
On Thu, Apr 9, 2015 at 11:37 AM, Vinod Kumar Vavilapalli <
vino...@hortonworks.
Arun Suresh created HDFS-8091:
-
Summary: ACLStatus and XAttributes emitted by custom
INodeAttributesProvider not being picked up correctly
Key: HDFS-8091
URL: https://issues.apache.org/jira/browse/HDFS-8091
Arun Suresh created HDFS-7970:
-
Summary: KMSClientProvider addDelegationToken does not notify
callers when Auth failure is due to Proxy User configuration a
Key: HDFS-7970
URL: https://issues.apache.org/jira/browse
Arun Suresh created HDFS-7935:
-
Summary: Support multi-homed networks when Kerberos security is
enabled
Key: HDFS-7935
URL: https://issues.apache.org/jira/browse/HDFS-7935
Project: Hadoop HDFS
Arun Suresh created HDFS-7931:
-
Summary: Spurious Error message "Could not find uri with key
[dfs.encryption.key.provider.uri] to create a key" appears even when Encryption
is dissabled
Key: HDFS-7931
Arun Suresh created HDFS-7920:
-
Summary: FIx WebHDFS AuthFilter to use
DelegationTokenAuthenticationFilter
Key: HDFS-7920
URL: https://issues.apache.org/jira/browse/HDFS-7920
Project: Hadoop HDFS
Arun Suresh created HDFS-7858:
-
Summary: Improve HA Namenode Failover detection on the client
using Zookeeper
Key: HDFS-7858
URL: https://issues.apache.org/jira/browse/HDFS-7858
Project: Hadoop HDFS
Arun Suresh created HDFS-7718:
-
Summary: DFSClient objects created by AbstractFileSystem objects
created by FileContext are not closed and results in thread leakage
Key: HDFS-7718
URL: https://issues.apache.org/jira
Arun Suresh created HDFS-5262:
-
Summary: HDFS Datanode goes out of memory and HBase Regionserver
hangs when dfs.client.socket-timeout=0
Key: HDFS-5262
URL: https://issues.apache.org/jira/browse/HDFS-5262
63 matches
Mail list logo
