Re: Mentorship opportunity for aspiring Hadoop developer
Hi Aaron, I'm interested in this opportunity. Please count me in. Thanks, Madhawa On Thu, Jan 17, 2019 at 3:25 AM Aaron Fabbri wrote: > Good call. I didn't think of GSOC. I'll check it out. > > I received a lot of email responses.. Tomorrow I'll send out an update with > a small survey so I can get more organized in helping the folks that > reached out so far. > > On Wed, Jan 16, 2019 at 4:21 AM Steve Loughran > wrote: > > > the google summer of code program is setting for the season, ASF supports > > this if you want to volunteer to help out there -it'd be great for the > > project and whoever joins up > > > > > On 14 Jan 2019, at 18:39, Aaron Fabbri wrote: > > > > > > Hi, > > > > > > I'd like to offer to mentor a developer who is interested in getting > into > > > Apache Hadoop development. > > > > > > If you or someone you know is interested, please email me (unicast). > This > > > would probably be a three month thing where we meet every week or two. > > > > > > I'm also curious if Apache and/or Hadoop communities have any program > or > > > resources on mentoring. I'm interested in growing the dev community so > > > please forward any good links or experiences. > > > > > > Cheers, > > > Aaron > > > > >
[jira] [Created] (HADOOP-16048) ABFS: Fix Date format parser
Da Zhou created HADOOP-16048: Summary: ABFS: Fix Date format parser Key: HADOOP-16048 URL: https://issues.apache.org/jira/browse/HADOOP-16048 Project: Hadoop Common Issue Type: Sub-task Components: fs/azure Environment: Parsing of the US date does not work on a machine with European time format, need to set "Locale.*_US_*" when creating SimpleDateFormat. Reporter: Da Zhou Assignee: Da Zhou Fix For: 3.2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Mentorship opportunity for aspiring Hadoop developer
Good call. I didn't think of GSOC. I'll check it out. I received a lot of email responses.. Tomorrow I'll send out an update with a small survey so I can get more organized in helping the folks that reached out so far. On Wed, Jan 16, 2019 at 4:21 AM Steve Loughran wrote: > the google summer of code program is setting for the season, ASF supports > this if you want to volunteer to help out there -it'd be great for the > project and whoever joins up > > > On 14 Jan 2019, at 18:39, Aaron Fabbri wrote: > > > > Hi, > > > > I'd like to offer to mentor a developer who is interested in getting into > > Apache Hadoop development. > > > > If you or someone you know is interested, please email me (unicast). This > > would probably be a three month thing where we meet every week or two. > > > > I'm also curious if Apache and/or Hadoop communities have any program or > > resources on mentoring. I'm interested in growing the dev community so > > please forward any good links or experiences. > > > > Cheers, > > Aaron > >
Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1
+1 (binding) Apologies for one more late vote! - Built from source and also installed the release tar. - Verified all Node Labels and node . - Ran sample jobs and verified UI Thanks and Regards, + Naga On Wed, Jan 16, 2019 at 10:34 PM Rohith Sharma K S < rohithsharm...@apache.org> wrote: > +1 (binding) Apologies for late vote! > > - Built from source for hbase profile=2.0 and deployed RM HA cluster along > with ATSv2.0 enabled. > - Ran sample jobs and verified all ATSv2.0 data are publishing. > - Verified UI2 for ATSv2.0 data! > > -Rohith Sharma K S > > On Wed, 16 Jan 2019 at 07:00, Sunil G wrote: > > > Thanks everyone for helping to vote this release! > > > > With 7 binding votes, 10 non-binding votes and no veto, this vote stands > > passed, > > I'm going to work on staging the release. > > > > Thanks, > > Sunil > > > > On Tue, Jan 15, 2019 at 9:59 PM Weiwei Yang wrote: > > > > > +1 (binding) > > > > > > - Setup a cluster, run teragen/terasort jobs > > > - Verified general readability of documentation (titles/navigations) > > > - Run some simple yarn commands: app/applicationattempt/container > > > - Checked restful APIs: RM cluster/metrics/scheduler/nodes, NM > > > node/apps/container > > > - Verified simple failover scenario > > > - Submitted distributed shell apps with affinity/anti-affinity > > constraints > > > - Configured conf based node attribute provider, alter attribute values > > > and verified the change > > > - Verified CLI add/list/remove node-attributes, submitted app with > simple > > > node-attribute constraint > > > > > > -- > > > Weiwei > > > > > >
Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1
+1 (binding) Apologies for late vote! - Built from source for hbase profile=2.0 and deployed RM HA cluster along with ATSv2.0 enabled. - Ran sample jobs and verified all ATSv2.0 data are publishing. - Verified UI2 for ATSv2.0 data! -Rohith Sharma K S On Wed, 16 Jan 2019 at 07:00, Sunil G wrote: > Thanks everyone for helping to vote this release! > > With 7 binding votes, 10 non-binding votes and no veto, this vote stands > passed, > I'm going to work on staging the release. > > Thanks, > Sunil > > On Tue, Jan 15, 2019 at 9:59 PM Weiwei Yang wrote: > > > +1 (binding) > > > > - Setup a cluster, run teragen/terasort jobs > > - Verified general readability of documentation (titles/navigations) > > - Run some simple yarn commands: app/applicationattempt/container > > - Checked restful APIs: RM cluster/metrics/scheduler/nodes, NM > > node/apps/container > > - Verified simple failover scenario > > - Submitted distributed shell apps with affinity/anti-affinity > constraints > > - Configured conf based node attribute provider, alter attribute values > > and verified the change > > - Verified CLI add/list/remove node-attributes, submitted app with simple > > node-attribute constraint > > > > -- > > Weiwei > > >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/ [Jan 15, 2019 3:59:59 AM] (aajisaka) YARN-9179. Fix NPE in AbstractYarnScheduler#updateNewContainerInfo. [Jan 15, 2019 1:15:18 PM] (stevel) HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message [Jan 15, 2019 11:11:16 PM] (bharat) HDDS-978. Fix typo in doc : Client > S3 section. Contributed by Dinesh [Jan 16, 2019 1:28:08 AM] (aajisaka) HADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes hadoop.hdfs.web.TestWebHdfsTimeouts cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-patch-pylint.txt [60K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/whitespace-eol.txt [9.3M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/whitespace-tabs.txt [1.1M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-hdds_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_common.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/diff-javadoc-javadoc-root.txt [752K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [328K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [84K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1018/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [84K]
Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1
Thanks everyone for helping to vote this release! With 7 binding votes, 10 non-binding votes and no veto, this vote stands passed, I'm going to work on staging the release. Thanks, Sunil On Tue, Jan 15, 2019 at 9:59 PM Weiwei Yang wrote: > +1 (binding) > > - Setup a cluster, run teragen/terasort jobs > - Verified general readability of documentation (titles/navigations) > - Run some simple yarn commands: app/applicationattempt/container > - Checked restful APIs: RM cluster/metrics/scheduler/nodes, NM > node/apps/container > - Verified simple failover scenario > - Submitted distributed shell apps with affinity/anti-affinity constraints > - Configured conf based node attribute provider, alter attribute values > and verified the change > - Verified CLI add/list/remove node-attributes, submitted app with simple > node-attribute constraint > > -- > Weiwei >
[jira] [Reopened] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile
[
https://issues.apache.org/jira/browse/HADOOP-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-15617:
-
> Reduce node.js and npm package loading in the Dockerfile
>
>
> Key: HADOOP-15617
> URL: https://issues.apache.org/jira/browse/HADOOP-15617
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> {code}
> RUN apt-get -y install nodejs && \
> ln -s /usr/bin/nodejs /usr/bin/node && \
> apt-get -y install npm && \
> npm install npm@latest -g && \
> npm install -g bower && \
> npm install -g ember-cli
> {code}
> should get reduced to
> {code}
> RUN apt-get -y install nodejs && \
> ln -s /usr/bin/nodejs /usr/bin/node && \
> apt-get -y install npm && \
> npm install npm@latest -g
> {code}
> The locally installed versions of bower and ember-cli aren't being used
> anymore. Removing these cuts the docker build time significantly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Jenkins builds of branch-2 failing with docker, npm
All branch-2 builds are failing with docker problems right now https://builds.apache.org/job/PreCommit-HADOOP-Build/15791/console no obvious clue to me as to what is wrong; that npm install is working for me locally
Re: Mentorship opportunity for aspiring Hadoop developer
the google summer of code program is setting for the season, ASF supports this if you want to volunteer to help out there -it'd be great for the project and whoever joins up > On 14 Jan 2019, at 18:39, Aaron Fabbri wrote: > > Hi, > > I'd like to offer to mentor a developer who is interested in getting into > Apache Hadoop development. > > If you or someone you know is interested, please email me (unicast). This > would probably be a three month thing where we meet every week or two. > > I'm also curious if Apache and/or Hadoop communities have any program or > resources on mentoring. I'm interested in growing the dev community so > please forward any good links or experiences. > > Cheers, > Aaron - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
