[ANNOUNCE] New Bigtop PMC member: Luca Toscano

2023-09-26 Thread Olaf Flebbe
On behalf of the Apache Bigtop PMC, I am pleased to announce that Luca Toscano (elukey) has accepted the invitation to join the Bigtop Project Management Committee. Please join me in congratulating Luca!

Re: Preparation status of the 3.0.1 release

2022-04-07 Thread Olaf Flebbe
Hi Peng, IIUC there wasn’t any functional Ambari community in place any more, so the project went into attic. As an Apache Software Project we are asked to look into software security and maintaibility. We cannot use discontinued / obsolete technology for building infrastructure, since users ex

Re: Followup on yesterday

2022-02-20 Thread Olaf Flebbe
t IIUC doesn't use any proxy but that could use > some retry logic). > > WIll keep investigating, if anybody has suggestions please let me know :) > > Luca > > On Sat, Feb 19, 2022 at 7:21 PM Olaf Flebbe wrote: >> >> Hi, >> >> gl

Re: Followup on yesterday

2022-02-19 Thread Olaf Flebbe
> > [1] > https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/COMPONENTS=alluxio,OS=debian-11/lastBuild/consoleFull > > On Thu, Feb 17, 2022 at 9:48 PM Olaf Flebbe wrote: >> >> Hi everyone, >> >> Yesterday Luca Toscano and me had

Followup on yesterday

2022-02-17 Thread Olaf Flebbe
Hi everyone, Yesterday Luca Toscano and me had a call to look into improving the situation of artifact downloads by caching . I was a bit surprised that the „nexus“ code is still in place and still seem to work somehow. Since having a repository server (a specialized proxy for maven repos) is

Re: Network failures while maven runs

2022-01-29 Thread Olaf Flebbe
Hi Luca, I think you are referring to random failures of maven downloads? We used a couple of countermeasures in the past, all of them proved problematic. We persisted the maven cache so the next by bind mounting a local directory onto the maven cache .m2 . We had nice permission issues and did

New Committer: Luca Toscano

2021-12-19 Thread Olaf Flebbe
The Project Management Committee (PMC) for Apache Bigtop has asked Luca Toscano to become a committer and we are pleased to announce that he has accepted! Being a committer enables easier contribution to the project since there is no need to go via the proxy patch submission process. This should

Re: ci.bigtop.apache.org's TLS cert expired

2021-12-18 Thread Olaf Flebbe
Hi, > Am 18.12.2021 um 13:30 schrieb Luca Toscano : > > Thanks Kengo! Certs renewed :) > > One nit - the name of the docker container to stop is > "jenkins-master-8080", not "jenkins-master" (maybe it doesn't even > need to be stopped? Is stopping httpd sufficient?) For renewing the CERT resta

Re: Some ideas about Jenkins

2021-12-15 Thread Olaf Flebbe
hi luca we can do the update together in the next days (evening local time in eu). best olaf > Am 15.12.2021 um 09:37 schrieb Luca Toscano : > > Hi everybody, > > Any feedback? I'd like to upgrade, if everybody agrees, Jenkins during > the next days. If anybody can review the procedure and

Re: Power (ppc64le) CI/CD upgrade

2021-12-11 Thread Olaf Flebbe
> Hi Olaf, > > makes sense! I am unable to ssh to the ppc node though (I have some > trouble decrypting the jenkins ssh key), if you have time later on > could you please try to ssh and docker login? > > Thanks! > > Luca > > On Sat, Dec 11, 2021 at 9:43 AM Ola

Re: Power (ppc64le) CI/CD upgrade

2021-12-11 Thread Olaf Flebbe
hi after setup a new node you need to do a „docker login“ on the jenkins slave account once. IIUC this node has been setup only a few days before olaf > Am 11.12.2021 um 09:17 schrieb Luca Toscano : > > Hi! > > I am very new to the project so I don't have a lot of context on the > ppc64 node

Re: Set up CI for Debian 11 Bullseye

2021-12-04 Thread Olaf Flebbe
> > Luca > > On Sat, Nov 27, 2021 at 8:49 PM Olaf Flebbe wrote: >> >> Hi, >> >> I had a quick look around. Job History was excessive: availlable back to >> 2017, I deleted all until 2019 and set the maximum life time to one year. >> I see th

Re: Set up CI for Debian 11 Bullseye

2021-11-27 Thread Olaf Flebbe
. Can someone please look at the config of „bigpetstore“, please? At least we have some air to breath now again on jenkins. Olaf > Am 27.11.2021 um 20:04 schrieb Olaf Flebbe : > > Regarding setup of jenkins, you can find a lot of info here: > > https://cwiki.apache.org/confluence

Re: Set up CI for Debian 11 Bullseye

2021-11-27 Thread Olaf Flebbe
Regarding setup of jenkins, you can find a lot of info here: https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Setup+Guide <https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Setup+Guide> Olaf > Am 27.11.2021 um 19:46 schrieb Olaf Flebbe : > > I am worki

Re: Set up CI for Debian 11 Bullseye

2021-11-27 Thread Olaf Flebbe
t; moment. No idea if there is a guide/tutorial for the cleanup, but I > guess it means accessing to the VM/hosts that are running Jenkins and > I have never done it (not even sure where to put my ssh key etc, what > is the hostname, etc..). > > Thanks! > > Luca > > On

Re: Set up CI for Debian 11 Bullseye

2021-11-26 Thread Olaf Flebbe
he code returns a HTTP 201 afaics so it > seems not failing to find it). > > Lemme know, I am probably missing something, too many new things :) > > Luca > > On Fri, Nov 26, 2021 at 6:24 PM Olaf Flebbe wrote: >> >> Hi Luca, >> >> Seems like jboss.or

Re: Set up CI for Debian 11 Bullseye

2021-11-26 Thread Olaf Flebbe
ackages/job/Bigtop-trunk-packages/745/COMPONENTS=flink,OS=debian-9/console > > I am wondering if https://github.com/apache/bigtop/pull/834 could help :) > > Luca > > On Fri, Nov 26, 2021 at 11:44 AM Olaf Flebbe wrote: >> >> Hi Luca, >> >> I once added a nexus

Re: Set up CI for Debian 11 Bullseye

2021-11-26 Thread Olaf Flebbe
kages/job/Bigtop-trunk-packages/ >>> and kick off a build, but I see "2021-10-02: temporarily disable >>> periodic execution for preparing 3.0.0 release." so before doing >>> anything I'd like some feedback (to avoid causing problems etc..). >>> >

Re: Set up CI for Debian 11 Bullseye

2021-11-19 Thread Olaf Flebbe
Hi Luca, I gave you super powers. Best Olaf > Am 19.11.2021 um 08:15 schrieb Luca Toscano : > > Hi everybody! > > I am working on https://issues.apache.org/jira/browse/BIGTOP-3600 and > IIUC I'd need to add the CI jobs now, but of course I don't have > permissions. If anybody has some time to

OpenPOWER Cluster

2021-05-18 Thread Olaf Flebbe
Hi Amir and others involved! I received an email from the OSL OpenPOWER Computing Cluster Admins concerning a survey and possible shutdown of the service of not responding to this survey. Background: IBM gave some big OpenPOWER machines to the OSL to be hosted exclusively for development of OSS

Re: Starting 3.0.0 release process

2021-05-11 Thread Olaf Flebbe
Hi, Sounds really great to have a plan for Bigtop 3.0. Regarding Debian 11: I would not recommend waiting until the final Debian release since I would not expect large shifts in focus with respect to current „testing“ any more. Usually the fine tuning of all the packages takes long time, but t

Re: PPC CI server failure

2021-04-16 Thread Olaf Flebbe
I already gave the public key to asanjar. Olaf > Am 16.04.2021 um 10:49 schrieb Evans Ye : > > Let me help. I was busy on a thing. > > > MrAsanjar . 於 2021年4月15日 週四 下午10:30寫道: > >> In order to set up the new Jenkins slave for ppc64le ( >> https://issues.apache.org/jira/browse/BIGTOP-3534) w

Re: [External Sender] Failed to build hadoop in our Bamboo agent

2021-03-24 Thread Olaf Flebbe
> Am 24.03.2021 um 19:42 schrieb Jason Wen >: > > Thanks Masatake for sharing this. > Do you know the possible reasons in the case of write failure besides 'No > space left on device'? > > Regards, > Jason There might be quotas or resouce limits in pl

Re: Website update for release 1.5

2021-02-10 Thread Olaf Flebbe
um 20:27 schrieb Olaf Flebbe : > > Hi, > > This is very odd, indeed. > > The jenkins job ran on December 15th to publish a new site > https://builds.apache.org/job/BigTop/job/pipeline-site/71/ > <https://builds.apache.org/job/BigTop/job/pipeline-site/71/> > > Th

Re: Website update for release 1.5

2021-02-10 Thread Olaf Flebbe
Hi, This is very odd, indeed. The jenkins job ran on December 15th to publish a new site https://builds.apache.org/job/BigTop/job/pipeline-site/71/ The log in asf-site branch shows this timing as well https://gitbox.apache.org/repos/a

FOSDEM

2021-01-26 Thread Olaf Flebbe
Hi, See what has been accepted at FOSDEM’s Big data devroom. https://fosdem.org/2021/schedule/event/big_data_arm/ Best Olaf

Re: Bigtop Site: Input needed

2021-01-25 Thread Olaf Flebbe
op site. The > > > example looks super great! > > > > > > I'd vote for Ananke for the following reasons: > > > 1. Seems like this solution strikes the balance between the maintenance > > > effort and the result we want. > > > 2. The do

Bigtop Site: Input needed

2020-12-29 Thread Olaf Flebbe
Hi, As previously discussed I had a look on making the website authoring more accessible. I totally underestimated it, my head hurts now (see below) :) And I am now at crossroads, need your input: First I decided to look at static site generaters, these are candidates: * Hugo : gohugo.io

Re: [ANNOUNCE] Apache Bigtop 1.5.0 released

2020-12-16 Thread Olaf Flebbe
That’s amazing! Thank you Kengo and all the contributors for all your efforts. I am asking myself if we shouldn’t announce it on the @ASFbigtop twitter handle ? We need to have a news page first, IMO . Unless someone else is stepping up I can try to create a news section and eventually conve

FOSDEM'21

2020-12-16 Thread Olaf Flebbe
Hi, your talk submissions are amazing! I love to attend the dev-room and see the progress Bigtop made in the past years. Now let’s wait for the dev room organizers. They potentially might ask us to squeeze two or three of our submissions into one slot. Best Olaf

Re: Strange behaviour of website publishing

2020-12-16 Thread Olaf Flebbe
Hi, The mechanism behind the ASF page deployments is git. So you are checking in a new revision. If the revision of a file is identical to the previous one (not considering the timestamp!) , it will not be included in the patchset deployed on server. Olaf > Am 16.12.2020 um 00:29 schrieb K

Fwd: HPC, Big Data and Data Science devroom at FOSDEM'21

2020-12-15 Thread Olaf Flebbe
i asked for an extension of the rfp olaf Anfang der weitergeleiteten Nachricht: > Von: Kenneth Hoste > Datum: 15. Dezember 2020 um 08:57:12 MEZ > An: Olaf Flebbe > Betreff: Aw: HPC, Big Data and Data Science devroom at FOSDEM'21 > > Hi Olaf, > > We'

Fwd: HPC, Big Data and Data Science devroom at FOSDEM'21

2020-12-13 Thread Olaf Flebbe
Hi, Anyone to promote Bigtop at FOSDEM’21 (virtual) ? Would be really great if we could get a Bigtop Version 1.5 Upgrade Talk or even a Bigtop@Wikimedia (Luca?) presented. FOSDEM is the biggest OSS event in Europe, by large. Best Olaf > Anfang der weitergeleiteten Nachricht: > > Von

Spam

2020-11-23 Thread Olaf Flebbe
Hi Luca, thanks for addressing the spam issue at INFRA. Best Olaf

Re: Update

2020-11-10 Thread Olaf Flebbe
gt; On Tue, Nov 10, 2020 at 1:00 AM Evans Ye wrote: >>> >>> OK. I got it now. >>> So the newly created volumes are currently attached to slave06_2 and >>> slave07_2, respectively. >>> However, they're standard HDD, not GP2 SSD. I think we can take

Re: Update

2020-11-05 Thread Olaf Flebbe
gt; they backups or something? >>>> >>>> Kengo Seki >>>> >>>> On Mon, Nov 2, 2020 at 6:41 PM Konstantin Boudnik >>> wrote: >>>>> >>>>> I'd say let replace the broken one. I don't think there

Re: Update

2020-10-30 Thread Olaf Flebbe
:09 schrieb Olaf Flebbe : > > Hi, > > I am doing an update of the machines in CI . Seems a couple of security fixes > are to be applied. > > Olaf

Update

2020-10-30 Thread Olaf Flebbe
Hi, I am doing an update of the machines in CI . Seems a couple of security fixes are to be applied. Olaf

Bigtop Website is now automatically built and deployed

2020-09-28 Thread Olaf Flebbe
Hi, News: * Bigtops Website is now automatically built and deployed * Implemented as a Jenkins pipeline job: see https://github.com/apache/bigtop/blob/master/Jenkinsfile.site * Updates are running on https://ci-builds.apache.org//job/BigTop/job/pipeline-site/

Re: Developer documenation

2020-09-26 Thread Olaf Flebbe
. Happy to help, just point me in the > right direction. I am excited to contribute and it's really a dream come > true. (sorry for admitting this out loud) > > On Tue, Sep 22, 2020 at 3:38 PM Olaf Flebbe wrote: > >> Hi Matt, >> >> I totally agree that docu

Re: Current status of the next release

2020-09-26 Thread Olaf Flebbe
Hi Kengo, great to see progress here. Thanks for the update Olaf > Am 23.09.2020 um 16:48 schrieb Kengo Seki : > > Hi everyone, > > Let me share the current status of the next release. > We've steadily moved forward and almost reached the goal. > I really appreciate your cooperation and contri

[jira] [Created] (BIGTOP-3419) Automate Deployment to asf-site

2020-09-26 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3419: --- Summary: Automate Deployment to asf-site Key: BIGTOP-3419 URL: https://issues.apache.org/jira/browse/BIGTOP-3419 Project: Bigtop Issue Type: Task

Re: Developer documenation

2020-09-22 Thread Olaf Flebbe
Hi Matt, I totally agree that documentation needs to be updated. From my perspective markdown files in the git repository are most suitable for users and accessible to our users. I am very open to accept Pull requests / Patches for docs. Contributors can ask for confluence (cwiki) privileges

Re: Bigtop website

2020-09-22 Thread Olaf Flebbe
Hey Matt, > Hey I would totally would love to help fix up the documentation as > previously mentioned. So your saying I can search in git to find the site > make some commits and we should be good to go? Yes, absolutely. Best Olaf

Re: Developer documenation

2020-09-22 Thread Olaf Flebbe
Hi Manfred, Great! AFAIK the most up to date information on how to (re)compile an package you will find here https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk I am assuming you are targeti

Re: Bigtop website

2020-09-21 Thread Olaf Flebbe
gt; what changes were made? For example, it seems that the pages are all static > now. From the CI job it seems that jenkins slave provided by infra has the > permission to push to any git repository. Have we done something > differently? Thanks! > > - Evans > > > Olaf Flebbe

Bigtop website

2020-09-20 Thread Olaf Flebbe
Hi *, Finally found time to look into implementing the workflow for pushing our website automatically bigtop.apache.org . As a test I create a job checkin the git repository once a day for new commits an deploying to bigtop.staged.apache.org

[jira] [Created] (BIGTOP-3409) Move bigtop website off from CMS: staging

2020-09-19 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3409: --- Summary: Move bigtop website off from CMS: staging Key: BIGTOP-3409 URL: https://issues.apache.org/jira/browse/BIGTOP-3409 Project: Bigtop Issue Type: Task

Re: Project website

2020-08-20 Thread Olaf Flebbe
ailto:andr...@apache.org>> > Date: Thu, Aug 20, 2020 at 4:53 PM > Subject: Re: Project website > To: Olaf Flebbe mailto:o...@oflebbe.de>> > > > Hi, Olaf: > > Nice to speak with you. > > Could you open a Jira ticket aimed at INFRA to track the project&#x

[jira] [Created] (BIGTOP-3388) Move Bigtop Site off Apache CMS

2020-08-20 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3388: --- Summary: Move Bigtop Site off Apache CMS Key: BIGTOP-3388 URL: https://issues.apache.org/jira/browse/BIGTOP-3388 Project: Bigtop Issue Type: Task

builds.apache.org: bigtop jobs will get lost

2020-08-20 Thread Olaf Flebbe
Hi, honestly I am a bit surprised, looking at builds.apache org: There are a couple of jobs running there: One Job: "Deploys Bigtop test execution into snapshot repository“ mvn clean export HADOOP_CONF_DIR= export HADOOP_HOME= mvn -f bigtop-tests/test-execution/pom.xml -DskipTests -DskipITs de

Re: Project website

2020-08-20 Thread Olaf Flebbe
Hi Andrew, thanks for reaching out to Bigtop. I reviewed the information you supplied and I feel a bit lost. We are already using a static site generate (mvn site plugin) and uploading this to https://svn.apache.org/repos/infra/websites/staging/bigtop/trunk/content

Re: Project website

2020-08-17 Thread Olaf Flebbe
hi, thanks for sending out a reminder... honestly I am not quite sure how our website really should work. it is a mess of jenkins, maven, subversion and manual steps involved and at some stage it seems to be a CMS in place. imo the complete website setup has to be reenginered. i can offer t

Re: Updated the ci.bigtop.apache.org certificate

2020-06-11 Thread Olaf Flebbe
Thanks! > Am 11.06.2020 um 14:24 schrieb Kengo Seki : > > Just for your information, I've just renewed the certificate for > ci.bigtop.apache.org in accordance with [1]. > Let me know if you find something wrong with it. > > [1]: > https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Se

Re: New Committer: Yuqi Gu

2020-06-10 Thread Olaf Flebbe
Welcome to the Apache Bigtop project, yuqi ! Best Olaf Von meinem iPad gesendet > Am 11.06.2020 um 04:13 schrieb Jun HE : > >  > The Project Management Committee (PMC) for Apache Bigtop has asked Yuqi Gu > to become a committer and we are pleased to announce that he has accepted! > > His

Re: [DISCUSS] [VOTE] Release Ambari-Mpack as a seperate top component in Bigtop

2020-06-09 Thread Olaf Flebbe
t; BigTop by having it's configuration managed by Ambari. Now is a great >>> time >>>> for making this move as HDP is no longer going to be managed by a >>> company, >>>> so BigTop could replace that role in Ambari. >>>> >>>> This mp

Re: [DISCUSS] [VOTE] Release Ambari-Mpack as a seperate top component in Bigtop

2020-06-07 Thread Olaf Flebbe
Hi, Sorry, I am super lost about the implications of that vote. Why do we need a vote in the first place? I am familiar with votes for additional committers, PMC additions and releases. For these votes we have the concept of binding votes by PMC members. Why should I care about this ? Does it h

Re: Bigtop Hadoop 3.2.1 error

2020-06-06 Thread Olaf Flebbe
Hi Thank you for you questions! > Am 06.06.2020 um 10:41 schrieb Jagat Singh : > > Hi, > > I am trying to use Bigtop to create deb file for Hadoop 3.2.1. I am using > Ubuntu 18.04. > > In the process of doing this, many questions came to my mind which I wanted > to learn about. > > 1) I

Re: [DISCUSS] Next Generation Bigtop CI Infra

2020-04-26 Thread Olaf Flebbe
Hi, have some limited experience with Jenkins2 aka Pipeline. IMO this resolves 3) quite nicely. Regarding 2) imo our deployment with docker compose is dead-end. Docker is simply not designed to support whole machine scenarios white systemd as a init process and predictive networking. while lx

Test your account

2020-04-17 Thread Olaf Flebbe
Hi Masatake, please test your account by adding yourself to the member page (Like BIGTOP-2622). You should be able to update the page (see https://cwiki.apache.org/confluence/display/BIGTOP/Deploying+Bigtop%27s+Apache+Website) Best, Olaf

New Bigtop PMC member: Kengo Seki

2020-04-17 Thread Olaf Flebbe
On behalf of the Apache Bigtop Project Management Committee, I am pleased to announce that Kengo Seki has accepted our invitation to join the Bigtop PMC. Please join me in congratulating Kengo! Regards, Olaf (on behalf of the ASF BigTop PMC)

New Committer: Masatake Iwasaki

2020-04-17 Thread Olaf Flebbe
The Project Management Committee (PMC) for Apache Bigtop has asked Masatake Iwasaki to become a committer and we are pleased to announce that he has accepted! Being a committer enables easier contribution to the project since there is no need to go via the proxy patch submission process. This sho

Re: Release-1.4.0

2020-03-08 Thread Olaf Flebbe
inal release tag as well. >> I think make it consistent by adding 1.4.0 and 1.3.0 release tag would be a >> great. >> Thanks for discovering this. >> >> Evans >> >> Olaf Flebbe 於 2020年3月8日 週日 下午5:08寫道: >> >>> Hi, >>> >>> since

[jira] [Created] (BIGTOP-3323) Fix hadoop pom for 1.4 branch

2020-03-08 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3323: --- Summary: Fix hadoop pom for 1.4 branch Key: BIGTOP-3323 URL: https://issues.apache.org/jira/browse/BIGTOP-3323 Project: Bigtop Issue Type: Task Affects

[jira] [Created] (BIGTOP-3322) Lintian Warnings in Hadoop

2020-03-08 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3322: --- Summary: Lintian Warnings in Hadoop Key: BIGTOP-3322 URL: https://issues.apache.org/jira/browse/BIGTOP-3322 Project: Bigtop Issue Type: Task

Release-1.4.0

2020-03-08 Thread Olaf Flebbe
Hi, since Luca Toscano asked, I am considering to add two bugfixes to the 1.4 branch with BIGTOP-3308. I was checking tags first: We have release-1.4.0-RC0 release-1.4.0-RC1 but no release-1.4.0 tag Is it ok to push the "release-1.4.0" tag to latest commit on branch-1.4? Additionally I would a

Updated the ci certificate

2020-02-29 Thread Olaf Flebbe
.. of ci.bigtop.apache.org since it was outdated. See https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Setup+Guide (last paragraph) Does anybody know have an idea why we don't receive email notifications from letsencrypt any more ? Best Olaf

[jira] [Created] (BIGTOP-3318) Use secure repo in bigtop-tests

2020-02-29 Thread Olaf Flebbe (Jira)
Olaf Flebbe created BIGTOP-3318: --- Summary: Use secure repo in bigtop-tests Key: BIGTOP-3318 URL: https://issues.apache.org/jira/browse/BIGTOP-3318 Project: Bigtop Issue Type: Task

Re: CI has to be updated

2020-02-20 Thread Olaf Flebbe
t you can go ahead for sure. I'll check back with you. Olaf Flebbe 於 2020年2月20日 週四 上午6:13寫道: Hi Evans, do you have time to refresh the CI docker image? Seems like jenkins urgently has to be updated. In case you don't have time I can try to find half an hour in the next days. Olaf

CI has to be updated

2020-02-19 Thread Olaf Flebbe
Hi Evans, do you have time to refresh the CI docker image? Seems like jenkins urgently has to be updated. In case you don't have time I can try to find half an hour in the next days. Olaf

Re: Bigtop error on Centos 7

2020-01-23 Thread Olaf Flebbe
hi the failed downloads are http:// downloads http download from nexus are now turned off for security reasons. there was another report for oozie with the same problem on this list iirc. imo this can only be solved by using additional tooling, smthg like a proxy changing http to https . nexus

Re: Happy new year!

2019-12-31 Thread Olaf Flebbe
Hi , happy to see some progress! Wish you all great twenties! olaf > Am 31.12.2019 um 21:35 schrieb Evans Ye : > > Hi folks, > > Another great year at Apache Bigtop. I'm glad for being one of the > community member. > > This year we have a big initiative: cloud native bigtop. I'm very excite

Re: [DISCUSS] Target distros on the 1.5.0 release

2019-11-20 Thread Olaf Flebbe
hi one source of problems was using puppet-forge for instance for puppet-stdlib and puppet-apt, since they require rather new versions. look out for 'puppet module install '. While all distros using apt do have matching prepackaged versions in their repository. other was different search

Re: During debuild, 'dh_strip_nondeterminism' can hang for about 6 hours?

2019-09-18 Thread Olaf Flebbe
Let me tell you I had similar issues when I worked on hadoop3 on amd64. As a workaround i disabled this step. olaf > Am 18.09.2019 um 09:19 schrieb Guodong Xu : > >> On Mon, Sep 16, 2019 at 4:15 PM Youngwoo Kim (김영우) wrote: >> >> Hi Guodong, >> >> It looks strange... I've never seen this be

Re: RFC: Building .tar.gz binary packaging for all components in Bigtop

2019-08-09 Thread Olaf Flebbe
Hi, Thanks. Olaf Am 05.08.19 um 04:07 schrieb Roman Shaposhnik: On Sun, Aug 4, 2019 at 9:42 AM Evans Ye wrote: It is because your input is valuable so we want to take that into consideration seriously. I personally like constructive discussions even if it doesn't look good. It is actually

Re: RFC: Building .tar.gz binary packaging for all components in Bigtop

2019-07-31 Thread Olaf Flebbe
for ages. Olaf Am 29.07.19 um 23:54 schrieb Konstantin Boudnik: Hey Olaf. Sorry, not sure how to read this? Out of the Bigtop or this silly commotion with tar.gz? Hopefully, just the latter one ;) Cos On Mon, Jul 29, 2019 at 10:21PM, Olaf Flebbe wrote: I am out of this project now. Do

Re: RFC: Building .tar.gz binary packaging for all components in Bigtop

2019-07-29 Thread Olaf Flebbe
Hi, 1. People are using docker for packaging and deployment instead of rpm/deb. You can package everything as a container, but it may or may not make sense. 2. Hadoop 3's messy layout don't fit into rpm/deb conventions. Maybe it's because they think it's the right design for the container er

Re: [DISCUSS] Roadmap for the next release.1.5? 2.0?

2019-07-24 Thread Olaf Flebbe
ken into pieces because... well, it is so broken? > > Thanks, > Cos > >> On Mon, Jul 22, 2019 at 10:34PM, Olaf Flebbe wrote: >> Hi, >> >> If I would have only known that google document before ... I am >> asking myself if we should link it from confluence.

Re: [DISCUSS] Roadmap for the next release.1.5? 2.0?

2019-07-22 Thread Olaf Flebbe
Hi, If I would have only known that google document before ... I am asking myself if we should link it from confluence. + hadoop 3. As you may know, I worked on it (bigtop-alpha branch), got it compiled and packaged. However, while testing, I discovered that Hadoop project built on top of so

Re: RFC: Building .tar.gz binary packaging for all components in Bigtop

2019-07-18 Thread Olaf Flebbe
Hi Maybe we have different target groups: For educational users, trying to figure out how everything works together, the single computer cluster is great. This Tar.gz artefact were never ever been sufficient to run in production. They did not contain 64bit libs for instance. They do not provide

Hadoop-3

2019-07-08 Thread Olaf Flebbe
Hi, in case anyone interested: I got Hadoop-3.1.2 somehow packaged for debian-9. Still a ton of configuration files and shortcuts to be adapted. It sits in Branch bigtop-alpha. Trying to reproduce the build with https://ci.bigtop.apache.org/job/Bigtop-alpha/ I am not sure for how long I can

Re: [Bigtop] Some question about build Hadoop on AArch64

2019-07-08 Thread Olaf Flebbe
%20ApacheBigData2015EU%20pub.pdf). ... and really just move away from using local builders of any other sort is that too much of a stretch? On Jul 8, 2019, at 3:11 PM, Olaf Flebbe wrote: Hi Right. This is automated compilation of protobuf is done while preparing the docker images. bigtop_toolchain/manifests

Re: [Bigtop] Some question about build Hadoop on AArch64

2019-07-08 Thread Olaf Flebbe
Hi Right. This is automated compilation of protobuf is done while preparing the docker images. bigtop_toolchain/manifests/protobuf.pp I like to note we use this approach for all platforms for consistency. Best, Olaf On 08.07.19 10:18, Zhenyu Zheng wrote: Hi Yuqi, Thanks for the reply, so

Re: systemd reported fatal error: New main PID [xxx] does not belong to service, and PID file is not owned by root. Refusing.

2019-06-24 Thread Olaf Flebbe
Hi, Systemd version 241 will be in the next stable version of debian, called "buster" Debian Buster is not supported today, anything might happen. Interesting to note that systemd seems to break. Has to be investigated. Guadong Xu, please file a JIRA ticket . I recommend to stick with debian

Re: [ANNOUNCE] Apache Bigtop 1.4.0 released

2019-06-19 Thread Olaf Flebbe
Great work, indeed! Thank you very much Evans! Olaf > Am 18.06.2019 um 21:48 schrieb Jay Vyas : > > Great work Evans .!.!.! > >> On Jun 18, 2019, at 9:28 PM, Jun HE wrote: >> >> Great! Thanks Evans for your hard work. >> >> Evans Ye 于2019年6月19日周三 上午12:07写道: >>> On behalf of the Apache Bigto

Re: [VOTE] Release Bigtop version 1.4.0 (Release Candidate 1)

2019-06-08 Thread Olaf Flebbe
Hi, only found time to check the signatures and checksum. Played for the first time with fedora deployments, seems to have some rough edges, but basically works. +1 Olaf > Am 05.06.2019 um 00:29 schrieb Evans Ye : > > Let's extend the vote to *Sunday, June 9th, 2019 at noon PDT*. > Let me kn

Re: [VOTE] Release Bigtop version 1.4.0

2019-05-17 Thread Olaf Flebbe
gt; Docker version 18.09.2, build 6247962 >> Check docker-compose: >> docker-compose version 1.18.0, build 8dd22a9 >> Check ruby: >> ruby 2.0.0p648 (2015-12-16) [aarch64-linux] >> Pulling bigtop (bigtop/puppet:trunk-centos-7-aarch64)... >> ERROR: manifest for bigto

Re: [VOTE] Release Bigtop version 1.4.0

2019-05-09 Thread Olaf Flebbe
Hi Evans, debian 9 should be supported on ppc64le olaf Von meinem iPad gesendet > Am 10.05.2019 um 03:27 schrieb Evans Ye : > > Yes it's expected. The failure was cause by not having corresponding > images. And all the failed builds are not supported in bigtop: > ARM: opensuse 42.3 > PPC: cent

Re: Question about Hadoop ARM CI

2019-05-04 Thread Olaf Flebbe
Hi Zhenyu, Apache Hadoop (and most of the other Big Data projects) do not care about cross platform, deployment, distribution, configuration, this is were Apache Bigtop jumps in. Cross platform builds (amd64, aarch64, ppc64le) are one of the main features of Apache Bigtop. Right now the jobs

Re: R.I.P. mrdocs (1963–2019)

2019-03-23 Thread Olaf Flebbe
Ruhe in Frieden, Peter

Re: [DISCUSS] Jump to 1.4.0 release directly instead of 1.3.1

2019-03-17 Thread Olaf Flebbe
company the author > might be affiliated with at the moment of writing. > >> On Wed, Mar 13, 2019 at 1:48 AM Olaf Flebbe wrote: >> >> Hi, >> >> We learned the hard way spark1 vs spark2 . Can we drop spark1 now? What do >> you think? >> >&

Re: [DISCUSS] Jump to 1.4.0 release directly instead of 1.3.1

2019-03-12 Thread Olaf Flebbe
st slightly bump it up >> to 2.2.3. >> The new release date is targeted at the end of March. >> >> >> >> Jun HE 於 2019年3月6日 週三 下午9:28寫道: >> >>> Awesome, and huge +1 to this! >>> >>> Konstantin Boudnik 于2019年3月6日周三 下午9:

Re: [DISCUSS] Jump to 1.4.0 release directly instead of 1.3.1

2019-03-04 Thread Olaf Flebbe
Hi Evans, You found and fixed a lot of bugs and made the smoke tests work, so a big +1 . Olaf > Am 04.03.2019 um 08:12 schrieb Evans Ye : > > -1 welcomed as well !!! > > Evans Ye 於 2019年3月4日 週一 下午3:11寫道: > >> Hi all, >> >> The overhaul as well as development is almost completed. With sever

[jira] [Created] (BIGTOP-3178) Fix two insecure maven repositories

2019-02-25 Thread Olaf Flebbe (JIRA)
Olaf Flebbe created BIGTOP-3178: --- Summary: Fix two insecure maven repositories Key: BIGTOP-3178 URL: https://issues.apache.org/jira/browse/BIGTOP-3178 Project: Bigtop Issue Type: Task

Re: Support LZO codec

2019-02-25 Thread Olaf Flebbe
Hi lzo is distributed under GPL. This is incompatible to ASLv2 . See category x https://apache.org/legal/resolved.html#what-can-we-not-include-in-an-asf-project-category-x olaf > Am 25.02.2019 um 17:50 schrieb Mikhail Epikhin : > > Hello. > > Why did you drop lzo codec support? > > I found

Re: [DISCUSS] Upgrade to Puppet 5.X

2019-02-16 Thread Olaf Flebbe
Hi all, some may recall we had this discussion before: I voted to stay at the distro provided packages and modules, since puppetlabs distro does not support our core target of being arch-independent. However, the downside of puppet in general is that we lose recent opensuse leap ( no support f

Re: [DISCUSS] Next minor Release of Apache Bigtop

2019-02-06 Thread Olaf Flebbe
Hi Evans, +1 to your proposal! Happy new year olaf > Am 06.02.2019 um 14:10 schrieb Evans Ye : > > Thank you all for supporting. I'll take the RM role and start driving the > release process. > > Due to limited development capacity of our community, my intention for this > release as well as

Re: [DISCUSS] Next minor Release of Apache Bigtop

2019-02-05 Thread Olaf Flebbe
Overhauling testing is great +1. > Am 03.02.2019 um 12:04 schrieb Evans Ye : > > Hi all, > > I'd like to propose a next minor release of Apache Bigtop, which is 1.3.1. > > Although Bigtop 1.3.0 was released back in Nov. 2018. It's a good sign for > a project to release early, release often. >

Re: Define the future of Apache Bigtop

2019-01-08 Thread Olaf Flebbe
Hi, Thanks all for sharing your views. Since I am not able to invest in Bigtop any more, I will not give recommendations. However I like to share to results of my previous work on topics (1) and (3) (1a) If you see that a particular software does not fit your needs, it is best to work with th

Gitbox (please review)

2019-01-07 Thread Olaf Flebbe
Hi, * CI has been bulk edited. * I updated all (hopefully) pages in confluence (not touching historic pages) * BIGTOP-3128 https://github.com/apache/bigtop/pull/438 has the changes in our repository in place, please review. (This is a monkey replace job) Cheers, Olaf

  1   2   3   4   5   6   7   8   9   10   >