Re: [ANNOUNCE] New Bigtop PMC member: Luca Toscano

2023-09-26 Thread Roman Shaposhnik
On Tue, Sep 26, 2023 at 8:48 PM Olaf Flebbe wrote: > > On behalf of the Apache Bigtop PMC, I am pleased to announce that > Luca Toscano (elukey) has accepted the invitation to join the > Bigtop Project Management Committee. > > Please join me in congratulating Luca! Congrats, Luca! Very well dese

Re: [DISCUSS] Add ClickHouse to Bigtop stack

2022-08-02 Thread Roman Shaposhnik
On Mon, Aug 1, 2022 at 10:17 AM 吴治国 wrote: > > Is there any conclusion? Personally, I'd be very excited to see ClickHouse properly integrated. My only concern is how well it would play with the rest of the stack. Have you ever reached out to upstream clickhouse community regarding this? Thanks,

Re: About Ambari

2022-06-07 Thread Roman Shaposhnik
On Tue, Jun 7, 2022 at 12:32 PM 吴治国 wrote: > > Hi Roman, > > Now we know 2 ways to bring back Ambari: > 1、We can find 3 former Ambari PMCs, and Apache community will discuss restart > from TLP. > 2、We can draft a proposal with 1 champion, 3 mentors and start a vote to > discuss restart from incu

Re: About Ambari

2022-06-07 Thread Roman Shaposhnik
On Fri, Jun 3, 2022 at 7:52 PM 吴治国 wrote: > > Of course. > > Hi everyone, > > Here are the details I share with Kengo, Brahma and Michiel: > > Let me explain why we want to restart Ambari's community and the current > status of re-incubation. > > Since Ambari still has large demands, the retireme

Re: Powered By Bigtop

2021-06-30 Thread Roman Shaposhnik
On Mon, Jun 28, 2021 at 10:24 PM Evans Ye wrote: > > Sure. That's a good suggestion. But to me it's hard to gather the > information by solely googling it. Even though there are evidences showing > they're using Bigtop, we can't 100% sure so representing them might be > error-phony. > > I'd really

Re: Interesting blog post from Linkedin

2021-06-12 Thread Roman Shaposhnik
On Fri, Jun 11, 2021 at 9:53 AM Luca Toscano wrote: > Hi everybody, > > > https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr > is a nice blog post reading. There are some interesting follow ups in > my opinion: > > - Fair vs Non-Fair lockin

Re: Wikimedia blogpost about Bigtop

2021-05-17 Thread Roman Shaposhnik
I must say -- I'm very impressed! Great blog post, Luca! Thanks, Roman. On Sun, May 16, 2021 at 1:04 AM Evans Ye wrote: > > Hi Luca, > > I've finished the review and overall I think it's good. We just need to add > more structures/sections/bullets so that users are easily to navigate > through.

Re: The Future of Ambari

2021-04-20 Thread Roman Shaposhnik
A few years in the making indeed! Thanks, Roman. On Sun, Apr 18, 2021 at 9:10 PM Evans Ye wrote: > > Great news. I think it's a good move to have deeper integration with > ambari, and making Bigtop the 1st class offering out of box in Ambari. > > Ganesh Raju 於 2021年4月19日 週一 上午10:13寫道: > > > Jus

Re: WDYT about adding Logstash and Kibana as Bigtop components

2020-03-02 Thread Roman Shaposhnik
This would be a great addition to Bigtop frankly! Thanks, Roman. On Mon, Mar 2, 2020 at 6:00 PM Yuqi Gu wrote: > > BIGTOP-3319 and BIGTOP-3320 are created to follow up it. > Really thanks for you comments and feedback. > > BR, > Yuqi > > On Tue, 3 Mar 2020 at 00:32, Evans Ye wrote: > > > +1. >

Re: Happy new year!

2019-12-31 Thread Roman Shaposhnik
Happy New Year, y'all So great to be among such awesome friends Thanks, Roman. On Tue, Dec 31, 2019 at 3:21 PM Manfred Paul wrote: > > Happy new year to all of you folks! > > For 2020 it would be nice to see Bigtop becoming the new HDP distribution for > Hadoop. Continue like this. > >

Re: Stickers @Apachecon ?

2019-08-20 Thread Roman Shaposhnik
AWESOME On Tue, Aug 20, 2019 at 5:15 PM Youngwoo Kim (김영우) wrote: > > Added to the sticker order. > https://cwiki.apache.org/confluence/display/COMDEV/ApacheCon+NA+2019 > > You'll find the Bigtop stickers and badges at ASF booth. :-) > > Thanks, > Youngwoo > > On Tue, Aug 20, 2019 at 11:25 A

Re: RFC: Building .tar.gz binary packaging for all components in Bigtop

2019-08-04 Thread Roman Shaposhnik
On Sun, Aug 4, 2019 at 9:42 AM Evans Ye wrote: > > It is because your input is valuable so we want to take that into > consideration seriously. I personally like constructive discussions even if > it doesn't look good. It is actually the beauty of the community. And I'd > like to emphasize that al

Re: Question about Hadoop ARM CI

2019-05-03 Thread Roman Shaposhnik
Hi Zhenyu! you may want to ask around on Apache Bigtop mailing list (CCed). We used to have Linaro folks maintain CI pipelines for Hadoop there. Thanks, Roman. On Sun, Apr 28, 2019 at 8:44 PM Zhenyu Zheng wrote: > > Hi, > > I'm from Huawei and currently our team is trying to enable ARM CI for p

Re: R.I.P. mrdocs (1963–2019)

2019-03-25 Thread Roman Shaposhnik
On Sun, Mar 24, 2019 at 7:51 PM Jay Vyas wrote: > > Wow , yeah this is really sad to hear. Peter was a huge morale pillar in the > bigtop community and in others as well . > > R.I.P and thanks to everyone. It would be nice if at some point we could > send something token to his family. That so

R.I.P. mrdocs (1963–2019)

2019-03-22 Thread Roman Shaposhnik
It is with incredibly heavy heart that I have to tell you all about this: https://www.scribus.net/r-i-p-mrdocs-1963-2019/ A lot of us Bigtop folks knew Peter in person and he was every bit the kind of man that made Open Source what it is today. I'm rattled and saddened to hear of his passing.

Re: [DISCUSS] Next minor Release of Apache Bigtop

2019-02-05 Thread Roman Shaposhnik
On Sun, Feb 3, 2019 at 12:05 PM Evans Ye wrote: > Hi all, > > I'd like to propose a next minor release of Apache Bigtop, which is 1.3.1. > > Although Bigtop 1.3.0 was released back in Nov. 2018. It's a good sign for > a project to release early, release often. > > The release will contain the fol

Fwd: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

2018-12-10 Thread Roman Shaposhnik
Guys, will it make sense for us to move voluntarily to beat the crowds and make sure that the service actually works for us? Thanks, Roman. -- Forwarded message - From: Daniel Gruno Date: Fri, Dec 7, 2018 at 8:52 AM Subject: [NOTICE] Mandatory relocation of Apache git repositorie

Re: [VOTE] Release Bigtop version 1.3.0

2018-11-21 Thread Roman Shaposhnik
This is so awesome! Thank you Jun for driving it! And congrats to Youngwoo on officially becoming a chair! Thanks, Roman. On Tue, Nov 20, 2018 at 9:51 PM 김영우 (YoungWoo Kim) wrote: > > Great! > Thank you Jun for dedicating your time and efforts into the 1.3.0 release > as a RM. > > Youngwoo > > O

Re: Bringing AVRO as a dependecy...

2018-10-08 Thread Roman Shaposhnik
On Sun, Oct 7, 2018 at 11:37 PM Konstantin Boudnik wrote: > > Guys, > > I want to bounce a question off the team: what would be the best way to bring > Avro dependency into the stack? I don't think it deserves to be a separate > component per se - after all it serves a niche purpose and doesn't st

Re: [ANNOUNCE] New Bigtop PMC member: Jun He

2018-09-26 Thread Roman Shaposhnik
Congrats Jun! On Wed, Sep 26, 2018 at 1:22 PM, Ganesh Raju wrote: > Congrats! Jun > > Sent from my iPhone > >> On Sep 26, 2018, at 12:19 PM, Evans Ye wrote: >> >> On behalf of the Apache Bigtop Project Management Committee, I am pleased >> to announce that Jun He has accepted our invitation to j

Re: Apachecon

2018-09-23 Thread Roman Shaposhnik
I'm arriving pretty late on Mon (tomorrow). Would love to hang out! On Fri, Sep 21, 2018 at 10:33 PM, Ganesh Raju wrote: > I will be at Apachecon next week, any other Bigtopers will be attending? Will > be good to catchup > > Thanks > Ganesh > > Sent from my iPhone > >> On Sep 17, 2018, at 10:53

Re: Slides for Aarch64

2018-06-21 Thread Roman Shaposhnik
in giving a talk ? > > Thanks, > Ganesh > > On Fri, Jun 15, 2018 at 5:35 PM Roman Shaposhnik > wrote: > >> On Thu, Jun 14, 2018 at 7:14 AM, Naresh Bhat >> wrote: >> > Hi Olaf >> > >> > Yes, we did a presentation. Thank you very much. It

Re: Slides for Aarch64

2018-06-15 Thread Roman Shaposhnik
On Thu, Jun 14, 2018 at 7:14 AM, Naresh Bhat wrote: > Hi Olaf > > Yes, we did a presentation. Thank you very much. It would not have > been possible to achieve this with out support from you guys. > We are thankful to BigTop community. And thank you guys for all the support from Linaro side! Bt

Re: Create multiarch docker images for bigtop-puppet/slaves

2018-05-28 Thread Roman Shaposhnik
Here's a few points from the peanut gallery: in general I find Docker multiarch pretty useful, but at the same time its not like having a schema like: bigtop/:--- wouldn't achieve the same. I'd say go with what feels simpler. As for scripts that create those -- that's just puppet in: https

Re: Settling in to the big chair :-)

2018-05-18 Thread Roman Shaposhnik
On Thu, May 17, 2018 at 6:23 PM, Peter Linnell wrote: > Hello all, > > I just wanted thank everyone who has brought me on board to be the next > chair. I'm hopeful I can meet up to the standards of our prior chairs. Or exceed them? ;-) > Given the project is healthy, active and IMO does not need

Fwd: ASF Board Meeting Summary - May 16, 2018

2018-05-16 Thread Roman Shaposhnik
Major congrats to Peter! Well deserved! Thanks, Roman. -- Forwarded message -- From: Phil Steitz Date: Wed, May 16, 2018 at 5:15 PM Subject: ASF Board Meeting Summary - May 16, 2018 To: committ...@apache.org The May board meeting took place on the 16th. The April minutes were

Re: BoF at FOSDEM : Bigtop future

2018-02-18 Thread Roman Shaposhnik
Well, I guess the time it took me to actually reply to this thread echoes overall point that Olaf is trying to make. A few comments inline: On Tue, Feb 6, 2018 at 2:43 PM, Olaf Flebbe wrote: > Hi, > > we had a BoF room at FOSDEM: Ganesh and Marcin from Linaro and Myself, Roman > attending shortl

Re: FOSDEM

2018-02-01 Thread Roman Shaposhnik
On Thu, Feb 1, 2018 at 11:43 AM, Olaf Flebbe wrote: > Hi, > > Confirmed, I can book a BoF room. > Should we meet: Marcin, Ganesh, Roman or anyone else? Yes. My proposal would be to meet in Bigdata/HPC devroom on Sun. Not sure about time -- but I'll be there quite a bit on Sun. Thanks, Roman.

Re: FOSDEM

2018-01-27 Thread Roman Shaposhnik
I'll be there as well! Arriving to the Train Station South on Fri 21:05, leaving on Mon morning. Would love to hang out with you guys! Btw, as a co-organizer of the Bigdata devroom I wanted to also invite whoever is going to be there to our dinner: Saturday February 3rd 2018 @7pm La Mirabelle

Re: Bigtop/2, Go Container !? Was: Upgrade Zookeeper

2017-12-27 Thread Roman Shaposhnik
On Wed, Dec 27, 2017 at 12:13 AM, Anton Chevychalov wrote: > Note that new YARN supports Docker as payload. So it is really difficult > to put that to containers. It actually isn't that difficult -- nested containers are pretty easy to do -- take a look at how Kubernetes folks are doing it for M

Re: ci red

2017-12-19 Thread Roman Shaposhnik
Wanted to echo Cos and Evans -- thanks a million for taking care of this. And yes log2email would be great -- since that way at least we can keep tabs on things. Thanks, Roman. On Tue, Dec 19, 2017 at 7:04 AM, Evans Ye wrote: > +1 > > We can manually send change logs to c...@bigtop.apache.org >

Re: Future plans? Hadoop 3.0.

2017-12-18 Thread Roman Shaposhnik
On Mon, Dec 18, 2017 at 2:26 AM, Антон Чевычалов wrote: > Hi Everyone! > > Could someone tell me a vision about Bigtop's future. We are trying to > deliver software faster and intend to make some changes in our system to > allow our customer have new versions as fast as it possible. Does it make >

Re: apache bigtop meetup

2017-12-02 Thread Roman Shaposhnik
+1 to FOSDEM On Sat, Dec 2, 2017 at 9:20 AM, Olaf Flebbe wrote: > Hi , > > couple of weeks ago there was a glimpse of discussion of a bigtop meetup. > > I had to work on funding to attend an overseas conference and now I am ready > to plan for 2018: Which conference are you Bigtoppers planning f

Re: [ANNOUNCE] New Bigtop PMC member Kevin Monroe

2017-11-27 Thread Roman Shaposhnik
Congrats Kevin! Well deserved! Thanks, Roman. On Mon, Nov 27, 2017 at 8:50 AM, Evans Ye wrote: > On behalf of the Apache Bigtop Project Management Committee, I am pleased to > announce that Kevin Monroe has accepted our invitation to join the Bigtop > PMC. > > Please join me in congratulating Ke

Re: Releasing 1.2.1

2017-09-25 Thread Roman Shaposhnik
Let me take a look today On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik wrote: > Explicitly adding Rvs in the loop > -- > With regards, > Konstantin (Cos) Boudnik > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > Disclaimer: Opinions expressed in this email are those of the author,

[jira] [Created] (BIGTOP-2881) Greenpulm 5.0 got released - lets switch the Bigtop to it

2017-09-08 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2881: Summary: Greenpulm 5.0 got released - lets switch the Bigtop to it Key: BIGTOP-2881 URL: https://issues.apache.org/jira/browse/BIGTOP-2881 Project: Bigtop

Re: Solr upgrade patch

2017-08-31 Thread Roman Shaposhnik
Awesome! Go ahead! Thanks, Roman. On Thu, Aug 31, 2017 at 2:36 AM, Jun HE wrote: > Hi, Evans, > > Sure, I'm willing and very glad to provide continuous contribution to > bigtop. > > And for solr, I've planed to upgrade exsiting smoke and deploy code to work > with 6.6.0. As you said, it will tak

[jira] [Created] (BIGTOP-2873) A few cosmetic changes to run_itest.sh output

2017-08-23 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2873: Summary: A few cosmetic changes to run_itest.sh output Key: BIGTOP-2873 URL: https://issues.apache.org/jira/browse/BIGTOP-2873 Project: Bigtop Issue

[jira] [Created] (BIGTOP-2871) Make run_itest report Standard Error from tests to stderr

2017-08-17 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2871: Summary: Make run_itest report Standard Error from tests to stderr Key: BIGTOP-2871 URL: https://issues.apache.org/jira/browse/BIGTOP-2871 Project: Bigtop

[jira] [Created] (BIGTOP-2870) testHCFS should be using USER_NAME for expected output

2017-08-17 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2870: Summary: testHCFS should be using USER_NAME for expected output Key: BIGTOP-2870 URL: https://issues.apache.org/jira/browse/BIGTOP-2870 Project: Bigtop

Gitbox enables the full GitHub workflow

2017-08-07 Thread Roman Shaposhnik
Hi! it has just come to my attention that Gitbox at ASF has been enabling full GitHub workflow (with being able to click Merge this PR button, etc.) for quite some time. This basically allows a project to have GH as a R/W repo as opposed to R/O mirror of what we all currnently have: https://gitbo

Re: Crail as part of BigTop

2017-07-10 Thread Roman Shaposhnik
Piling on top of others: I think this also will make an excellent proposal. Any chance you can consider this for: http://www.prnewswire.com/news-releases/odpi-launches-apache-bigtop-grant-fund-program-300472753.html ? Thanks, Roman. On Mon, Jul 10, 2017 at 4:15 PM, Animesh Trivedi wrote: >

I'll have very sporadic email connectivity for the next 3 weeks

2017-07-10 Thread Roman Shaposhnik
Hi! just a quick note that I'll have very sporadic email connectivity for the next 3 weeks. This pretty much means that all the email to the lists will go unnoticed until end of July. If there's something urgent you can try emailing me directly, but no guarantees. See y'all back in Aug! Thanks,

Re: Smoke tests and lotta dependencies in ODPi suite

2017-06-16 Thread Roman Shaposhnik
Sorry for not jumping on this sooner -- this sounds like a great idea. Is there a JIRA associated with this? Thanks, Roman. On Mon, Jun 12, 2017 at 1:03 PM, Konstantin Boudnik wrote: > Roman, > > I noticed that just by running 'gradle wrapper' I can trigger the dependencies > resolution for all

Re: c...@apache.org has invited you to join a Slack team

2017-06-12 Thread Roman Shaposhnik
FYI: there's also this that seems to be more official (idea being one channel per project so it'll be like #bigtop) -- Forwarded message -- From: John D. Ament Date: Wed, Mar 29, 2017 at 6:54 AM Subject: Slack Invites To: "gene...@incubator.apache.org" All, Based on the on-goi

Re: Who's in town for Dataworks Summit?

2017-06-12 Thread Roman Shaposhnik
Based on the Doodle I reserved a table for 10 ppl at Gordon Biersch for 7pm tomorrow 13/6. Here's the address: 33 E San Fernando St, San Jose, CA 95113 See you guys there tomorrow! Thanks, Roman. On Sat, Jun 10, 2017 at 5:14 PM, Roman Shaposhnik wrote: > Great! So it appears there&#x

Re: Who's in town for Dataworks Summit?

2017-06-10 Thread Roman Shaposhnik
no > > > > On 06/07/2017 11:09 AM, MrAsanjar . wrote: >> >> +1 >> >> >> On Wed, Jun 7, 2017 at 12:19 PM, Evans Ye wrote: >> >>> +1 ! >>> >>> 2017-06-08 1:01 GMT+08:00 Roman Shaposhnik : >>> >>>> Hi! >>

Who's in town for Dataworks Summit?

2017-06-07 Thread Roman Shaposhnik
Hi! I know that Cos and I will be attending. Anyone else has definite travel plans for next week? Would be great to hang out. Thanks, Roman.

Re: Bigtop Puppet current status

2017-06-06 Thread Roman Shaposhnik
On Sun, Jun 4, 2017 at 9:32 PM, Evans Ye wrote: > Hi Bigtopers, > > I've shared this on my Apache Big Data talk, but haven't got a chance to > share with you yet. > This is a Jenkins matrix job to show the healthy status of our component > deployment code. > Each run deploys hdfs + Y on X, where X

Re: Reorganizing Bigtop wiki page

2017-05-28 Thread Roman Shaposhnik
I gave evans_ye full perms (including admin). Enjoy! Thanks, Roman. On Sun, May 28, 2017 at 4:04 AM, Evans Ye wrote: > Hi folks, > > Recently I'm organizing our wiki pages. > However, the hierarchal tree on the left hand side looks unfriendly for > users to navigate our stuffs. > > It's much bet

Re: Support of CentOS 7 ARM64 docker-slaves

2017-05-27 Thread Roman Shaposhnik
On Fri, May 26, 2017 at 4:46 AM, Naresh Bhat wrote: > Hi, > > I did a build of docker image, bigtop on ARM64 Cavium ThunderX hardware. > Since there is no existing of centos 7 AArch64 docker-slaves. I have > created a one and the patch is available > https://git.linaro.org/leg/bigdata/bigtop-trun

Re: [DISCUSS] Bigtop 1.2.1 release

2017-05-27 Thread Roman Shaposhnik
On Thu, May 25, 2017 at 6:25 PM, Evans Ye wrote: > Hi Bigtopers, > > Is there any interest in making Bigtop 1.2.1 release? > > I'm a +1 on this due to some fixes/features in Bigtop Sandbox. I'm +1 as well, but I won't be able to help with it much (I can provide guidance tho). > Plus the fix for

Re: Bigtop Lunch gathering @ Apache Big Data North America

2017-05-18 Thread Roman Shaposhnik
#x27;d like to join, meet me at: > > Location: hacking area > Time 1:10 PM > > Here's the roadmap discussion that Roman put up before(Thanks!): > > https://docs.google.com/document/d/1F2Gxu8GARQDZXgqHn12LKkQ5wCV_AF4b_tVmjYB6YfA/edit > > Evans > > 2017-04-03

Re: [ANNOUNCE] New Bigtop PMC member Amir Sanjar

2017-05-10 Thread Roman Shaposhnik
Congrats and welcome to the PMC club! Thanks, Roman. On Wed, May 10, 2017 at 8:18 AM, Evans Ye wrote: > On behalf of the Apache Bigtop Project Management Committee, I am pleased > to announce that Amir Sanjar has accepted our invitation to join the Bigtop > PMC. > > Please join me in congratula

Re: Failed building hadoop-deb

2017-04-29 Thread Roman Shaposhnik
On Tue, Apr 25, 2017 at 11:07 PM, Olaf Flebbe wrote: > Hi, > > There may be issues with netty and zookeeper within hadoop depending on each > other. > https://issues.apache.org/jira/browse/HADOOP-12928 > https://issues.apache.org/jira/browse/HADOOP-13413 > > We have a dependency on curator as well

Re: Failed building hadoop-deb

2017-04-29 Thread Roman Shaposhnik
On Mon, Apr 24, 2017 at 10:49 PM, Olaf Flebbe wrote: > Hi, > > When nobody fixes our CI these kind of errors got unnoticed. Agree. This is pretty embarrassing :-( I was planning to spend some time on 1.2.1 and do some CI improvements as part of that -- but it looks like it only will be possible

Re: Failed building hadoop-deb

2017-04-24 Thread Roman Shaposhnik
Strictly speaking we no longer support 14.04 Thanks, Roman. On Mon, Apr 24, 2017 at 6:46 PM, Andrew Musselman wrote: > From master on Ubuntu 16.04; is there an issue using the ubuntu-14.04 > docker image? > > $ sudo docker run -u jenkins --rm --workdir /ws -v `pwd`:/ws > bigtop/slaves:trunk-ubu

[jira] [Created] (BIGTOP-2746) Migrate to Puppet 4

2017-04-19 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2746: Summary: Migrate to Puppet 4 Key: BIGTOP-2746 URL: https://issues.apache.org/jira/browse/BIGTOP-2746 Project: Bigtop Issue Type: Improvement

Re: new puppet apt module incompatible with puppet 3

2017-04-19 Thread Roman Shaposhnik
Speaking of which, IIRC Puppet 3 is officially EOL starting 2017. Should we collectively invest effort in making sure that Bigtop 1.3 is running 100% on Puppet 4? Do folks know of any issues that would prevent this migration? Thanks, Roman. On Wed, Apr 19, 2017 at 11:14 AM, Kevin Monroe wrote:

Bigtop 1.2.1 ?

2017-04-18 Thread Roman Shaposhnik
Hi! it seems that we may have enough things patched to warrant 1.2.1 Just in case I created the version tag and tagged a few issues with it. I'll let it stew until mid next week and then we can decide. Sounds good? Thanks, Roman.

Re: Bigtop-trunk-packages CI job

2017-04-17 Thread Roman Shaposhnik
On Sun, Apr 16, 2017 at 7:56 AM, Evans Ye wrote: > I found that the link on our home page for ci is broken ( > http://bigtop.apache.org/download.html#releases) > Hence I changed the job name back. Thanks! > In additional, it seems that the packages job is stable enough for all the > platform exc

Re: Bigtop Ambari status?

2017-04-12 Thread Roman Shaposhnik
On Wed, Apr 12, 2017 at 10:40 AM, MrAsanjar . wrote: > Hi > What is the status of Bigtop Ambari 2.5? Is it ready for prime time? It is fairly functional if you deploy it in a certain way (which is, unfortunately true about Ambari in general). Also, it comes with no stacks at all. You're on your

Re: solr

2017-04-11 Thread Roman Shaposhnik
On Tue, Apr 11, 2017 at 8:24 AM, Arnaud Launay wrote: > Le Tue, Apr 11, 2017 at 07:59:24AM -0700, Konstantin Boudnik a écrit: >> No particular reason, except for no one has made the effort to >> update it. If you are interested - that'd be great! > > I've already begun to work on it (4.10.4 doesn'

Re: spark 1.6.x package in bigtop 1.2 repo

2017-04-11 Thread Roman Shaposhnik
so... we are good on this one? Thanks, Roman. On Tue, Apr 11, 2017 at 12:56 PM, MrAsanjar . wrote: > sounds reasonable, thanks > > On Tue, Apr 11, 2017 at 2:07 PM, Evans Ye wrote: > >> So the reason for that is you already have spark 1.6 installed and tried to >> upgrade to 2.1 by apt-get updat

[jira] [Created] (BIGTOP-2736) Automate last mile of release process

2017-04-07 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2736: Summary: Automate last mile of release process Key: BIGTOP-2736 URL: https://issues.apache.org/jira/browse/BIGTOP-2736 Project: Bigtop Issue Type

Bigtop.next roadmap/ideas

2017-04-05 Thread Roman Shaposhnik
Hi! with Bigtop 1.2.0 out, I think it is perfect time for us to start thinking about what we would want to see in Bigtop 1.3.0 and beyond (all the way to Bigtop 2.x). To get our creative juices flowing I've put together a very simple document: https://docs.google.com/document/d/1F2Gxu8GARQDZXgq

Re: [RESULT] [VOTE] Release Bigtop version 1.2.0

2017-04-05 Thread Roman Shaposhnik
On Wed, Apr 5, 2017 at 12:24 PM, Olaf Flebbe wrote: > > Oh yes, you are right ! > > https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-by-jenkins/COMPONENTS=ambari,OS=debian-8/30/console > > Shows an error, but packages anyway ! > > [ERROR] Failed to execute goal on project ambari-metrics-stor

Re: [RESULT] [VOTE] Release Bigtop version 1.2.0

2017-04-05 Thread Roman Shaposhnik
On Wed, Apr 5, 2017 at 2:40 AM, Arnaud Launay wrote: > Le Tue, Apr 04, 2017 at 03:01:04PM -0700, Roman Shaposhnik a écrit: >> Thank you all for taking Bigtop 1.2.0 for a spin! I'll do the final >> steps of release publishing shortly. > > It still doesn't compile un

[RESULT] [VOTE] Release Bigtop version 1.2.0

2017-04-04 Thread Roman Shaposhnik
On Wed, Mar 29, 2017 at 6:51 PM, Roman Shaposhnik wrote: > This is the vote for release 1.2.0 of Apache Bigtop. > > It fixes the following issues: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12334717 > > The vote will close on

Re: N.America apachcon & bigtop meetup

2017-04-03 Thread Roman Shaposhnik
I plan to be there but would appreciate if somebody can help organize us getting together ;-) Thanks, Roman. On Tue, Mar 28, 2017 at 12:01 PM, Evans Ye wrote: > I might be there, though there's no CFP acceptance ;) > I'd like to have a Bigtop meetup. At least we can sync up for the status > and

Re: [VOTE] Release Bigtop version 1.2.0

2017-04-03 Thread Roman Shaposhnik
Hi Ed! On Mon, Apr 3, 2017 at 1:09 PM, Ed Espino wrote: > I'm on the Apache HAWQ Incubator project. Our initial binary release will > be validated against TLP Apache Bigtop. Coincidentally, our release paths > are crossing as both projects are currently in the early stages of their > respective v

[jira] [Created] (BIGTOP-2732) Review RAT exclusion list

2017-04-03 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2732: Summary: Review RAT exclusion list Key: BIGTOP-2732 URL: https://issues.apache.org/jira/browse/BIGTOP-2732 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-2731) come with a way to deal with year in the NOTICE that doesn't require yearly update

2017-04-03 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2731: Summary: come with a way to deal with year in the NOTICE that doesn't require yearly update Key: BIGTOP-2731 URL: https://issues.apache.org/jira/browse/BIGTOP

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-31 Thread Roman Shaposhnik
On Fri, Mar 31, 2017 at 8:49 PM, Konstantin Boudnik wrote: > I have deployed a trivial cluster and ran some MapReduce example and > everything worked! > > The bad news: I found some bugs in the Ignite's deployment (or rather > the discrepancies in 1.9's expectations for the configuration files). >

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-31 Thread Roman Shaposhnik
On Wed, Mar 29, 2017 at 6:51 PM, Roman Shaposhnik wrote: > This is the vote for release 1.2.0 of Apache Bigtop. > > It fixes the following issues: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12334717 > > The vote will close on

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-31 Thread Roman Shaposhnik
On Fri, Mar 31, 2017 at 11:02 AM, Olaf Flebbe wrote: > Hi, > > That's the infamous frontend-maven-plugin, downloading and trying to execute > "node" for amd64 on each arch. Amir, you patched around these issues in the > past ? That's one problem -- but I'm pretty sure its not the only one. Lik

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-31 Thread Roman Shaposhnik
On Fri, Mar 31, 2017 at 10:55 AM, Evans Ye wrote: > -1 Evans, could you please substantiate your -1? > Good news: > Binary convenient packages looks good except ppc64le > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.0/ > > Bad news: > Ambari 2.5 can't build on ppc64le > https://ci.b

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-30 Thread Roman Shaposhnik
On Thu, Mar 30, 2017 at 10:45 AM, Olaf Flebbe wrote: > Hi Roman, > > thanks, for your answer. I am fine with it! > > Next to a bug: > > The release proposition does not contain a valid key: The bigtop.repo.asc > file should contain the gpg key which signed the repository. It i.e. your > public k

Re: [jira] [Created] (BIGTOP-2726) Bump ambari version to 2.5

2017-03-30 Thread Roman Shaposhnik
attach some kind of debug output from Maven? Also, is git available in your build environment? Thanks, Roman. On Thu, Mar 30, 2017 at 11:25 AM, Roman Shaposhnik wrote: > Hi Arnaud! > > this looks like a real issue. Thanks for reporting it. Let me take a look > and possibly cut a new

Re: [jira] [Created] (BIGTOP-2726) Bump ambari version to 2.5

2017-03-30 Thread Roman Shaposhnik
Hi Arnaud! this looks like a real issue. Thanks for reporting it. Let me take a look and possibly cut a new RC. Thanks, Roman. On Thu, Mar 30, 2017 at 10:42 AM, Arnaud Launay wrote: > Le Thu, Mar 30, 2017 at 09:58:16AM -0700, Roman Shaposhnik a écrit: >> Java 7 is no longer supported

Re: [jira] [Created] (BIGTOP-2726) Bump ambari version to 2.5

2017-03-30 Thread Roman Shaposhnik
Java 7 is no longer supported by Bigtop. Thanks, Roman. On Thu, Mar 30, 2017 at 9:18 AM, Arnaud Launay wrote: > Le Tue, Mar 28, 2017 at 07:20:42PM +0000, Roman Shaposhnik (JIRA) a écrit: >> Summary: Bump ambari version to 2.5 > > Does not compile entirely here >

Re: aarch64 binary convenience artifacts for Bigtop 1.2.0

2017-03-30 Thread Roman Shaposhnik
On Thu, Mar 30, 2017 at 8:35 AM, wrote: > Roman, > > > > Absolutely. I can get that done asap. > > Also we would want to look at the cause itself, so we will be trying to do > that as well. Great. You can see one of the leading causes of instability right here: https://ci.bigtop.apache.org/

Re: [VOTE] Release Bigtop version 1.2.0

2017-03-30 Thread Roman Shaposhnik
On Wed, Mar 29, 2017 at 10:54 PM, Olaf Flebbe wrote: > Hi Roman, > > Thanks for you efforts! CI looks really good now. > > What was the consensus for the BIGTOP-2716 ? I honestly think it isn't a blocker and it seems that nobody put a strong argument forward to the contrary. Thus it is now pushed

aarch64 binary convenience artifacts for Bigtop 1.2.0

2017-03-30 Thread Roman Shaposhnik
Hi! as you saw I staged all the convenience artifacts for the release except for the aarch64. That is because the build slave is highly unstable at this point and I can't get a build at all. The symptoms range from docker daemon hanging all the time to the writes failing. I'm starting to suspect

[VOTE] Release Bigtop version 1.2.0

2017-03-29 Thread Roman Shaposhnik
This is the vote for release 1.2.0 of Apache Bigtop. It fixes the following issues: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12334717 The vote will close on Tuesday, April 4th, 2017 at noon PDT. Please download, test and vote with [ ] +1, accept RC1 as

[jira] [Created] (BIGTOP-2727) fix deployment tasks

2017-03-28 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2727: Summary: fix deployment tasks Key: BIGTOP-2727 URL: https://issues.apache.org/jira/browse/BIGTOP-2727 Project: Bigtop Issue Type: Bug

Re: Bigtop 1.2

2017-03-28 Thread Roman Shaposhnik
rent setup. We always can move the stuff >> > when ready. >> > >> > I will work on the URL updates late tonight, after finishing whatever >> > chores I currently have. Or if somebody has a cycle - please chime in >> > ;) >> > >> >

Re: Bigtop 1.2

2017-03-28 Thread Roman Shaposhnik
On Tue, Mar 28, 2017 at 12:25 PM, Konstantin Boudnik wrote: > Great job indeed! And out of these four only two are really material, > so I'd say branching is quite warranted > > However, I suggest we add one more change - rename the provisioner > URLs to repos.bigtop.apache.org instead of what is

Bigtop 1.2

2017-03-28 Thread Roman Shaposhnik
Hi! great news everybody. We're down to only 4 JIRAs for the 1.2 release: https://s.apache.org/4HYY I'll start the branching, etc. today and hope to cut the RC tomorrow. Thanks, Roman.

[jira] [Created] (BIGTOP-2726) Bump ambari version to 2.5

2017-03-28 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2726: Summary: Bump ambari version to 2.5 Key: BIGTOP-2726 URL: https://issues.apache.org/jira/browse/BIGTOP-2726 Project: Bigtop Issue Type: Bug

Re: Docker engine on ARM build slave is down

2017-03-28 Thread Roman Shaposhnik
On Tue, Mar 28, 2017 at 12:07 PM, Evans Ye wrote: > Hi folks, > > It seems that the docker engine on our ARM slave is down: > > https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages-by-jenkins/ > > /usr/bin/docker-current: Cannot connect to the Docker daemon. Is the > docker daemon

[jira] [Created] (BIGTOP-2725) a few usability improvements to run_itest.sh

2017-03-27 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2725: Summary: a few usability improvements to run_itest.sh Key: BIGTOP-2725 URL: https://issues.apache.org/jira/browse/BIGTOP-2725 Project: Bigtop Issue

[jira] [Created] (BIGTOP-2724) putting a final nail in Java's 7 coffin

2017-03-27 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created BIGTOP-2724: Summary: putting a final nail in Java's 7 coffin Key: BIGTOP-2724 URL: https://issues.apache.org/jira/browse/BIGTOP-2724 Project: Bigtop Issue

Re: Releasing 1.2 for non-x86 architectures

2017-03-27 Thread Roman Shaposhnik
On Mon, Mar 27, 2017 at 5:49 PM, MrAsanjar . wrote: > +1 on Roman proposal.. > I ran multiple small smoke tests with x86 zeppelin, spark 1.6.x and tez on > ppc64le and they looked fine. Hadoop however failed when native libraries > were included, as expected. > I would do more extensive testing wh

Re: what happened to ppc64le build?

2017-03-27 Thread Roman Shaposhnik
We're using this URL now: https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages-by-jenkins/ On Mon, Mar 27, 2017 at 10:08 AM, MrAsanjar . wrote: > HI team, > I just realized the path to Bigtop builds for ppc64le is no longer valid. > https://ci.bigtop.apache.org/job/Bigtop-trun

Re: Releasing 1.2 for non-x86 architectures

2017-03-27 Thread Roman Shaposhnik
On Mon, Mar 27, 2017 at 10:05 AM, MrAsanjar . wrote: > we need to be careful here, some components have build dependencies to > other native components. Casing point, Zeppelin, Tez, and Amabri have > dependencies to frontend-maven-plugin that pulls in native NodeJS binary > based on the build syst

Re: Releasing 1.2 for non-x86 architectures

2017-03-25 Thread Roman Shaposhnik
this for you. > Simply add different arch specific packages (which can be found by name). > > I am not sure about the yum side of things. > > > Olaf > > > Am 24.03.2017 um 01:42 schrieb Roman Shaposhnik : > > Hi! > > recent issues surrounding builds on two

Releasing 1.2 for non-x86 architectures

2017-03-23 Thread Roman Shaposhnik
Hi! recent issues surrounding builds on two of our two non-x86 platforms got me thinking that while it is fun to build on them (to iron out kinds in JDK and what not) we don't actually have to release the packages for most of the projects since all those are arch independent. The only ones that AR

Re: Build failed due to OpenJDK 1.8.0_121 changes

2017-03-23 Thread Roman Shaposhnik
There's no 111 :-( Jun, Naresh, Ganesh, out of the list available on the URL Olaf provided -- what should we pick? Thanks, Roman. On Thu, Mar 23, 2017 at 1:28 PM, Olaf Flebbe wrote: >>> >>> So for the incoming 1.2.0 release, to fix this on aarch64/ubuntu-16.04 I >>> see two ways: >>> 1. Downgra

Re: Build failed due to OpenJDK 1.8.0_121 changes

2017-03-23 Thread Roman Shaposhnik
On Thu, Mar 23, 2017 at 7:36 AM, Ganesh Raju wrote: > Forwarding to dev mailing list. Any thoughts ? > > Thanks > Ganesh Raju > > > -- Forwarded message -- > From: Jun He > Date: Thu, Mar 23, 2017 at 5:10 AM > Subject: Build failed due to OpenJDK

  1   2   3   4   5   6   7   8   9   10   >