Re: [ANNOUNCE] New Bigtop PMC member Amir Sanjar

2017-05-10 Thread Jonathan Kelly
Congratulations, Amir! On Wed, May 10, 2017 at 9:05 AM Kevin Monroe wrote: > Aaaand there goes the neighborhood ;) > > Congrats Amir!! > > On May 10, 2017 10:40 AM, "Ganesh Raju" wrote: > > > Congratulations! Amir > > > > On Wed, May 10, 2017

Re: N.America apachcon & bigtop meetup

2017-03-27 Thread Jonathan Kelly
I will not be there, but I'm pretty sure one or more of my teammates from EMR will be there. I'll let you know when I find out. ~ Jonathan On Mon, Mar 27, 2017 at 5:52 PM MrAsanjar . wrote: > is there any plans for Bigtop meetups during NA ApacheCon conference in > Miami? >

Re: Fresh zeppelin in bigtop repo

2017-03-17 Thread Jonathan Kelly
Cos, This was already done somewhat recently in https://issues.apache.org/jira/browse/BIGTOP-2689, but of course it's not in the latest release of Bigtop. Viktor, are you asking about the latest release of Bigtop? So maybe Viktor's request aligns with the "Picking up Bigtop 1.2 release" thread

Re: merry xmas team

2017-01-01 Thread Jonathan Kelly
Merry (Belated) Christmas and Happy New Year, Amir, and everybody else too! ~ Jonathan On Sun, Dec 25, 2016 at 5:30 PM MrAsanjar . wrote: > > >

Re: New Committer Jonathan Kelly

2016-12-08 Thread Jonathan Kelly
e <o...@oflebbe.de>: > > > > > The Project Management Committee (PMC) for Apache Bigtop has asked > > > Jonathan Kelly > > > to become a committer and we are pleased to announce that the > invitation > > > was accepted. > > > > >

Re: Test your account

2016-12-08 Thread Jonathan Kelly
All done, thanks! http://bigtop.apache.org/team-list.html On Thu, Dec 8, 2016 at 10:21 AM Jonathan Kelly <jonathaka...@gmail.com> wrote: > Oh, never mind! After "brew install svn" to install a newer version of svn > than what came with my Mac, it worked just fine. > &g

Re: Test your account

2016-12-08 Thread Jonathan Kelly
Olaf, I was able to push my commit to the repo, but I'm having trouble deploying the site, even after following the instructions on https://issues.apache.org/jira/browse/BIGTOP-1639. I'm hitting a different error from what is mentioned there: [ERROR] Failed to execute goal

[jira] [Created] (BIGTOP-2629) Add Jonathan Kelly to team list

2016-12-08 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-2629: -- Summary: Add Jonathan Kelly to team list Key: BIGTOP-2629 URL: https://issues.apache.org/jira/browse/BIGTOP-2629 Project: Bigtop Issue Type: Task

Re: spark compile: solution ?

2016-11-28 Thread Jonathan Kelly
Olaf, are you absolutely sure this is what is happening though? According to http://davidb.github.io/scala-maven-plugin/example_incremental.html, the useZincServer property doesn't actually seem to *start* Zinc; it just causes the build to use it if it is available. This is how the Spark build has

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread Jonathan Kelly
And here's one for upgrading to Spark 2.0.2: https://issues.apache.org/jira/browse/BIGTOP-2592 On Thu, Nov 17, 2016 at 1:39 PM Jonathan Kelly <jonathaka...@gmail.com> wrote: > Here's a new JIRA and patch for that spark-rpm build break: > https://issues.apache.org/jira/browse

[jira] [Created] (BIGTOP-2592) Upgrade to Spark 2.0.2

2016-11-17 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-2592: -- Summary: Upgrade to Spark 2.0.2 Key: BIGTOP-2592 URL: https://issues.apache.org/jira/browse/BIGTOP-2592 Project: Bigtop Issue Type: Task

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread Jonathan Kelly
Here's a new JIRA and patch for that spark-rpm build break: https://issues.apache.org/jira/browse/BIGTOP-2591 On Thu, Nov 17, 2016 at 11:37 AM Jonathan Kelly <jonathaka...@gmail.com> wrote: > Olaf, > > Makes sense. I wasn't sure how you wanted to handle it. I will delete that >

[jira] [Created] (BIGTOP-2591) Fix bug in BIGTOP-2569

2016-11-17 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-2591: -- Summary: Fix bug in BIGTOP-2569 Key: BIGTOP-2591 URL: https://issues.apache.org/jira/browse/BIGTOP-2591 Project: Bigtop Issue Type: Bug

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread Jonathan Kelly
modify/upload patches in resolved jiras > > please open a new one, attach it there and do not forget to use proper > summary. This will increase your karma ! > > i am on the flight /rail back. Will handle this tomorrow evening . (my cet > time zone) > > olaf > > > Am

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread Jonathan Kelly
miss anything? ~ Jonathan On Thu, Nov 17, 2016 at 9:43 AM Jonathan Kelly <jonathaka...@gmail.com> wrote: > What are the build breaks? Are you referring to applications that depend > upon Spark but don't work with Spark 2 yet? There are some patches that I > can probably contri

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread Jonathan Kelly
What are the build breaks? Are you referring to applications that depend upon Spark but don't work with Spark 2 yet? There are some patches that I can probably contribute for fixing these build breaks (your option #2, sorta). Btw, if there are problems that we can't quite fix very well with

Re: Spark 2 and Zeppelin

2016-11-14 Thread Jonathan Kelly
Good point. I can probably contribute a patch for this upgrade. ~ Jonathan On Mon, Nov 14, 2016 at 10:12 AM MrAsanjar . wrote: > Since bigtop spark is about to get upgraded to Spark 2.x, I strongly > recommend to upgrade zeppelin to version 0.6.1 as well. It has spark 2.0 >

Re: Deploy bleeding edge?

2016-06-07 Thread Jonathan Kelly
t 09:08PM, Jonathan Kelly wrote: > > I'm not sure this will work very well, since many apps depend upon other > > apps but have not yet upgraded to support the latest version of their > > dependencies. > > > > For example, Spark 2.0 is going to be released in the next mon

Re: Deploy bleeding edge?

2016-06-07 Thread Jonathan Kelly
I'm not sure this will work very well, since many apps depend upon other apps but have not yet upgraded to support the latest version of their dependencies. For example, Spark 2.0 is going to be released in the next month or so, but Hive, Mahout, Oozie, Zeppelin and possibly more do not yet

Re: Moving away from JDK7

2016-05-03 Thread Jonathan Kelly
Andrew, Which Bigtop apps are affected by this Maven enforcer plugin problem that forces JDK 7? I wasn't aware of that, but I haven't yet tried building Bigtop with JDK 8. I've had success doing the "build with 7, run with 8" approach though, but of course I haven't tried this with all of the

[jira] [Created] (BIGTOP-2414) Rename Tachyon to Alluxio

2016-04-29 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-2414: -- Summary: Rename Tachyon to Alluxio Key: BIGTOP-2414 URL: https://issues.apache.org/jira/browse/BIGTOP-2414 Project: Bigtop Issue Type: Task Affects

Re: mahout-download fails

2016-01-18 Thread Jonathan Kelly
a > successful download. > > The situation might be also caused by the script that chooses the closest > mirror every time you hit the website. Either some mirrors are no good or > script might experience some issues like overload or else. > > Cos > > On Fri, Jan 15, 2016

Re: mahout-download fails

2016-01-15 Thread Jonathan Kelly
also fails with realclean whether run separately or in same invocation) > On Jan 15, 2016, at 8:49 PM, Konstantin Boudnik <c...@apache.org> wrote: > >> On Fri, Jan 15, 2016 at 01:17AM, Jonathan Kelly wrote: >> No, it's not related to new app versions. This happens any time I

Re: mahout-download fails

2016-01-14 Thread Jonathan Kelly
I have noticed errors like this as well. If I add "--stacktrace" to the arguments, I see that the Apache mirror returned a 403 for the URL. As Andrew says, doing a wget on the same exact URL works fine. Also, I'm pretty sure I've noticed that the error only occurs while I'm in the office on the

Re: mahout-download fails

2016-01-14 Thread Jonathan Kelly
> wrote: > If a release has been published just recently, then it might not be on all > mirrors yet. That's the only explanation I have. > > Cos > > On Fri, Jan 15, 2016 at 12:11AM, Jonathan Kelly wrote: > > I have noticed errors like this as well. If I add "--stackt

Re: 1.0 release repos on S3 are not available

2015-10-22 Thread Jonathan Kelly
somebody from S3 how this works, as well as asking (as much of a long shot as it is) whether or not it's possible to recover the data from the old bucket. ~ Jonathan Kelly On Thu, Oct 22, 2015 at 3:45 PM, Konstantin Boudnik <c...@apache.org> wrote: > It might be some sort of name-retenti

Re: Nightly CI build is failing

2015-10-08 Thread Jonathan Kelly
Maven should already be 3.3.3 as of https://issues.apache.org/jira/browse/BIGTOP-1953, right? On Thu, Oct 8, 2015 at 9:32 AM, Konstantin Boudnik wrote: > Looks like we are pretty much all-green on the CI side. Two issues left: > - Mahout expects Maven >=3.3.3 (which I think is

Re: SparkR adds 150+ packages to build

2015-10-06 Thread Jonathan Kelly
ue, Oct 6, 2015 at 2:53 AM, Jonathan Kelly <jonathaka...@gmail.com> > wrote: > > > RJ, > > > > Yes, makes sense. And good point about it meaning more commits. :) Hehe. > > > > ~ Jonathan > > > > On Mon, Oct 5, 2015 at 4:34 PM, RJ Nowling <rnowl

Re: SparkR adds 150+ packages to build

2015-10-05 Thread Jonathan Kelly
as a second patch / JIRA. And I'd like to see the > puppet deployment changed as a third JIRA/PR. > > If you can do that, I can review the first two and get those in. > > I apologize for the extra work but you'll also get more commits this way. > :) > > RJ > > > On

Re: SparkR adds 150+ packages to build

2015-10-05 Thread Jonathan Kelly
Ah, you guys reminded me that I'd completely forgotten to include in my Spark 1.5.1 patch the changes I had made to add R to the toolchain, but it sounds like you don't actually want that added right now anyway? Of course, Spark won't build without it though (after my patch, that is), unless I

Re: Proposed init-hcfs improvements

2015-09-17 Thread Jonathan Kelly
nit-Hdfs.sh should overtime be deleted and replaced with pure hcfs > implementation, so maybe we can do that as part of this work? > > > On Sep 14, 2015, at 8:37 PM, Jonathan Kelly <jonathaka...@gmail.com> > wrote: > > > > Hey, all, > > > > I'm working on som

Proposed init-hcfs improvements

2015-09-14 Thread Jonathan Kelly
rough to init-hcfs.groovy. 4. Finally, init-hcfs.groovy will be changed to read from this YAML file in the format below instead of the hardcoded JSON file we have been using, assuming the community is OK with this file format change. Thanks, Jonathan Kelly [1] hadoop::init_hdfs::hdfs

[jira] [Created] (BIGTOP-1834) Upgrade to Spark 1.3.1

2015-04-16 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-1834: -- Summary: Upgrade to Spark 1.3.1 Key: BIGTOP-1834 URL: https://issues.apache.org/jira/browse/BIGTOP-1834 Project: Bigtop Issue Type: Task

[jira] [Created] (BIGTOP-1795) Upgrade bigtop_toolchain to Maven 3.1

2015-03-31 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-1795: -- Summary: Upgrade bigtop_toolchain to Maven 3.1 Key: BIGTOP-1795 URL: https://issues.apache.org/jira/browse/BIGTOP-1795 Project: Bigtop Issue Type: Task

[jira] [Commented] (BIGTOP-1769) Zeppelin Integration

2015-03-23 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376487#comment-14376487 ] Jonathan Kelly commented on BIGTOP-1769: I had already started working

[jira] [Commented] (BIGTOP-1769) Zeppelin Integration

2015-03-23 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376531#comment-14376531 ] Jonathan Kelly commented on BIGTOP-1769: I looked through more of the build

[jira] [Commented] (BIGTOP-1769) Zeppelin Integration

2015-03-23 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376518#comment-14376518 ] Jonathan Kelly commented on BIGTOP-1769: Oops, sorry, I meant to include

[jira] [Commented] (BIGTOP-1769) Zeppelin Integration

2015-03-23 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377007#comment-14377007 ] Jonathan Kelly commented on BIGTOP-1769: I figured out what was wrong with my

[jira] [Resolved] (BIGTOP-1767) Add facility to puppet manifests for configuring and enabling Ganglia metrics sink in Hadoop

2015-03-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly resolved BIGTOP-1767. Resolution: Duplicate Resolving as duplicate of BIGTOP-921 Add facility to puppet

[jira] [Commented] (BIGTOP-1480) Define BOM for 1.0 release of Bigtop

2015-03-19 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369959#comment-14369959 ] Jonathan Kelly commented on BIGTOP-1480: Yeah, https://issues.apache.org/jira

[jira] [Commented] (BIGTOP-263) we need a way to provide supervision for long running daemon applications

2015-03-18 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367877#comment-14367877 ] Jonathan Kelly commented on BIGTOP-263: --- What about upstart? we need a way

[jira] [Commented] (BIGTOP-1755) Upgrade to Spark 1.3.0

2015-03-17 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366448#comment-14366448 ] Jonathan Kelly commented on BIGTOP-1755: Bigtop doesn't really care about

[jira] [Created] (BIGTOP-1755) Upgrade to Spark 1.3.0

2015-03-13 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-1755: -- Summary: Upgrade to Spark 1.3.0 Key: BIGTOP-1755 URL: https://issues.apache.org/jira/browse/BIGTOP-1755 Project: Bigtop Issue Type: Task

[jira] [Updated] (BIGTOP-1755) Upgrade to Spark 1.3.0

2015-03-13 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated BIGTOP-1755: --- Attachment: BIGTOP-1755.patch Upgrade to Spark 1.3.0

[jira] [Commented] (BIGTOP-1755) Upgrade to Spark 1.3.0

2015-03-13 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361166#comment-14361166 ] Jonathan Kelly commented on BIGTOP-1755: If you're referring to anything like

[jira] [Commented] (BIGTOP-1725) Exclude null values from BOM json output added in BIGTOP-1718

2015-03-13 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361395#comment-14361395 ] Jonathan Kelly commented on BIGTOP-1725: Thanks for the review. I will move

[jira] [Updated] (BIGTOP-1752) Add Zinc to bigtop_toolchain so that it may be used by Spark builds

2015-03-12 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated BIGTOP-1752: --- Attachment: BIGTOP-1752.patch Add Zinc to bigtop_toolchain so that it may be used by Spark

[jira] [Created] (BIGTOP-1752) Add Zinc to bigtop_toolchain so that it may be used by Spark builds

2015-03-11 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-1752: -- Summary: Add Zinc to bigtop_toolchain so that it may be used by Spark builds Key: BIGTOP-1752 URL: https://issues.apache.org/jira/browse/BIGTOP-1752 Project

[jira] [Updated] (BIGTOP-1725) Exclude null values from BOM json output added in BIGTOP-1718

2015-03-05 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/BIGTOP-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated BIGTOP-1725: --- Attachment: BIGTOP-1725.patch Please see BIGTOP-1725.patch instead of the other attached

[jira] [Created] (BIGTOP-1725) Exclude null values from BOM json output added in BIGTOP-1718

2015-03-05 Thread Jonathan Kelly (JIRA)
Jonathan Kelly created BIGTOP-1725: -- Summary: Exclude null values from BOM json output added in BIGTOP-1718 Key: BIGTOP-1725 URL: https://issues.apache.org/jira/browse/BIGTOP-1725 Project: Bigtop