Hi!
apologies for the extra wide distribution (this exhausts my once
a year ASF mail-to-all-bigdata-projects quota ;-)) but I wanted
to suggest that all of you should consider submitting talks
to FOSDEM 2017 HPC, Bigdata and Data Science DevRoom:
https://hpc-bigdata-fosdem17.github.io/
It
As most of you probably know FOSDEM 2016 (the biggest,
100% free open source developer conference) is right
around the corner:
https://fosdem.org/2016/
We hope to have an ASF booth and we would love to see as
many ASF projects as possible present at various tracks
(AKA Developer rooms):
Congrats and welcome!
Thanks,
Roman.
On Wed, Dec 17, 2014 at 7:55 AM, Steve Loughran ste...@hortonworks.com wrote:
On behalf of the Apache Hadoop PMC, I am pleased to announce that Akira
Ajisaka
and Tsuyoshi Ozawa have been elected as committers on the Apache
Hadoop project. We appreciate
Congrats and welcome!
Thanks,
Roman.
On Fri, Dec 5, 2014 at 12:43 PM, Chris Douglas cdoug...@apache.org wrote:
On behalf of the Apache Hadoop PMC, I'm pleased to announce (albeit
belatedly) that Carlo Curino has been elected as a committer on the
project. Congratulations Carlo; thank you for
Congrats and welcome!
Thanks,
Roman.
On Thu, Dec 4, 2014 at 11:56 AM, Sandy Ryza sandy.r...@cloudera.com wrote:
On behalf of the Apache Hadoop PMC, I am pleased to announce that Gera
Shegalov and Robert Kanter have been elected as committers on the Apache
Hadoop project. We appreciate all the
Major congrats! Well done!
Thanks,
Roman.
On Tue, Nov 19, 2013 at 9:27 AM, Alejandro Abdelnur t...@cloudera.com wrote:
On behalf of the Apache Hadoop PMC, I am pleased to announce that Karthik
Kambatla has been elected a committer in the Apache Hadoop project. We
appreciate all the work
On Thu, Oct 24, 2013 at 4:33 PM, Alejandro Abdelnur t...@cloudera.com wrote:
On behalf of the Apache Hadoop PMC, I am pleased to announce that Roman
Shaposhnik has been elected a committer in the Apache Hadoop project. We
appreciate all the work Roman has put into the project so far, and look
On Fri, Oct 18, 2013 at 2:31 PM, Joe Doherty j.dohe...@kitbag.com wrote:
Hi all
My first attempt at installing Hadoop so be gentle!
I was wondering what flavour of Linux is best recommended / supported for
Hadoop.
I hope this isn't a stupid question but being a newbie I'd rather start
Hi!
Apache Bigtop community is happy to announce our
next releaseof Bigtop 0.6.0. This latest release is based
on Hadoop 2.0.5-alpha and it provides full integration
between the following Hadoop ecosystem projects:
* Apache Zookeeper 3.4.5
* Apache Flume 1.3.1
* Apache HBase 0.94.5
*
On Tue, Jun 11, 2013 at 8:54 AM, Tim St Clair tstcl...@redhat.com wrote:
Greetings Hadoop Development Community,
As some of you are aware, we've been looking to bring the upstream 2.X series
into the Fedora channels.
That's pretty awesome! Now, here's a couple question I've got:
1. is
On Wed, May 15, 2013 at 1:20 AM, Matt Foley ma...@apache.org wrote:
Additional features that everybody wants in Hadoop-2 still remain to be
added. We KNOW these will result in non-backward-compatible API changes.
So by trying to do a stability line of code now, we are terminating the
effort
On Tue, May 14, 2013 at 10:40 AM, Arun C Murthy a...@hortonworks.com wrote:
I'll do the 2.1 series by renaming the planned 2.0.5 to 2.1.
Not that it matters anymore (since Konstantin has tabulated the vote) but
I'd like to state for the record that this move:
2.0.5-beta - 2.1
2.0.5 now
On Sat, May 4, 2013 at 3:33 PM, Tsz Wo Sze szets...@yahoo.com wrote:
The proposal sounds like an ideal solution but it is impractical.
I think it is hard to make all API changes now and freezing them.
Either it will just take a long time to finish the API changes, or
we may miss some important
On Wed, May 1, 2013 at 12:53 PM, Konstantin Shvachko
shv.had...@gmail.com wrote:
Please vote on the following plan for Hadoop release 2.0.5
I'm -1 (non-binding) on calling it 2.0.5. It has to be either 2.0.5-alpha
or 2.0.5-beta.
Thanks,
Roman.
P.S. For completeness' sake:
# I'd be +1
On Mon, Apr 29, 2013 at 11:53 AM, Robert Evans ev...@yahoo-inc.com wrote:
This depends on how quickly Yahoo will be off of branch-0.23 and if Yahoo
is the only one maintaining it then it will not receive any bug fixes.
Does that make branch-0.23 any less stable, no. Does it make it less
On Wed, Apr 24, 2013 at 8:17 PM, Konstantin Shvachko
shv.had...@gmail.com wrote:
There was and is a number of discussions about Hadoop version
compatibility, feature porting, stability. I think that many problems of
Hadoop are the result of our flawed release processes and can be solved by
On Thu, Apr 25, 2013 at 8:28 AM, Robert Evans ev...@yahoo-inc.com wrote:
(Putting on my Yahoo! hat now) we at Yahoo! are still
trying to figure out the exact time frame as to when and how we can move
off of 0.23 and on to 2.0. I don't know if we are going to be supporting
0.23 beyond critical
Hi!
Now that Hadoop 2.0.4-alpha is released I'd like
to open up a discussion on what practical steps
would it take for us as a community to get
Hadoop 2.X from alpha to beta?
There's quite a few preconditions to be met for a piece of
software to reach beta status. Quite a few of them are now
On Tue, Apr 9, 2013 at 7:03 PM, Arun C Murthy a...@hortonworks.com wrote:
Thanks Xuan, Vinod and Cos.
I'll spin the rc0 in the next 24hrs.
Once the official RC is ready I'll pull the tarball into the Bigtop infra
and will provide integration testing results.
In fact, I think starting from
Hi!
Thanks to the tireless work of the Bigtop and Hadoop committers
we've made quite a bit of progress on 2.0.4-alpha. The build
pipeline that we've setup seems to be rather nice (and perhaps
could be utilized for all future releases of Hadoop). The first
stage of the pipeline is available here:
On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy a...@hortonworks.com wrote:
Folks,
To fix YARN-429 and a couple of other critical bugs, I've created
branch-2.0.4-alpha and necessary versions in jira etc.
Currently, here is the list of bugs slated for this release:
On Wed, Mar 6, 2013 at 7:24 AM, Arun C Murthy a...@hortonworks.com wrote:
The issue that a downstream
integration project is likely to have is - for once - the absence of
regularly published development artifacts. In the light of it didn't
happen if there's no picture here's a couple of
Hi!
for the past couple of releases of Hadoop 2.X code line the issue
of integration between Hadoop and its downstream projects has
become quite a thorny issue. The poster child here is Oozie, where
every release of Hadoop 2.X seems to be breaking the compatibility
in various unpredictable ways.
with a good strategy of how to recover.
More on that in a few days.
Thanks,
Roman.
On Sun, Feb 10, 2013 at 9:42 PM, Roman Shaposhnik r...@apache.org wrote:
Dear Bigtop and upstream developers,
I would like to submit the following as a proposed
bill of materials (BOM) for Bigtop 0.6.0 release
On Tue, Jan 29, 2013 at 9:51 AM, Arun C Murthy a...@hortonworks.com wrote:
I believe we can disregard MAPREDUCE-4820 since MAPREDUCE-4549 is already in
branch-2. FYI.
Arun, that very well may be the case -- let me take a closer look and
report back (on the JIRA).
Also, any chance you could
On Mon, Jan 28, 2013 at 3:11 PM, Roman Shaposhnik r...@apache.org wrote:
Hi Arun,
On Wed, Jan 16, 2013 at 6:52 AM, Arun C Murthy a...@hortonworks.com wrote:
Happy new year folks!
I'm glad to see that we are down to the last couple of blockers I hope we
can resolve in the next 24-hrs or so
Hi Arun,
On Wed, Jan 16, 2013 at 6:52 AM, Arun C Murthy a...@hortonworks.com wrote:
Happy new year folks!
I'm glad to see that we are down to the last couple of blockers I hope we can
resolve in the next 24-hrs or so.
Once done, I'll create a branch-2.0.3-alpha to unblock branch-2
for
Hi!
Apache Bigtop community is happy to announce our first
TLP release of Bigtop 0.5.0. This latest release is based
on Hadoop 2.0.2-alpha and it provides full integration
between the following Hadoop ecosystem projects:
* Apache Zookeeper 3.4.5
* Apache Flume 1.3.0
* Apache HBase 0.94.2
On Mon, Dec 3, 2012 at 10:02 AM, lohit lohit.vijayar...@gmail.com wrote:
Hello Hadoop Release managers,
Any update on this?
To pile on (and hopefully revive the old thread):
Is there any chance that Hadoop 2.0.3 can
be pushed out before the end of the year?
Also, based on the experience of
On Wed, Oct 17, 2012 at 1:01 PM, Adam Berry ambe...@yahoo-inc.com wrote:
Hello,
Below is a proposal for a new incubator project. This idea came out of and
had strong support on
the general hadoop list, see the thread at
On Tue, Aug 28, 2012 at 7:33 PM, Mattmann, Chris A (388J)
chris.a.mattm...@jpl.nasa.gov wrote:
[decided to minimize traffic and to simply put this in one thread]
Hi Guys,
See the recent discussion on these threads:
YARN as its own Hadoop sub project: http://s.apache.org/WW1
Maintain a
On Thu, May 17, 2012 at 8:16 AM, Thomas Graves tgra...@yahoo-inc.com wrote:
+1, src tarball contents look good, builds, and ran some jobs on a single
node cluster using both built from source and binary.
+1 based on the Bigtop 0.4.0-SNAPSHOT test results.
There were a couple of Mahout
On Wed, May 16, 2012 at 7:15 AM, smith jack thinke...@gmail.com wrote:
but it used to be ant, why abandon ant?
I'd say the following 3 benefits were totally worth the switch:
* standardization of build system
* standardization of dependency management (for both upstream and
downstream
Especially, now that there's a release pending, it would be very nice
to give downstream components a chance to catch up.
Any reason those builds are not happening?
Thanks,
Roman.
On Mon, Mar 19, 2012 at 3:38 PM, Todd Lipcon t...@cloudera.com wrote:
On the other hand, it does suck for users if they update from 1.x to
2.x and they end up losing some bug fixes or features they
previously were running.
Keep in mind that nobody's proposing to rename .22 branch into 2 right
Arun, let me answer both of your questions in the same reply:
On Mon, Mar 19, 2012 at 4:38 PM, Arun C Murthy a...@hortonworks.com wrote:
So, let me ask again - is there anyone willing to step up and fix security in
branch-0.22?
If not, and I haven't seen evidence to the contrary for a very
On Mon, Mar 19, 2012 at 5:13 PM, Arun C Murthy a...@hortonworks.com wrote:
We've discussed several options:
(1) Rename branch-0.22 to branch-2, rename branch-0.23 to branch-3.
(2) Rename branch-0.23 to branch-3, keep branch-0.22 as-is i.e. leave a hole.
(3) Rename branch-0.23 to branch-2,
On Sun, Mar 18, 2012 at 6:31 PM, Arun Murthy a...@hortonworks.com wrote:
Agree. In fact, I'm happy to rename branch-0.23 to branch-Y (Y 1),
if we can agree on the other thread, create the RC.
I agree with Todd (P) that its time to call it some thing other than
0.23, particularly with HDFS
On Sun, Mar 18, 2012 at 8:25 PM, Todd Papaioannou drluckys...@gmail.com wrote:
On Mar 18, 2012, at 7:18 PM, Roman Shaposhnik wrote:
Personally, I'm for branch-3. Regardless of the potential of .22 I'd
rather keep a slot for it. Worse case -- we don't have Hadoop 2 ever.
Well, that would just
Hi Jukka!
Original Message
Subject: Bigtop status (Was: [Incubator Wiki] Update of March2012 by
RomanShaposhnik)
Date: Sat, 10 Mar 2012 12:54:01 +0100
From: Jukka Zitting jukka.zitt...@gmail.com
Reply-To: gene...@incubator.apache.org
To: gene...@incubator.apache.org
Hi,
On Fri, Feb 17, 2012 at 11:23 PM, Arun C Murthy a...@hortonworks.com wrote:
I've created another release candidate for hadoop-0.23.1 that I would like to
release.
It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc2/
The hadoop-0.23.1-rc2 svn tag:
On Wed, Feb 22, 2012 at 7:45 PM, Vinod Kumar Vavilapalli
vino...@hortonworks.com wrote:
Roman,
you are compiling on 64 bit machines?
I'm compiling on both 32bit and 64bit architectures.
not only make it impossible to build the right version
of container executor without hand-editing the
On Wed, Feb 8, 2012 at 1:33 AM, Arun C Murthy a...@hortonworks.com wrote:
I've created a release candidate for hadoop-0.23.1 that I would like to
release.
Not sure whether security is in scope for 0.23.1 but the following
issue is consistently
preventing me from running a kerberized cluster:
On Wed, Feb 8, 2012 at 1:33 AM, Arun C Murthy a...@hortonworks.com wrote:
# Also, several downstream projects (HBase, Pig, Oozie, Hive etc.) seem to
be playing nicely with hadoop-0.23.1.
On that note, it would be really nice if we can, somehow, influence
the only community that
hasn't really
On Wed, Feb 8, 2012 at 10:56 AM, Arun C Murthy a...@hortonworks.com wrote:
Let's continue discussion on jira, we can help debug your environment.
It could very well be an environmental issue, no disagreement there. That said,
given that we've ran into this issue right away suggests that *at
On Wed, Feb 8, 2012 at 1:33 AM, Arun C Murthy a...@hortonworks.com wrote:
I've created a release candidate for hadoop-0.23.1 that I would like to
release.
It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc0/
Pulled this RC into Bigtop, built on all the 6 supported
On Tue, Dec 6, 2011 at 9:13 AM, Owen O'Malley o...@hortonworks.com wrote:
On Mon, Dec 5, 2011 at 10:29 PM, Konstantin Boudnik c...@apache.org wrote:
I am sure things like that are controlled by projects' bylaws that's why
there's nothing specific at the apache level about that.
The vote is
On Tue, Dec 6, 2011 at 11:50 AM, Konstantin Shvachko
shv.had...@gmail.com wrote:
Ok. The vote will run till Saturday.
That is, of course, fine.
The question that I have is a different one: is my understanding of the
process correct and THE ONLY thing that could potentially affect the
outcome
On Sat, Dec 3, 2011 at 10:52 PM, Konstantin Boudnik c...@apache.org wrote:
I agree with you: they artifacts are essentially the same, so there's no need
to reset the vote IMO.
Agreed. I compared the two tarballs and the changes don't warrant retesting
from the standpoint of functionality.
On Sat, Dec 3, 2011 at 5:48 PM, Konstantin Shvachko
shv.had...@gmail.com wrote:
I updated the artifacts.
+1 on releasing Hadoop 0.22
I pulled the artifacts into Bigtop, verified the signatures and built
packages for the
following stack:
Hadoop 0.22 RC
HBase 0.92 RC
Zookeeper 3.4.0
The
On Tue, Nov 29, 2011 at 2:47 AM, Konstantin Shvachko
shv.had...@gmail.com wrote:
I created a release candidate for hadoop-0.22.0 available for review at:
http://people.apache.org/~shv/hadoop-0.22.0-rc0/
Pulled this RC into Bigtop and certified the following stack:
Hadoop 0.22
HBase 0.92
On Thu, Nov 17, 2011 at 2:45 AM, Steve Loughran ste...@apache.org wrote:
-0.23 is a superset of the MR and HDFS APIs compatible with previous
versions (I don't know or care whether or not it is a proper superset or
not). The goal here is that end user apps and higher levels in the stack
On Thu, Nov 17, 2011 at 11:09 AM, Arun C Murthy a...@hortonworks.com wrote:
I don't know which are the ones in 'every single downstream component' - care
to enumerate?
The ones I'm aware of, which have since been fixed are:
https://issues.apache.org/jira/browse/HBASE-4510 -
On Wed, Nov 16, 2011 at 1:11 PM, Matt Foley mfo...@hortonworks.com wrote:
I support giving all three active code branches a clean start, on an equal
footing:
- The next release of 0.20-security (formerly expected as 0.20.205.1) to
be 1.0.0, establishing branch-1.0
- The next release of 0.22
The Apache Bigtop team is pleased to announce the release of Bigtop
0.2.0-incubating from the Apache Incubator (including convenience
Linux repositories).
This is the first release that includes Hadoop 0.20.205.0, Apache Mahout 0.5
and a full set of Puppet deployment code.
The release is
I apologize for the wide distribution, but I don't know of any
other mailing list that would hit all the folks involved in
various Hadoop ecosystem projects except for general@
I think there are quite a few of us attending ApacheCON and
also interested in talking about integrating different
On Wed, Nov 2, 2011 at 3:11 PM, Alan Gates ga...@hortonworks.com wrote:
Roman,
As of Daniel's checkin this morning (see
https://issues.apache.org/jira/browse/PIG-2125) Pig trunk compiles against
0.23.
Perfect! Tiny question: given that you seem to have committed it to
0.10 and 0.9
On Tue, Nov 1, 2011 at 2:47 AM, Arun C Murthy a...@hortonworks.com wrote:
I've created a release candidate for hadoop-0.23.0 that I would like to
release.
Great news!
This should also help downstream projects (Pig, Hive, HBase) start testing
against the 0.23 line.
I would love to help with
On Fri, Oct 28, 2011 at 2:29 AM, Konstantin Shvachko
shv.had...@gmail.com wrote:
2. Assemble build is needed.
By assemble build I mean a Jenkins target which produces a tarball
that includes all three sub-projects. It is like a daily build. One of
this builds is assigned to be release a
On Fri, Oct 28, 2011 at 2:29 AM, Konstantin Shvachko
shv.had...@gmail.com wrote:
Hi everybody,
We reached the homestretch for hadoop-0.22 release.
The testing proceeds very well.
- The builds are building
- HDFS and MR are running under load well now.
- We applied pretty simple custom
On Tue, Oct 18, 2011 at 12:24 PM, Matt Foley ma...@apache.org wrote:
On Friday 14 Oct, the Hadoop community voted ten to zero (including four PMC
members voting in favor) to accept the release of Hadoop 0.20.205.0.
Once we pulled this release into Bigtop the first thing we discovered was
that
Hi Jagane!
On Wed, Oct 5, 2011 at 4:20 PM, Jagane Sundar jag...@apache.org wrote:
For example, if we had a distro with support for the following features:
At the risk of repeating myself I'd like to point out that even though your
ideal distro my not exist at the moment we, as a community, have
On Wed, Oct 5, 2011 at 7:00 PM, Jagane Sundar jag...@apache.org wrote:
As far as deployment automation is concerned, I am eager to know what other
approaches you are familiar with. Chef/Puppet et. al. are not interesting to
me. I want this to have end user self-serve service characteristics,
On Tue, Sep 27, 2011 at 9:55 PM, J. Rottinghuis jrottingh...@gmail.com wrote:
Will have to give BigTop a try...
Let me know if you have any feedback.
With the patch for https://issues.apache.org/jira/browse/PIG-2277 applied
Pig (0.8 for now, and 0.9 in the works) will compile and run against
2011/9/29 milind.bhandar...@emc.com:
[CC'ng Pig-dev].
In terms of interest, what is the community more interested in seeing work
with Hadoop 0.22 ? Pig 0.8.x or Pig.0.9.
I took a look at pig 0.9 added features:
New parser (still has corner cases)
UDFs in languages other than Java
On Wed, Sep 28, 2011 at 11:54 AM, milind.bhandar...@emc.com wrote:
This is great progress folks !!!
Thanks. Actually, for all those who care about .23 I've created a hadoop-0.23
branch in Bigtop and hooked up 3 additional Jenkins jobs:
On Wed, Sep 28, 2011 at 6:56 PM, Ted Yu yuzhih...@gmail.com wrote:
Minor correction to Todd's report, currently HBase TRUNK doesn't compile
against 0.23 (
https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-23/42/console
):
[ERROR]
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-22-branch/75/console
Anybody knows what's going on? Avro update?
avro-generate:
[mkdir] Created dir:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-22-branch/trunk/build/src/org/apache/hadoop/mapreduce/jobhistory
On Fri, Sep 23, 2011 at 7:40 PM, Konstantin Boudnik c...@apache.org wrote:
I'd say let's take a look at how bad are the problems; what are discrepancies?
Do you have any build links or some such to point to?
Sorry. Took me a bit longer to hook up everything to our jenkins. Here's the
URL for
Hi Arun!
Thanks for the quick reply!
I'm sorry if I had too many questions in my original email, but I can't find
an answer to my integration tests question. Could you, please, share
a URL with us where I can find out more about them?
On Mon, Sep 26, 2011 at 11:20 PM, Arun C Murthy
For all those of you who would want to help with testing
Hadoop 0.22 release, I've setup a job on Bigtop to
produce an entire Hadoop stack on top of 0.22.
The good news is that it is now super simple to give it
all a spin. If you are on Ubuntu/Debian you can try:
$ cd /etc/apt/sources.list.d
On Fri, Sep 23, 2011 at 7:40 PM, Konstantin Boudnik c...@apache.org wrote:
I'd say let's take a look at how bad are the problems; what are discrepancies?
Excellent point! In fact, let me hook these jobs to Bigtop's Jenkis so that this
info gets to be seen by anybody who wants to. I'll take care
Hi Arun!
Great news! Hopefuly you wouldn't mind answering some of the questions below...
On Mon, Sep 26, 2011 at 2:07 PM, Arun C Murthy a...@hortonworks.com wrote:
NextGen MapReduce (aka MRv2, aka YARN) is coming along great:
# We are happy to report we've done extensive scale testing to
On Sun, Sep 25, 2011 at 6:02 PM, Konstantin Shvachko
shv.had...@gmail.com wrote:
Good news Roman!
About connecting with other projects.
HBase is compiling with 0.22.
That is trunk of HBase right? IOW, we don't really have a released version
that is compatible with .22?
For Pig there is
On Fri, Sep 16, 2011 at 2:21 AM, Konstantin Shvachko
shv.had...@gmail.com wrote:
== TESTING ==
5. I think Steve's idea of integrating 0.22 with Apache BigTop is
great. Will be glad to see any steps in this direction.
The basic integration is done. We can produce fully functional RPM
and DEB
75 matches
Mail list logo
