Re: svn commit: r1374118 - in /incubator/public/dist: HEADER.html README.html
sebb AT ASF wrote: > I was unable to SVN update the dist area on minotaur. > > Last successful update was by crossley - maybe it will work for you? > If not, infra will probably need to run a cleanup. No, i just now did try. No, not updating for me. -David > On 17 August 2012 01:48, wrote: > > Author: sebb > > Date: Fri Aug 17 00:48:50 2012 > > New Revision: 1374118 > > > > URL: http://svn.apache.org/viewvc?rev=1374118&view=rev > > Log: > > Apache server generates HTML preable and postamble so remove these from > > HEADER and README > > > > Modified: > > incubator/public/dist/HEADER.html > > incubator/public/dist/README.html > > > > Modified: incubator/public/dist/HEADER.html > > URL: > > http://svn.apache.org/viewvc/incubator/public/dist/HEADER.html?rev=1374118&r1=1374117&r2=1374118&view=diff > > == > > --- incubator/public/dist/HEADER.html (original) > > +++ incubator/public/dist/HEADER.html Fri Aug 17 00:48:50 2012 > > @@ -1,9 +1,3 @@ > > - > > - > > - > > -Apache Software Foundation - Index of /dist/incubator > > - > > - > > > >Apache Incubator distribution directory > > > > > > Modified: incubator/public/dist/README.html > > URL: > > http://svn.apache.org/viewvc/incubator/public/dist/README.html?rev=1374118&r1=1374117&r2=1374118&view=diff > > == > > --- incubator/public/dist/README.html (original) > > +++ incubator/public/dist/README.html Fri Aug 17 00:48:50 2012 > > @@ -57,5 +57,3 @@ href="http://www.pc-tools.net/win32/free > > > >We strongly recommend that you verify your downloads with both PGP > > and MD5. > > > > - > > - - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: svn commit: r1374118 - in /incubator/public/dist: HEADER.html README.html
I was unable to SVN update the dist area on minotaur. Last successful update was by crossley - maybe it will work for you? If not, infra will probably need to run a cleanup. On 17 August 2012 01:48, wrote: > Author: sebb > Date: Fri Aug 17 00:48:50 2012 > New Revision: 1374118 > > URL: http://svn.apache.org/viewvc?rev=1374118&view=rev > Log: > Apache server generates HTML preable and postamble so remove these from > HEADER and README > > Modified: > incubator/public/dist/HEADER.html > incubator/public/dist/README.html > > Modified: incubator/public/dist/HEADER.html > URL: > http://svn.apache.org/viewvc/incubator/public/dist/HEADER.html?rev=1374118&r1=1374117&r2=1374118&view=diff > == > --- incubator/public/dist/HEADER.html (original) > +++ incubator/public/dist/HEADER.html Fri Aug 17 00:48:50 2012 > @@ -1,9 +1,3 @@ > - > - > - > -Apache Software Foundation - Index of /dist/incubator > - > - > >Apache Incubator distribution directory > > > Modified: incubator/public/dist/README.html > URL: > http://svn.apache.org/viewvc/incubator/public/dist/README.html?rev=1374118&r1=1374117&r2=1374118&view=diff > == > --- incubator/public/dist/README.html (original) > +++ incubator/public/dist/README.html Fri Aug 17 00:48:50 2012 > @@ -57,5 +57,3 @@ href="http://www.pc-tools.net/win32/free > >We strongly recommend that you verify your downloads with both PGP and > MD5. > > - > - > > > > - > To unsubscribe, e-mail: cvs-unsubscr...@incubator.apache.org > For additional commands, e-mail: cvs-h...@incubator.apache.org > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[VOTE] Release Wink 1.2.1-incubating (RC1)
This is the Apache Wink 1.2.1-incubating release, a minor release which mainly address compilation issues with some implementations of JDK 7.0 compilers. We are requesting a lazy consensus vote, as we have already received 3 binding IPMC +1 votes during the release voting on wink-dev. Vote thread : http://www.mail-archive.com/wink-dev@incubator.apache.org/msg04371.html Vote result: http://www.mail-archive.com/wink-dev@incubator.apache.org/msg04398.html The distribution artifacts and RAT reports are available for review at: http://people.apache.org/~lresende/wink/wink-1.2.1-incubating-RC1/ The release tag is at: https://svn.apache.org/repos/asf/incubator/wink/tags/wink-1.2.1-incubating-RC1/ Staging maven repository is available at repository.apache.org : https://repository.apache.org/index.html#stagingRepositories -- Luciano Resende http://people.apache.org/~lresende http://twitter.com/lresende1975 http://lresende.blogspot.com/ - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] [VOTE] Graduate Apache Any23 from the Apache Incubator
On 16 August 2012 18:55, Mattmann, Chris A (388J) wrote: > Hey Sebb, > > On Aug 16, 2012, at 10:47 AM, sebb wrote: > > X. Establish the Apache Any23 Project > > WHEREAS, the Board of Directors deems it to be in the best > interests of the Foundation and consistent with the Foundation's > purpose to establish a Project Management Committee charged with > the creation and maintenance of open-source software, for > distribution at no charge to the public, related to the automatic > crawling, > parsing and analyzing of data to produce RDF. > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management > Committee (PMC), to be known as the "Apache Any23 Project", > be and hereby is established pursuant to Bylaws of the > Foundation; and be it further > > RESOLVED, that the Apache Any23 Project be and hereby is > responsible for the creation and maintenance of software > related to the automatic crawling, parsing and analyzing of data > to produce RDF and be it further "RDF" on its own seems a little cryptic; perhaps needs expansion. >>> >>> s/RDF/W3C's Resource Description Framework/ ? >> >> That would help define RDF, but that was not my prime concern. >> >> The web-page suggests that Any23 can do more than create RDF files: >> >> "As a command-line tool for extracting and converting between the >> supported formats." >> >> I think that would be outside the scope as defined above. > > How about: > > related to automatic crawling, parsing, analyzing, producing, and converting > RDF > data? > > Sound better? At first glance, with the previous version in mind, it seems better. But when re-read in isolation the phrase implies to me that only RDF data is involved. == Not sure how well known RDF is as a TLA. For avoidance of doubt, perhaps put: RDF (Resource Description Framework) data where necessary. > Cheers, > Chris > > ++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattm...@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++ > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] [VOTE] Graduate Apache Any23 from the Apache Incubator
Hey Sebb, On Aug 16, 2012, at 10:47 AM, sebb wrote: X. Establish the Apache Any23 Project WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to the automatic crawling, parsing and analyzing of data to produce RDF. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Any23 Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Any23 Project be and hereby is responsible for the creation and maintenance of software related to the automatic crawling, parsing and analyzing of data to produce RDF and be it further >>> >>> "RDF" on its own seems a little cryptic; perhaps needs expansion. >> >> s/RDF/W3C's Resource Description Framework/ ? > > That would help define RDF, but that was not my prime concern. > > The web-page suggests that Any23 can do more than create RDF files: > > "As a command-line tool for extracting and converting between the > supported formats." > > I think that would be outside the scope as defined above. How about: related to automatic crawling, parsing, analyzing, producing, and converting RDF data? Sound better? Cheers, Chris ++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++ - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] [VOTE] Graduate Apache Any23 from the Apache Incubator
On 16 August 2012 17:42, Mattmann, Chris A (388J) wrote: > Hi Sebb, > > On Aug 16, 2012, at 9:32 AM, sebb wrote: > >> On 16 August 2012 14:41, Mattmann, Chris A (388J) >> wrote: >>> Hi Folks, >>> >>> We have already called and completed a community VOTE with the Any23 >>> community and the Tika PMC and they have positively recommended Any23's >>> graduation from the Incubator. >> >> According to the Incubator status page, the name search is not yet complete. > > I know Lewis was doing this recently. When we first had the project accepted > into Incubation before Robert finished updating the PODLINGNAMESEARCH > stuff I think I did some searching (on Google/etc.). I'm fairly comfortable > that > we can check this off -- Any23 is fairly obtuse and AFAIK originated at the > research institutions represented by those folks here on the project. > > I'm +1 though to simply update the page and check it off. I or someone else > (Lewis) will do that shortly. > >> >>> VOTE: http://s.apache.org/fU >>> RESULT: http://s.apache.org/VAl >>> >>> I am now calling for a VOTE with the Incubator PMC to graduate Any23 from >>> the Incubator. I'll leave the VOTE open for at least the next 72 hours. >>> >>> [ ] +1 Graduate Any23 from the Apache Incubator. >>> [ ] +0 Don't care. >>> [ ] -1 Don't graduate Any23 from the Apache Incubator because... >>> >>> The Any23 draft board resolution is pasted for your consideration below. >>> >>> Thank you! >>> >>> Cheers, >>> Chris Mattmann >>> Any23 Champion >>> >>> P.S. Here's my +1! >>> >>> - >>> X. Establish the Apache Any23 Project >>> >>> WHEREAS, the Board of Directors deems it to be in the best >>> interests of the Foundation and consistent with the Foundation's >>> purpose to establish a Project Management Committee charged with >>> the creation and maintenance of open-source software, for >>> distribution at no charge to the public, related to the automatic >>> crawling, >>> parsing and analyzing of data to produce RDF. >>> >>> NOW, THEREFORE, BE IT RESOLVED, that a Project Management >>> Committee (PMC), to be known as the "Apache Any23 Project", >>> be and hereby is established pursuant to Bylaws of the >>> Foundation; and be it further >>> >>> RESOLVED, that the Apache Any23 Project be and hereby is >>> responsible for the creation and maintenance of software >>> related to the automatic crawling, parsing and analyzing of data >>> to produce RDF and be it further >> >> "RDF" on its own seems a little cryptic; perhaps needs expansion. > > s/RDF/W3C's Resource Description Framework/ ? That would help define RDF, but that was not my prime concern. The web-page suggests that Any23 can do more than create RDF files: "As a command-line tool for extracting and converting between the supported formats." I think that would be outside the scope as defined above. > Cheers, > Chris > > ++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattm...@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++ > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] [VOTE] Graduate Apache Any23 from the Apache Incubator
Hi, On Thu, Aug 16, 2012 at 5:42 PM, Mattmann, Chris A (388J) wrote: >> >> According to the Incubator status page, the name search is not yet complete. Yep this should have been updated by myself. Having opened the issue, browsed the web and other commonly used resources for such a task I'm also convince that Apache Any23 is a suitable name for us to remain using. For reference the issue you refer to it at [0] which I will duly resolve and close based on my comments above. Thanks for keeping us in check with this one. > I know Lewis was doing this recently. When we first had the project accepted > into Incubation before Robert finished updating the PODLINGNAMESEARCH > stuff I think I did some searching (on Google/etc.). I'm fairly comfortable > that > we can check this off -- Any23 is fairly obtuse and AFAIK originated at the > research institutions represented by those folks here on the project. > > I'm +1 though to simply update the page and check it off. I or someone else > (Lewis) will do that shortly. > +1 will be done by tonight. >> >> "RDF" on its own seems a little cryptic; perhaps needs expansion. > > s/RDF/W3C's Resource Description Framework/ ? > If Chris' suggestion reaches a medium here then I am +1 for editing the proposal based on this. Thanks Lewis [0] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-9 - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[DISCUSS] [VOTE] Graduate Apache Any23 from the Apache Incubator
Hi Sebb, On Aug 16, 2012, at 9:32 AM, sebb wrote: > On 16 August 2012 14:41, Mattmann, Chris A (388J) > wrote: >> Hi Folks, >> >> We have already called and completed a community VOTE with the Any23 >> community and the Tika PMC and they have positively recommended Any23's >> graduation from the Incubator. > > According to the Incubator status page, the name search is not yet complete. I know Lewis was doing this recently. When we first had the project accepted into Incubation before Robert finished updating the PODLINGNAMESEARCH stuff I think I did some searching (on Google/etc.). I'm fairly comfortable that we can check this off -- Any23 is fairly obtuse and AFAIK originated at the research institutions represented by those folks here on the project. I'm +1 though to simply update the page and check it off. I or someone else (Lewis) will do that shortly. > >> VOTE: http://s.apache.org/fU >> RESULT: http://s.apache.org/VAl >> >> I am now calling for a VOTE with the Incubator PMC to graduate Any23 from >> the Incubator. I'll leave the VOTE open for at least the next 72 hours. >> >> [ ] +1 Graduate Any23 from the Apache Incubator. >> [ ] +0 Don't care. >> [ ] -1 Don't graduate Any23 from the Apache Incubator because... >> >> The Any23 draft board resolution is pasted for your consideration below. >> >> Thank you! >> >> Cheers, >> Chris Mattmann >> Any23 Champion >> >> P.S. Here's my +1! >> >> - >> X. Establish the Apache Any23 Project >> >> WHEREAS, the Board of Directors deems it to be in the best >> interests of the Foundation and consistent with the Foundation's >> purpose to establish a Project Management Committee charged with >> the creation and maintenance of open-source software, for >> distribution at no charge to the public, related to the automatic >> crawling, >> parsing and analyzing of data to produce RDF. >> >> NOW, THEREFORE, BE IT RESOLVED, that a Project Management >> Committee (PMC), to be known as the "Apache Any23 Project", >> be and hereby is established pursuant to Bylaws of the >> Foundation; and be it further >> >> RESOLVED, that the Apache Any23 Project be and hereby is >> responsible for the creation and maintenance of software >> related to the automatic crawling, parsing and analyzing of data >> to produce RDF and be it further > > "RDF" on its own seems a little cryptic; perhaps needs expansion. s/RDF/W3C's Resource Description Framework/ ? Cheers, Chris ++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++ - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Graduate Apache Any23 from the Apache Incubator
On 16 August 2012 14:41, Mattmann, Chris A (388J) wrote: > Hi Folks, > > We have already called and completed a community VOTE with the Any23 > community and the Tika PMC and they have positively recommended Any23's > graduation from the Incubator. According to the Incubator status page, the name search is not yet complete. > VOTE: http://s.apache.org/fU > RESULT: http://s.apache.org/VAl > > I am now calling for a VOTE with the Incubator PMC to graduate Any23 from > the Incubator. I'll leave the VOTE open for at least the next 72 hours. > > [ ] +1 Graduate Any23 from the Apache Incubator. > [ ] +0 Don't care. > [ ] -1 Don't graduate Any23 from the Apache Incubator because... > > The Any23 draft board resolution is pasted for your consideration below. > > Thank you! > > Cheers, > Chris Mattmann > Any23 Champion > > P.S. Here's my +1! > > - >X. Establish the Apache Any23 Project > > WHEREAS, the Board of Directors deems it to be in the best > interests of the Foundation and consistent with the Foundation's > purpose to establish a Project Management Committee charged with > the creation and maintenance of open-source software, for > distribution at no charge to the public, related to the automatic > crawling, > parsing and analyzing of data to produce RDF. > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management > Committee (PMC), to be known as the "Apache Any23 Project", > be and hereby is established pursuant to Bylaws of the > Foundation; and be it further > > RESOLVED, that the Apache Any23 Project be and hereby is > responsible for the creation and maintenance of software > related to the automatic crawling, parsing and analyzing of data > to produce RDF and be it further "RDF" on its own seems a little cryptic; perhaps needs expansion. > > RESOLVED, that the office of "Vice President, Apache Any23" be > and hereby is created, the person holding such office to > serve at the direction of the Board of Directors as the chair > of the Apache Any23 Project, and to have primary responsibility > for management of the projects within the scope of > responsibility of the Apache Any23 Project; and be it further > > RESOLVED, that the persons listed immediately below be and > hereby are appointed to serve as the initial members of the > Apache Any23 Project: > > * Lewis John McGibbney > * Paul Ramirez > * Simone Tripodi > * Tommaso Teofili > * Davide Palmisano > * Giovanni Tummarello > * Michele Mostarda > * Reto Bachmann-Gmür > * Szymon Danielczyk > * Andy Seaborne > * Peter AnsellApache ID requested ans...@apache.org> > > > NOW, THEREFORE, BE IT FURTHER RESOLVED, that Michele Mostarda > be appointed to the office of Vice President, Apache Any23 to > serve in accordance with and subject to the direction of the > Board of Directors and the Bylaws of the Foundation until > death, resignation, retirement, removal or disqualification, > or until a successor is appointed; and be it further > > RESOLVED, that the Apache Any23 Project be and hereby > is tasked with the migration and rationalization of the Apache > Incubator Any23 podling; and be it further > > RESOLVED, that all responsibilities pertaining to the Apache > Incubator Any23 podling encumbered upon the Apache Incubator > Project are hereafter discharged. > > ++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattm...@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++ > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Graduate Apache Any23 from the Apache Incubator
On 16/08/12 14:41, Mattmann, Chris A (388J) wrote: Hi Folks, We have already called and completed a community VOTE with the Any23 community and the Tika PMC and they have positively recommended Any23's graduation from the Incubator. VOTE: http://s.apache.org/fU RESULT: http://s.apache.org/VAl I am now calling for a VOTE with the Incubator PMC to graduate Any23 from the Incubator. I'll leave the VOTE open for at least the next 72 hours. [ ] +1 Graduate Any23 from the Apache Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Any23 from the Apache Incubator because... The Any23 draft board resolution is pasted for your consideration below. Thank you! Cheers, Chris Mattmann Any23 Champion P.S. Here's my +1! +1 (binding) The community and project are in good shape. Andy - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [PROPOSAL] Drill for the Apache Incubator
The mailing list request is in infra's hands. One of the better sources of information about Dremel is the BigQuery documentation. That says that the right side of a join must be < 8MB and that the only outer join available is a left out join. What Drill does is somewhat of a different question. On Thu, Aug 16, 2012 at 12:18 AM, Tomer Shiran wrote: > Yes, we plan to support joins. > > We are in the process of setting up the mailing lists. > > On Thu, Aug 16, 2012 at 12:09 AM, karthik tunga >wrote: > > > The proposal looks great. I was wondering what operations will drill > > support ? > > For example the dremel paper doesn't talk about joins, will drill support > > joins ? > > > > Sorry if I missed it, is there a dev mailing list I could subscribe to ? > > > > Cheers, > > Karthik > > > > On 13 August 2012 23:55, Bernd Fondermann > >wrote: > > > > > great proposal and a very promising mentor lineup. > > > > > > Have fun, > > > > > > Bernd > > > > > > On Thu, Aug 2, 2012 at 11:40 PM, Ted Dunning > > wrote: > > > > Abstract > > > > > > > > Drill is a distributed system for interactive analysis of large-scale > > > > datasets, inspired by Google’s Dremel ( > > > > http://research.google.com/pubs/pub36632.html). > > > > > > > > Proposal > > > > > > > > Drill is a distributed system for interactive analysis of large-scale > > > > datasets. Drill is similar to Google’s Dremel, with the additional > > > > flexibility needed to support a broader range of query languages, > data > > > > formats and data sources. It is designed to efficiently process > nested > > > > data. It is a design goal to scale to 10,000 servers or more and to > be > > > able > > > > to process petabyes of data and trillions of records in seconds. > > > > > > > > Background > > > > == > > > > Many organizations have the need to run data-intensive applications, > > > > including batch processing, stream processing and interactive > analysis. > > > In > > > > recent years open source systems have emerged to address the need for > > > > scalable batch processing (Apache Hadoop) and stream processing > (Storm, > > > > Apache S4). In 2010 Google published a paper called “Dremel: > > Interactive > > > > Analysis of Web-Scale Datasets,” describing a scalable system used > > > > internally for interactive analysis of nested data. No open source > > > project > > > > has successfully replicated the capabilities of Dremel. > > > > > > > > Rationale > > > > = > > > > There is a strong need in the market for low-latency interactive > > analysis > > > > of large-scale datasets, including nested data (eg, JSON, Avro, > > Protocol > > > > Buffers). This need was identified by Google and addressed internally > > > with > > > > a system called Dremel. > > > > > > > > In recent years open source systems have emerged to address the need > > for > > > > scalable batch processing (Apache Hadoop) and stream processing > (Storm, > > > > Apache S4). Apache Hadoop, originally inspired by Google’s internal > > > > MapReduce system, is used by thousands of organizations processing > > > > large-scale datasets. Apache Hadoop is designed to achieve very high > > > > throughput, but is not designed to achieve the sub-second latency > > needed > > > > for interactive data analysis and exploration. Drill, inspired by > > > Google’s > > > > internal Dremel system, is intended to address this need. > > > > > > > > It is worth noting that, as explained by Google in the original > paper, > > > > Dremel complements MapReduce-based computing. Dremel is not intended > > as a > > > > replacement for MapReduce and is often used in conjunction with it to > > > > analyze outputs of MapReduce pipelines or rapidly prototype larger > > > > computations. Indeed, Dremel and MapReduce are both used by thousands > > of > > > > Google employees. > > > > > > > > Like Dremel, Drill supports a nested data model with data encoded in > a > > > > number of formats such as JSON, Avro or Protocol Buffers. In many > > > > organizations nested data is the standard, so supporting a nested > data > > > > model eliminates the need to normalize the data. With that said, flat > > > data > > > > formats, such as CSV files, are naturally supported as a special case > > of > > > > nested data. > > > > > > > > The Drill architecture consists of four key components/layers: > > > > * Query languages: This layer is responsible for parsing the user’s > > query > > > > and constructing an execution plan. The initial goal is to support > the > > > > SQL-like language used by Dremel and Google BigQuery ( > > > > https://developers.google.com/bigquery/docs/query-reference), which > we > > > call > > > > DrQL. However, Drill is designed to support other languages and > > > programming > > > > models, such as the Mongo Query Language ( > > > > http://www.mongodb.org/display/DOCS/Mongo+Query+Language), > Cascading ( > > > > http://www.cascading.org/) or Plume ( > https://github
[VOTE] Graduate Apache Any23 from the Apache Incubator
Hi Folks, We have already called and completed a community VOTE with the Any23 community and the Tika PMC and they have positively recommended Any23's graduation from the Incubator. VOTE: http://s.apache.org/fU RESULT: http://s.apache.org/VAl I am now calling for a VOTE with the Incubator PMC to graduate Any23 from the Incubator. I'll leave the VOTE open for at least the next 72 hours. [ ] +1 Graduate Any23 from the Apache Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Any23 from the Apache Incubator because... The Any23 draft board resolution is pasted for your consideration below. Thank you! Cheers, Chris Mattmann Any23 Champion P.S. Here's my +1! - X. Establish the Apache Any23 Project WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to the automatic crawling, parsing and analyzing of data to produce RDF. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Any23 Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Any23 Project be and hereby is responsible for the creation and maintenance of software related to the automatic crawling, parsing and analyzing of data to produce RDF and be it further RESOLVED, that the office of "Vice President, Apache Any23" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Any23 Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Any23 Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Any23 Project: * Lewis John McGibbney * Paul Ramirez * Simone Tripodi * Tommaso Teofili * Davide Palmisano * Giovanni Tummarello * Michele Mostarda * Reto Bachmann-Gmür * Szymon Danielczyk * Andy Seaborne * Peter Ansell NOW, THEREFORE, BE IT FURTHER RESOLVED, that Michele Mostarda be appointed to the office of Vice President, Apache Any23 to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Any23 Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Any23 podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Any23 podling encumbered upon the Apache Incubator Project are hereafter discharged. ++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++ - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Apache OpenMeetings Drupal Plugin 1.0 Incubating Release Candidate 1
I'll wait with Joomla plugin release until this will be resolved . On Wed, Aug 15, 2012 at 2:01 PM, seba.wag...@gmail.com < seba.wag...@gmail.com> wrote: > Lets talk to the legal team and discuss with them I don't think we > will get a definite answer at the incubator list. > > But one question remains: There was already a positive vote for the > Moodle release. I will stop the release process now and will not send > any announce. > I will delete the release from > /var/www.apache.org/dist/incubator/openmeetings again until the legal > issues are resolved. > > Sebastian > > 2012/8/15 Alexei Fedotov : > > What if we double license the code under public domain? > > > > Those who install the plug-in for Drupal, just use public code to create > > their own GPL licensed distribution at that moment. > > 15.08.2012 1:10 пользователь "Christian Grobmeier" > > написал: > > > >> Hi, > >> > >> I can understand having 10 projects on apache-extras is not really > >> great - but legals are more important than comfort. > >> > >> I am afraid I cannot answer the legal question. But my understanding > >> seems to be similar to what Sam Ruby thinks: > >> > >> > http://markmail.org/message/srggkothptvoemxg#query:+page:1+mid:33hztgfyfxdb3jef+state:results > >> > >> I would feel better if we would get a green light from legal here. I > >> know this is an another hurdle for you but if we have one time > >> clarification we never need to it that again. We should also look at > >> the licenses of the other plugins. > >> > >> Cheers > >> Christian > >> > >> > >> > >> On Tue, Aug 14, 2012 at 9:52 PM, seba.wag...@gmail.com > >> wrote: > >> > Hi Christian, > >> > > >> > we have been discussing a similar issue some time ago about the Moodle > >> Plugin: > >> > http://markmail.org/thread/jf2r4ljxgdc7cfqe > >> > > >> > There is also a discussion on legal-discuss list on similar topic: > >> > http://markmail.org/message/srggkothptvoemxg > >> > > >> > As you can see from the list of plugins that we already maintain: > >> > https://builds.apache.org/view/M-R/view/OpenMeetings/ > >> > This is a quite important question. > >> > > >> > Although Apache Extra might be a good place for it legally having 10 > >> > subproject will be a tough task to handle. > >> > > >> > Sebastian > >> > > >> > 2012/8/14 Christian Grobmeier : > >> >> Hello guys, > >> >> > >> >> just was reviewing this release and it looks good so far. I have > >> >> reviewed the content, did not check the sigs at the moment. > >> >> > >> >> One question raised to my mind: Drupal is GPL licensed. You wrote a > >> >> plugin for Drupal. Isn't it the case it needs to be licensed like > >> >> Drupal then? Probably I am paranoid here, but I would love to get a > >> >> clear answer at this. Becuase if that is the case the plug cannot be > >> >> released from the ASF and must go to for example apache-extras.org > >> >> > >> >> Cheers > >> >> Christian > >> >> > >> >> On Tue, Aug 14, 2012 at 3:53 PM, seba.wag...@gmail.com > >> >> wrote: > >> >>> Dear Incubator Members, > >> >>> > >> >>> I would like to start a vote about releasing Apache OpenMeetings > Drupal > >> >>> Plugin 1.0 Incubating Release Candidate 1 > >> >>> > >> >>> There was already a positive vote on the developer mailing list: > >> >>> > >> >>> +1 IPMC: yegor > >> >>> +1 PPMC: solomax, albus, german, aaf(mentor), sebawagner > >> >>> Wider community: Irina > >> >>> > >> >>> Vote Thread: > >> >>> http://markmail.org/message/qufzi46cpl242sqx > >> >>> > >> >>> Changes are in the Changelog: > >> >>> > >> > https://svn.apache.org/repos/asf/incubator/openmeetings/tags/plugins/drupal/1.0RC1/CHANGELOG > >> >>> > >> >>> Release artefacts: > >> >>> http://people.apache.org/~sebawagner/drupal-plugin-1.0-incubating/ > >> >>> > >> >>> Tag: > >> >>> > >> > https://svn.apache.org/repos/asf/incubator/openmeetings/tags/plugins/drupal/1.0RC1 > >> >>> > >> >>> PGP release keys (signed using 93A30395): > >> >>> http://www.apache.org/dist/incubator/openmeetings/KEYS > >> >>> > >> >>> [ ] +1 approve > >> >>> [ ] +0 no opinion > >> >>> [ ] -1 disapprove (and reason why) > >> >>> > >> >>> Thanks! > >> >>> Sebastian > >> >> > >> >> > >> >> > >> >> -- > >> >> http://www.grobmeier.de > >> >> https://www.timeandbill.de > >> >> > >> >> - > >> >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >> >> For additional commands, e-mail: general-h...@incubator.apache.org > >> >> > >> > > >> > > >> > > >> > -- > >> > Sebastian Wagner > >> > https://twitter.com/#!/dead_lock > >> > http://www.webbase-design.de > >> > http://www.wagner-sebastian.com > >> > seba.wag...@gmail.com > >> > > >> > - > >> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >> > For additional commands, e-mail: general-h...@incubator.apache.org > >> > > >> > >> > >> > >> -- > >> http://www.grobmeier.de > >> htt
Re: [PROPOSAL] Drill for the Apache Incubator
Yes, we plan to support joins. We are in the process of setting up the mailing lists. On Thu, Aug 16, 2012 at 12:09 AM, karthik tunga wrote: > The proposal looks great. I was wondering what operations will drill > support ? > For example the dremel paper doesn't talk about joins, will drill support > joins ? > > Sorry if I missed it, is there a dev mailing list I could subscribe to ? > > Cheers, > Karthik > > On 13 August 2012 23:55, Bernd Fondermann >wrote: > > > great proposal and a very promising mentor lineup. > > > > Have fun, > > > > Bernd > > > > On Thu, Aug 2, 2012 at 11:40 PM, Ted Dunning > wrote: > > > Abstract > > > > > > Drill is a distributed system for interactive analysis of large-scale > > > datasets, inspired by Google’s Dremel ( > > > http://research.google.com/pubs/pub36632.html). > > > > > > Proposal > > > > > > Drill is a distributed system for interactive analysis of large-scale > > > datasets. Drill is similar to Google’s Dremel, with the additional > > > flexibility needed to support a broader range of query languages, data > > > formats and data sources. It is designed to efficiently process nested > > > data. It is a design goal to scale to 10,000 servers or more and to be > > able > > > to process petabyes of data and trillions of records in seconds. > > > > > > Background > > > == > > > Many organizations have the need to run data-intensive applications, > > > including batch processing, stream processing and interactive analysis. > > In > > > recent years open source systems have emerged to address the need for > > > scalable batch processing (Apache Hadoop) and stream processing (Storm, > > > Apache S4). In 2010 Google published a paper called “Dremel: > Interactive > > > Analysis of Web-Scale Datasets,” describing a scalable system used > > > internally for interactive analysis of nested data. No open source > > project > > > has successfully replicated the capabilities of Dremel. > > > > > > Rationale > > > = > > > There is a strong need in the market for low-latency interactive > analysis > > > of large-scale datasets, including nested data (eg, JSON, Avro, > Protocol > > > Buffers). This need was identified by Google and addressed internally > > with > > > a system called Dremel. > > > > > > In recent years open source systems have emerged to address the need > for > > > scalable batch processing (Apache Hadoop) and stream processing (Storm, > > > Apache S4). Apache Hadoop, originally inspired by Google’s internal > > > MapReduce system, is used by thousands of organizations processing > > > large-scale datasets. Apache Hadoop is designed to achieve very high > > > throughput, but is not designed to achieve the sub-second latency > needed > > > for interactive data analysis and exploration. Drill, inspired by > > Google’s > > > internal Dremel system, is intended to address this need. > > > > > > It is worth noting that, as explained by Google in the original paper, > > > Dremel complements MapReduce-based computing. Dremel is not intended > as a > > > replacement for MapReduce and is often used in conjunction with it to > > > analyze outputs of MapReduce pipelines or rapidly prototype larger > > > computations. Indeed, Dremel and MapReduce are both used by thousands > of > > > Google employees. > > > > > > Like Dremel, Drill supports a nested data model with data encoded in a > > > number of formats such as JSON, Avro or Protocol Buffers. In many > > > organizations nested data is the standard, so supporting a nested data > > > model eliminates the need to normalize the data. With that said, flat > > data > > > formats, such as CSV files, are naturally supported as a special case > of > > > nested data. > > > > > > The Drill architecture consists of four key components/layers: > > > * Query languages: This layer is responsible for parsing the user’s > query > > > and constructing an execution plan. The initial goal is to support the > > > SQL-like language used by Dremel and Google BigQuery ( > > > https://developers.google.com/bigquery/docs/query-reference), which we > > call > > > DrQL. However, Drill is designed to support other languages and > > programming > > > models, such as the Mongo Query Language ( > > > http://www.mongodb.org/display/DOCS/Mongo+Query+Language), Cascading ( > > > http://www.cascading.org/) or Plume (https://github.com/tdunning/Plume > ). > > > * Low-latency distributed execution engine: This layer is responsible > for > > > executing the physical plan. It provides the scalability and fault > > > tolerance needed to efficiently query petabytes of data on 10,000 > > servers. > > > Drill’s execution engine is based on research in distributed execution > > > engines (eg, Dremel, Dryad, Hyracks, CIEL, Stratosphere) and columnar > > > storage, and can be extended with additional operators and connectors. > > > * Nested data formats: This layer is responsible for supporting various > > > data formats. The init
Re: [PROPOSAL] Drill for the Apache Incubator
The proposal looks great. I was wondering what operations will drill support ? For example the dremel paper doesn't talk about joins, will drill support joins ? Sorry if I missed it, is there a dev mailing list I could subscribe to ? Cheers, Karthik On 13 August 2012 23:55, Bernd Fondermann wrote: > great proposal and a very promising mentor lineup. > > Have fun, > > Bernd > > On Thu, Aug 2, 2012 at 11:40 PM, Ted Dunning wrote: > > Abstract > > > > Drill is a distributed system for interactive analysis of large-scale > > datasets, inspired by Google’s Dremel ( > > http://research.google.com/pubs/pub36632.html). > > > > Proposal > > > > Drill is a distributed system for interactive analysis of large-scale > > datasets. Drill is similar to Google’s Dremel, with the additional > > flexibility needed to support a broader range of query languages, data > > formats and data sources. It is designed to efficiently process nested > > data. It is a design goal to scale to 10,000 servers or more and to be > able > > to process petabyes of data and trillions of records in seconds. > > > > Background > > == > > Many organizations have the need to run data-intensive applications, > > including batch processing, stream processing and interactive analysis. > In > > recent years open source systems have emerged to address the need for > > scalable batch processing (Apache Hadoop) and stream processing (Storm, > > Apache S4). In 2010 Google published a paper called “Dremel: Interactive > > Analysis of Web-Scale Datasets,” describing a scalable system used > > internally for interactive analysis of nested data. No open source > project > > has successfully replicated the capabilities of Dremel. > > > > Rationale > > = > > There is a strong need in the market for low-latency interactive analysis > > of large-scale datasets, including nested data (eg, JSON, Avro, Protocol > > Buffers). This need was identified by Google and addressed internally > with > > a system called Dremel. > > > > In recent years open source systems have emerged to address the need for > > scalable batch processing (Apache Hadoop) and stream processing (Storm, > > Apache S4). Apache Hadoop, originally inspired by Google’s internal > > MapReduce system, is used by thousands of organizations processing > > large-scale datasets. Apache Hadoop is designed to achieve very high > > throughput, but is not designed to achieve the sub-second latency needed > > for interactive data analysis and exploration. Drill, inspired by > Google’s > > internal Dremel system, is intended to address this need. > > > > It is worth noting that, as explained by Google in the original paper, > > Dremel complements MapReduce-based computing. Dremel is not intended as a > > replacement for MapReduce and is often used in conjunction with it to > > analyze outputs of MapReduce pipelines or rapidly prototype larger > > computations. Indeed, Dremel and MapReduce are both used by thousands of > > Google employees. > > > > Like Dremel, Drill supports a nested data model with data encoded in a > > number of formats such as JSON, Avro or Protocol Buffers. In many > > organizations nested data is the standard, so supporting a nested data > > model eliminates the need to normalize the data. With that said, flat > data > > formats, such as CSV files, are naturally supported as a special case of > > nested data. > > > > The Drill architecture consists of four key components/layers: > > * Query languages: This layer is responsible for parsing the user’s query > > and constructing an execution plan. The initial goal is to support the > > SQL-like language used by Dremel and Google BigQuery ( > > https://developers.google.com/bigquery/docs/query-reference), which we > call > > DrQL. However, Drill is designed to support other languages and > programming > > models, such as the Mongo Query Language ( > > http://www.mongodb.org/display/DOCS/Mongo+Query+Language), Cascading ( > > http://www.cascading.org/) or Plume (https://github.com/tdunning/Plume). > > * Low-latency distributed execution engine: This layer is responsible for > > executing the physical plan. It provides the scalability and fault > > tolerance needed to efficiently query petabytes of data on 10,000 > servers. > > Drill’s execution engine is based on research in distributed execution > > engines (eg, Dremel, Dryad, Hyracks, CIEL, Stratosphere) and columnar > > storage, and can be extended with additional operators and connectors. > > * Nested data formats: This layer is responsible for supporting various > > data formats. The initial goal is to support the column-based format used > > by Dremel. Drill is designed to support schema-based formats such as > > Protocol Buffers/Dremel, Avro/AVRO-806/Trevni and CSV, and schema-less > > formats such as JSON, BSON or YAML. In addition, it is designed to > support > > column-based formats such as Dremel, AVRO-806/Trevni and RCFile, and > > row-based f
