Re: [VOTE] Release Apache Kylin-0.7.1-incubating
+1 (binding) Verified hash and signature. Compiled on Win7 64bit, JDK 1.7.0_51 Unit test has known issue on Win7, but fine on Mac. On Mon, Jun 8, 2015 at 12:31 PM, Henry Saputra wrote: > Hash files look good > Signature look good > Source download and compiled > Looks like not 3rd party exes > DISCLAIMER file looks good > NOTICE and LICENSE files look good > > > +1 (binding) > > Congrats guys! > > - Henry > > > On Sun, Jun 7, 2015 at 12:49 AM, Luke Han wrote: > > Hi all, > > > > The Apache Kylin community has voted on and approved a proposal to > release > > Apache Kylin 0.7.1 (incubating), the first release of Apache Kylin. > > > > Since this is first release after join Apache Incubating project, we > would > > like to hear more feedback from incubator community and please help to > > verify and vote our release candidate. We already have applied some > > suggestion > > in last vote attempt, please refer to below vote mail thread for detail. > > > > Proposal: > > http://s.apache.org/kylin-0.7.1-vote_rc3 > > > > Vote result: > > 10 binding +1 votes > > 0 non-binding +1 votes > > No -1 votes > > http://s.apache.org/kylin-0.7.1-result_rc3 > > > > > > The commit to be voted upon: > > > https://github.com/apache/incubator-kylin/commit/6a7d07dd79ffc00ba1ece330010275b6f0715de8 > > > > Its hash is 6a7d07dd79ffc00ba1ece330010275b6f0715de8. > > > > The artifacts to be voted on are located here: > > > https://dist.apache.org/repos/dist/dev/incubator/kylin/apache-kylin-0.7.1-incubating-rc3/ > > > > The hashes of the artifacts are as follows: > > src.zip.md5 792f7c984db55927a60aa129001fa9c6 > > src.zip.sha1 2c64e617c8ac7a57140225c0bd737d5f5f66a4e0 > > src.tar.gz.md5 9f196c930c85b0a9d932ce6dee004422 > > src.tar.gz.sha1 74e685aa426cd21f4708a1c84ae11dac3b535f91 > > > > A staged Maven repository is available for review at: > > https://repository.apache.org/content/repositories/orgapachekylin-1006/ > > > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/lukehan.asc > > > > Pursuant to the Releases section of the Incubation Policy and with > > the endorsement of our mentors we would now like to request > > the permission of the Incubator PMC to publish the release. The vote > > is open for 72 hours, or until the necessary number of votes (3 +1) > > is reached. > > > > [ ] +1 Release this package > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > > > Luke Han, on behalf of Apache Kylin PPMC > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [VOTE] Release Apache Kylin-0.7.2-incubating
On Mon, Jul 20, 2015 at 10:30 AM, Owen O'Malley wrote: > * All of the java files are in org.apache.kylin package. Only exceptions > were in the > atopcalcite module: > * net.hydromatic.optiq.runtime > * org.eigenbase.sql2rel > Are those classes coming from a different package? Do you intend to > repackage them? > These files are copied from apache-calcite and made small local changes. The original author is Julian Hyde. I'm sending patches to calcite so that these local override won't be required in future release. Thanks for your support! On Tue, Jul 21, 2015 at 6:15 AM, Julian Hyde wrote: > +1 (binding) > > Checked signature and hashes. > Built and ran unit tests (jdk 1.8, mac os x). > > Julian > > On Jul 20, 2015, at 1:36 PM, Ted Dunning wrote: > > > +1 (binding) > > > > What I did: > > > > Checked signatures and hashes > > Ran unit tests > > Ran RAT, inspected exclusions > > Searched for files with odd permissions, found many executable files > > > > > > > > What I suggest: > > > > Files that don't need to be executable should not be. There are 6 shell > > scripts in the source, but there are another 30 files that are marked as > > executable that should not be. > > > > > > > > On Mon, Jul 20, 2015 at 10:30 AM, Owen O'Malley > wrote: > > > >> * Checked GPG signature and hashes. > >> * Built and ran unit tests. > >> * Checked that all java files had Apache headers. > >> * All of the java files are in org.apache.kylin package. Only exceptions > >> were in the > >> atopcalcite module: > >>* net.hydromatic.optiq.runtime > >>* org.eigenbase.sql2rel > >> Are those classes coming from a different package? Do you intend to > >> repackage them? > >> > >> +1 (binding) > >> > >> > >> On Sat, Jul 18, 2015 at 12:43 AM, Henry Saputra < > henry.sapu...@gmail.com> > >> wrote: > >> > >>> Signature file looks good > >>> Hashes are checked (NOTE next time probably use sha512) > >>> NOTICE file looks good > >>> LICENSE file looks good > >>> DISCLAIMER exists > >>> No 3rd party exes. > >>> > >>> +1 (binding) > >>> > >>> > >>> > >>> On Thu, Jul 16, 2015 at 9:22 PM, Luke Han wrote: > Hi all, > > The Apache Kylin community has voted on and approved a proposal to > >>> release > Apache Kylin 0.7.2 (incubating), the first release of Apache Kylin. > > We already have applied some suggestion > in last vote attempt, please refer to below vote mail thread for > >> detail. > > Proposal: > http://s.apache.org/kylin-0.7.2-vote_rc2 > > Vote result: > http://s.apache.org/kylin-0.7.2-vote_result > > 5 binding +1 votes > 2 non-binding +1 votes > No -1 votes > > > The commit to be voted upon: > > >>> > >> > https://github.com/apache/incubator-kylin/commit/f7a28422645bc209b2c38bb05b24a340444f9066 > > Its hash is f7a28422645bc209b2c38bb05b24a340444f9066. > > The artifacts to be voted on are located here: > > >>> > >> > https://dist.apache.org/repos/dist/dev/incubator/kylin/apache-kylin-0.7.2-incubating-rc2/ > > The hashes of the artifacts are as follows: > src.tar.gz.md5 334c0981d0a258f2d83402bdb75486dd > src.tar.gz.sha1 c377bcb7be17e0ad5540ce2a3d1366cc0c451eda > > A staged Maven repository is available for review at: > > >> https://repository.apache.org/content/repositories/orgapachekylin-1008/ > > Release artifacts are signed with the following key: > https://people.apache.org/keys/committer/lukehan.asc > > Pursuant to the Releases section of the Incubation Policy and with > the endorsement of our mentors we would now like to request > the permission of the Incubator PMC to publish the release. The vote > is open for 72 hours, or until the necessary number of votes (3 +1) > is reached. > > [ ] +1 Release this package > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > +1 from Luke > > Luke Han, on behalf of Apache Kylin PPMC > >>> > >>> - > >>> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >>> For additional commands, e-mail: general-h...@incubator.apache.org > >>> > >>> > >> > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [VOTE] Graduate Calcite from the Apache Incubator
+1 (non-binding) :-) On Wed, Sep 16, 2015 at 10:45 AM, Nick Dimiduk wrote: > +1 (non-binding) > > On Monday, September 14, 2015, Julian Hyde wrote: > > > This is a vote for Calcite to become a top-level project. > > > > Since joining the Incubator in May, 2014, the Calcite > > community has: > > * Produced eight IPMC-approved releases under two release > > managers; > > * Added five new committers and one new PPMC member; > > * Collaborated successfully with several other Apache > > projects (Drill, Hive, Kylin, Phoenix, Samza); > > * Grown into an active community (typical monthly activity > > is 100 emails, 30 commits and 20 issues fixed); > > * Conducted a successful community vote to graduate with > > 20 +1 votes, of which 2 were from our mentors, 12 were > > from committers, and 6 were from IPMC members. > > > > Further information: the discussion on the dev list [1], > > vote thread [2] and result [3]. Also relevant are the > > incubation status page [4] and a thread on this list > > requesting review of whether Calcite met the criteria to > > graduate [5]. > > > > Below is our proposed resolution for the Board. > > > > Please vote: > > > > [ ] +1 Graduate Apache Calcite as a top-level project > > [ ] +0 > > [ ] -1 Do not graduate Apache Calcite because… > > > > Here is my vote: > > +1 (binding) > > > > Voting will last 72 hours, ending at 19:00 Pacific on > > September 17th. > > > > Julian Hyde, on behalf of Calcite PPMC > > > > [1] http://s.apache.org/ZPC > > [2] http://s.apache.org/rvB > > [3] http://s.apache.org/sv > > [4] http://incubator.apache.org/projects/calcite.html > > [5] http://s.apache.org/itP > > > > - - - snip - - - > > > > WHEREAS, the Board of Directors deems it to be in the best > > interests of the Foundation and consistent with the > > Foundation's purpose to establish a Project Management > > Committee charged with the creation and maintenance of > > open-source software, for distribution at no charge to the > > public, related to parsing and planning queries on data in a > > wide variety of formats. > > > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management > > Committee (PMC), to be known as the "Apache Calcite > > Project", be and hereby is established pursuant to Bylaws of > > the Foundation; and be it further > > > > RESOLVED, that the Apache Calcite Project be and hereby is > > responsible for the creation and maintenance of software > > related to parsing and planning queries on data in a wide > > variety of formats; and be it further > > > > RESOLVED, that the office of "Vice President, Apache > > Calcite" be and hereby is created, the person holding such > > office to serve at the direction of the Board of Directors > > as the chair of the Apache Calcite Project, and to have > > primary responsibility for management of the projects within > > the scope of responsibility of the Apache Calcite Project; > > and be it further > > > > RESOLVED, that the persons listed immediately below be and > > hereby are appointed to serve as the initial members of the > > Apache Calcite Project: > > > > * Alan Gates > > * Aman Sinha > > * Ashutosh Chauhan > > * James R. Taylor > > * Jacques Nadeau > > * Jesús Camacho Rodríguez > > * Jinfeng Ni > > * John Pullokkaran > > * Julian Hyde > > * Nick Dimiduk > > * Steven Noels > > * Ted Dunning > > * Vladimir Sitnikov > > > > NOW, THEREFORE, BE IT FURTHER RESOLVED, that Julian Hyde be > > appointed to the office of Vice President, Apache Calcite, > > to serve in accordance with and subject to the direction of > > the Board of Directors and the Bylaws of the Foundation > > until death, resignation, retirement, removal or > > disqualification, or until a successor is appointed; and be > > it further > > > > RESOLVED, that the Apache Calcite Project be and hereby is > > tasked with the migration and rationalization of the Apache > > Incubator Calcite podling; and be it further > > > > RESOLVED, that all responsibilities pertaining to the Apache > > Incubator Calcite podling encumbered upon the Apache > > Incubator Project are hereafter discharged. > > > > - - - end - - - > > > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > >
Re: 回复: [VOTE] Graduate Apache Kylin from the Apache Incubator
+1 :-) On Sat, Oct 17, 2015 at 7:17 AM, Saha, Debashis wrote: > +1 > > -Original Message- > From: 蒋旭 [mailto:jiangxu.ch...@qq.com] > Sent: Friday, October 16, 2015 1:23 AM > To: general > Subject: 回复: [VOTE] Graduate Apache Kylin from the Apache Incubator > > +1 > Jiang Xu > -- 原始邮件 -- > 发件人: "Henry Saputra";; > 发送时间: 2015年10月16日(星期五) 上午9:16 > 收件人: "general@incubator.apache.org"; > > 主题: Re: [VOTE] Graduate Apache Kylin from the Apache Incubator > > > > +1 (binding) > > On Thursday, October 15, 2015, Luke Han wrote: > > > The Apache Kylin community and project made significant advances > > during the incubating (from Nov 2014) and believes it is ready to > > graduate as a top-level project. > > > > The Apache Kylin is very active. The PPMC doubled in size (added 6 > > committers and 2 mentors) and increased diversity in the past year. > > Released 3 version in the past 6 months. There were presentations > > about Apache Kylin at most of the big conferences of the world > > (including Strata+Hadoop World London, Hadoop Summit San Jose, > > ApacheCon EU, Big Data Technology China, Database Technology > > Conference > > China) and some meetups (Bay Area, > > Beijing and one is coming in this weekend in Shanghai), and many talks > > around the world. > > The dev mailing list is growing very month, about 500+ topics per > > month now. > > The community created 1000+ JIRA tickets, many patches from > > contributors/committers have been merged into code base. > > > > A vote passed unanimously on the dev@ list (27 +1 votes). Please find > > below references to the graduation preparation artifacts: > > * discussion on dev list [1] > > * vote thread [2] > > * podling name search [3] > > * incubation status [4] > > * proposed resolution below > > > > We believe Apache Kylin is ready to become a top-level project and if > > the IPMC agree we will move to a formal vote. > > There are a few more items to be updated on the project status page > > and others during the next couple of days. > > > > > > Many thanks to the mentors and the IPMC for the support, Luke Han (on > > behalf of the Apache Kylin PPMC) > > > > [1] http://s.apache.org/KylinDisGraduate > > [2] http://s.apache.org/KylinGraduateVote > > [3] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-86 > > [4] http://incubator.apache.org/projects/kylin.html > > > > > > > > Apache Kylin top-level project resolution: > > === > > > >WHEREAS, the Board of Directors deems it to be in the best > >interests of the Foundation and consistent with the > >Foundation's purpose to establish a Project Management > >Committee charged with the creation and maintenance of > >open-source software, for distribution at no charge to the > >public, relative to distributed and scalable OLAP engine > > > >NOW, THEREFORE, BE IT RESOLVED, that a Project Management > >Committee (PMC), to be known as the "Apache Kylin Project", > >be and hereby is established pursuant to Bylaws of the > >Foundation; and be it further > > > >RESOLVED, that the Apache Kylin Project be and hereby is > >responsible for the creation and maintenance of open-source > >software related to distributed and scalable OLAP engine; > >and be it further > > > >RESOLVED, that the office of "Vice President, Kylin" be and > >hereby is created, the person holding such office to serve at > >the direction of the Board of Directors as the chair of the > >Apache Kylin Project, and to have primary responsibility for > >management of the projects within the scope of responsibility > >of the Apache Kylin Project; and be it further > > > >RESOLVED, that the persons listed immediately below be and > >hereby are appointed to serve as the initial members of the > >Apache Kylin Project: > > > > * Dayue Gao > > * Jason Zhong > > * Julian Hyde > > * Luke Han > > * Henry Saputra > > * Hongbin Ma > > * Hua Huang > > * Owen O'Malley > > * P. Taylor Goetz > > * Qianhao Zhou > > * Shaofeng Shi > > * Song Yi > > * Ted Dunning > > * Xu Jiang > > * Yang Li > > * Yerui Sun < sunyerui at apache dot org> > > > > > >NOW, THEREFORE, BE IT FURTHER RESOLVED, that Luke Han > >be appointed to the office of Vice President,Apache Kylin, to > serve > >in accordance with and subject to the direction of the Board of > >Directors and the Bylaws of the Foundation until death, > >resignation, retirement, removal or disqualification, or until > >a successor is appointed; and be it further > > > >RESOLVED, that the initial Apache Kylin Project be and hereby > >is tasked with the creation of a set of bylaws
Re: [VOTE] Release Apache Kylin 1.1-incubating (rc1)
+1 Checksum is correct. Unit test passed on java version "1.7.0_71", OpenJDK Runtime Environment (rhel-2.5.3.1.el6-x86_64 u71-b14) On Thu, Oct 15, 2015 at 10:00 AM, Luke Han wrote: > +1 > > MD5 & SHA1 checksum verified > License files are all there > > Unit Test passed > > > > Best Regards! > - > > Luke Han > > On Thu, Oct 15, 2015 at 9:42 AM, ShaoFeng Shi > wrote: > > > Hi all, > > > > The Apache Kylin community has voted on and approved a proposal to > release > > Apache Kylin 1.1-incubating. > > > > Proposal:http://s.apache.org/Jzu > > > > Vote result: > > 7 binding +1 votes > > 6 non-binding +1 votes > > No -1 voteshttp://s.apache.org/kylin-1.1-result_rc1 > > > > > > The commit to be voted > > upon: > > > https://github.com/apache/incubator-kylin/commit/1955a2f9aea7b7f608f0496c00807715ea4246a5 > > > > Its hash is 1955a2f9aea7b7f608f0496c00807715ea4246a5. > > > > The artifacts to be voted on are located > > here: > > > https://dist.apache.org/repos/dist/dev/incubator/kylin/apache-kylin-1.1-incubating-rc1/ > > > > The hashes of the artifacts are as follows: > > apache-kylin-1.1-incubating-src.tar.gz.md5 > 18dfbb012e1eb807b1a5c1b134a537aa > > apache-kylin-1.1-incubating-src.tar.gz.sha1 > > 041ee010c67a0b5611d9dd06f7fd6f37388c5374 > > > > A staged Maven repository is available for review > > at: > https://repository.apache.org/content/repositories/orgapachekylin-1012/ > > > > Release artifacts are signed with the following > > key:https://people.apache.org/keys/committer/shaofengshi.asc > > > > Pursuant to the Releases section of the Incubation Policy and with > > the endorsement of our mentors we would now like to request > > the permission of the Incubator PMC to publish the release. The vote > > is open for 72 hours, or until the necessary number of votes (3 +1) > > is reached. > > > > [ ] +1 Release this package > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > > > Shaofeng Shi, on behalf of Apache Kylin ppmcshaofeng...@apache.org > > >
Re: [VOTE] Accept Eagle into Apache Incubation
+1 (non-binding) On Mon, Oct 26, 2015 at 10:50 AM, hongbin ma wrote: > +1 (non binding) > > On Mon, Oct 26, 2015 at 12:20 AM, Ralph Goers > wrote: > > > +1 (binding) > > > > Ralph > > > > > On Oct 23, 2015, at 7:11 AM, Manoharan, Arun > > wrote: > > > > > > Hello Everyone, > > > > > > Thanks for all the feedback on the Eagle Proposal. > > > > > > I would like to call for a [VOTE] on Eagle joining the ASF as an > > incubation project. > > > > > > The vote is open for 72 hours: > > > > > > [ ] +1 accept Eagle in the Incubator > > > [ ] ±0 > > > [ ] -1 (please give reason) > > > > > > Eagle is a Monitoring solution for Hadoop to instantly identify access > > to sensitive data, recognize attacks, malicious activities and take > actions > > in real time. Eagle supports a wide variety of policies on HDFS data and > > Hive. Eagle also provides machine learning models for detecting anomalous > > user behavior in Hadoop. > > > > > > The proposal is available on the wiki here: > > > https://wiki.apache.org/incubator/EagleProposal > > > > > > The text of the proposal is also available at the end of this email. > > > > > > Thanks for your time and help. > > > > > > Thanks, > > > Arun > > > > > > > > > > > > Eagle > > > > > > Abstract > > > Eagle is an Open Source Monitoring solution for Hadoop to instantly > > identify access to sensitive data, recognize attacks, malicious > activities > > in hadoop and take actions. > > > > > > Proposal > > > Eagle audits access to HDFS files, Hive and HBase tables in real time, > > enforces policies defined on sensitive data access and alerts or blocks > > user’s access to that sensitive data in real time. Eagle also creates > user > > profiles based on the typical access behaviour for HDFS and Hive and > sends > > alerts when anomalous behaviour is detected. Eagle can also import > > sensitive data information classified by external classification engines > to > > help define its policies. > > > > > > Overview of Eagle > > > Eagle has 3 main parts. > > > 1.Data collection and storage - Eagle collects data from various hadoop > > logs in real time using Kafka/Yarn API and uses HDFS and HBase for > storage. > > > 2.Data processing and policy engine - Eagle allows users to create > > policies based on various metadata properties on HDFS, Hive and HBase > data. > > > 3.Eagle services - Eagle services include policy manager, query service > > and the visualization component. Eagle provides intuitive user interface > to > > administer Eagle and an alert dashboard to respond to real time alerts. > > > > > > Data Collection and Storage: > > > Eagle provides programming API for extending Eagle to integrate any > data > > source into Eagle policy evaluation framework. For example, Eagle hdfs > > audit monitoring collects data from Kafka which is populated from > namenode > > log4j appender or from logstash agent. Eagle hive monitoring collects > hive > > query logs from running job through YARN API, which is designed to be > > scalable and fault-tolerant. Eagle uses HBase as storage for storing > > metadata and metrics data, and also supports relational database through > > configuration change. > > > > > > Data Processing and Policy Engine: > > > Processing Engine: Eagle provides stream processing API which is an > > abstraction of Apache Storm. It can also be extended to other streaming > > engines. This abstraction allows developers to assemble data > > transformation, filtering, external data join etc. without physically > bound > > to a specific streaming platform. Eagle streaming API allows developers > to > > easily integrate business logic with Eagle policy engine and internally > > Eagle framework compiles business logic execution DAG into program > > primitives of underlying stream infrastructure e.g. Apache Storm. For > > example, Eagle HDFS monitoring transforms audit log from Namenode to > object > > and joins sensitivity metadata, security zone metadata which are > generated > > from external programs or configured by user. Eagle hive monitoring > filters > > running jobs to get hive query string and parses query string into object > > and then joins sensitivity metadata. > > > Alerting Framework: Eagle Alert Framework includes stream metadata API, > > scalable policy engine framework, extensible policy engine framework. > > Stream metadata API allows developers to declare event schema including > > what attributes constitute an event, what is the type for each attribute, > > and how to dynamically resolve attribute value in runtime when user > > configures policy. Scalable policy engine framework allows policies to be > > executed on different physical nodes in parallel. It is also used to > define > > your own policy partitioner class. Policy engine framework together with > > streaming partitioning capability provided by all streaming platforms > will > > make sure policies and events can be evaluated in a fully distributed > way. > > Extensible policy engine framework
Re: [VOTE] Accept Beam into the Apache Incubator
+1 (non-binding) On Friday, January 29, 2016, Adunuthula, Seshu wrote: > +1 (non-binding) > > On 1/28/16, 12:05 PM, "Julian Hyde" > > wrote: > > >+1 (binding) > > > >> On Jan 28, 2016, at 10:42 AM, Mayank Bansal > wrote: > >> > >> +1 (non-binding) > >> > >> Thanks, > >> Mayank > >> > >> On Thu, Jan 28, 2016 at 10:23 AM, Seetharam Venkatesh < > >> venkat...@innerzeal.com > wrote: > >> > >>> +1 (binding). > >>> > >>> Thanks! > >>> > >>> On Thu, Jan 28, 2016 at 10:19 AM Ted Dunning > > >>> wrote: > >>> > +1 > > > > On Thu, Jan 28, 2016 at 10:02 AM, John D. Ament > > > wrote: > > > +1 > > > > On Thu, Jan 28, 2016 at 9:28 AM Jean-Baptiste Onofré > >> > > wrote: > > > >> Hi, > >> > >> the Beam proposal (initially Dataflow) was proposed last week. > >> > >> The complete discussion thread is available here: > >> > >> > >> > > > > >>> > >>> > http://mail-archives.apache.org/mod_mbox/incubator-general/201601.mbox/% > >>>3CCA%2B%3DKJmvj4wyosNTXVpnsH8PhS7jEyzkZngc682rGgZ3p28L42Q%40mail.gmail.c > >>>om%3E > >> > >> As reminder the BeamProposal is here: > >> > >> https://wiki.apache.org/incubator/BeamProposal > >> > >> Regarding all the great feedbacks we received on the mailing list, > >>we > >> think it's time to call a vote to accept Beam into the Incubator. > >> > >> Please cast your vote to: > >> [] +1 - accept Apache Beam as a new incubating project > >> [] 0 - not sure > >> [] -1 - do not accept the Apache Beam project (because: ...) > >> > >> Thanks, > >> Regards > >> JB > >> > >> ## page was renamed from DataflowProposal > >> = Apache Beam = > >> > >> == Abstract == > >> > >> Apache Beam is an open source, unified model and set of > >> language-specific SDKs for defining and executing data processing > >> workflows, and also data ingestion and integration flows, supporting > >> Enterprise Integration Patterns (EIPs) and Domain Specific Languages > >> (DSLs). Dataflow pipelines simplify the mechanics of large-scale > >>> batch > >> and streaming data processing and can run on a number of runtimes > >>> like > >> Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud > service). > >> Beam also brings DSL in different languages, allowing users to > >>easily > >> implement their data integration processes. > >> > >> == Proposal == > >> > >> Beam is a simple, flexible, and powerful system for distributed data > >> processing at any scale. Beam provides a unified programming model, > >>a > >> software development kit to define and construct data processing > >> pipelines, and runners to execute Beam pipelines in several runtime > >> engines, like Apache Spark, Apache Flink, or Google Cloud Dataflow. > Beam > >> can be used for a variety of streaming or batch data processing > >>goals > >> including ETL, stream analysis, and aggregate computation. The > >> underlying programming model for Beam provides MapReduce-like > >> parallelism, combined with support for powerful data windowing, and > >> fine-grained correctness control. > >> > >> == Background == > >> > >> Beam started as a set of Google projects (Google Cloud Dataflow) > focused > >> on making data processing easier, faster, and less costly. The Beam > >> model is a successor to MapReduce, FlumeJava, and Millwheel inside > >> Google and is focused on providing a unified solution for batch and > >> stream processing. These projects on which Beam is based have been > >> published in several papers made available to the public: > >> > >> * MapReduce - http://research.google.com/archive/mapreduce.html > >> * Dataflow model - > >>> http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf > >> * FlumeJava - http://research.google.com/pubs/pub35650.html > >> * MillWheel - http://research.google.com/pubs/pub41378.html > >> > >> Beam was designed from the start to provide a portable programming > >> layer. When you define a data processing pipeline with the Beam > >>> model, > >> you are creating a job which is capable of being processed by any > number > >> of Beam processing engines. Several engines have been developed to > >>> run > >> Beam pipelines in other open source runtimes, including a Beam > >>runner > >> for Apache Flink and Apache Spark. There is also a ³direct runner², > >>> for > >> execution on the developer machine (mainly for dev/debug purposes). > >> Another runner allows a Beam program to run on a managed service, > Google > >> Cloud Dataflow, in Google Cloud Platform. The Dataflow Java SDK is > >> already available on GitHub, and independent from the Google Cloud > >> Dataflow service. Another Python SDK is curre
Re: [VOTE] [Kylin] Accept donation of Kylin New Modeling System
+1 (with my Kylin developer hat on, haha) On Fri, Mar 3, 2023 at 10:54 AM Cheng Pan wrote: > @Xiaoxiang, thanks, will check the details later. > > Thanks, > Cheng Pan > > > On Mar 3, 2023 at 10:43:36, Xiaoxiang Yu wrote: > > > Thanks for notification. > > > > The file has been moved to > > > https://github.com/apache/kylin/blob/doc5.0/website/blog/2022-12-18-Introduction_of_Metadata/protocol-buffer/metadata.proto > > . > > > > And there is another technical article(Chinese ver) wrote by Pengfei, > > https://kylin.apache.org/5.0/blog/introduction_of_metadata_cn, talks the > > details of "new metadata design" . > > > > > > -- > > *Best wishes to you ! * > > *From :**Xiaoxiang Yu* > > > > > > > > At 2023-03-03 10:17:08, "Cheng Pan" wrote: > > > +1 (non-binding), glad to see the Apache Kylin community becomes active > > >again. > > > > > >BTW, the link of "New metadata design"[1] in README seems broken? > > > > > >[1] > > > > https://github.com/apache/kylin/blob/kylin5/document/protocol-buffer/metadata.proto > > > > > >Thanks, > > >Cheng Pan > > > > > > > > >On Mar 2, 2023 at 21:54:18, ShaoFeng Shi > wrote: > > > > > >> The Apache Kylin PMC has voted [1] to accept the donation of the > > >> new modeling system. > > >> > > >> The donation initially was a commit [2] on a separate branch; under > the > > >> review > > >> and collaboration with the community in the past several months, the > > >> lastest > > >> version is at branch "kylin5" [3]. > > >> > > >> The code was developed by the Kyligence, which has signed the CCLA to > the > > >> secretary, and all contributors for the codebase have ICLA. > > >> > > >> Here is the IP clearance form: > > >> > > >> > https://incubator.apache.org/ip-clearance/kylin-new-modeling-system.html > > >> > > >> > > >> This lazy consensus vote will be open for at least 72 hours. > > >> > > >> > > >> [1] https://lists.apache.org/thread/2kzld4glj50ojshhpx3m63zsvxm8ps5l > > >> [2] > > >> > > >> > https://github.com/apache/kylin/commit/edab8698b6a9770ddc4cd00d9788d718d032b5e8 > > >> [3] https://github.com/apache/kylin/commits/kylin5 > > >> > > >> Best regards, > > >> > > >> Shaofeng Shi 史少锋 > > >> Apache Kylin PMC, > > >> Apache Incubator PMC, > > >> Email: shaofeng...@apache.org > > >> > > >> Apache Kylin FAQ: > https://kylin.apache.org/docs/gettingstarted/faq.html > > >> Join Kylin user mail group: user-subscr...@kylin.apache.org > > >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > >> > > > > >