Re: [PROPOSAL] Silk as new Incubator project

2014-09-27 Thread Konstantin Boudnik
I was thinking along the lines of having commits going to the dev@
list and when the traffic becomes heavier to open the commits@, but
your approach might be better. I will update the proposal accordingly.
Thanks!
--
  Take care,
Konstantin (Cos) Boudnik
2CAC 8312 4870 D885 8616  6115 220F 6980 1F27 E622

Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.


On Fri, Sep 26, 2014 at 8:53 PM, Henry Saputra henry.sapu...@gmail.com wrote:
 Cos,

 I believe you may also need commits@ list for all the commits
 activities to the source repo.

 - Henry

 On Fri, Sep 26, 2014 at 8:36 PM, Konstantin Boudnik c...@apache.org wrote:
 We have updated the proposal with the section of
  Comparative analysis to relevant projects

 which addresses the questions expressed below.

 Regards,
   Cos

 On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
 Hi Cos,

 Looks like a good start of the proposal.

 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?

 Would love to have comparisons to existing ASF projects section to the 
 proposal.

 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.

 - Henry

 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and 
  user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), 
  Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community 
  around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. 
  Here are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of 
  various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to 
  streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of 
  traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory 
  data
  fabric - that would provide suitable APIs for different types of 
  payloads: from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from 
  companies like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the 
  technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 
  2007 and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 
  20,000,000
  GridGain nodes started in the last 5 years.
 
  

Re: [PROPOSAL] Silk as new Incubator project

2014-09-27 Thread Branko Čibej
On 27.09.2014 05:38, Konstantin Boudnik wrote:
 Hi David.

 I believe it will be needing a usual place to publish releases

Release tarballs go here before the release vote starts:

https://dist.apache.org/repos/dist/dev/incubator/ignite

After the vote passes, they should be moved here:

https://dist.apache.org/repos/dist/release/incubator/ignite

Feel free to create the ignite directories as necessary.


Note that .../release/... is distributed to mirrors; over at Subversion,
we wait 24 hours between moving release bits to .../release/... and
announcing the release, to make sure that all mirrors have caught up.
Only the latest reelase should be there, any older versions must be
deleted. They should have been automagically moved to

http://archive.apache.org/dist/incubator/ignite

fairly soon after they appear on dist.apache.org; if they don't, nudge
Infra.

-- Brane


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [PROPOSAL] Silk as new Incubator project

2014-09-26 Thread David Nalley
On Fri, Sep 19, 2014 at 12:40 AM, Konstantin Boudnik c...@apache.org wrote:
 I would like to propose Silk as an Apache Incubator project. The new
 proposal is added to https://wiki.apache.org/incubator/SilkProposal and
 is duplicated below.


Hi Cos:

Are there any other resources that Ignite will likely need past the
wiki/bugtracker/vcs/website?

--David

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [PROPOSAL] Silk as new Incubator project

2014-09-26 Thread Konstantin Boudnik
We have updated the proposal with the section of 
 Comparative analysis to relevant projects

which addresses the questions expressed below.

Regards,
  Cos

On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
 Hi Cos,
 
 Looks like a good start of the proposal.
 
 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?
 
 Would love to have comparisons to existing ASF projects section to the 
 proposal.
 
 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.
 
 - Henry
 
 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. Here 
  are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory data
  fabric - that would provide suitable APIs for different types of payloads: 
  from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from companies 
  like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 2007 
  and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 20,000,000
  GridGain nodes started in the last 5 years.
 
  == Initial Goals ==
 
  The number one goal during ASF incubation will coalesce around building a 
  true
  active and vibrant community governed by the “Apache Way”. The initial
  development goals for Silk primarily revolve around migrating the existing 
  code
  base, documentation, and refactoring of the existing internal build, test 
  release processes. We believe these initial goals are sufficiently 
  difficult to
  be considered early milestones.
 
  Some of the specific initial goals include:
   * Migrate the existing Silk code base to the ASF.
   * Refactor development, testing, build and release processes to work in 
  ASF.
   * Attract developer and user interest in the new Apache Silk project.
   * Road map the integration efforts with “sister” projects in ASF 
  

Re: [PROPOSAL] Silk as new Incubator project

2014-09-26 Thread Konstantin Boudnik
Hi David.

I believe it will be needing a usual place to publish releases and perhaps
some CI time-share on builds.apache.org, but I am sure the latter could be
addressed by using different resources if it seems to be an issue.

Regards,
  Cos

On Fri, Sep 26, 2014 at 03:50PM, David Nalley wrote:
 On Fri, Sep 19, 2014 at 12:40 AM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
 
 Hi Cos:
 
 Are there any other resources that Ignite will likely need past the
 wiki/bugtracker/vcs/website?
 
 --David
 
 -
 To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
 For additional commands, e-mail: general-h...@incubator.apache.org
 


signature.asc
Description: Digital signature


Re: [PROPOSAL] Silk as new Incubator project

2014-09-25 Thread Andrew Purtell
 It seems like an implementation detail to me, but do you think this needs to 
 be added into the proposal?

No, thanks for the clarification.

On Wed, Sep 24, 2014 at 9:26 PM, Konstantin Boudnik c...@apache.org wrote:
 Andrew,

 as far as I know Ignite has a component that works with Hadoop (HDFS) as a
 storage layer and that's pretty much all I could say about the declared
 dependency. Ignite doesn't require Hadoop to deliver any functionality, it
 doesn't provide any additions to Hadoop - HDFS is just yet another file
 system. Now, because Ignite is an In-Memory Data Fabric I am sure it does
 decent amount of caching to reduce IO overhead.

 It seems like an implementation detail to me, but do you think this needs to
 be added into the proposal?

 Thanks!
   Cos

 On Mon, Sep 22, 2014 at 08:34AM, Andrew Purtell wrote:
 On Sun, Sep 21, 2014 at 6:59 PM, Konstantin Boudnik c...@apache.org wrote:
  On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
  Hi Cos,
 
  Looks like a good start of the proposal.
 
  How would this project relate to compare to existing ones like Apache
  Spark, Storm, or Samza?
 
  The proposal will be updated shortly with these details.

 I browsed GridGain's website briefly, perhaps there could also be a
 bit of detail in the proposal how it relates to the Apache Hadoop
 project?


  Would love to have comparisons to existing ASF projects section to the 
  proposal.
 
  Also, would you guys mind adding or soliciting more mentors?
  Seemed like most of initial committers have not been involved in ASF
  yet so may need some help to adjust to Apache way.
 
  Good point, Henry! Would you consider investing a few cycles on your own 
  and
  join the mentors for this proposal? Thanks in advance!

 If you need more mentors, I'd be happy to volunteer.


 
  Cos
 
 
  - Henry
 
  On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org 
  wrote:
   I would like to propose Silk as an Apache Incubator project. The new
   proposal is added to https://wiki.apache.org/incubator/SilkProposal and
   is duplicated below.
  
   --
   Regards,
 Cos
  
  
   = Silk Apache Incubator Proposal =
  
   == Abstract ==
  
   Apache Silk will be a unified In-Memory Data Fabric providing 
   high-performance,
   distributed in-memory data management software layer between various 
   data
   sources and user applications.
  
   == Proposal ==
  
   Apache Silk is written mostly in Java and Scala with small amount of 
   C++ code
   and will initially combine the following technologies under one unified
   umbrella:
* In-Memory Data Grid
* In-Memory Compute Grid
* In-Memory Streaming Processing
   This unified in-memory fabric will provide high-performance, distributed
   in-memory software layer that sits in between various data sources and 
   user
   applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
   Applications
   APIs will be available for Java (and Java-based scripting languages), 
   Scala,
   C++ and .NET (C#).
  
   GridGain Systems, Inc. submits this proposal to donate its Apache 
   2.0-licensed
   open source project generally known as “GridGain In-Memory Computing 
   Platform”,
   its source code, documentation, and websites to the Apache Software 
   Foundation
   (“ASF”) with the goal of extending the vibrant open source community 
   around
   this technology ultimately governed by “Apache Way”.  Proposed Naming
  
   We have been advised by the ASF mentors that the name “Silk” may not be 
   ideal
   because the name may be too generic and may not pass ASF legal check. 
   Here are
   the alternatives that we have come up with and any of those will be 
   acceptable
   for the project pending the ASF legal green light:
* Apache Silk (preferable name)
* Apache Sylk
* Apache Memstor
* Apache Ignite
  
   == Background  Rationale ==
  
   In-Memory Data Fabric is a natural and evolutionary consolidation of 
   various
   “in-memory technologies” from the last decade. From simple local caching
   (JSR-107), to distributed caching, to data grids and databases, to 
   streaming
   and plug-n-play acceleration - the in-memory space has grown quite
   dramatically.
  
   With rapid advances in NVRAM and significant price reduction of 
   traditional
   DRAM on one hand, and growing sophistication and demand for faster data
   processing on another - many users of these silo-ed technologies and 
   products
   started to look for a “strategic approach” to in-memory - an in-memory 
   data
   fabric - that would provide suitable APIs for different types of 
   payloads: from
   data caching, to data grids, to in-memory SQL data stores, to HPC, to 
   streaming
   processing.
  
   With expensive and proprietary in-memory computing products from 
   companies like
   Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
   unhindered
   access to advanced open source in-memory software technology, the 
   technology
   

Re: [PROPOSAL] Silk as new Incubator project

2014-09-24 Thread Konstantin Boudnik
Thanks Henry - great to have you!

On Mon, Sep 22, 2014 at 11:15AM, Henry Saputra wrote:
 Thanks for the response, Konstantin.
 
 Definitely glad to help as mentor.
 I have added my name as one of the mentors in the list.
 
 Still love to see the Relationships to other Apache projects section
 in the proposal.
 
 - Henry
 
 
 
 On Sun, Sep 21, 2014 at 6:59 PM, Konstantin Boudnik c...@apache.org wrote:
  On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
  Hi Cos,
 
  Looks like a good start of the proposal.
 
  How would this project relate to compare to existing ones like Apache
  Spark, Storm, or Samza?
 
  The proposal will be updated shortly with these details.
 
  Would love to have comparisons to existing ASF projects section to the 
  proposal.
 
  Also, would you guys mind adding or soliciting more mentors?
  Seemed like most of initial committers have not been involved in ASF
  yet so may need some help to adjust to Apache way.
 
  Good point, Henry! Would you consider investing a few cycles on your own and
  join the mentors for this proposal? Thanks in advance!
 
  Cos
 
 
  - Henry
 
  On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org 
  wrote:
   I would like to propose Silk as an Apache Incubator project. The new
   proposal is added to https://wiki.apache.org/incubator/SilkProposal and
   is duplicated below.
  
   --
   Regards,
 Cos
  
  
   = Silk Apache Incubator Proposal =
  
   == Abstract ==
  
   Apache Silk will be a unified In-Memory Data Fabric providing 
   high-performance,
   distributed in-memory data management software layer between various data
   sources and user applications.
  
   == Proposal ==
  
   Apache Silk is written mostly in Java and Scala with small amount of C++ 
   code
   and will initially combine the following technologies under one unified
   umbrella:
* In-Memory Data Grid
* In-Memory Compute Grid
* In-Memory Streaming Processing
   This unified in-memory fabric will provide high-performance, distributed
   in-memory software layer that sits in between various data sources and 
   user
   applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
   Applications
   APIs will be available for Java (and Java-based scripting languages), 
   Scala,
   C++ and .NET (C#).
  
   GridGain Systems, Inc. submits this proposal to donate its Apache 
   2.0-licensed
   open source project generally known as “GridGain In-Memory Computing 
   Platform”,
   its source code, documentation, and websites to the Apache Software 
   Foundation
   (“ASF”) with the goal of extending the vibrant open source community 
   around
   this technology ultimately governed by “Apache Way”.  Proposed Naming
  
   We have been advised by the ASF mentors that the name “Silk” may not be 
   ideal
   because the name may be too generic and may not pass ASF legal check. 
   Here are
   the alternatives that we have come up with and any of those will be 
   acceptable
   for the project pending the ASF legal green light:
* Apache Silk (preferable name)
* Apache Sylk
* Apache Memstor
* Apache Ignite
  
   == Background  Rationale ==
  
   In-Memory Data Fabric is a natural and evolutionary consolidation of 
   various
   “in-memory technologies” from the last decade. From simple local caching
   (JSR-107), to distributed caching, to data grids and databases, to 
   streaming
   and plug-n-play acceleration - the in-memory space has grown quite
   dramatically.
  
   With rapid advances in NVRAM and significant price reduction of 
   traditional
   DRAM on one hand, and growing sophistication and demand for faster data
   processing on another - many users of these silo-ed technologies and 
   products
   started to look for a “strategic approach” to in-memory - an in-memory 
   data
   fabric - that would provide suitable APIs for different types of 
   payloads: from
   data caching, to data grids, to in-memory SQL data stores, to HPC, to 
   streaming
   processing.
  
   With expensive and proprietary in-memory computing products from 
   companies like
   Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
   unhindered
   access to advanced open source in-memory software technology, the 
   technology
   they can trust to develop with and deploy for critical applications.  
   Current
   Status
  
   Apache Silk will be based on the technology that is currently developed 
   by
   GridGain Systems and available under Apache 2.0 license
   (http://www.gridgain.org). The software has been in development since 
   2007 and
   in production since 2009. It is currently used by over 500 production
   deployments with over 1,000,000 downloads to date, and with over 
   20,000,000
   GridGain nodes started in the last 5 years.
  
   == Initial Goals ==
  
   The number one goal during ASF incubation will coalesce around building 
   a true
   active and vibrant community governed by the “Apache Way”. The initial
   

Re: [PROPOSAL] Silk as new Incubator project

2014-09-24 Thread Konstantin Boudnik
Andrew,

as far as I know Ignite has a component that works with Hadoop (HDFS) as a
storage layer and that's pretty much all I could say about the declared
dependency. Ignite doesn't require Hadoop to deliver any functionality, it
doesn't provide any additions to Hadoop - HDFS is just yet another file
system. Now, because Ignite is an In-Memory Data Fabric I am sure it does
decent amount of caching to reduce IO overhead.

It seems like an implementation detail to me, but do you think this needs to
be added into the proposal?

Thanks!
  Cos

On Mon, Sep 22, 2014 at 08:34AM, Andrew Purtell wrote:
 On Sun, Sep 21, 2014 at 6:59 PM, Konstantin Boudnik c...@apache.org wrote:
  On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
  Hi Cos,
 
  Looks like a good start of the proposal.
 
  How would this project relate to compare to existing ones like Apache
  Spark, Storm, or Samza?
 
  The proposal will be updated shortly with these details.
 
 I browsed GridGain's website briefly, perhaps there could also be a
 bit of detail in the proposal how it relates to the Apache Hadoop
 project?
 
 
  Would love to have comparisons to existing ASF projects section to the 
  proposal.
 
  Also, would you guys mind adding or soliciting more mentors?
  Seemed like most of initial committers have not been involved in ASF
  yet so may need some help to adjust to Apache way.
 
  Good point, Henry! Would you consider investing a few cycles on your own and
  join the mentors for this proposal? Thanks in advance!
 
 If you need more mentors, I'd be happy to volunteer.
 
 
 
  Cos
 
 
  - Henry
 
  On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org 
  wrote:
   I would like to propose Silk as an Apache Incubator project. The new
   proposal is added to https://wiki.apache.org/incubator/SilkProposal and
   is duplicated below.
  
   --
   Regards,
 Cos
  
  
   = Silk Apache Incubator Proposal =
  
   == Abstract ==
  
   Apache Silk will be a unified In-Memory Data Fabric providing 
   high-performance,
   distributed in-memory data management software layer between various data
   sources and user applications.
  
   == Proposal ==
  
   Apache Silk is written mostly in Java and Scala with small amount of C++ 
   code
   and will initially combine the following technologies under one unified
   umbrella:
* In-Memory Data Grid
* In-Memory Compute Grid
* In-Memory Streaming Processing
   This unified in-memory fabric will provide high-performance, distributed
   in-memory software layer that sits in between various data sources and 
   user
   applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
   Applications
   APIs will be available for Java (and Java-based scripting languages), 
   Scala,
   C++ and .NET (C#).
  
   GridGain Systems, Inc. submits this proposal to donate its Apache 
   2.0-licensed
   open source project generally known as “GridGain In-Memory Computing 
   Platform”,
   its source code, documentation, and websites to the Apache Software 
   Foundation
   (“ASF”) with the goal of extending the vibrant open source community 
   around
   this technology ultimately governed by “Apache Way”.  Proposed Naming
  
   We have been advised by the ASF mentors that the name “Silk” may not be 
   ideal
   because the name may be too generic and may not pass ASF legal check. 
   Here are
   the alternatives that we have come up with and any of those will be 
   acceptable
   for the project pending the ASF legal green light:
* Apache Silk (preferable name)
* Apache Sylk
* Apache Memstor
* Apache Ignite
  
   == Background  Rationale ==
  
   In-Memory Data Fabric is a natural and evolutionary consolidation of 
   various
   “in-memory technologies” from the last decade. From simple local caching
   (JSR-107), to distributed caching, to data grids and databases, to 
   streaming
   and plug-n-play acceleration - the in-memory space has grown quite
   dramatically.
  
   With rapid advances in NVRAM and significant price reduction of 
   traditional
   DRAM on one hand, and growing sophistication and demand for faster data
   processing on another - many users of these silo-ed technologies and 
   products
   started to look for a “strategic approach” to in-memory - an in-memory 
   data
   fabric - that would provide suitable APIs for different types of 
   payloads: from
   data caching, to data grids, to in-memory SQL data stores, to HPC, to 
   streaming
   processing.
  
   With expensive and proprietary in-memory computing products from 
   companies like
   Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
   unhindered
   access to advanced open source in-memory software technology, the 
   technology
   they can trust to develop with and deploy for critical applications.  
   Current
   Status
  
   Apache Silk will be based on the technology that is currently developed 
   by
   GridGain Systems and available under Apache 2.0 license

Re: [PROPOSAL] Silk as new Incubator project

2014-09-22 Thread Andrew Purtell
On Sun, Sep 21, 2014 at 6:59 PM, Konstantin Boudnik c...@apache.org wrote:
 On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
 Hi Cos,

 Looks like a good start of the proposal.

 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?

 The proposal will be updated shortly with these details.

I browsed GridGain's website briefly, perhaps there could also be a
bit of detail in the proposal how it relates to the Apache Hadoop
project?


 Would love to have comparisons to existing ASF projects section to the 
 proposal.

 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.

 Good point, Henry! Would you consider investing a few cycles on your own and
 join the mentors for this proposal? Thanks in advance!

If you need more mentors, I'd be happy to volunteer.



 Cos


 - Henry

 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), 
  Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. Here 
  are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of 
  various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to 
  streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory data
  fabric - that would provide suitable APIs for different types of payloads: 
  from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from companies 
  like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the 
  technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 2007 
  and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 20,000,000
  GridGain nodes started in the last 5 years.
 
  == Initial Goals ==
 
  The number one goal during ASF incubation will coalesce around building a 
  true
  active and vibrant community governed by the “Apache Way”. The initial
  development goals for Silk primarily revolve around migrating the existing 
  code
  base, documentation, and refactoring of the existing internal build, test 
  release processes. We believe these initial goals are sufficiently 
  difficult to
  be considered early milestones.
 
  

Re: [PROPOSAL] Silk as new Incubator project

2014-09-22 Thread Henry Saputra
Thanks for the response, Konstantin.

Definitely glad to help as mentor.
I have added my name as one of the mentors in the list.

Still love to see the Relationships to other Apache projects section
in the proposal.

- Henry



On Sun, Sep 21, 2014 at 6:59 PM, Konstantin Boudnik c...@apache.org wrote:
 On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
 Hi Cos,

 Looks like a good start of the proposal.

 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?

 The proposal will be updated shortly with these details.

 Would love to have comparisons to existing ASF projects section to the 
 proposal.

 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.

 Good point, Henry! Would you consider investing a few cycles on your own and
 join the mentors for this proposal? Thanks in advance!

 Cos


 - Henry

 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), 
  Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. Here 
  are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of 
  various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to 
  streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory data
  fabric - that would provide suitable APIs for different types of payloads: 
  from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from companies 
  like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the 
  technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 2007 
  and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 20,000,000
  GridGain nodes started in the last 5 years.
 
  == Initial Goals ==
 
  The number one goal during ASF incubation will coalesce around building a 
  true
  active and vibrant community governed by the “Apache Way”. The initial
  development goals for Silk primarily revolve around migrating the existing 
  code
  base, documentation, and refactoring of the existing internal build, test 
  release processes. We believe these initial goals are sufficiently 
  difficult to
  be 

Re: [PROPOSAL] Silk as new Incubator project

2014-09-21 Thread Konstantin Boudnik
On Thu, Sep 18, 2014 at 10:21PM, Henry Saputra wrote:
 Hi Cos,
 
 Looks like a good start of the proposal.
 
 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?

The proposal will be updated shortly with these details.

 Would love to have comparisons to existing ASF projects section to the 
 proposal.
 
 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.

Good point, Henry! Would you consider investing a few cycles on your own and
join the mentors for this proposal? Thanks in advance!

Cos

 
 - Henry
 
 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. Here 
  are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory data
  fabric - that would provide suitable APIs for different types of payloads: 
  from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from companies 
  like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 2007 
  and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 20,000,000
  GridGain nodes started in the last 5 years.
 
  == Initial Goals ==
 
  The number one goal during ASF incubation will coalesce around building a 
  true
  active and vibrant community governed by the “Apache Way”. The initial
  development goals for Silk primarily revolve around migrating the existing 
  code
  base, documentation, and refactoring of the existing internal build, test 
  release processes. We believe these initial goals are sufficiently 
  difficult to
  be considered early milestones.
 
  Some of the specific initial goals include:
   * Migrate the existing Silk code base to the ASF.
   * Refactor development, testing, build and release processes to work in 
  ASF.
   * Attract developer and user interest in the new Apache Silk project.
   * Road map the integration 

Re: [PROPOSAL] Silk as new Incubator project

2014-09-21 Thread Konstantin Boudnik
I have addressed sebb's note on the user list and removed it from the resource
section. Also, the proposal was renamed to Ignite and new page is available
under
  https://wiki.apache.org/incubator/IgniteProposal

Thanks for the input everyone,
  Cos

On Thu, Sep 18, 2014 at 09:40PM, Konstantin Boudnik wrote:
 I would like to propose Silk as an Apache Incubator project. The new 
 proposal is added to https://wiki.apache.org/incubator/SilkProposal and
 is duplicated below.
 
 --
 Regards,
   Cos
 
 
 = Silk Apache Incubator Proposal =
 
 == Abstract ==
 
 Apache Silk will be a unified In-Memory Data Fabric providing 
 high-performance,
 distributed in-memory data management software layer between various data
 sources and user applications.
 
 == Proposal ==
 
 Apache Silk is written mostly in Java and Scala with small amount of C++ code
 and will initially combine the following technologies under one unified
 umbrella:
  * In-Memory Data Grid
  * In-Memory Compute Grid
  * In-Memory Streaming Processing
 This unified in-memory fabric will provide high-performance, distributed
 in-memory software layer that sits in between various data sources and user
 applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
 Applications
 APIs will be available for Java (and Java-based scripting languages), Scala,
 C++ and .NET (C#).
 
 GridGain Systems, Inc. submits this proposal to donate its Apache 2.0-licensed
 open source project generally known as “GridGain In-Memory Computing 
 Platform”,
 its source code, documentation, and websites to the Apache Software Foundation
 (“ASF”) with the goal of extending the vibrant open source community around
 this technology ultimately governed by “Apache Way”.  Proposed Naming
 
 We have been advised by the ASF mentors that the name “Silk” may not be ideal
 because the name may be too generic and may not pass ASF legal check. Here are
 the alternatives that we have come up with and any of those will be acceptable
 for the project pending the ASF legal green light:
  * Apache Silk (preferable name)
  * Apache Sylk
  * Apache Memstor
  * Apache Ignite
 
 == Background  Rationale ==
 
 In-Memory Data Fabric is a natural and evolutionary consolidation of various
 “in-memory technologies” from the last decade. From simple local caching
 (JSR-107), to distributed caching, to data grids and databases, to streaming
 and plug-n-play acceleration - the in-memory space has grown quite
 dramatically.
 
 With rapid advances in NVRAM and significant price reduction of traditional
 DRAM on one hand, and growing sophistication and demand for faster data
 processing on another - many users of these silo-ed technologies and products
 started to look for a “strategic approach” to in-memory - an in-memory data
 fabric - that would provide suitable APIs for different types of payloads: 
 from
 data caching, to data grids, to in-memory SQL data stores, to HPC, to 
 streaming
 processing.
 
 With expensive and proprietary in-memory computing products from companies 
 like
 Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an unhindered
 access to advanced open source in-memory software technology, the technology
 they can trust to develop with and deploy for critical applications.  Current
 Status
 
 Apache Silk will be based on the technology that is currently developed by
 GridGain Systems and available under Apache 2.0 license
 (http://www.gridgain.org). The software has been in development since 2007 and
 in production since 2009. It is currently used by over 500 production
 deployments with over 1,000,000 downloads to date, and with over 20,000,000
 GridGain nodes started in the last 5 years.
 
 == Initial Goals ==
 
 The number one goal during ASF incubation will coalesce around building a true
 active and vibrant community governed by the “Apache Way”. The initial
 development goals for Silk primarily revolve around migrating the existing 
 code
 base, documentation, and refactoring of the existing internal build, test 
 release processes. We believe these initial goals are sufficiently difficult 
 to
 be considered early milestones.
 
 Some of the specific initial goals include:
  * Migrate the existing Silk code base to the ASF.
  * Refactor development, testing, build and release processes to work in ASF.
  * Attract developer and user interest in the new Apache Silk project.
  * Road map the integration efforts with “sister” projects in ASF eco-system 
 like Storm and Spark.
  * Incorporate externally developed features into the core Apache Silk 
 project.
 
 == Known Risks ==
 
 This proposal is not without its risks, some of which are outlined below.
 
 The current list of committers are primarily from GridGain Systems. One of the
 key purposes of proposing Silk for incubation is to attract new committers and
 spur the adoption of Silk. The ASF has a well-deserved reputation of fostering
 and building open source communities, which makes it the ideal location to
 

Re: [PROPOSAL] Silk as new Incubator project

2014-09-19 Thread Christian Grobmeier
Not saying anything on the proposal itself, I would be concerned because
of the name Silk.
There is this:
http://lucidworks.com/product/integrations/silk/
which is related to Apache Solr and Lucene and also gets some attention.
While it may not solve the same thing, I wouldn't use the name Silk at
least because
it somehow works with other Apache products. It could lead to confusion.

If the podling is accepted, I suggest to consider this before resources
are created

-- 
  Christian Grobmeier
  grobme...@gmail.com

On Fri, Sep 19, 2014, at 07:21, Henry Saputra wrote:
 Hi Cos,
 
 Looks like a good start of the proposal.
 
 How would this project relate to compare to existing ones like Apache
 Spark, Storm, or Samza?
 
 Would love to have comparisons to existing ASF projects section to the
 proposal.
 
 Also, would you guys mind adding or soliciting more mentors?
 Seemed like most of initial committers have not been involved in ASF
 yet so may need some help to adjust to Apache way.
 
 - Henry
 
 On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org
 wrote:
  I would like to propose Silk as an Apache Incubator project. The new
  proposal is added to https://wiki.apache.org/incubator/SilkProposal and
  is duplicated below.
 
  --
  Regards,
Cos
 
 
  = Silk Apache Incubator Proposal =
 
  == Abstract ==
 
  Apache Silk will be a unified In-Memory Data Fabric providing 
  high-performance,
  distributed in-memory data management software layer between various data
  sources and user applications.
 
  == Proposal ==
 
  Apache Silk is written mostly in Java and Scala with small amount of C++ 
  code
  and will initially combine the following technologies under one unified
  umbrella:
   * In-Memory Data Grid
   * In-Memory Compute Grid
   * In-Memory Streaming Processing
  This unified in-memory fabric will provide high-performance, distributed
  in-memory software layer that sits in between various data sources and user
  applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
  Applications
  APIs will be available for Java (and Java-based scripting languages), Scala,
  C++ and .NET (C#).
 
  GridGain Systems, Inc. submits this proposal to donate its Apache 
  2.0-licensed
  open source project generally known as “GridGain In-Memory Computing 
  Platform”,
  its source code, documentation, and websites to the Apache Software 
  Foundation
  (“ASF”) with the goal of extending the vibrant open source community around
  this technology ultimately governed by “Apache Way”.  Proposed Naming
 
  We have been advised by the ASF mentors that the name “Silk” may not be 
  ideal
  because the name may be too generic and may not pass ASF legal check. Here 
  are
  the alternatives that we have come up with and any of those will be 
  acceptable
  for the project pending the ASF legal green light:
   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite
 
  == Background  Rationale ==
 
  In-Memory Data Fabric is a natural and evolutionary consolidation of various
  “in-memory technologies” from the last decade. From simple local caching
  (JSR-107), to distributed caching, to data grids and databases, to streaming
  and plug-n-play acceleration - the in-memory space has grown quite
  dramatically.
 
  With rapid advances in NVRAM and significant price reduction of traditional
  DRAM on one hand, and growing sophistication and demand for faster data
  processing on another - many users of these silo-ed technologies and 
  products
  started to look for a “strategic approach” to in-memory - an in-memory data
  fabric - that would provide suitable APIs for different types of payloads: 
  from
  data caching, to data grids, to in-memory SQL data stores, to HPC, to 
  streaming
  processing.
 
  With expensive and proprietary in-memory computing products from companies 
  like
  Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an 
  unhindered
  access to advanced open source in-memory software technology, the technology
  they can trust to develop with and deploy for critical applications.  
  Current
  Status
 
  Apache Silk will be based on the technology that is currently developed by
  GridGain Systems and available under Apache 2.0 license
  (http://www.gridgain.org). The software has been in development since 2007 
  and
  in production since 2009. It is currently used by over 500 production
  deployments with over 1,000,000 downloads to date, and with over 20,000,000
  GridGain nodes started in the last 5 years.
 
  == Initial Goals ==
 
  The number one goal during ASF incubation will coalesce around building a 
  true
  active and vibrant community governed by the “Apache Way”. The initial
  development goals for Silk primarily revolve around migrating the existing 
  code
  base, documentation, and refactoring of the existing internal build, test 
  release processes. We believe these initial goals are sufficiently 
  difficult to
  

Re: [PROPOSAL] Silk as new Incubator project

2014-09-19 Thread sebb
The user mailing list is not normally used for podlings.
Only the developer and private lists are needed.

On 19 September 2014 05:40, Konstantin Boudnik c...@apache.org wrote:
 I would like to propose Silk as an Apache Incubator project. The new
 proposal is added to https://wiki.apache.org/incubator/SilkProposal and
 is duplicated below.

 --
 Regards,
   Cos


 = Silk Apache Incubator Proposal =

 == Abstract ==

 Apache Silk will be a unified In-Memory Data Fabric providing 
 high-performance,
 distributed in-memory data management software layer between various data
 sources and user applications.

 == Proposal ==

 Apache Silk is written mostly in Java and Scala with small amount of C++ code
 and will initially combine the following technologies under one unified
 umbrella:
  * In-Memory Data Grid
  * In-Memory Compute Grid
  * In-Memory Streaming Processing
 This unified in-memory fabric will provide high-performance, distributed
 in-memory software layer that sits in between various data sources and user
 applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
 Applications
 APIs will be available for Java (and Java-based scripting languages), Scala,
 C++ and .NET (C#).

 GridGain Systems, Inc. submits this proposal to donate its Apache 2.0-licensed
 open source project generally known as “GridGain In-Memory Computing 
 Platform”,
 its source code, documentation, and websites to the Apache Software Foundation
 (“ASF”) with the goal of extending the vibrant open source community around
 this technology ultimately governed by “Apache Way”.  Proposed Naming

 We have been advised by the ASF mentors that the name “Silk” may not be ideal
 because the name may be too generic and may not pass ASF legal check. Here are
 the alternatives that we have come up with and any of those will be acceptable
 for the project pending the ASF legal green light:
  * Apache Silk (preferable name)
  * Apache Sylk
  * Apache Memstor
  * Apache Ignite

 == Background  Rationale ==

 In-Memory Data Fabric is a natural and evolutionary consolidation of various
 “in-memory technologies” from the last decade. From simple local caching
 (JSR-107), to distributed caching, to data grids and databases, to streaming
 and plug-n-play acceleration - the in-memory space has grown quite
 dramatically.

 With rapid advances in NVRAM and significant price reduction of traditional
 DRAM on one hand, and growing sophistication and demand for faster data
 processing on another - many users of these silo-ed technologies and products
 started to look for a “strategic approach” to in-memory - an in-memory data
 fabric - that would provide suitable APIs for different types of payloads: 
 from
 data caching, to data grids, to in-memory SQL data stores, to HPC, to 
 streaming
 processing.

 With expensive and proprietary in-memory computing products from companies 
 like
 Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an unhindered
 access to advanced open source in-memory software technology, the technology
 they can trust to develop with and deploy for critical applications.  Current
 Status

 Apache Silk will be based on the technology that is currently developed by
 GridGain Systems and available under Apache 2.0 license
 (http://www.gridgain.org). The software has been in development since 2007 and
 in production since 2009. It is currently used by over 500 production
 deployments with over 1,000,000 downloads to date, and with over 20,000,000
 GridGain nodes started in the last 5 years.

 == Initial Goals ==

 The number one goal during ASF incubation will coalesce around building a true
 active and vibrant community governed by the “Apache Way”. The initial
 development goals for Silk primarily revolve around migrating the existing 
 code
 base, documentation, and refactoring of the existing internal build, test 
 release processes. We believe these initial goals are sufficiently difficult 
 to
 be considered early milestones.

 Some of the specific initial goals include:
  * Migrate the existing Silk code base to the ASF.
  * Refactor development, testing, build and release processes to work in ASF.
  * Attract developer and user interest in the new Apache Silk project.
  * Road map the integration efforts with “sister” projects in ASF eco-system 
 like Storm and Spark.
  * Incorporate externally developed features into the core Apache Silk 
 project.

 == Known Risks ==

 This proposal is not without its risks, some of which are outlined below.

 The current list of committers are primarily from GridGain Systems. One of the
 key purposes of proposing Silk for incubation is to attract new committers and
 spur the adoption of Silk. The ASF has a well-deserved reputation of fostering
 and building open source communities, which makes it the ideal location to
 attempt this community bootstrap.

 Most of the initial committers are supported by their employers to work on
 Silk, and may be assigned to work on other 

Re: [PROPOSAL] Silk as new Incubator project

2014-09-19 Thread Roman Shaposhnik
On Fri, Sep 19, 2014 at 8:36 AM, Christian Grobmeier
grobme...@gmail.com wrote:
 Not saying anything on the proposal itself, I would be concerned because
 of the name Silk.
 There is this:
 http://lucidworks.com/product/integrations/silk/
 which is related to Apache Solr and Lucene and also gets some attention.
 While it may not solve the same thing, I wouldn't use the name Silk at
 least because
 it somehow works with other Apache products. It could lead to confusion.

 If the podling is accepted, I suggest to consider this before resources
 are created

Yup. Hence the following set of potential names:

   * Apache Silk (preferable name)
   * Apache Sylk
   * Apache Memstor
   * Apache Ignite

It would be very useful if we can get feedback on
the most/least pref. ones from that list.

Thanks,
Roman.

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [PROPOSAL] Silk as new Incubator project

2014-09-19 Thread Donald Whytock
On Fri, Sep 19, 2014 at 12:57 PM, Roman Shaposhnik ro...@shaposhnik.org
wrote:

 On Fri, Sep 19, 2014 at 8:36 AM, Christian Grobmeier
 grobme...@gmail.com wrote:
  Not saying anything on the proposal itself, I would be concerned because
  of the name Silk.
  There is this:
  http://lucidworks.com/product/integrations/silk/
  which is related to Apache Solr and Lucene and also gets some attention.
  While it may not solve the same thing, I wouldn't use the name Silk at
  least because
  it somehow works with other Apache products. It could lead to confusion.
 
  If the podling is accepted, I suggest to consider this before resources
  are created

 Yup. Hence the following set of potential names:

* Apache Silk (preferable name)
* Apache Sylk
* Apache Memstor
* Apache Ignite

 It would be very useful if we can get feedback on
 the most/least pref. ones from that list.


Memstor is a trademark in the US:

http://www.kingleetech.com/membrane-chemicals/additional-products/membrane-storage-products/memstor

I'd actually wondered about Membrain, but that's a different chemical
product.

Sylk is an adult product whose URL I'm not visiting at the office.

I'd think Ignite is a standard-enough English word that no one could
reasonably claim exclusivity (but IANAL).

Don


RE: [PROPOSAL] Silk as new Incubator project

2014-09-19 Thread Dennis E. Hamilton
orcnote below

-Original Message-
From: dwhyt...@gmail.com [mailto:dwhyt...@gmail.com] On Behalf Of Donald Whytock
Sent: Friday, September 19, 2014 13:52
To: general@incubator.apache.org
Subject: Re: [PROPOSAL] Silk as new Incubator project

On Fri, Sep 19, 2014 at 12:57 PM, Roman Shaposhnik ro...@shaposhnik.org
wrote:

 On Fri, Sep 19, 2014 at 8:36 AM, Christian Grobmeier
 grobme...@gmail.com wrote:
  Not saying anything on the proposal itself, I would be concerned because
  of the name Silk.
  There is this:
  http://lucidworks.com/product/integrations/silk/
[ ... ]
* Apache Silk (preferable name)
* Apache Sylk
* Apache Memstor
* Apache Ignite

 It would be very useful if we can get feedback on
 the most/least pref. ones from that list.

[ ... ]

I'd think Ignite is a standard-enough English word that no one could
reasonably claim exclusivity (but IANAL).

Don

orcnote
Ignite is used within software names, as in AIR Music Technology Ignite.  The 
splash screen says Ignite by air.  I have no idea whether Apache Ignite is 
enough for non-confusion.  Too bad about Sylk.
/orcnote


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [PROPOSAL] Silk as new Incubator project

2014-09-18 Thread Henry Saputra
Hi Cos,

Looks like a good start of the proposal.

How would this project relate to compare to existing ones like Apache
Spark, Storm, or Samza?

Would love to have comparisons to existing ASF projects section to the proposal.

Also, would you guys mind adding or soliciting more mentors?
Seemed like most of initial committers have not been involved in ASF
yet so may need some help to adjust to Apache way.

- Henry

On Thu, Sep 18, 2014 at 9:40 PM, Konstantin Boudnik c...@apache.org wrote:
 I would like to propose Silk as an Apache Incubator project. The new
 proposal is added to https://wiki.apache.org/incubator/SilkProposal and
 is duplicated below.

 --
 Regards,
   Cos


 = Silk Apache Incubator Proposal =

 == Abstract ==

 Apache Silk will be a unified In-Memory Data Fabric providing 
 high-performance,
 distributed in-memory data management software layer between various data
 sources and user applications.

 == Proposal ==

 Apache Silk is written mostly in Java and Scala with small amount of C++ code
 and will initially combine the following technologies under one unified
 umbrella:
  * In-Memory Data Grid
  * In-Memory Compute Grid
  * In-Memory Streaming Processing
 This unified in-memory fabric will provide high-performance, distributed
 in-memory software layer that sits in between various data sources and user
 applica tions. Data sources can include SQL RDBMS, NoSQL, or HDFS. 
 Applications
 APIs will be available for Java (and Java-based scripting languages), Scala,
 C++ and .NET (C#).

 GridGain Systems, Inc. submits this proposal to donate its Apache 2.0-licensed
 open source project generally known as “GridGain In-Memory Computing 
 Platform”,
 its source code, documentation, and websites to the Apache Software Foundation
 (“ASF”) with the goal of extending the vibrant open source community around
 this technology ultimately governed by “Apache Way”.  Proposed Naming

 We have been advised by the ASF mentors that the name “Silk” may not be ideal
 because the name may be too generic and may not pass ASF legal check. Here are
 the alternatives that we have come up with and any of those will be acceptable
 for the project pending the ASF legal green light:
  * Apache Silk (preferable name)
  * Apache Sylk
  * Apache Memstor
  * Apache Ignite

 == Background  Rationale ==

 In-Memory Data Fabric is a natural and evolutionary consolidation of various
 “in-memory technologies” from the last decade. From simple local caching
 (JSR-107), to distributed caching, to data grids and databases, to streaming
 and plug-n-play acceleration - the in-memory space has grown quite
 dramatically.

 With rapid advances in NVRAM and significant price reduction of traditional
 DRAM on one hand, and growing sophistication and demand for faster data
 processing on another - many users of these silo-ed technologies and products
 started to look for a “strategic approach” to in-memory - an in-memory data
 fabric - that would provide suitable APIs for different types of payloads: 
 from
 data caching, to data grids, to in-memory SQL data stores, to HPC, to 
 streaming
 processing.

 With expensive and proprietary in-memory computing products from companies 
 like
 Oracle, SAP, Microsoft, and IBM -  the developers worldwide need an unhindered
 access to advanced open source in-memory software technology, the technology
 they can trust to develop with and deploy for critical applications.  Current
 Status

 Apache Silk will be based on the technology that is currently developed by
 GridGain Systems and available under Apache 2.0 license
 (http://www.gridgain.org). The software has been in development since 2007 and
 in production since 2009. It is currently used by over 500 production
 deployments with over 1,000,000 downloads to date, and with over 20,000,000
 GridGain nodes started in the last 5 years.

 == Initial Goals ==

 The number one goal during ASF incubation will coalesce around building a true
 active and vibrant community governed by the “Apache Way”. The initial
 development goals for Silk primarily revolve around migrating the existing 
 code
 base, documentation, and refactoring of the existing internal build, test 
 release processes. We believe these initial goals are sufficiently difficult 
 to
 be considered early milestones.

 Some of the specific initial goals include:
  * Migrate the existing Silk code base to the ASF.
  * Refactor development, testing, build and release processes to work in ASF.
  * Attract developer and user interest in the new Apache Silk project.
  * Road map the integration efforts with “sister” projects in ASF eco-system 
 like Storm and Spark.
  * Incorporate externally developed features into the core Apache Silk 
 project.

 == Known Risks ==

 This proposal is not without its risks, some of which are outlined below.

 The current list of committers are primarily from GridGain Systems. One of the
 key purposes of proposing Silk for incubation is to attract new