+1 (binding)
On 4/25/17, 1:27 PM, "Julian Hyde" <jh...@apache.org> wrote:
+1 binding
> On Apr 25, 2017, at 12:48 PM, moon soo Lee <m...@apache.org> wrote:
>
> +1 (non-binding)
>
> On Tue, Apr 25, 2017 at 11:49 AM Ashutosh Chauhan <hashut...@apache.org>
> wrote:
>
>> +1 (binding)
>>
>> Thanks,
>> Ashutosh
>>
>> On Mon, Apr 24, 2017 at 5:45 AM, Luke Han <luke...@gmail.com> wrote:
>>
>>> +1 binding
>>>
>>> Love to see Superset to be new incubator project.
>>>
>>>
>>> Best Regards!
>>> ---------------------
>>>
>>> Luke Han
>>>
>>> On Sun, Apr 23, 2017 at 10:53 PM, Jeff Feng <jeff.f...@gmail.com> wrote:
>>>
>>>> Dear Apache Incubator Community,
>>>>
>>>> We have updated the Superset proposal
>>>> <https://wiki.apache.org/incubator/SupersetProposal> (copied below) for
>>>>
>>>> Apache Incubation with an additional mentor (Luke Han -
>>>> luke....@apache.org),
>>>> and would like to start a vote thread for acceptance into the
incubator.
>>>>
>>>> Our team is excited to share Superset with the Apache community and we
>>>> hope
>>>> for the your continued support!
>>>>
>>>> Cheers,
>>>> Jeff & the Superset Team
>>>>
>>>>
>>>>
>>>>
>>>> = Superset =
>>>>
>>>> == Abstract ==
>>>> Superset is an enterprise-ready web application for data exploration,
>> data
>>>> visualization and dashboarding.
>>>>
>>>> == Proposal ==
>>>> Superset is business intelligence (BI) software that helps modern
>>>> organizations visualize and interact with their data. Superset enables
>>>> users explore data from a variety of databases, assemble beautiful
>>>> dashboards and share their findings. Superset works neatly with all
>>>> modern
>>>> SQL-speaking databases, and integrates with Druid.io to provide
>> real-time,
>>>> interactive, blazing fast data access to large datasets.
>>>>
>>>> == Background ==
>>>> Data is mission critical. To succeed in this era, organizations need to
>>>> provide low-friction, intuitive and interactive access to data. It is
>>>> paramount for knowledge workers to be capable of answering their own
>>>> questions by querying, exploring and visualizing data.
>>>>
>>>> The entire business intelligence industry has pivoted from a model of
>>>> centralized top-down platforms driven by IT organizations to
>> self-service
>>>> analytics and agile workflows by any user. This shift unblocks
>>>> centralized
>>>> service bottlenecks for creating data visualizations while also
creating
>>>> an
>>>> environment that is iterative and fast-moving. This means that
business
>>>> intelligence software must also be easy and delightful to use.
>>>> Self-service analytics doesn’t mean that admin and governance features
>> are
>>>> not needed.
>>>> Modern BI tools provide fine-grain access controls and auditing
>>>> capabilities to understand how data is being used. Superset is a
>> solution
>>>> that delivers on all of these vectors.
>>>>
>>>> The technology stack is also constantly morphing - vendors are
>> struggling
>>>> to provide cheap, quick and easy solutions to access data. Business
>>>> intelligence users are finding existing solutions lacking as these
>>>> software
>>>> products either disregard or react slowly to recent game-changing
>>>> technologies like Druid.io, PrestoDB, Apache Drill, Apache Kylin,
d3.js,
>>>> React.js and iPython’s Jupyter for instance.
>>>>
>>>> == Rationale ==
>>>> Business intelligence is more relevant today than at any other point in
>>>> history. Organizations are currently very limited in options for open
>>>> source data visualization solutions, especially solutions that are both
>>>> self-service and enterprise-ready. Every company informing their
>>>> decisions
>>>> with data needs a BI tool.
>>>>
>>>> We believe that Superset will be a strong compliment to existing Apache
>>>> Software Foundation technologies by offering scalable user interactions
>> to
>>>> distributed storage and computation solutions. Users will often find
>> that
>>>> Superset can act as a catalyst for tooling that can visualize the
>>>> byproduct
>>>> of data and computation infrastructure.
>>>>
>>>> Superset has many key design elements that help fill a gap in current
>>>> solutions for organizations:
>>>> * Easy, low friction access to data through a simple, web-based data
>>>> exploration interface. Composing charts and dashboards are intuitive.
>>>> Eliminating the need to write code or SQL empowers anyone to use it.
>>>> * Access to a wide array of rich, interactive data visualization types.
>>>> * Enterprise-ready: Integration with different authentication
>> mechanisms
>>>> and granular permissions centered around actions and data access.
>>>> * Realtime & fast: Superset provides realtime analytics at the speed of
>>>> thought on very large datasets when integrated with Druid.io.
>>>> * Broad data access: Consume data out of any SQL-speaking relational
>>>> database.
>>>> * Extensible: Can be extended to talk to many noSQL databases like
>> Apache
>>>> Drill, Elastic Search, and other popular database engines.
>>>> * Fast loading dashboards with configurable web-scale caching.
>>>> * Plug-in framework that enables organizations to build custom
>> analytical
>>>> applications with new UI/UX interfaces.
>>>> * SQL Lab, a state-of-the-art SQL IDE that empowers SQL-speaking users
>>>> with more flexibility. SQL Lab integrates with the visualization
engine
>>>> seamlessly.
>>>>
>>>> == Initial Goals ==
>>>> The initial goals of the Superset project are several-fold:
>>>> * Move the existing codebase to Apache and integrate with the Apache
>>>> development process.
>>>> * Redesign the user interface and interaction model for creating
>>>> visualizations/dashboards and connecting to data sources
>>>> * Build robust support for security and governance of the tool
>> including
>>>> popular authorization modules (including Apache Ranger and Apache
>> Sentry)
>>>> and a more sophisticated permissions system
>>>> * Grow the extensibility of the project both in terms of enhanced
>>>> connectivity to NoSQL-based data sources and creating a plug-in
>> framework
>>>> that enables organizations to build custom analytical applications
which
>>>> require a new UI/UX
>>>>
>>>> == Current Status ==
>>>> By many standards, Superset is already a successful open source
project.
>>>> As
>>>> of March 2017, Superset is officially used in production at about a
>> dozen
>>>> companies, has received contributions from over one hundred
contributors
>>>> on
>>>> Github, 1500+ forks, and 12k+ stars.
>>>>
>>>> Sizeable companies like Airbnb, Yahoo! and Hortonworks have made
>>>> significant contributions, and expressed their commitment to the
>> project.
>>>> The product is feature complete and has been viable for months. It
>> already
>>>> serves as the main interface for consuming data at many companies of
>>>> different sizes.
>>>>
>>>> While the product is usable, there’s room for improvement across the
>>>> board,
>>>> starting with providing a smoother user experience around content
>>>> creation,
>>>> making sure all features work out-of-the-box on more platforms and
>>>> databases, providing better user training guides and videos, having a
>>>> predictable release process, and increasing the overall quality of the
>>>> Superset releases.
>>>>
>>>> === Meritocracy ===
>>>> We plan to invest in supporting a meritocracy. We will discuss the
>>>> requirements in an open forum. Several companies have expressed
interest
>>>> in
>>>> this project, and we intend to invite additional developers to
>>>> participate.
>>>> We will encourage and monitor community participation so that
privileges
>>>> can be extended to those that contribute.
>>>>
>>>> === Community ===
>>>> The need for an enterprise-ready data visualization and exploration
>>>> platform in the open source community is tremendous. While Superset is
>>>> fairly well known, recognized and used within the Druid.io community,
>>>> adoption is currently limited outside of that niche. There is a huge
>>>> opportunity to grow the community to hundreds if not thousands of
>>>> organizations, and we are hoping that embracing “the Apache way” will
>>>> accelerate the growth of our community.
>>>>
>>>> We have already been active at seeking and inviting contributions, and
>> are
>>>> planning to scale the project by investing time and growing the support
>>>> structure to grow the community.
>>>>
>>>> === Core Developers ===
>>>> The initial committers for Superset include experienced full stack,
>>>> front-end and data engineers:
>>>> * Maxime Beauchemin (Airbnb)
>>>> * Alanna Scott (Airbnb)
>>>> * Bogdan Kyryliuk (Airbnb)
>>>> * Vera Liu (Airbnb)
>>>> * Jeff Feng (Airbnb)
>>>> * Ashutosh Chauhan (Hortonworks)
>>>> * Nishant Bangarwa (Hortonworks)
>>>> * Slim Bouguerra (Hortonworks)
>>>> * Priyank Shah (Hortonworks)
>>>> * Sriharsha Chintalapani (Hortonworks)
>>>> * Daniel Dai (Hortonworks)
>>>>
>>>> We realize that additional employer diversity is needed, and we will
>> work
>>>> aggressively to recruit developers from additional companies.
>>>>
>>>> === Alignment ===
>>>> The initial committers strongly believe that a system for interactive
>>>> visualization of data will gain broader adoption as an open source,
>>>> community driven project, where the community can contribute not only
to
>>>> the core components, but also to a growing collection of connectors,
>>>> visualizations and improving integration a all potential data sources.
>>>> Superset already integrates closely with Apache Hive, the Hive
>> metastore,
>>>> as well as most SQL-speaking databases found in modern data ecosystems.
>>>>
>>>> == Known Risks ==
>>>>
>>>> === Orphaned Products ===
>>>> Superset is a vital component for both visualizing, accessing and
>>>> democratizing data at Airbnb. Also at Hortonworks, Superset is a core
>>>> component of the DataFlow product offering. Thus, the risk of the
>> project
>>>> being orphaned is relatively low. The project could be at risk if
>> Airbnb
>>>> changes their approach for democratizing data or if Hortonworks changes
>>>> their strategy in the market. In such an event, the committers plan to
>>>> continue working on the project on their own time, thought the progress
>>>> will likely be slower. We plan to mitigate this risk by recruiting
>>>> additional committers.
>>>>
>>>> === Inexperience with Open Source ===
>>>> The initial committers include veteran Apache members (committers and
>> PPMC
>>>> members) and other developers who have varying degrees of experience
>> with
>>>> open source projects. All have been involved with source code that has
>>>> been
>>>> released under an open source license, and several also have experience
>>>> developing code with an open source development process.
>>>>
>>>> === Homogenous Developers ===
>>>> The initial committers are employed by Airbnb Inc. and Hortonworks. We
>> are
>>>> committed to recruiting additional committers from other companies.
>>>>
>>>> === Reliance on Salaried Developers ===
>>>> It is expected that Superset development will occur on both salaried
>> time
>>>> and on volunteer time, after hours. The majority of initial committers
>> are
>>>> paid by their employer to contribute to this project. However, they are
>>>> all
>>>> passionate about the project, and we are confident that the project
will
>>>> continue even if no salaried developers contribute to the project. We
>> are
>>>> committed to recruiting additional committers including non-salaried
>>>> developers.
>>>>
>>>> === Relationships with Other Apache Products ===
>>>> To the knowledge of the Initial Committers, there are no direct
>>>> competitors
>>>> to Superset within the Apache Software Foundation. That said, Apache
>>>> Zeppelin is an indirect competitor, but it solves a different use case.
>>>>
>>>> Apache Zeppelin is a web-based notebook that enables interactive data
>>>> analytics. It enables the creation of beautiful data-driven,
interactive
>>>> and collaborative documents with SQL, Scala and more. Although a user
>> can
>>>> create data visualizations using this project, it leverages a notebook
>>>> style user interfaces and it is geared towards the Spark community
where
>>>> Scala and SQL co-exist
>>>>
>>>> We look forward to collaborating with those communities, as well as
>> other
>>>> Apache communities.
>>>>
>>>> === An Excessive Fascination with the Apache Brand ===
>>>> Superset is solving two huge challenges:
>>>> The challenge of enabling every knowledge worker to make data informed
>>>> decisions, particularly those who are not deeply skilled at writing
SQL.
>>>> The challenge of visualizing huge amounts of data interactively and in
>>>> real-time
>>>>
>>>> Superset was first developed as a data visualization solution for
>> Druid.io
>>>> as a way to visualize billions of rows of data. Since then, usage of
>>>> Superset has expanded to address data visualization use cases across
SQL
>>>> speaking data sources as well.
>>>>
>>>> Our rationale for developing Superset as an Apache project is detailed
>> in
>>>> the Rationale Section. We believe that the Apache brand and community
>>>> process will help us attract more contributors to this project, and
help
>>>> grow the footprint of the project through usage at other organizations
>> and
>>>> within other applications. Establishing consensus among users and
>>>> developers will result in a more valuable tool for everyone.
>>>>
>>>> == Documentation ==
>>>> References to further reading material:
>>>> * [[http://airbnb.io/superset/|Superset Documentation]]
>>>> * [[
>>>> https://medium.com/airbnb-engineering/caravel-airbnb-s-data-
>>>> exploration-platform-15a72aa610e5#.npqmmbu25|Blog
>>>> Post: Superset: Airbnb’s Data Exploration Platform]]
>>>> * [[
>>>> https://medium.com/airbnb-engineering/superset-scaling-data-
>>>> access-and-visual-insights-at-airbnb-3ce3e9b88a7f#.a505zvb1t|Blog
>>>> Post: Superset: Scaling Data Access & Visual Insights at Airbnb]]
>>>>
>>>> == Initial Source ==
>>>> The origin of the proposed code base can be found at
>>>> https://github.com/airbnb/superset. The code base is primarily in
>>>> Python.
>>>>
>>>> == Source and Intellectual Property Submission Plan ==
>>>> We do not expect any complications for the submission of the Superset
>> code
>>>> base. Our code is already in Github and there is only a single code
>> base.
>>>>
>>>> == External Dependencies ==
>>>> List of Python packages, from the Python Package Index (Pypi):
>>>>
>>>> * boto3
>>>> * celery
>>>> * cryptography
>>>> * flask-appbuilder
>>>> * flask-cache
>>>> * flask-migrate
>>>> * flask-script
>>>> * flask-sqlalchemy
>>>> * flask-testing
>>>> * humanize
>>>> * gunicorn
>>>> * markdown
>>>> * pandas
>>>> * parsedatetime
>>>> * pydruid
>>>> * PyHive
>>>> * python-dateutil
>>>> * requests
>>>> * simplejson
>>>> * six
>>>> * sqlalchemy
>>>> * sqlalchemy-utils
>>>> * sqlparse
>>>> * thrift
>>>> * thrift-sasl
>>>> * werkzeug
>>>>
>>>> List of Javascript packages, from NPM:
>>>> * autobind-decorator
>>>> * bootstrap
>>>> * bootstrap-datepicker
>>>> * brace
>>>> * brfs
>>>> * cal-heatmap
>>>> * classnames
>>>> * d3
>>>> * d3-cloud
>>>> * d3-sankey
>>>> * d3-scale
>>>> * d3-tip
>>>> * datamaps
>>>> * datatables-bootstrap3-plugin
>>>> * datatables.net-bs
>>>> * font-awesome
>>>> * gridster
>>>> * immutability-helper
>>>> * immutable
>>>> * jquery
>>>> * lodash.throttle
>>>> * mapbox-gl
>>>> * moment
>>>> * moments
>>>> * mustache
>>>> * nvd3
>>>> * react
>>>> * react-ace
>>>> * react-bootstrap
>>>> * react-bootstrap-table
>>>> * react-dom
>>>> * react-draggable
>>>> * react-gravatar
>>>> * react-grid-layout
>>>> * react-map-gl
>>>> * react-redux
>>>> * react-resizable
>>>> * react-select
>>>> * react-syntax-highlighter
>>>> * reactable
>>>> * redux
>>>> * redux-localstorage
>>>> * redux-thunk
>>>> * shortid
>>>> * style-loader
>>>> * supercluster
>>>> * topojson
>>>> * victory
>>>> * viewport-mercator-project
>>>>
>>>> == Cryptography ==
>>>> The proposal does not include cryptographic code.
>>>>
>>>> == Required Resources ==
>>>>
>>>> === Mailing List ===
>>>> There is a current mailing list as a Google Group “airbnb_superset”
that
>>>> we
>>>> are planning on deprecating as the Apache.org become ready to serve our
>>>> community.
>>>>
>>>> * superset-private
>>>> * superset-dev
>>>> * superset-user
>>>>
>>>> === Subversion Directory ===
>>>> Git is the preferred source control system.
>>>> http://svn.apache.org/repos/asf/incubator/superset
>>>>
>>>> == Git Repository ==
>>>> Git is the preferred source control system, we’re assuming
>>>> https://github.com/apache/incubator-superset based on the naming scheme
>>>>
>>>> == Issue Tracking ==
>>>> JIRA Superset (SUPERSET). If possible, we’d like to use Github issues &
>>>> PRs
>>>> to manage our project as much as possible. It’s been said that there
are
>>>> ways to keep Github’s issues in sync with Jira, allowing us to get best
>> of
>>>> both worlds. If that is not possible, we will comply to using Jira.
>>>>
>>>> == Other Resources ==
>>>> We currently use a set of Github integrated services that are free to
>> the
>>>> open source community, like Travis-ci, Code Climate, Coveralls,
>>>> Landscape.io, Requires.io, david-dm and Gitter. We would like to keep
>>>> using
>>>> these services as they allow us to scale contributions and optimize our
>>>> development flows. These services require some elevated rights on the
>>>> Github repository in order to set up or tune and we would like for the
>>>> committers to have the required rights.
>>>>
>>>>
>>>> == Initial Committers ==
>>>>
>>>> * Maxime Beauchemin <maxime.beauche...@airbnb.com> - PPMC & Committer
>>>> * Alanna Scott <alanna.sc...@airbnb.com> - PPMC & Committer
>>>> * Bogdan Kyryliuk <b.kyryl...@gmail.com> - PPMC & Committer
>>>> * Vera Liu <vera....@airbnb.com> - Committer
>>>> * Jeff Feng <jeff.f...@airbnb.com> - PPMC & Committer
>>>> * Ashutosh Chauhan <hashut...@apache.org> - Mentor & Committer
>>>> * Nishant Bangarwa <nbanga...@hortonworks.com> - PPMC & Committer
>>>> * Slim Bouguerra <sbougue...@hortonworks.com> - Committer
>>>> * Priyank Shah <ps...@hortonworks.com> - Committer
>>>> * Harsha Chintalapani <schintalap...@hortonworks.com> - Committer
>>>> * Daniel Dai <da...@apache.org> - Champion & Committer
>>>> * Luke Han <luke....@apache.org> - Mentor
>>>>
>>>> == Affiliations ==
>>>> The initial committers are employees of Airbnb Inc. and Hortonworks.
>>>>
>>>> == Sponsors ==
>>>>
>>>> === Champion ===
>>>> Daniel Dai <da...@apache.org>
>>>>
>>>> === Nominated Mentors ===
>>>> * Ashutosh Chauhan <hashut...@apache.org>
>>>> * Luke Han <luke....@apache.org>
>>>>
>>>> === Sponsoring Entity ===
>>>> Incubator PMC
>>>>
>>>
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
