Nice, really good news on the INFRA front! I think the hardware specs sound reasonable. And a periodic backup of the website's database to Infra's backup solution sounds reasonable too.
Can you accept and review my proposal for the website? On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <becket....@gmail.com> wrote: > > > > I have a very capable and motivated frontend developer who would be > > willing to implement what I've mocked in my proposal. > > > That is awesome! > > I created a Jira ticket[1] to Apache Infra and got the reply. It looks that > Apache infra team could provide a decent VM. The last piece is how to > ensure the data is persisted so we won't lose the project info / user > feedbacks when the VM is down. If Apache infra does not provide a > persistent storage for DB backup, we can always ask for multiple VMs and do > the fault tolerance by ourselves. It seems we can almost say the hardware > side is also ready. > > Thanks, > > Jiangjie (Becket) Qin > > [1] https://issues.apache.org/jira/browse/INFRA-18010 > > On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rmetz...@apache.org> > wrote: > > > Thank you for reaching out to Infra and the ember client. > > When I first saw the Ember repository, I thought it is the whole thing > > (frontend and backend), but while testing it, I realized it is "only" the > > frontend. I'm not sure if it makes sense to adjust the Ember observer > > client, or just write a simple UI from scratch. > > I have a very capable and motivated frontend developer who would be > > willing to implement what I've mocked in my proposal. > > In addition, I found somebody (Congxian Qiu) who seems to be eager to > help > > with this project for the backend: > > https://github.com/rmetzger/flink-community-tools/issues/4 > > > > For Infra: I made the same experience when asking for more GitHub > > permissions for "flinkbot": They didn't respond on their mailing list, > only > > on Jira. > > > > > > > > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <becket....@gmail.com> wrote: > > > >> Thanks for writing up the specifications. > >> > >> Regarding the website source code, Austin found a website[1] whose > >> frontend code[2] is available publicly. It lacks some support (e.g > login), > >> but it is still a good starting point. One thing is that I did not find > a > >> License statement for that source code. I'll reach out to the author to > see > >> if they have any concern over our usage. > >> > >> Apache Infra has not replied to my email regarding some details about > the > >> VM. I'll open an infra Jira ticket tomorrow if there is still no > response. > >> > >> Thanks, > >> > >> Jiangjie (Becket) Qin > >> > >> [1] https://emberobserver.com/ > >> [2] https://github.com/emberobserver/client > >> > >> > >> > >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rmetz...@apache.org> > >> wrote: > >> > >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company > >>> website. I guess the likelihood that they give out code from their > company > >>> website is fairly low. > >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll > >>> reactivate as part of this PR: > >>> https://github.com/apache/flink-web/pull/187 > >>> > >>> Spark-packages.org did not respond to my request. > >>> I will propose a short specification in Becket's initial document. > >>> > >>> > >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <ni...@basjes.nl> wrote: > >>> > >>>> Hi, > >>>> > >>>> The Beam project has something in this area that is simply a page > >>>> within their documentation website: > >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/ > >>>> > >>>> Niels Basjes > >>>> > >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bowenl...@gmail.com> wrote: > >>>> > > >>>> > Confluent hub for Kafka is another good example of this kind. I > >>>> personally like it over the spark site. May worth checking it out with > >>>> Kafka folks > >>>> > > >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <becket....@gmail.com> > >>>> wrote: > >>>> >> > >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the > >>>> >> ecosystem page and the navigation. > >>>> >> > >>>> >> Thanks, > >>>> >> > >>>> >> Jiangjie (Becket) Qin > >>>> >> > >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rmetz...@apache.org > > > >>>> wrote: > >>>> >> > >>>> >> > Okay. I will reach out to spark-packages.org and see if they are > >>>> willing > >>>> >> > to share. > >>>> >> > > >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe > sync > >>>> with > >>>> >> > the "Software Projects" listed here: > >>>> >> > > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) > >>>> and > >>>> >> > link it in the navigation? > >>>> >> > > >>>> >> > Best, > >>>> >> > Robert > >>>> >> > > >>>> >> > > >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <becket....@gmail.com > > > >>>> wrote: > >>>> >> > > >>>> >> >> Hi Robert, > >>>> >> >> > >>>> >> >> I think it at least worths checking if spark-packages.org > owners > >>>> are > >>>> >> >> willing to share. Thanks for volunteering to write the > requirement > >>>> >> >> descriptions! In any case, that will be very helpful. > >>>> >> >> > >>>> >> >> Since a static page has almost no cost, and we will need it to > >>>> redirect > >>>> >> >> to the dynamic site anyways, how about we first do that while > >>>> working on > >>>> >> >> the dynamic website? > >>>> >> >> > >>>> >> >> Thanks, > >>>> >> >> > >>>> >> >> Jiangjie (Becket) Qin > >>>> >> >> > >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <u...@apache.org> > >>>> wrote: > >>>> >> >> > >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We > >>>> could then > >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we > >>>> have the > >>>> >> >>> resources in the community to quickly start with a dynamic > site, > >>>> I'm > >>>> >> >>> not apposed. > >>>> >> >>> > >>>> >> >>> – Ufuk > >>>> >> >>> > >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger < > >>>> rmetz...@apache.org> > >>>> >> >>> wrote: > >>>> >> >>> > > >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs > >>>> hosted by > >>>> >> >>> Infra > >>>> >> >>> > look suitable. > >>>> >> >>> > > >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used > to > >>>> be > >>>> >> >>> linked, > >>>> >> >>> > but has been removed from the navigation bar for some reason. > >>>> This is > >>>> >> >>> the > >>>> >> >>> > page: https://flink.apache.org/ecosystem.html > >>>> >> >>> > We could update the page and add it back to the navigation > bar > >>>> for the > >>>> >> >>> > coming weeks. What do you think? > >>>> >> >>> > > >>>> >> >>> > I would actually like to push for a dynamic page right away. > >>>> >> >>> > > >>>> >> >>> > I know it's kind of a bold move, but how do you feel about > >>>> sending the > >>>> >> >>> > owners of spark-packages.org a short note, if they are > >>>> interested in > >>>> >> >>> > sharing the source? We could maintain the code together in a > >>>> public > >>>> >> >>> repo. > >>>> >> >>> > If they are not interested in sharing, or we decide not to > ask > >>>> in the > >>>> >> >>> first > >>>> >> >>> > place, I'm happy to write down a short description of the > >>>> requirements, > >>>> >> >>> > maybe some mockups. We could then see if we find somebody > here > >>>> in the > >>>> >> >>> > community who's willing to implement it. > >>>> >> >>> > Given the number of people who are eager to contribute, I > >>>> believe we > >>>> >> >>> will > >>>> >> >>> > be able to find somebody pretty soon. > >>>> >> >>> > > >>>> >> >>> > > >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin < > >>>> becket....@gmail.com> > >>>> >> >>> wrote: > >>>> >> >>> > > >>>> >> >>> > > Forgot to provide the link... > >>>> >> >>> > > > >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache > >>>> infra > >>>> >> >>> services) > >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail > >>>> provided > >>>> >> >>> by > >>>> >> >>> > > Apache Infra) > >>>> >> >>> > > > >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin < > >>>> becket....@gmail.com> > >>>> >> >>> wrote: > >>>> >> >>> > > > >>>> >> >>> > >> Hi Robert, > >>>> >> >>> > >> > >>>> >> >>> > >> Thanks for the feedback. These are good points. We should > >>>> absolutely > >>>> >> >>> > >> shoot for a dynamic website to support more interactions > in > >>>> the > >>>> >> >>> community. > >>>> >> >>> > >> There might be a few things to solve: > >>>> >> >>> > >> 1. The website code itself. An open source solution would > >>>> be great. > >>>> >> >>> TBH, > >>>> >> >>> > >> I do not have much experience on building a website. It'll > >>>> be great > >>>> >> >>> if > >>>> >> >>> > >> someone could help comment on the solution here. > >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides > >>>> a few > >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not > see > >>>> >> >>> database > >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD > >>>> jail[2]. > >>>> >> >>> > >> > >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback! > >>>> >> >>> > >> > >>>> >> >>> > >> @Shaoxuan Wang <wshaox...@gmail.com> > >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. > We > >>>> >> >>> probably need > >>>> >> >>> > >> a page in the Flink official site anyways, even just > >>>> provide links > >>>> >> >>> it to > >>>> >> >>> > >> the ecosystem website. So listing the connectors in that > >>>> static > >>>> >> >>> page seems > >>>> >> >>> > >> something we could start with while we are working on the > >>>> dynamic > >>>> >> >>> pages. > >>>> >> >>> > >> > >>>> >> >>> > >> Thanks, > >>>> >> >>> > >> > >>>> >> >>> > >> Jiangjie (Becket) Qin > >>>> >> >>> > >> > >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang < > >>>> wshaox...@gmail.com> > >>>> >> >>> > >> wrote: > >>>> >> >>> > >> > >>>> >> >>> > >>> Hi Becket and Robert, > >>>> >> >>> > >>> > >>>> >> >>> > >>> I like this idea! Let us roll this out with Flink > >>>> connectors at > >>>> >> >>> the > >>>> >> >>> > >>> first beginning. We can start with a static page, and > >>>> upgrade it > >>>> >> >>> when we > >>>> >> >>> > >>> find a better solution for dynamic one with rich > functions. > >>>> >> >>> > >>> > >>>> >> >>> > >>> Regards, > >>>> >> >>> > >>> Shaoxuan > >>>> >> >>> > >>> > >>>> >> >>> > >>> > >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger < > >>>> rmetz...@apache.org > >>>> >> >>> > > >>>> >> >>> > >>> wrote: > >>>> >> >>> > >>> > >>>> >> >>> > >>>> Hey Becket, > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> This is a great idea! > >>>> >> >>> > >>>> For this to be successful, we need to make sure the page > >>>> is placed > >>>> >> >>> > >>>> prominently so that the people submitting something will > >>>> get > >>>> >> >>> attention for > >>>> >> >>> > >>>> their contributions. > >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we > >>>> want > >>>> >> >>> features > >>>> >> >>> > >>>> such as up and downvoting or comments. > >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and > >>>> endorsed > >>>> >> >>> by > >>>> >> >>> > >>>> the community. > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> Does anybody here know any existing software that we > >>>> could use? > >>>> >> >>> > >>>> The only think I was able to find is AUR: > >>>> >> >>> https://aur.archlinux.org/ > >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The > >>>> source > >>>> >> >>> code of this > >>>> >> >>> > >>>> portal is open source, but the layout and structure is > >>>> not an > >>>> >> >>> ideal fit for > >>>> >> >>> > >>>> our requirements) > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> Best, > >>>> >> >>> > >>>> Robert > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin < > >>>> becket....@gmail.com> > >>>> >> >>> > >>>> wrote: > >>>> >> >>> > >>>> > >>>> >> >>> > >>>>> Hi folks, > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>>> I would like to start a discussion thread about > creating > >>>> a Flink > >>>> >> >>> > >>>>> ecosystem website. The website aims to help > contributors > >>>> who > >>>> >> >>> have developed > >>>> >> >>> > >>>>> projects around Flink share their work with the > >>>> community. > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>>> Please see the following doc for more details. > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>> > https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit# > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>>> Thanks, > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>>> Jiangjie (Becket) Qin > >>>> >> >>> > >>>>> > >>>> >> >>> > >>>> > >>>> >> >>> > >>>> >> >> > >>>> > >>>> > >>>> > >>>> -- > >>>> Best regards / Met vriendelijke groeten, > >>>> > >>>> Niels Basjes > >>>> > >>> >
