Re: Docker/Helm releases

2020-09-16 Thread Kaxil Naik
Thanks, will check it out this week. On Wed, Sep 16, 2020, 14:11 Jarek Potiuk wrote: > My proposal > > https://cwiki.apache.org/confluence/display/COMDEV/Updates+of+policies+for+the+convenience+packages > have > gone through the first round of comments and updates. I invite more voices > to the

Re: Docker/Helm releases

2020-09-16 Thread Jarek Potiuk
My proposal https://cwiki.apache.org/confluence/display/COMDEV/Updates+of+policies+for+the+convenience+packages have gone through the first round of comments and updates. I invite more voices to the discussion: https://lists.apache.org/thread.html/rcb608739206d788785081073a0deb417ffa9981634975fc552

Re: Docker/Helm releases

2020-09-13 Thread Jarek Potiuk
Hello Everyone, As promised, I prepared a draft of the proposal of changes that I would love if a number of interested people discuss it, comment, criticise, agree on eventually, and submit to the ASF Board for Approval. I tried to capture all the context, but also I marked clearly all the propos

Re: Docker/Helm releases

2020-09-09 Thread Daniel Imberman
Thank you Niclas, this will help us a lot in figuring out our helm situation via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.6&source=email_footer_2] On Wed, Sep 9, 2020 at 5:36 AM, Kaxil Naik wrote: Credits to Jarek on that one, he is the one who is actually dra

Re: Docker/Helm releases

2020-09-09 Thread Kaxil Naik
Credits to Jarek on that one, he is the one who is actually drafting the proposal. On Wed, Sep 9, 2020, 13:31 Niclas Hedhman wrote: > Corporate requirements are typically that they can build everything from > sources and have clear instructions (preferably scriptable) on how to do > that. > > Go

Re: Docker/Helm releases

2020-09-09 Thread Niclas Hedhman
Corporate requirements are typically that they can build everything from sources and have clear instructions (preferably scriptable) on how to do that. Good to hear that ComDev is in the loop and you are together working on draft proposals. It will be greatly appreciated. Niclas On Wed, Sep 9

Re: Docker/Helm releases

2020-09-09 Thread Kaxil Naik
Thanks for your thoughtful reply. It clarifies few things but we will also definitely wait until the lines/rules are more clearer and we (Airflow PMC) would be very happy to help shape the rules if needed. On Wed, Sep 9, 2020, 13:26 Niclas Hedhman wrote: > No changes have been decided on recentl

Re: Docker/Helm releases

2020-09-09 Thread Niclas Hedhman
No changes have been decided on recently. If you have external dependencies that can be viewed as System Requirements, then you don't need to provide your own build instructions. Think; "Windows is a (optional) System Requirement" and what is reasonable in that case. So Docker itself could be a S

Re: Docker/Helm releases

2020-09-09 Thread Jarek Potiuk
Added Niclas to my response :). Responding to devlist when someone from outside of it sends a message is tricky :) On Wed, Sep 9, 2020 at 12:35 PM Jarek Potiuk wrote: > Hello Niclas, > > Thanks for that. > > I feel that this guidance already answers most of my questions. > > I volunteered to lea

Re: Docker/Helm releases

2020-09-09 Thread Jarek Potiuk
Thanks! A really useful one. It's definitely not about bit-by-bit reproducibility. That also came in our discussion about images with the Apache Security team. I am much more advocate of what we currently have in our Production images - they are designed in the way that you should be able to have

Re: Docker/Helm releases

2020-09-09 Thread Kaxil Naik
Hi Niclas, I am glad to hear that the term "Convenience Binaries" is under review. Few things we were not clear or have some difference of opinion are: 1) Licensing a) Should we check all the binaries used in Dockerfiles for license-compliance? b) For Dockerfiles used in Helm Chart, is checkin

Re: Docker/Helm releases

2020-09-09 Thread Ash Berlin-Taylor
Jarek, you might want to check out https://reproducible-builds.org/ -- it's come out of Debian with the aim to try and make binary builds of .deb/software installed via .deb binary reproducible. I think you have less strict goals in mind than bit-for-bit identical rebuilds of docker images? If so

Re: Docker/Helm releases

2020-09-09 Thread Jarek Potiuk
Hello Niclas, Thanks for that. I feel that this guidance already answers most of my questions. I volunteered to lead proposal discussion and preparation for the ASF Board on this subject (and I am sure other PMCs from Airflow will also be engaged a lot, so I hope we can work out some reasonable

Docker/Helm releases

2020-09-08 Thread Niclas Hedhman
Hi everyone, The report submitted to the September Board meeting is requesting guidance on binary releases, such as Docker and Helm. I act as the board's shepherd of Airflow, and here to help if needed. First of all, Apache Software Foundation releases Open SOURCE software, and the source release