Re: [DISCUSS] Migrate precommit git repos from kgyrtkirk to apache
This is the new repo: https://github.com/apache/hive-dev-box It has the initial code from Zoltan, LICENSE, NOTICE & Disclaimer-WIP file + I added Apache Header to all the files wherever possible. We need a docker space to push these built images, have requested INFRA for the same. The repo is in WIP stage, If you find something problematic, please push a fix to the repo or let me know. Some observations: * The build command works on x86 box only not on aarch64, * The github action to push the images doesn't work, that needs to be fixed -Ayush On Mon, 22 Jan 2024 at 21:55, Ayush Saxena wrote: > I think we are now not using Zoltan's repo. We are using a fork from a > contributor in the hive code.[1], I will go ahead and create a repo under > Apache Hive for hive-dev-box tomorrow & put the LICENSE, NOTICE & > DISCLAIMER-WIP files in it, Then will take things from there, atleast it > would be a starting point and all of us can take care of things from there > slowly-slowly :-) > > Shout out, if anyone has objections around it. > > -Ayush > > > [1] > https://github.com/apache/hive/blob/1aeaff2057a2f4c241f8bcc53a2a529e6e7f45d4/Jenkinsfile#L124C44-L124C65 > > On Wed, 6 Sept 2023 at 20:11, Stamatis Zampetakis > wrote: > >> Based on the discussion under LEGAL-653, it seems that the only >> requirement to migrate the repos under the Apache namespace is to >> apply the AL2 license in the majority of the files in there. >> >> I am looking for volunteers so that we can review the existing code in >> those repo and apply the AL2 license where possible. Depending on how >> many people step up we can divide the work accordingly. >> >> It would be interesting to see if we can use RAT [1] to >> automate/assist in this process. >> >> Best, >> Stamatis >> >> [1] https://creadur.apache.org/rat/apache-rat-plugin/usage.html >> >> On Thu, Aug 24, 2023 at 11:05 AM Stamatis Zampetakis >> wrote: >> > >> > For the licensing question, I just created LEGAL-653 [1]. >> > >> > [1] https://issues.apache.org/jira/browse/LEGAL-653 >> > >> > On Thu, Aug 24, 2023 at 11:55 AM Stamatis Zampetakis >> wrote: >> > > >> > > Creating the new repos should be kind of trivial. I think I will be >> > > able to do it using https://selfserve.apache.org/. >> > > >> > > Since this will bring quite a bit of code under the ASF I will wait a >> > > couple of days till I create the new repos. >> > > >> > > Once this is done, I think we can simply push the content from the old >> > > repos to the new ones. To avoid any kind of IP problems it would be >> > > best if Zoltan does this step. >> > > >> > > One thing that we may need to be careful about is the licensing of >> > > these repos. We are not going to make source releases from there but >> > > since the code will be under the ASF namespace people will assume that >> > > it is ASF licensed so they may start copy-pasting stuff from there. >> > > >> > > Is there anything preventing us from putting the code under the AL2 >> license? >> > > >> > > Best, >> > > Stamatis >> > > >> > > On Wed, Aug 23, 2023 at 6:14 PM Attila Turoczy >> > > wrote: >> > > > >> > > > Thank you, Stamatis! Also, Zoltan for the "donation" :) >> > > > >> > > > -Attila >> > > > >> > > > On Wed, Aug 23, 2023 at 4:53 PM Ayush Saxena >> wrote: >> > > > >> > > > > +1, >> > > > > Thanx Stamatis foe initiating this. This was something which was >> in my >> > > > > mind as well since long but couldn’t find time. >> > > > > >> > > > > -Ayush >> > > > > >> > > > > > On 23-Aug-2023, at 6:19 PM, Zoltan Haindrich >> wrote: >> > > > > > >> > > > > > Hey Stamatis! >> > > > > > >> > > > > > I'm happy to donate these repos / help with the migration! >> > > > > > I should have done it earlier - but it was never top >> priority...thank >> > > > > you for initiating it! >> > > > > > >> > > > > > cheers, >> > > > > > Zoltan >> > > > > > >> > > > > >> On 8/23/23 14:00, Stamatis Zampetakis wrote: >> > > > > >> Hi all, >> > > > > >> Our precommit infrastructure uses code that resides in the >> following >> > > > > repos. >> > > > > >> * https://github.com/kgyrtkirk/hive-test-kube >> > > > > >> * https://github.com/kgyrtkirk/hive-toolbox >> > > > > >> * https://github.com/kgyrtkirk/hive-dev-box >> > > > > >> These are mainly maintained by Zoltán Haindrich who is always >> helpful >> > > > > >> and kind to investigate and resolve issues. >> > > > > >> For facilitating contributions from the apache community and >> also >> > > > > >> removing some burden from Zoltan's shoulders it may be a good >> time to >> > > > > >> migrate those and put them under the apache namespace. >> > > > > >> For the initial migration, we could have a straightforward 1 >> to 1 >> > > > > >> mapping as shown below: >> > > > > >> * https://github.com/apache/hive-test-kube >> > > > > >> * https://github.com/apache/hive-toolbox >> > > > > >> * https://github.com/apache/hive-dev-box >> > > > > >> How do you feel about this? >> > > > > >> Best, >> > > > > >> Stamatis >> > > > >
Re: [DISCUSS] Migrate precommit git repos from kgyrtkirk to apache
I think we are now not using Zoltan's repo. We are using a fork from a contributor in the hive code.[1], I will go ahead and create a repo under Apache Hive for hive-dev-box tomorrow & put the LICENSE, NOTICE & DISCLAIMER-WIP files in it, Then will take things from there, atleast it would be a starting point and all of us can take care of things from there slowly-slowly :-) Shout out, if anyone has objections around it. -Ayush [1] https://github.com/apache/hive/blob/1aeaff2057a2f4c241f8bcc53a2a529e6e7f45d4/Jenkinsfile#L124C44-L124C65 On Wed, 6 Sept 2023 at 20:11, Stamatis Zampetakis wrote: > Based on the discussion under LEGAL-653, it seems that the only > requirement to migrate the repos under the Apache namespace is to > apply the AL2 license in the majority of the files in there. > > I am looking for volunteers so that we can review the existing code in > those repo and apply the AL2 license where possible. Depending on how > many people step up we can divide the work accordingly. > > It would be interesting to see if we can use RAT [1] to > automate/assist in this process. > > Best, > Stamatis > > [1] https://creadur.apache.org/rat/apache-rat-plugin/usage.html > > On Thu, Aug 24, 2023 at 11:05 AM Stamatis Zampetakis > wrote: > > > > For the licensing question, I just created LEGAL-653 [1]. > > > > [1] https://issues.apache.org/jira/browse/LEGAL-653 > > > > On Thu, Aug 24, 2023 at 11:55 AM Stamatis Zampetakis > wrote: > > > > > > Creating the new repos should be kind of trivial. I think I will be > > > able to do it using https://selfserve.apache.org/. > > > > > > Since this will bring quite a bit of code under the ASF I will wait a > > > couple of days till I create the new repos. > > > > > > Once this is done, I think we can simply push the content from the old > > > repos to the new ones. To avoid any kind of IP problems it would be > > > best if Zoltan does this step. > > > > > > One thing that we may need to be careful about is the licensing of > > > these repos. We are not going to make source releases from there but > > > since the code will be under the ASF namespace people will assume that > > > it is ASF licensed so they may start copy-pasting stuff from there. > > > > > > Is there anything preventing us from putting the code under the AL2 > license? > > > > > > Best, > > > Stamatis > > > > > > On Wed, Aug 23, 2023 at 6:14 PM Attila Turoczy > > > wrote: > > > > > > > > Thank you, Stamatis! Also, Zoltan for the "donation" :) > > > > > > > > -Attila > > > > > > > > On Wed, Aug 23, 2023 at 4:53 PM Ayush Saxena > wrote: > > > > > > > > > +1, > > > > > Thanx Stamatis foe initiating this. This was something which was > in my > > > > > mind as well since long but couldn’t find time. > > > > > > > > > > -Ayush > > > > > > > > > > > On 23-Aug-2023, at 6:19 PM, Zoltan Haindrich > wrote: > > > > > > > > > > > > Hey Stamatis! > > > > > > > > > > > > I'm happy to donate these repos / help with the migration! > > > > > > I should have done it earlier - but it was never top > priority...thank > > > > > you for initiating it! > > > > > > > > > > > > cheers, > > > > > > Zoltan > > > > > > > > > > > >> On 8/23/23 14:00, Stamatis Zampetakis wrote: > > > > > >> Hi all, > > > > > >> Our precommit infrastructure uses code that resides in the > following > > > > > repos. > > > > > >> * https://github.com/kgyrtkirk/hive-test-kube > > > > > >> * https://github.com/kgyrtkirk/hive-toolbox > > > > > >> * https://github.com/kgyrtkirk/hive-dev-box > > > > > >> These are mainly maintained by Zoltán Haindrich who is always > helpful > > > > > >> and kind to investigate and resolve issues. > > > > > >> For facilitating contributions from the apache community and > also > > > > > >> removing some burden from Zoltan's shoulders it may be a good > time to > > > > > >> migrate those and put them under the apache namespace. > > > > > >> For the initial migration, we could have a straightforward 1 to > 1 > > > > > >> mapping as shown below: > > > > > >> * https://github.com/apache/hive-test-kube > > > > > >> * https://github.com/apache/hive-toolbox > > > > > >> * https://github.com/apache/hive-dev-box > > > > > >> How do you feel about this? > > > > > >> Best, > > > > > >> Stamatis > > > > > >
Re: Subscribe to security ML (Hive Committers)
For traceability purposes, please subscribe to the mailing list with your @apache.org address. Any other requests will be denied from now onwards. The moderators (us) have no way to tell if the request comes from a valid Hive community member or a malicious attacker. On Mon, Jan 22, 2024 at 11:16 AM Stamatis Zampetakis wrote: > > The security issues are of utmost importance to ASF projects and > should be treated in a timely manner. > > Thanks Ayush for the reminder! > > Best, > Stamatis > > On Mon, Jan 22, 2024 at 11:05 AM Ayush Saxena wrote: > > > > Hi Folks, > > In case any of the committers or PMC members are not subscribed to the > > security mailing list, please subscribe & help address or share pointers if > > you can. > > > > if you are a committer, please send a mail to: > > security-subscr...@hive.apache.org > > > > This mail list is moderated, so the request needs to be approved, so please > > send a request from an email id which the moderator (like me) can identify. > > > > If you have any issues with the process, do reach out to me or any other > > moderator. > > > > -Ayush
Re: [Discuss] Enable Attachments for Hive mailing lists
+1 for me as well. We need it. -Attila On Mon, Jan 22, 2024 at 1:25 PM Ayush Saxena wrote: > Hi All, > As of now we don't allow having attachments on the hive mailing lists > (apart from security ML), This prevents us from attaching patches/design > doc or even screenshots of issues being reported on our mailing lists. > > A lot of projects allow that, I feel we should enable this for our Hive > mailing lists as well for better dev experience. > > Let me know your thoughts!!! > > Obviously a +1 from me > > -Ayush >
[Discuss] Enable Attachments for Hive mailing lists
Hi All, As of now we don't allow having attachments on the hive mailing lists (apart from security ML), This prevents us from attaching patches/design doc or even screenshots of issues being reported on our mailing lists. A lot of projects allow that, I feel we should enable this for our Hive mailing lists as well for better dev experience. Let me know your thoughts!!! Obviously a +1 from me -Ayush
Re: Re: Cleanup remote feature/wip branches
Cleanup is complete. Thanks to Krisztian and Zhihua for helping out! I only kept https://github.com/apache/hive/tree/release-1.1 cause I was unsure of its purpose. Best, Stamatis On Fri, Jan 19, 2024 at 6:46 PM Chao Sun wrote: > > +1 > > On Fri, Jan 19, 2024 at 4:33 AM Attila Turoczy > wrote: > > > > +1 > > > > On Fri, 19 Jan 2024 at 04:30, dengzhhu653 wrote: > > > > > +1 > > > At 2024-01-19 19:58:49, "Krisztian Kasa" > > > wrote: > > > >+1 > > > > > > > >On Fri, Jan 19, 2024 at 11:28 AM Alessandro Solimando < > > > >alessandro.solima...@gmail.com> wrote: > > > > > > > >> +1, thanks Stamatis > > > >> > > > >> On Fri, Jan 19, 2024, 11:14 Ayush Saxena wrote: > > > >> > > > >> > +1 > > > >> > > > > >> > -Ayush > > > >> > > > > >> > > On 19-Jan-2024, at 3:41 PM, Stamatis Zampetakis > > > >> > wrote: > > > >> > > > > > >> > > Hey everyone, > > > >> > > > > > >> > > I noticed that in our official git repo [1] we have some kind of > > > >> > > feature/WIP branches (see list below). Most of them (if not all) > > > >> > > are > > > >> > > stale, add noise, and some of them eat CI resources (storage and > > > CPU) > > > >> > > since Jenkins picks them up for builds/precommits. > > > >> > > > > > >> > > I would like to drop those at the end of this email. Please +1 if > > > you > > > >> > agree. > > > >> > > > > > >> > > Best, > > > >> > > Stamatis > > > >> > > > > > >> > > [1] https://github.com/apache/hive/branches/all > > > >> > > > > > >> > > git branch -r | grep origin | grep -v "branch-" | grep -v "master" > > > >> > > origin/HIVE-23274_280_rb > > > >> > > origin/HIVE-23337_280_rb > > > >> > > origin/HIVE-23403_280_rb > > > >> > > origin/HIVE-23440_280_rb > > > >> > > origin/HIVE-23470_rb > > > >> > > origin/HIVE-4115 > > > >> > > origin/branc-2.3 > > > >> > > origin/cbo > > > >> > > origin/dependabot/maven/com.google.protobuf-protobuf-java-3.21.7 > > > >> > > > > > >> > > > > >> > > > origin/dependabot/maven/itests/qtest-druid/org.eclipse.jetty-jetty-server-9.4.51.v20230217 > > > >> > > origin/dependabot/maven/org.apache.commons-commons-text-1.10.0 > > > >> > > > > > >> origin/dependabot/maven/org.eclipse.jetty-jetty-server-9.4.51.v20230217 > > > >> > > origin/dependabot/maven/org.postgresql-postgresql-42.4.3 > > > >> > > > > > >> > > > > >> > > > origin/dependabot/maven/standalone-metastore/com.google.protobuf-protobuf-java-3.21.7 > > > >> > > > > > >> > > > > >> > > > origin/dependabot/maven/standalone-metastore/org.eclipse.jetty-jetty-server-9.4.51.v20230217 > > > >> > > > > > >> > > > > >> > > > origin/dependabot/maven/standalone-metastore/org.postgresql-postgresql-42.4.3 > > > >> > > origin/ptf-windowing > > > >> > > origin/release-1.1 > > > >> > > origin/revert-1365-upgrade-guava > > > >> > > origin/revert-1855-HIVE-24624 > > > >> > > origin/revert-2694-HIVE-25355 > > > >> > > origin/revert-3624-HIVE-26567 > > > >> > > origin/revert-4247-hive-23256 > > > >> > > origin/revert-4306-HIVE-27330 > > > >> > > origin/revert-4452-HIVE-57988-BetweenBugFix > > > >> > > origin/revert-4501-OptimizeGetPartitionAPI > > > >> > > origin/vectorization > > > >> > > > > >> > > >
Re: Subscribe to security ML (Hive Committers)
The security issues are of utmost importance to ASF projects and should be treated in a timely manner. Thanks Ayush for the reminder! Best, Stamatis On Mon, Jan 22, 2024 at 11:05 AM Ayush Saxena wrote: > > Hi Folks, > In case any of the committers or PMC members are not subscribed to the > security mailing list, please subscribe & help address or share pointers if > you can. > > if you are a committer, please send a mail to: > security-subscr...@hive.apache.org > > This mail list is moderated, so the request needs to be approved, so please > send a request from an email id which the moderator (like me) can identify. > > If you have any issues with the process, do reach out to me or any other > moderator. > > -Ayush
Subscribe to security ML (Hive Committers)
Hi Folks, In case any of the committers or PMC members are not subscribed to the security mailing list, please subscribe & help address or share pointers if you can. if you are a committer, please send a mail to: security-subscr...@hive.apache.org This mail list is moderated, so the request needs to be approved, so please send a request from an email id which the moderator (like me) can identify. If you have any issues with the process, do reach out to me or any other moderator. -Ayush
