Re: [DISC] Self-Hosted Runners for Arrow

2023-02-16 Thread Martin Grigorov
can keep using Travis CI via Crossbow by the following > > approach: > > https://github.com/apache/arrow/pull/14751 > > > > Travis CI for https://github.com/ursacomputing/crossbow is > > sponsored by Voltron Data (not ASF) for arm64 Linux > > packages. > > > &g

Re: [DISC] Self-Hosted Runners for Arrow

2023-02-14 Thread Raúl Cumplido
s, > -- > kou > > In > "Re: [DISC] Self-Hosted Runners for Arrow" on Fri, 16 Dec 2022 19:26:36 > +0100, > Jacob Wujciak wrote: > > > No news with regards to arrow specific S390x machines but apparently IBM > > has donated a number of S

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-22 Thread Sutou Kouhei
In "Re: [DISC] Self-Hosted Runners for Arrow" on Fri, 16 Dec 2022 19:26:36 +0100, Jacob Wujciak wrote: > No news with regards to arrow specific S390x machines but apparently IBM > has donated a number of S390x VMs to the ASF which we should be able to use > but I have n

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-22 Thread Jacob Wujciak
If there are no objections we will start setting up the instance and working with INFRA to connect it to the arrow repo after the holidays. Happy Holidays Everyone! On Mon, Dec 19, 2022 at 3:15 PM Jacob Wujciak wrote: > Jarek, thank you for the glowing review :) > > Yes, we will have

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-19 Thread Jacob Wujciak
Jarek, thank you for the glowing review :) Yes, we will have monitoring setup in the instance we are going to host to protect against abuse like that but as we use a non-FOSS tool for monitoring internally there is no code included for this at this time. I would like to give a shout out to

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-18 Thread Jarek Potiuk
Comment from outside - I looked briefly at the implementation and docs and the GHA controller looks very clear and straightforward to implement. Fantastic job Jacob and big shoutout to Voltron Data for implementing and open-sourcing it. I am going to try it out in Apache Airflow very soon. We

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-16 Thread Jacob Wujciak
No news with regards to arrow specific S390x machines but apparently IBM has donated a number of S390x VMs to the ASF which we should be able to use but I have not had the time yet to investigate this option. Matt Topol schrieb am Fr., 16. Dez. 2022, 17:01: > These are awesome! Has there been

Re: [DISC] Self-Hosted Runners for Arrow

2022-12-16 Thread Matt Topol
These are awesome! Has there been any luck in reaching out to IBM to see if they could donate one or more s390x VMs to use as runners for testing the s390x builds? That is probably my only concern with Travis going away at EOY, since we don't have a way currently to test those builds on GH

[DISC] Self-Hosted Runners for Arrow

2022-12-16 Thread Jacob Wujciak
I would like to propose the addition of a self-hosted runner system to the arrow repository to add speciality runners (arm64 and CUDA). This will allow us to compensate for the arm64 jobs that previously ran on Travis, which will be turned off EOY[1]. The migration to GitHub Issues will require a