Re: [AIP-44] PoC JSON RPC

Makes sense. It's ok exchanging a json, but it's also important to provide a schema for input validation in those cases. Yes, you'll have to maintain the schema, but safer is better than sorry. Two questions: 1. which is the model that you want to serialize? I don't see a clear speration of conce

Re: [AIP-44] PoC JSON RPC

Hello, this is something i'd like to work too in my spare time but some i'd rather use flatbuffers for the payload since its duality json/binary. Flatbuffers have the nice feature that they're able to parse JSON files that conform to a schema into FlatBuffer binary files, so you c

Re: [LOOKING FOR MENTORS] New Outreachy and Season of Docs rounds

writer recruiting > began on February 3, 2022. > > For more information about the program visit the Season of Docs site > <http://developers.google.com/season-of-docs>. If you have additional > questions, please email the Season of Docs team at season-of-docs > @google.com > . > > Best, > > The Season of Docs team > > On Sun, Feb 27, 2022 at 11:30 PM Giorgio Zoppi > wrote: > >> Same here Jarek, >> I am willing to help. This has been the reason that I joined the last >> call. It will nice to have a better monitoring. >> >>

Re: [LOOKING FOR MENTORS] New Outreachy and Season of Docs rounds

Same here Jarek, I am willing to help. This has been the reason that I joined the last call. It will nice to have a better monitoring.

Re: Muti-tenancy Meeting #4 summary

Hello, It was quite interesting. From my side, we have done some work in the past with GRPC and with envoy proxy translating calls from REST to GRPC. The problem was to store remotely browser settings. - https://blog.envoyproxy.io/envoy-and-grpc-web-a-fresh-new-alternative-to-rest-6504ce7eb880 - ht

Re: [DISCUSSION] AIP-47 New design of Airflow System Tests

Hello Mateuz, it's ok for me. Good. BR, Giorgio Il giorno mar 15 feb 2022 alle ore 10:51 Mateusz Nojek ha scritto: > Hello again, > > I agree with your (Niko, Giorgio) points that the environment needs to be > set up as easy as possible, but I will leave it to the providers, as > mentioned befor

Re: [sig-multitenancy]: Meeting for multi-tenancy state and AIP-45/AIP-46 introductory discussions

Hello Everyone, is there any follow up of this meeting? I would like to participate if it's possible. Best Regards, Giorgio Il giorno mar 1 feb 2022 alle ore 15:29 Jarek Potiuk ha scritto: > Hello Everyone, > > I think it's about the time for the next sig-multitenancy meeting : > > I created a

Re: [DISCUSSION] AIP-47 New design of Airflow System Tests

Hello, we had some experiments last year about using Airflow to run tests directly from the CI, it was good but at the end we had no way to complete the solution, also it was a bit too much. The good thing of that is that: - you can create dependencies between testsets - you can trigger via CI (Jen

Re: [DISCUSSION] Specify tasks to skip when triggering DAG

Hey Jurek, Just a question about the future development, is the XComm backend replaceable now? The real power of Airflow is the 'defacto' the glue between different ways of mangling data, such as Python is the glue when you need to implement things a lower level, ie. Altair Simulation software is

Re: Performance.

ate threads for each of the questions you > have (in Github Discussions) this is a much more efficient way of asking > for help. But Again DevList is likely not the best place to ask those > questions. > > J > > > On Tue, Feb 1, 2022 at 8:42 PM Giorgio Zoppi > wrote: > >

Performance.

Hi devs, I have tried multiple LocalExecutors in 16GB vm and sometimes I have experienced workers consuming a lot of memory, Is this normal? Is there any incoming activity to improve worker performance for python operators? Is there any java/go operator available? Best Regards, Giorgio

Re: [sig-multitenancy]: Meeting for multi-tenancy state and AIP-45/AIP-46 introductory discussions

Hello, can i join the meeting? I am reviewing airflow in depth. I am interested in helping. Best Regards, Giorgio.

Re: Can airflow be used for automated testing?

Hello Kamil, looks like Airflow is a task executor, can I use it for executing any shell script, any python code or java code. Am i wrong? Well, i have found some medium post https://towardsdatascience.com/selenium-on-airflow-automate-a-daily-online-task-60afc05afaae So theoretically i can do what

Re: Can airflow be used for automated testing?

Hello, for black box testing, using the dag where each node there is a test. So when i trigger the flow every night, i would have automagically the test and report done, independently from technologies. Best Regards, Girogio -- Life is a chess game - Anonymous.

Can airflow be used for automated testing?

Hello, has anyone used airflow for automated testing? Best Regards, Giorgio