Thanks all for the reply and insights! I am going to investigate the grpc passthru feature which is supported by the API gateway product. Btw, I wrote a simple Arrow Flight Server in python, but I couldn't figure out how to call it from grpcurl (all my attempts failed), is that even possible? ________________________________ From: Hélder Gregório <[email protected]> Sent: Saturday, March 15, 2025 8:28 AM To: [email protected] <[email protected]> Subject: Re: api gateway with arrow flight grpc
Hi, I'm not sure about integration with the services you mentioned but assuming some responsibilities of the API Gateway are handling authentication and load balancing, you can implement a flight proxy by creating a service that implements FlightProducer interface. The service can access headers for validation if needed and redirect vectors it receives to the designated flight server using another flight client. Hope it helps On Sat, Mar 15, 2025 at 3:03 AM kekronbekron <[email protected]<mailto:[email protected]>> wrote: Sure - https://www.definite.app/blog/duck-takes-flight https://blobs.duckdb.org/events/duckcon6/rusty-conover-airport-for-duckdb-letting-duckdb-take-apache-arrow-flights.pdf On Saturday, March 15th, 2025 at 01:25, Bryce Mecum <[email protected]<mailto:[email protected]>> wrote: > Hi kekronbekron, can you share any pointers to the pattern you mention > and where people are talking about it? It sounds like something I > might be interested in tracking. > > On Thu, Mar 13, 2025 at 7:27 PM kekronbekron > [email protected]<mailto:[email protected]> wrote: > > > I'm embarking on exactly this. > > Amusing how this pattern has become "vocal" in the past few weeks, though > > Flight has existed for a few years now. > > > > On Friday, March 14th, 2025 at 03:56, Paul Whalen > > [email protected]<mailto:[email protected]> wrote: > > > > I haven’t used anything you’ve mentioned, but I have deployed an arrow > > flight server in an istio/envoy service mesh, and seen all the benefits of > > gRPC in that context without any trouble. > > > > I’ve often though it would be fun to write an envoy filter for the Flight > > or Flight SQL protocol, but it isn’t clear to me that there’s much demand > > for it (for comparison, there’s one for Postgres: > > https://www.envoyproxy.io/docs/envoy/latest/intro/arch_overview/other_protocols/postgres). > > > > Paul > > > > On Mar 13, 2025, at 5:05 PM, Z A > > [email protected]<mailto:[email protected]> wrote: > > > > Thanks Felipe! > > ________________________________ > > From: Felipe Oliveira Carvalho > > [email protected]<mailto:[email protected]> > > Sent: Thursday, March 13, 2025 12:29 AM > > To: [email protected]<mailto:[email protected]> > > [email protected]<mailto:[email protected]> > > Subject: Re: api gateway with arrow flight grpc > > > > No, but if these are gRPC proxies they should work. > > > > On Wed, 12 Mar 2025 at 18:13 Z A > > [email protected]<mailto:[email protected]> wrote: > > > > Hi, > > I just subscribed to this mailing list, and apologize if this is a silly > > question. > > Has anyone ever done any integration of API Gateway (i.e. Kong, Tyk, > > KrakenD, etc.) with your own Arrow Flight Server? > > Thanks!
