Thanks for the discussion. In https://github.com/apache/flink/pull/8067 we made an initial version on adding thrift-format support in flink, and haven't got time to finish it. Feel free to take it over and make changes. I've also linked this discussion thread in https://issues.apache.org/jira/browse/FLINK-11746.
Regards, -Yu On Tue, Jul 21, 2020 at 1:14 AM Jark Wu <imj...@gmail.com> wrote: > Thanks Dawid for the link. I have a glance at the PR. > > I think we can continue the thrift format based on the PR (would be better > to reach out to the author). > > Best, > Jark > > On Tue, 21 Jul 2020 at 15:58, Dawid Wysakowicz <dwysakow...@apache.org> > wrote: > > > Hi, > > > > I've just spotted this PR that might be helpful in the discussion: > > https://github.com/apache/flink/pull/8067 > > > > Best, > > > > Dawid > > > > On 20/07/2020 04:30, Benchao Li wrote: > > > Hi Chen, > > > > > > Thanks for bringing up this discussion. We are doing something similar > > > internally recently. > > > > > > Our use case is that many services in our company are built with > > > thrift protocol, and we > > > want to support accessing these RPC services natively with Flink SQL. > > > Currently, there are two ways that we aim to support, they are thrift > RPC > > > Sink and thrift RPC > > > temporal table (dimension table). > > > Then our scenario is that we need to support both (de)ser with > > > thrift format, and accessing > > > the thrift RPC service. > > > > > > Jeff Zhang <zjf...@gmail.com> 于2020年7月19日周日 上午9:43写道： > > > > > >> Hi Chen, > > >> > > >> Right, this is what I mean. Could you provide more details about the > > >> desr/ser work ? Giving a concrete example or usage scenario would be > > >> helpful. > > >> > > >> > > >> > > >> Chen Qin <qinnc...@gmail.com> 于2020年7月18日周六 下午11:09写道： > > >> > > >>> Jeff, > > >>> > > >>> Are you referring something like this SPIP? > > >>> > > >>> > > >> > > > https://docs.google.com/document/d/1ug4K5e2okF5Q2Pzi3qJiUILwwqkn0fVQaQ-Q95HEcJQ/edit#heading=h.x97c6tj78zo0 > > >>> Not at this moment, we are working on desr/ser work at the moment. > > Would > > >> be > > >>> good to starts discussion and learn if folks working on related areas > > and > > >>> align. > > >>> > > >>> Chen > > >>> > > >>> On Sat, Jul 18, 2020 at 6:41 AM Jeff Zhang <zjf...@gmail.com> wrote: > > >>> > > >>>> Hi Chen, > > >>>> > > >>>> Are building something like hive thrift server ? > > >>>> > > >>>> Chen Qin <qinnc...@gmail.com> 于2020年7月18日周六 上午8:50写道： > > >>>> > > >>>>> Hi there, > > >>>>> > > >>>>> Here in Pinterest, we utilize thrift end to end in our tech stack. > As > > >>> we > > >>>>> have been building Flink as a service platform, the team spent time > > >>>> working > > >>>>> on supporting Flink jobs with thrift format and successfully > > >> launched a > > >>>>> good number of important jobs in Production in H1. > > >>>>> > > >>>>> In H2, we are looking at supporting Flink SQL with native Thrift > > >>> support. > > >>>>> We have some prototypes already running in development settings and > > >>> plan > > >>>> to > > >>>>> move forward on this approach. > > >>>>> > > >>>>> In the long run, we thought out of box thrift format support would > > >>>> benefit > > >>>>> other folks as well. So the question is if there is already some > > >> effort > > >>>>> around this space we can sync with? > > >>>>> > > >>>>> Chen > > >>>>> Pinterest Data > > >>>>> > > >>>> > > >>>> -- > > >>>> Best Regards > > >>>> > > >>>> Jeff Zhang > > >>>> > > >> > > >> -- > > >> Best Regards > > >> > > >> Jeff Zhang > > >> > > > > > > > >
