Hi, I don’t have any experience with Athena but this sounds doable. It seems that you only need to have some way of writing into S3 and then Athena will pick up the data in S3 when running queries. Multiple folks have used Flink to write data from Kafka into S3, the most recent case I know from the mailing lists is probably Seth (in cc), could you maybe comment if you find some time?
Best, Aljoscha > On 31. May 2017, at 04:10, Madhukar Thota <madhukar.th...@gmail.com> wrote: > > Anyone used used Amazon Athena with Apache Flink? > > I have use case where I want to write streaming data ( which is in Avro > format) from kafka to s3 by converting into parquet format and update S3 > location with daily partitions on Athena table. > > Any guidance is appreciated. >
