[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17485330#comment-17485330 ] Danny Cranmer commented on FLINK-8314: -- Resolving as duplicate, since we have added Firehose support with FLIP-171 > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Connectors / Kinesis >Reporter: Ivan Mushketyk >Priority: Not a Priority > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17329749#comment-17329749 ] Flink Jira Bot commented on FLINK-8314: --- This issue has been labeled "stale-minor" for 7 days. It is closed now. If you are still affected by this or would like to raise the priority of this ticket please re-open, removing the label "auto-closed" and raise the ticket priority accordingly. > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Connectors / Kinesis >Reporter: Ivan Mushketyk >Priority: Minor > Labels: stale-minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17321611#comment-17321611 ] Flink Jira Bot commented on FLINK-8314: --- This issue and all of its Sub-Tasks have not been updated for 180 days. So, it has been labeled "stale-minor". If you are still affected by this bug or are still interested in this issue, please give an update and remove the label. In 7 days the issue will be closed automatically. > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Connectors / Kinesis >Reporter: Ivan Mushketyk >Priority: Minor > Labels: stale-minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778947#comment-16778947 ] Praveen Gattu commented on FLINK-8314: -- Hi - Kinesis FH doesn't support read functionality, so FH as Flink source doesn't make sense. However FH as sink is useful for customers as it allows managed delivery of streaming data to various AWS services and Splunk. We in Kinesis Data Analytics(https://docs.aws.amazon.com/kinesisanalytics/latest/java/how-sinks.html) have implemented this sink and support it a part of our service. If the community finds this Fh sink useful and there is interest we are happy to contribute the sink back to the project. Thanks > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Kinesis Connector >Reporter: Ivan Mushketyk >Priority: Minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311784#comment-16311784 ] Tzu-Li (Gordon) Tai commented on FLINK-8314: I have never used Kinesis FH before, but from the information I see so far, it seems like FH is essentially a "router" layer that provides better integration between Kinesis and other AWS services. The API itself seems to require configuring either S3, Splunk, etc. as the destination of a FH delivery stream. Due to this, I'm not sure how FH would make sense as a Flink source. [~ivan.mushketyk] are you already aware of any specific user cases that require FH as a Flink source? > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Kinesis Connector >Reporter: Ivan Mushketyk >Priority: Minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308524#comment-16308524 ] Bowen Li commented on FLINK-8314: - [~aljoscha] I believe this is unnecessary. First, Firehose (FH) is just a wrapper with Kinesis inside, to better integrate with AWS eg. S3. Second, users can create a FH and set Kinesis as source, and Kinesis's data will automatically goes into FH. Based on the above two reasons, I believe there's no need to create an extra FH connector and maintain it in Flink. > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Kinesis Connector >Reporter: Ivan Mushketyk >Priority: Minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-8314) Add support for Kinesis Firehose
[ https://issues.apache.org/jira/browse/FLINK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308230#comment-16308230 ] Aljoscha Krettek commented on FLINK-8314: - So this would essentially be another connector that is not exactly like Kinesis but in the same ecosystem? [~tzulitai] and [~phoenixjiangnan], what do you think? > Add support for Kinesis Firehose > > > Key: FLINK-8314 > URL: https://issues.apache.org/jira/browse/FLINK-8314 > Project: Flink > Issue Type: New Feature > Components: Kinesis Connector >Reporter: Ivan Mushketyk >Priority: Minor > > [Kinesis > Firehose|https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html] > is another product in Kinesis Family that allows zero-ops scalable stream > for delivering streaming data to S3, RedShift, Elasticsearch, etc. It has a > different > [API|http://docs.aws.amazon.com/firehose/latest/APIReference/Welcome.html]. > I can contribute this myself, but I wonder if this feature makes sense to you. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
