Re: S3 schema for jar location?

2024-08-02 Thread Ahmed Hamdy
/opt/flink/plugins/flink-s3-fs-hadoop/ ``` 1- https://mvnrepository.com/artifact/org.apache.flink/flink-s3-fs-hadoop 2- https://mvnrepository.com/artifact/org.apache.flink/flink-s3-fs-presto Best Regards Ahmed Hamdy On Fri, 2 Aug 2024 at 00:05, Maxim Senin via user wrote: > When will Fl

Re: Elasticsearch 8.x Connector in Maven

2024-07-31 Thread Ahmed Hamdy
] for a release manager to pick up the 3.1 release. 1-https://issues.apache.org/jira/browse/FLINK-26088 2-https://lists.apache.org/list.html?d...@flink.apache.org Best Regards Ahmed Hamdy On Wed, 31 Jul 2024 at 15:06, Rion Williams wrote: > Hi again all, > > Just following up on this as I’v

Re: Event de duplication in flink with rabbitmq connector

2024-07-18 Thread Ahmed Hamdy
ent with different configurations for rocksdb compaction. Best Regards Ahmed Hamdy On Thu, 18 Jul 2024 at 13:52, banu priya wrote: > Hi Ahmed, > > Thanks for the clarification. I see from flink documentation that Kafka > sinks are transactional and de dupl

Re: Event de duplication in flink with rabbitmq connector

2024-07-18 Thread Ahmed Hamdy
, reprocessing is bound by the checkpoint interval which is 5 minutes, you can make it tighter if it suits your case better. Best Regards Ahmed Hamdy On Thu, 18 Jul 2024 at 11:37, banu priya wrote: > Hi All, > > Gentle reminder about bow query. > > Thanks > Banu > > On T

Re: DynamoDB Table API Connector Failing On Row Deletion - "The provided key element does not match the schema"

2024-05-31 Thread Ahmed Hamdy
https://github.com/apache/flink-connector-aws repo. One of the committers should be able to review it then. Best Regards Ahmed Hamdy On Fri, 31 May 2024 at 00:55, Rob Goretsky wrote: > Hello! > > I am looking to use the DynamoDB Table API connector to write rows to AWS > DynamoDB.

Re: Flink kafka connector for v 1.19.0

2024-05-10 Thread Ahmed Hamdy
Hi Aniket The community is currently working on releasing a new version for all the connectors that is compatible with 1.19. Please follow the announcements in Flink website[1] to get notified when it is available. 1-https://flink.apache.org/posts/ Best Regards Ahmed Hamdy On Fri, 10 May 2024

Re: Apache Flink-Redis Connector Depreciated In New Version | Adsolut Media

2024-05-09 Thread Ahmed Hamdy
Hi Kush Unfortunately there is currently no real Redis connector maintained by the Flink community. I am aware that Bahir's version might be outdated but we are currently working on a community supported connector[1] 1-https://github.com/apache/flink-connector-redis-streams Best Regards Ahmed

Re: Suggestions for aggregating records to a Kinesis Sink, (or generic Async Sink)?

2024-04-29 Thread Ahmed Hamdy
ustom process function to hold batches of records in state and emit an aggregated record but this might not be consistent with KPL aggregation of course and de-aggregated records could be not retrieved so I would advise not to take this approach. Best Regards Ahmed Hamdy On Mon, 29 Apr 2024 at 1

Re: Discussion thread : Proposal to add Conditions in Flink CRD's Status field

2024-03-27 Thread Ahmed Hamdy
I am sorry it should be "d...@flink.apache.org" Best Regards Ahmed Hamdy On Wed, 27 Mar 2024 at 13:00, Ahmed Hamdy wrote: > Hi Lajith, > Could you please open the discussion thread against "d...@apache.flink.org", > I believe it is better suited there. > Best Re

Re: Discussion thread : Proposal to add Conditions in Flink CRD's Status field

2024-03-27 Thread Ahmed Hamdy
Hi Lajith, Could you please open the discussion thread against "d...@apache.flink.org", I believe it is better suited there. Best Regards Ahmed Hamdy On Wed, 27 Mar 2024 at 05:33, Lajith Koova wrote: >  > > Hello, > > > Starting discussion thread here to discuss