Re: Setting Timers in applyToKeyedState

2024-08-28 Thread Jose Vargas Badilla via user
process function with multiple keyed states whose keysets differ by several orders of magnitude. In such cases, a user may want to apply a function on just the smaller keyset. Thanks, Jose On Wed, Aug 28, 2024 at 10:47 AM Jose Vargas Badilla < jose.var...@datadoghq.com> wrote: > Hi, >

Setting Timers in applyToKeyedState

2024-08-28 Thread Jose Vargas Badilla via user
Hi, I recently learned that timers can be set in the KeyedStateFunction that is passed to KeyedBroadcastProcessFunction.Context#applyToKeyedState. The "trick" is to store a reference to the timerService that is available in processElement. This is behavior I have not seen explicitly documented be

Re: EnvironmentInformation class logs secrets passed as JVM/CLI arguments

2021-06-17 Thread Jose Vargas
; really secure. The industry practice is to either use a sidecar approach or > fetch secrets file-based (e.g., docker mounts). Even using ENV is > discouraged. > > On Wed, Jun 16, 2021 at 11:28 PM Jose Vargas > wrote: > >> Hi, >> >> I am using Flink 1.13.1 and

EnvironmentInformation class logs secrets passed as JVM/CLI arguments

2021-06-16 Thread Jose Vargas
these configuration logs. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/dev/datastream/application_parameters/#from-the-command-line-arguments [2] https://issues.apache.org/jira/browse/FLINK-14047 Thanks, -- Jose Vargas Software Engineer, Data Engineering E: j

Re: RabbitMQ source does not stop unless message arrives in queue

2021-06-01 Thread Jose Vargas
e/ sink. Hopefully, the > new FLIP-27 sources will help you guys out there! The upcoming HybridSource > in FLIP-150 [1] might also be interesting to you in finely controlling > sources. > > @Jose Vargas I've created FLINK-22698 [2] to > track your issue. Do you have a small

RabbitMQ source does not stop unless message arrives in queue

2021-05-13 Thread Jose Vargas
state. Regular checkpoints and savepoints complete successfully, it is only the stop-with-savepoint request where I see this behavior. Respectfully, Jose Vargas Software Engineer, Data Engineering E: jose.var...@fiscalnote.com fiscalnote.com <https://www.fiscalnote.com> | info.c