[jira] [Commented] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838894#comment-17838894 ] Vadim Vararu commented on FLINK-35115: -- Great, thanks for quick fix (y) > Kinesis connector wri

[jira] [Comment Edited] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838854#comment-17838854 ] Vadim Vararu edited comment on FLINK-35115 at 4/19/24 4:54 AM

[jira] [Commented] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838854#comment-17838854 ] Vadim Vararu commented on FLINK-35115: -- [~a.pilipenko] 4.3.0 will be released for Flink 1.18

[jira] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115 ] Vadim Vararu deleted comment on FLINK-35115: -- was (Author: JIRAUSER305101): [~a.pilipenko] 4.3.0 will be released for Flink 1.18 as well, right? > Kinesis connector writes wrong Kine

[jira] [Commented] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838853#comment-17838853 ] Vadim Vararu commented on FLINK-35115: -- [~a.pilipenko] 4.3.0 will be released for Flink 1.18

[jira] [Commented] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838121#comment-17838121 ] Vadim Vararu commented on FLINK-35115: -- [~a.pilipenko] Yes, I can reproduce this consistently

[jira] [Commented] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837533#comment-17837533 ] Vadim Vararu commented on FLINK-35115: -- FYI it's reproducible in Kinesis -> Flink -> S3 sin

[jira] [Updated] (FLINK-35115) Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Vararu updated FLINK-35115: - Summary: Kinesis connector writes wrong Kinesis sequence number at stop with savepoint

[jira] [Created] (FLINK-35115) Kinesis connector writes wrong sequence number at stop with savepoint

Vadim Vararu created FLINK-35115: Summary: Kinesis connector writes wrong sequence number at stop with savepoint Key: FLINK-35115 URL: https://issues.apache.org/jira/browse/FLINK-35115 Project: Flink

[jira] [Updated] (FLINK-35115) Kinesis connector writes wrong sequence number at stop with savepoint

[ https://issues.apache.org/jira/browse/FLINK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Vararu updated FLINK-35115: - Affects Version/s: 1.18.1 > Kinesis connector writes wrong sequence number at s

[jira] [Created] (FLINK-35115) Kinesis connector writes wrong sequence number at stop with savepoint

Vadim Vararu created FLINK-35115: Summary: Kinesis connector writes wrong sequence number at stop with savepoint Key: FLINK-35115 URL: https://issues.apache.org/jira/browse/FLINK-35115 Project: Flink

Lifecycle of a map function

Hi all, I'm trying to guess understand what is the lifecycle of a map function in spark/yarn context. My understanding is that function is instantiated on the master and then passed to each executor (serialized/deserialized). What I'd like to confirm is that the function is

Re: Re:Flink batch job memory/disk leak when invoking set method on a static Configuration object.

Hi, I've run it on a standalone Flink cluster. No Yarn involved. From: Haibo Sun Sent: Friday, June 28, 2019 6:13 AM To: Vadim Vararu Cc: user@flink.apache.org Subject: Re:Flink batch job memory/disk leak when invoking set method on a static Configuration object

Flink batch job memory/disk leak when invoking set method on a static Configuration object.

Hi guys, I have a simple batch job with a custom output formatter that writes to a local file. public class JobHadoop { public static void main(String[] args) throws Exception { ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();

Broadcast state before events stream consumption

Hi all, I need to use the broadcast state mechanism (https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_state.html) for the next scenario. I have a reference data stream (slow) and an events stream (fast running) and I want to do a kind of lookup in the

Flink streaming. Broadcast reference data map across nodes

Hi all, I would like to do something similar to Spark's broadcast mechanism. Basically, i have a big dictionary of reference data that has to be accessible from all the nodes (in order to do some joins of log line with reference line). I did not find yet a way to do it. Any ideas?

Re: Is it OK to have very many session windows?

e per pane has to be kept in memory? Regards, Timo Am 20/02/17 um 16:34 schrieb Vadim Vararu: HI guys, Is it okay to have very many (tens of thousands or hundreds of thousand) of session windows? Thanks, Vadim.

Is it OK to have very many session windows?

HI guys, Is it okay to have very many (tens of thousands or hundreds of thousand) of session windows? Thanks, Vadim.

ImportTSV write to remote HDFS concurrently.

Hi guys, I'm trying to run the importTSV job and to write the result into a remote HDFS. Isn't it supposed to write data concurrently? Asking cause i get the same time with 2 and 4 nodes and i can see that there is only 1 reduce running. Where is the bottleneck? Thanks, Vadim.

unsubscribe

unsubscribe - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org

Re: Is JavaSparkContext.wholeTextFiles distributed?

Spark can create distributed datasets from any storage source supported by Hadoop, including your local file system, HDFS, Cassandra, HBase, Amazon S3 , etc. Spark supports text files, SequenceFiles

Is JavaSparkContext.wholeTextFiles distributed?

Hi guys, I'm trying to read many filed from s3 using JavaSparkContext.wholeTextFiles(...). Is that executed in a distributed manner? Please give me a link to the place in documentation where it's specified. Thanks, Vadim.

Pig 0.11.1 blocks at: Connecting to hadoop file system at: file:///

Hi, Trying to run pig in local mode: //tmp/pig-0.11.1/bin/pig -x local -m /tmp/pig.properties -f "/tmp/pig-scripts/local/pig_script.pig"/ It blocks at the: /2016-04-25 08:46:55,947 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system

Re: Exception in the bean after onException

Solved, it was an issue on the Throwable object, not a Camel one. Thanks. On Tue, Nov 4, 2014 at 9:27 AM, Vadim Vararu vararu.va...@gmail.com wrote: Yes, that works, but as i've observed, i get this way only the cause message, and not the whole stacktrace. On Mon, Nov 3, 2014 at 6:55 PM

Exception in the bean after onException

Hi, I have a global error handler that passes the exchange to a processor. I wonder why the exception attribute of the injected Exchange is null in this case? //GLOBAL ERROR MANAGEMENT onException(Throwable.class) .process(new GlobalLoggerProcessor()); I can find the message

Re: Exception in the bean after onException

the caused exception in the parameter. On Mon, Nov 3, 2014 at 4:53 PM, Vadim Vararu vararu.va...@gmail.com wrote: Hi, I have a global error handler that passes the exchange to a processor. I wonder why the exception attribute of the injected Exchange is null in this case? //GLOBAL

[Stripes-users] welcome page

Hi everybody! How could i set the welcome page to be not a .jsp, but an action, dispatched by the stripes dispatcher. I tried to do this: welcome-file-list welcome-file/Default.action/welcome-file /welcome-file-list so, i have in default package a Default class that implements ActionBean