I wanna assign timestamp after keyBy.
because the stream does not aligned before keyBy.
I’ve already tested as like your code.
It occured many warnings that timestamp monotony violated.
> On Sep 8, 2016, at 4:32 PM, Dong-iL, Kim wrote:
>
> Thanks for replying. pushpendra.
> The ass
Thanks for replying. pushpendra.
The assignTimestamp method returns not KeyedStream but DataStream.
so I cannot use windowing.
is it possible casting to KeyedStream?
Regards
> On Sep 8, 2016, at 3:12 PM, pushpendra.jaiswal
> wrote:
>
> Please refer
> https://ci.apache.org/projects/flink/flink-d
Hi.
my stream data is from some files. ( files -> kafka -> flink(source -> keyBy ->
windowing) )
data is arranged in a file.
I wanna assingTimestamp after keyBy.
How can I do that.
Regards.
Hi,
I’m using HDFS as state backend.
The checkpoints folder grows bigger every moments.
What shall I do?
Regards.
g everything as it is,
> except instead of using "ValueState" in the RichFlatMapFunction, you use a
> java.util.HashMap
> - If the program works within windows, it could be that events arrive out
> of order (are you using Event Time here?)
>
> Greetings,
>
Hi. Stephan.
do you mean using map on local excution?
I’ve tested it but not works at all.
Thanks.
> On Aug 15, 2016, at 4:56 PM, Dong-iL, Kim wrote:
>
> Hi.
> I've tested the program with window function(keyBy->window->collect). it has
> no problem.
>
>
in the same way or not.
>
> Greetings,
> Stephan
>
>
>
>
> On Fri, Aug 12, 2016 at 12:46 PM, Dong-iL, Kim <mailto:kim.s...@gmail.com>> wrote:
> Hi.
> I checked order of data. but it is alright.
> Is there any other possibilities?
> Thank you.
>
lier
> event that creates the state?
>
> Greetings,
> Stephan
>
> On Fri, Aug 12, 2016 at 12:04 PM, Dong-iL, Kim <mailto:kim.s...@gmail.com>> wrote:
> Nope.
> I added log in End.
> but there is same log.
> is there any fault in my code?
>
> thank you.
quot;CommCardHistory" where you check the state.
>
> On Fri, Aug 12, 2016 at 6:59 AM, Dong-iL, Kim wrote:
>> in my code, is the config of ExecutionEnv alright?
>>
>>
>>> On Aug 11, 2016, at 8:47 PM, Dong-iL, Kim wrote:
>>>
>>>
>>&
in my code, is the config of ExecutionEnv alright?
> On Aug 11, 2016, at 8:47 PM, Dong-iL, Kim wrote:
>
>
> my code and log is as below.
>
>
>val getExecuteEnv: StreamExecutionEnvironment = {
>val env =
> StreamExecutionEnvironment.getExecutionEnvi
; Also, do you use Flink standalone or on Yarn?
>
> Stephan
>
> On Tue, Aug 9, 2016 at 11:00 AM, Dong-iL, Kim <mailto:kim.s...@gmail.com>> wrote:
> Hi.
> I’m trying to set external hdfs as state backend.
> my os user name is ec2-user. hdfs user is hadoop.
> there is a
ug 11, 2016, at 7:01 PM, Ufuk Celebi wrote:
>
> What do you mean with lost exactly?
>
> You call value() and it returns a value (!= null/defaultValue) and you
> call it again and it returns null/defaultValue for the same key with
> no update in between?
>
> On Thu, Aug 11,
Hi.
I’m using flink 1.0.3 on aws EMR.
sporadically value of ValueState is lost.
what is starting point for solving this problem.
Thank you.
Hi.
I’m trying to set external hdfs as state backend.
my os user name is ec2-user. hdfs user is hadoop.
there is a permission denied exception.
I wanna specify hdfs user name.
I set hadoop.job.ugi in core-site.xml and HADOOP_USER_NAME on command line.
but not works.
what shall I do?
thanks.
s"Field order of input type $inputType is not deterministic." )
}
when A is a PojoType, hasDeterministicFieldOrder always returns false.
what shall I do using Pojo.
Thanks.
> On Aug 1, 2016, at 6:11 PM, Dong-iL, Kim wrote:
>
> I’ve tried like this, but not work.
&
field
> order.
>
> Am 01/08/16 um 10:56 schrieb Dong-iL, Kim:
>> Hi Timo.
>> I’m using scala API.
>> There is no error with java API.
>> my code snippet is this.
>>
>> dataSet.toTable
>> .groupBy(“id")
>>
ot;pojoField as a, pojoField2
> as b");
>
> I hope that helps. Otherwise it would help if you could supply a code snippet
> of your program.
>
> Timo
>
> Am 01/08/16 um 10:19 schrieb Dong-iL, Kim:
>> my flink ver is 1.0.3.
>> thanks.
>>
>>> On
my flink ver is 1.0.3.
thanks.
> On Aug 1, 2016, at 5:18 PM, Dong-iL, Kim wrote:
>
> I’ve create a program using table API and get an exception like this.
> org.apache.flink.api.table.ExpressionException: You cannot rename fields upon
> Table creation: Field order of input type
I’ve create a program using table API and get an exception like this.
org.apache.flink.api.table.ExpressionException: You cannot rename fields upon
Table creation: Field order of input type PojoType<….> is not deterministic.
There is an error not in java program, but in scala program.
how can I us
I’m sorry. I’ve asked but there is no reply.
I wanna add config file to class path.(eg. hibernate.cfg.xml)
I’ve put it in FLINK_LIB_DIR. It was shipped but not in class path.
I’ve used the option(-C, —class path) of flink common but not work.
what shall I do?
public Request map(String value) throws Exception {
> return objectMapper.readValue(value, Request.class);
> }
> })
>
> On Fri, Jul 22, 2016 at 5:20 PM, Dong iL, Kim wrote:
>
>> oops. stephan already answered.
>> sorry. T^T
>>
>
oops. stephan already answered.
sorry. T^T
On Sat, Jul 23, 2016 at 12:16 AM, Dong iL, Kim wrote:
> is open method signature right? or typo?
>
> void open(Configuration parameters) throws Exception;
>
> On Sat, Jul 23, 2016 at 12:09 AM, Stephan Ewen wrote:
>
>> I thi
is open method signature right? or typo?
void open(Configuration parameters) throws Exception;
On Sat, Jul 23, 2016 at 12:09 AM, Stephan Ewen wrote:
> I think you overrode the open method with the wrong signature. The right
> signature would be "open(Configuration cfg) {...}". You probably over
rking.
Best Regards,
Dong-iL, Kim.
--
http://www.kiva.org"; TARGET="_top">
http://www.kiva.org/images/bannerlong.png"; WIDTH="460"
HEIGHT="60" ALT="Kiva - loans that change lives" BORDER="0"
ALIGN="BOTTOM">
24 matches
Mail list logo
