Re: Live configuration change

2018-11-06 Thread Nicos Maris
Ning can you provide another example except for rate limiting?

On Tue, Nov 6, 2018, 6:20 PM Piotr Nowojski  Hi,
>
> Sorry but none that I’m aware of. As far as I know, the only way to
> dynamically configure Kafka source would be for you to copy and modify it’s
> code.
>
> Piotrek
>
> > On 6 Nov 2018, at 15:19, Ning Shi  wrote:
> >
> > In the job I'm implementing, there are a couple of configuration
> > variables that I wnat to change at runtime, such as rate limit at the
> > Kafka source. I know it's possible to use a control stream and join it
> > with the normal stream to configure things in certain operators, but
> > this doesn't work for the source. Is there any other way to configure
> > settings at runtime?
> >
> > Thanks,
> >
> > --
> > Ning
>
>


Re: DatabaseClient at async example

2018-10-03 Thread Nicos Maris
Thanks Amit.

I will start with the following and see how it goes.

 
io.vertx
vertx-jdbc-client
3.3.3


org.mariadb.jdbc
mariadb-java-client
1.5.5


On Wed, Oct 3, 2018, 10:11 PM Amit Jain  wrote:

> Hi Nicos,
>
> DatabaseClient is an example class to describe the asyncio concept. There
> is no interface/class for this client in Flink codebase. You can use any
> mariaDB client implementation which supports concurrent request to DB.
>
> --
> Cheers,
> Amit
>
> On Wed, Oct 3, 2018 at 8:14 PM Nicos Maris  wrote:
>
>> Hello,
>>
>> I have a short question about the following example in your
>> documentation.
>>
>>
>> https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/operators/asyncio.html
>>
>>
>> Which is the package and the maven dependency of the class
>> DatabaseClient?
>>
>> I am building a Proof of Concept based on the above documentation and
>> mariaDB.
>>
>


Re: test windows

2018-09-08 Thread Nicos Maris
Hi all,


It took me some time to reply.

I am focusing on testing my job, not on unit tests and the SourceFunction
as in WindowFunctionITCase.scala
<https://github.com/apache/flink/blob/master/flink-streaming-scala/src/test/scala/org/apache/flink/streaming/api/scala/WindowFunctionITCase.scala>
has
helped me a lot :)


Is there any test with keyed windows?

I am writing in java with POJOs instead of tuples.

On Fri, Aug 31, 2018 at 3:43 PM David Anderson 
wrote:

> The flink training exercises have a simpler example of using a
> TwoInputStreamOperatorTestHarness from outside of the Flink code base that
> you can refer to. The two input test harness is more or less the same as
> the one input test harness.
>
>
> https://github.com/dataArtisans/flink-training-exercises/blob/master/src/test/java/com/dataartisans/flinktraining/exercises/datastream_java/process/EventTimeJoinTest.java
>
> You'll need these dependencies:
>
> 
>org.apache.flink
>flink-test-utils-junit
>${flink.version}
> 
>
> 
>org.apache.flink
>flink-streaming-java_2.11
>${flink.version}
>test
>test-jar
> 
>
> 
>org.mockito
>mockito-all
>1.10.19
>jar
>test
> 
>
> 
>org.apache.flink
>    flink-runtime_2.11
>${flink.version}
>test
>test-jar
> 
>
> On Thu, Aug 30, 2018 at 3:04 PM Nicos Maris  wrote:
> >
> > Can the OneInputStreamOperatorTestHarness be used to test pipelines with
> time windows?
> >
> > Can someone explain this test harness preferably with a tiny example?
> >
> > I see here that "it is currently not a part of public API and can be
> subject to change", but I assume it is the only thing I can get from flink
> as regards automated testing of pipelines with time windows.
> >
> > On Tue, Aug 28, 2018 at 3:12 PM Nicos Maris 
> wrote:
> >>
> >> Hi Zhengwen,
> >>
> >>
> >> I have tested my job manually (both by submitting a job and through
> execute()) and I am trying to write a test.
> >>
> >> The following project states that it has the feature "Test stream
> windowing with timestamped input" but I do not want to rely on a project
> other than flink.
> >>
> >> https://github.com/ottogroup/flink-spector
> >>
> >> The following folder doesn't seam to demonstrate such capability for
> testing.
> >>
> >>
> https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/test/java/org/apache/flink/streaming/test
> >>
> >>
> >>
> >> On Tue, Aug 28, 2018 at 2:55 PM ZhengWen ZHU  wrote:
> >>>
> >>> Hi Nicos,
> >>> Under the flink-example module, there are many examples, including
> batch and streaming.  You could build the project from the source, this way
> you could found many jars under the target directory. You can submit these
> jars to the Flink cluster. Also, you could run these examples directly from
> your IDE by standalone mode.
> >>>
> >>> best,
> >>> Zhengwen
> >>>
> >>> On Tue, Aug 28, 2018 at 7:35 PM Nicos Maris 
> wrote:
> >>>>
> >>>> Hi all,
> >>>>
> >>>>
> >>>> How can I test in Java any streaming job that has a time window?
> >>>>
> >>>>
> >>>> best,
> >>>> Nicos
> >>>
> >>>
> >>>
> >>> --
> >>> _
> >>>
> >>> Zhu Zhengwen
> >>> State Key Laboratory For Novel Software Technology
> >>> Dept. of Computer Sci. & Tech., Nanjing University
> >>> 9, Hankou Road, Nanjing, China.
>
>
>
> --
> David Anderson | Training Coordinator | data Artisans
> --
> Join Flink Forward - The Apache Flink Conference
> Stream Processing | Event Driven | Real Time
>


Re: replacing WindowFunction with AggregateFunction

2018-09-08 Thread Nicos Maris
This
<https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/windows.html#incremental-window-aggregation-with-aggregatefunction>
seams
to be the way to go but I get "cannot resolve method" at the method
'aggregate'.

My aggregareFunction implements the following:

AggregateFunction<
IngressPOJO,
CountersAccumulator,
CountersAccumulator
>

And my processWindowFunction implements the following:

ProcessWindowFunction<
CountersAccumulator,
Tuple2,
String,
TimeWindow
>


On Sun, Sep 9, 2018 at 4:40 AM Nicos Maris  wrote:

> Hi,
>
>
> I am replacing replacing my legacy
> <https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/windows.html#windowfunction-legacy>
> WindowFunction with AggregateFunction.
>
> I use TumblingEventTimeWindows, how can I get the start
> <https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/streaming/api/windowing/windows/TimeWindow.html#getStart-->
> and end time?
>


replacing WindowFunction with AggregateFunction

2018-09-08 Thread Nicos Maris
Hi,


I am replacing replacing my legacy

WindowFunction with AggregateFunction.

I use TumblingEventTimeWindows, how can I get the start

and end time?


maxOutOfOrderness

2018-09-07 Thread Nicos Maris
Hello,


Does maxOutOfOrderness

affect performance?

Setting it to Long.MAX_VALUE doesn't affect performance, so either flink is
really fast in my simple pipeline or my understanding is terribly wrong :p


Re: ODP: API for delayed/scheduled interval input source for integrationtests

2018-09-01 Thread Nicos Maris
flink-spector is not really active and I have tried it and it is not as
simple as it seams to be.

On Sat, Sep 1, 2018 at 10:45 PM Yee-Ning Cheng  wrote:

> I haven't tried it yet, but I saw flink-spector which seems to actually do
> what I want..
>
> https://github.com/ottogroup/flink-spector/wiki/Defining-Input
>
> Although having it as part of the normal API would be nice as that library
> is already out of date (1.5.0)
>
>
>
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>


Re: test windows

2018-08-30 Thread Nicos Maris
Can the OneInputStreamOperatorTestHarness
<https://github.com/apache/flink/blob/master/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorTest.java>
be used to test pipelines with time windows?

Can someone explain this test harness preferably with a tiny example?

I see here
<https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/testing.html#testing-checkpointing-and-state-handling>
that "it is currently not a part of public API and can be subject to
change", but I assume it is the only thing I can get from flink as regards
automated testing of pipelines with time windows.

On Tue, Aug 28, 2018 at 3:12 PM Nicos Maris  wrote:

> Hi Zhengwen,
>
>
> I have tested my job manually (both by submitting a job and through
> execute()) and I am trying to write a test.
>
> The following project states that it has the feature "Test stream
> windowing with timestamped input" but I do not want to rely on a project
> other than flink.
>
> https://github.com/ottogroup/flink-spector
>
> The following folder doesn't seam to demonstrate such capability for
> testing.
>
>
> https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/test/java/org/apache/flink/streaming/test
>
>
>
> On Tue, Aug 28, 2018 at 2:55 PM ZhengWen ZHU  wrote:
>
>> Hi Nicos,
>> Under the flink-example module, there are many examples, including batch
>> and streaming.  You could build the project from the source, this way you
>> could found many jars under the target directory. You can submit these jars
>> to the Flink cluster. Also, you could run these examples directly from your
>> IDE by standalone mode.
>>
>> best,
>> Zhengwen
>>
>> On Tue, Aug 28, 2018 at 7:35 PM Nicos Maris 
>> wrote:
>>
>>> Hi all,
>>>
>>>
>>> How can I test in Java any streaming job that has a time window?
>>>
>>>
>>> best,
>>> Nicos
>>>
>>
>>
>> --
>>
>>
>>
>>
>> *_Zhu ZhengwenState Key
>> Laboratory For Novel Software TechnologyDept. of Computer Sci. & Tech.,
>> Nanjing University*
>> *9, Hankou Road, Nanjing, China.*
>>
>


Re: test windows

2018-08-28 Thread Nicos Maris
Hi Zhengwen,


I have tested my job manually (both by submitting a job and through
execute()) and I am trying to write a test.

The following project states that it has the feature "Test stream windowing
with timestamped input" but I do not want to rely on a project other than
flink.

https://github.com/ottogroup/flink-spector

The following folder doesn't seam to demonstrate such capability for
testing.

https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/test/java/org/apache/flink/streaming/test



On Tue, Aug 28, 2018 at 2:55 PM ZhengWen ZHU  wrote:

> Hi Nicos,
> Under the flink-example module, there are many examples, including batch
> and streaming.  You could build the project from the source, this way you
> could found many jars under the target directory. You can submit these jars
> to the Flink cluster. Also, you could run these examples directly from your
> IDE by standalone mode.
>
> best,
> Zhengwen
>
> On Tue, Aug 28, 2018 at 7:35 PM Nicos Maris  wrote:
>
>> Hi all,
>>
>>
>> How can I test in Java any streaming job that has a time window?
>>
>>
>> best,
>> Nicos
>>
>
>
> --
>
>
>
>
> *_Zhu ZhengwenState Key Laboratory
> For Novel Software TechnologyDept. of Computer Sci. & Tech., Nanjing
> University*
> *9, Hankou Road, Nanjing, China.*
>


test windows

2018-08-28 Thread Nicos Maris
Hi all,


How can I test in Java any streaming job that has a time window?


best,
Nicos


Re: would you join a Slack workspace for Flink?

2018-08-27 Thread Nicos Maris
I agree with you Fabian.

The question then is how to instruct users to add code to their email. What
about the following? Where should it be placed?


If you send us an email with a code snippet, make sure that:

1. you do not link to files in external services as such files can change,
get deleted or the link might break and thus make an archived email thread
useless
2. you paste text instead of screenshots of text
3. you keep formatting when pasting code in order to keep the code readable
4. there are enough import statements to avoid ambiguities



On Mon, Aug 27, 2018 at 10:51 AM Fabian Hueske  wrote:

> Hi,
>
> I don't think that recommending Gists is a good idea.
> Sure, well formatted and highlighted code is nice and much better than
> posting screenshots but Gists can be deleted.
> Deleting a Gist would make an archived thread useless.
> I would definitely support instructions on how to add code to a mail.
>
> Regarding the overall topic of some kind of chat room.
> I would not participate in that.
> The Flink user mailing list is one of the most active user lists of the
> ASF.
> It's already quite challenging to keep up with the loads of mails.
> Adding a synchronous channel to that would make things worse for me.
> (That's probably also one of the reasons why the IRC channel is abandoned.)
> I can of course only speak for myself, but I would imaging that many
> members of the community who are helping out on the mailing list feel the
> same.
>
> Best,
> Fabian
>
> Am So., 26. Aug. 2018 um 15:17 Uhr schrieb Nicos Maris <
> nicos.ma...@gmail.com>:
>
>> Hi Dominik,
>>
>> I was writing about gitter just now :)
>>
>> If searchability is an issue, then indeed we could consider the free plan
>> of gitter: https://billing.gitter.im
>>
>>
>> In any case, we should instruct users who paste code snippets at the
>> mailing list to use http://gist.github.com
>>
>>
>> On Sun, Aug 26, 2018 at 4:13 PM Dominik Wosiński 
>> wrote:
>>
>>>
>>>
>>> -- Forwarded message -
>>> From: Dominik Wosiński 
>>> Date: niedz., 26 sie 2018 o 15:12
>>> Subject: ODP: would you join a Slack workspace for Flink?
>>> To: Hequn Cheng 
>>>
>>>
>>> Hey,
>>> I have been facing this issue for multiple open source projects and
>>> discussions. Slack in my opinion has two main issues :
>>>
>>>  - the already mentioned issue with searching, through
>>> search engine
>>>
>>>  - Slack is still commercial application.
>>>
>>> The second issue is quite important, because for free version Slack
>>> gives 10k messages of history. I personally think that for Flink this would
>>> to loss all messages that are older than a week possibly. This is the big
>>> issue as it woul most certainly lead to asking the same questions over and
>>> over again. I’ve seen really big slack groups for some big projects where
>>> the history would last like 3-4 days and this is pure nightmare.
>>>
>>> The better solution would be to use gitter than Slack IMHO if there is
>>> need for such way of communication.
>>>
>>> Best Regards,
>>> Dominik.
>>>
>>>
>>>
>>> Wysłane z aplikacji Poczta
>>> <https://go.microsoft.com/fwlink/?LinkId=550986> dla Windows 10
>>>
>>>
>>>
>>> *Od: *Hequn Cheng 
>>> *Wysłano: *niedziela, 26 sierpnia 2018 14:37
>>> *Do: *Nicos Maris 
>>> *DW: *ches...@apache.org; user 
>>> *Temat: *Re: would you join a Slack workspace for Flink?
>>>
>>>
>>>
>>> Hi Nicos,
>>>
>>>
>>>
>>> Thanks for bring up this discussion. :-)
>>>
>>> Slack is a good way to communicate, but it seems not very fit for the
>>> open source field. The messages on Slack are mixed up and can not be
>>> searched through search engine.
>>>
>>>
>>>
>>> Best, Hequn
>>>
>>>
>>>
>>> On Sun, Aug 26, 2018 at 7:22 PM Nicos Maris 
>>> wrote:
>>>
>>> Chesnay can you take a look at the following PR?
>>>
>>>
>>>
>>> https://github.com/apache/flink-web/pull/120
>>>
>>>
>>>
>>> On Sun, Aug 26, 2018 at 1:09 PM Chesnay Schepler 
>>> wrote:
>>>
>>> There have been previous discussions around using slack and they were
>>> rejected.
>>>
>>> Personally I would just remove the 

Re: would you join a Slack workspace for Flink?

2018-08-26 Thread Nicos Maris
Hi Dominik,

I was writing about gitter just now :)

If searchability is an issue, then indeed we could consider the free plan
of gitter: https://billing.gitter.im


In any case, we should instruct users who paste code snippets at the
mailing list to use http://gist.github.com


On Sun, Aug 26, 2018 at 4:13 PM Dominik Wosiński  wrote:

>
>
> -- Forwarded message -
> From: Dominik Wosiński 
> Date: niedz., 26 sie 2018 o 15:12
> Subject: ODP: would you join a Slack workspace for Flink?
> To: Hequn Cheng 
>
>
> Hey,
> I have been facing this issue for multiple open source projects and
> discussions. Slack in my opinion has two main issues :
>
>  - the already mentioned issue with searching, through search
> engine
>
>  - Slack is still commercial application.
>
> The second issue is quite important, because for free version Slack gives
> 10k messages of history. I personally think that for Flink this would to
> loss all messages that are older than a week possibly. This is the big
> issue as it woul most certainly lead to asking the same questions over and
> over again. I’ve seen really big slack groups for some big projects where
> the history would last like 3-4 days and this is pure nightmare.
>
> The better solution would be to use gitter than Slack IMHO if there is
> need for such way of communication.
>
> Best Regards,
> Dominik.
>
>
>
> Wysłane z aplikacji Poczta
> <https://go.microsoft.com/fwlink/?LinkId=550986> dla Windows 10
>
>
>
> *Od: *Hequn Cheng 
> *Wysłano: *niedziela, 26 sierpnia 2018 14:37
> *Do: *Nicos Maris 
> *DW: *ches...@apache.org; user 
> *Temat: *Re: would you join a Slack workspace for Flink?
>
>
>
> Hi Nicos,
>
>
>
> Thanks for bring up this discussion. :-)
>
> Slack is a good way to communicate, but it seems not very fit for the open
> source field. The messages on Slack are mixed up and can not be searched
> through search engine.
>
>
>
> Best, Hequn
>
>
>
> On Sun, Aug 26, 2018 at 7:22 PM Nicos Maris  wrote:
>
> Chesnay can you take a look at the following PR?
>
>
>
> https://github.com/apache/flink-web/pull/120
>
>
>
> On Sun, Aug 26, 2018 at 1:09 PM Chesnay Schepler 
> wrote:
>
> There have been previous discussions around using slack and they were
> rejected.
>
> Personally I would just remove the IRC channel; I'm not aware of any
> committer actually spending time there.
>
> On 25.08.2018 17:07, Nicos Maris wrote:
>
>
>
> Hi all,
>
>
>
>
>
> This mailing list is for user support and questions. If you would also use
> slack for user support and questions, then please vote at the following
> ticket. If you don't have an account at that jira, you can reply to this
> email with a "+1".
>
>
>
>
>
> [FLINK-10217 <https://issues.apache.org/jira/browse/FLINK-3862>] use
> Slack for user support and questions
>  Current status
>
> For user support and questions, users are instructed to subscribe to
> user@flink.apache.org but there are users like me who enjoy using also a
> chat channel. However, the instructions to do so are not clear and the IRC
> activity is low and it is definitely not indicative of the project's
> activity
> <https://issues.apache.org/jira/browse/FLINK-3862?focusedCommentId=16152376=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16152376>
> .
>
> The website <https://flink.apache.org/community.html> mentions that "If
> you want to talk with the Flink committers and users in a chat, there is an 
> IRC
> channel <https://flink.apache.org/community.html#irc>."
> Option 1: Use Slack
>
> An example of an Apache project that is using Slack
> <https://tedium.co/2017/10/17/irc-vs-slack-chat-history> is:
> http://mesos.apache.org/community
>
> I can assist on setting it up if at least one expert joins from the very
> beginning.
> Option 2: Keep using IRC and document it
>
> Add the missing section
> <https://github.com/apache/flink-web/blob/master/community.md#irc> at the
> website along with instructions for people who have never used IRC.
> Option 3: Use only the mailing list
>
> Use only user@flink.apache.org for user support and questions and do not
> mention IRC at the website.
>
>
>
>
>


Re: would you join a Slack workspace for Flink?

2018-08-26 Thread Nicos Maris
Chesnay can you take a look at the following PR?

https://github.com/apache/flink-web/pull/120

On Sun, Aug 26, 2018 at 1:09 PM Chesnay Schepler  wrote:

> There have been previous discussions around using slack and they were
> rejected.
>
> Personally I would just remove the IRC channel; I'm not aware of any
> committer actually spending time there.
>
> On 25.08.2018 17:07, Nicos Maris wrote:
>
>
> Hi all,
>
>
> This mailing list is for user support and questions. If you would also use
> slack for user support and questions, then please vote at the following
> ticket. If you don't have an account at that jira, you can reply to this
> email with a "+1".
>
>
> [FLINK-10217 <https://issues.apache.org/jira/browse/FLINK-3862>] use
> Slack for user support and questions
>
> Current status
>
> For user support and questions, users are instructed to subscribe to
> user@flink.apache.org but there are users like me who enjoy using also a
> chat channel. However, the instructions to do so are not clear and the IRC
> activity is low and it is definitely not indicative of the project's
> activity
> <https://issues.apache.org/jira/browse/FLINK-3862?focusedCommentId=16152376=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16152376>
> .
>
> The website <https://flink.apache.org/community.html> mentions that "If
> you want to talk with the Flink committers and users in a chat, there is an 
> IRC
> channel <https://flink.apache.org/community.html#irc>."
> Option 1: Use Slack
>
> An example of an Apache project that is using Slack
> <https://tedium.co/2017/10/17/irc-vs-slack-chat-history> is:
> http://mesos.apache.org/community
>
> I can assist on setting it up if at least one expert joins from the very
> beginning.
> Option 2: Keep using IRC and document it
>
> Add the missing section
> <https://github.com/apache/flink-web/blob/master/community.md#irc> at the
> website along with instructions for people who have never used IRC.
> Option 3: Use only the mailing list
>
> Use only user@flink.apache.org for user support and questions and do not
> mention IRC at the website.
>
>
>


would you join a Slack workspace for Flink?

2018-08-25 Thread Nicos Maris
Hi all,


This mailing list is for user support and questions. If you would also use
slack for user support and questions, then please vote at the following
ticket. If you don't have an account at that jira, you can reply to this
email with a "+1".


[FLINK-10217 ] use Slack
for user support and questions

Current status

For user support and questions, users are instructed to subscribe to
user@flink.apache.org but there are users like me who enjoy using also a
chat channel. However, the instructions to do so are not clear and the IRC
activity is low and it is definitely not indicative of the project's
activity

.

The website  mentions that "If you
want to talk with the Flink committers and users in a chat, there is an IRC
channel ."
Option 1: Use Slack

An example of an Apache project that is using Slack
 is:
http://mesos.apache.org/community

I can assist on setting it up if at least one expert joins from the very
beginning.
Option 2: Keep using IRC and document it

Add the missing section
 at the
website along with instructions for people who have never used IRC.
Option 3: Use only the mailing list

Use only user@flink.apache.org for user support and questions and do not
mention IRC at the website.


Re: python vs java api

2018-07-31 Thread Nicos Maris
Thanks Vino,


Comparing functionalities in terms of the transformations is clear but what
about timestamps and state?

On Tue, Jul 31, 2018 at 6:47 PM vino yang  wrote:

> Hi Nicos,
>
> You can read the official documentation of latest Python API about
> DataStream transformation[1] and latest Java API transformation[2].
>
> However, the latest documentation may not react the new feature especially
> for Python API, so you can also compare the implementation of
> DataStream(java)[3] and PythonDataStream [4]. Note, for [3], it's not
> completed because some API exists in other stream objects such keyed data
> stream.
>
> [1]:
> https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/python.html#transformations
> [2]:
> https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/operators/index.html#datastream-transformations
> [3]:
> https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java
> [4]:
> https://github.com/apache/flink/blob/master/flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonDataStream.java
>
> Thanks, vino.
>
>
> 2018-07-31 22:59 GMT+08:00 Nicos Maris :
>
>> Which java features of flink are not supported by the python API when
>> writing a pipeline?
>>
>
>


Re: scala IT

2018-07-31 Thread Nicos Maris
Isn't the returns functions deprecated?

On Tue, Jul 31, 2018, 5:32 AM vino yang  wrote:

> Hi Nicos,
>
> The thrown exception has given you a clear solution hint:
> The return type of function 'apply(Mu
>ltiplyByTwoTest.scala:43)' could not be determined automatically, due
> to type erasure. You can giv
>e type information hints by using the returns(...) method on the result
> of the transformation call
>, or by letting your function implement the 'ResultTypeQueryable'
> interface.
>
> You can consider the second option. More information on the Flink type
> system can be found in the official documentation[1].
>
> [1]:
> https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/types_serialization.html#type-information-in-the-scala-api
>
> Thanks, vino.
>
> 2018-07-31 6:30 GMT+08:00 Nicos Maris :
>
>> Hi all,
>>
>>
>> the integration test in scala documented at the testing section fails:
>>
>> https://travis-ci.org/nicosmaris/HelloDockerScalaSbt/builds/410075764
>>
>> In previous commits of my demo repo, I tried typextractor , basictypeinfo
>> and resultTypeQuerable with no success. I am new to flink and to Scala and
>> I would like to have both, not flink with Java.
>>
>> Am I doing something that is fundamentally wrong?
>>
>>
>> thanks,
>> Nicos Maris
>>
>
>


scala IT

2018-07-30 Thread Nicos Maris
Hi all,


the integration test in scala documented at the testing section fails:

https://travis-ci.org/nicosmaris/HelloDockerScalaSbt/builds/410075764

In previous commits of my demo repo, I tried typextractor , basictypeinfo
and resultTypeQuerable with no success. I am new to flink and to Scala and
I would like to have both, not flink with Java.

Am I doing something that is fundamentally wrong?


thanks,
Nicos Maris