Thanks Joe!

Best regards/祝好,

Chang Liu 刘畅



On Fri, Aug 24, 2018 at 6:55 PM Joe Malt <jm...@yelp.com> wrote:

> Hi Chang,
>
> A time-saving tip for finding which library contains a class: go to
> https://search.maven.org/
> and enter fc: followed by the fully-qualified name of the class. You
> should get the library as a search result.
>
> In this case for example, you'd search for
> fc:org.apache.flink.runtime.operators.testutils.MockEnvironmentBuilder
>
> Best,
>
> Joe Malt
> Engineering Intern, Stream Processing
> Yelp Inc.
>
> On Fri, Aug 24, 2018 at 4:50 AM, Chang Liu <fluency...@gmail.com> wrote:
>
>> No worries, I found it here:
>>
>> <dependency>
>>     <groupId>org.apache.flink</groupId>
>>     <artifactId>flink-runtime_${scala.binary.version}</artifactId>
>>     <version>${flink.version}</version>
>>     <type>test-jar</type>
>>     <scope>test</scope>
>> </dependency>
>>
>>
>> Best regards/祝好,
>>
>> Chang Liu 刘畅
>>
>>
>>
>> On Fri, Aug 24, 2018 at 1:16 PM Chang Liu <fluency...@gmail.com> wrote:
>>
>>> Hi Hequn,
>>>
>>> I have added the following dependencies:
>>>
>>> <dependency>
>>>     <groupId>org.apache.flink</groupId>
>>>     <artifactId>flink-streaming-java_${scala.binary.version}</artifactId>
>>>     <version>${flink.version}</version>
>>>     <type>test-jar</type>
>>>     <scope>test</scope>
>>> </dependency>
>>> <dependency>
>>>     <groupId>org.mockito</groupId>
>>>     <artifactId>mockito-core</artifactId>
>>>     <version>2.21.0</version>
>>>     <scope>test</scope>
>>> </dependency>
>>>
>>>
>>> But got the exception:   java.lang.NoClassDefFoundError:
>>> org/apache/flink/runtime/operators/testutils/MockEnvironmentBuilder
>>>
>>> Do you know which library contains this class? Thanks :)
>>>
>>> Best regards/祝好,
>>>
>>> Chang Liu 刘畅
>>> DevOps Engineer
>>> WB TECH / Cyber Crime Prevention Team
>>>
>>> Mobile: +31(0)687859981
>>> Email: fluency...@gmail.com  &  chang.l...@ing.nl
>>>
>>>
>>>
>>> On Mon, Aug 13, 2018 at 1:42 PM Hequn Cheng <chenghe...@gmail.com>
>>> wrote:
>>>
>>>> Hi Change,
>>>>
>>>> Try
>>>> <dependency>
>>>> <groupId>org.apache.flink</groupId>
>>>> <artifactId>flink-streaming-java_2.11</artifactId>
>>>> <version>${flink.version}</version>
>>>> <type>test-jar</type>
>>>> <scope>test</scope>
>>>> </dependency>
>>>> .
>>>>
>>>> On Mon, Aug 13, 2018 at 6:42 PM, Chang Liu <fluency...@gmail.com>
>>>> wrote:
>>>>
>>>>> And another question: which library should I include in order to use
>>>>> these harnesses? I do have this flink-test-utils_2.11 in my pom, but I
>>>>> cannot find the harnesses.
>>>>>
>>>>> I also have the following in my pom:
>>>>>
>>>>>    - flink-core
>>>>>    - flink-clients_2.11
>>>>>    - flink-scala_2.11
>>>>>    - flink-streaming-java_2.11
>>>>>    - flink-streaming-java_2.11
>>>>>    - flink-connector-kafka-0.11_2.11
>>>>>
>>>>>
>>>>> Best regards/祝好,
>>>>>
>>>>> Chang Liu 刘畅
>>>>>
>>>>>
>>>>> On 13 Aug 2018, at 04:01, Hequn Cheng <chenghe...@gmail.com> wrote:
>>>>>
>>>>> Hi Chang,
>>>>>
>>>>> There are some harness tests which can be used to test your function.
>>>>> It is also a common way to test function or operator in flink internal
>>>>> tests. Currently, the harness classes mainly include:
>>>>>
>>>>>    - KeyedOneInputStreamOperatorTestHarness
>>>>>    - KeyedTwoInputStreamOperatorTestHarness
>>>>>    - OneInputStreamOperatorTestHarness
>>>>>    - TwoInputStreamOperatorTestHarness
>>>>>
>>>>> You can take a look at the source code of these classes.
>>>>>
>>>>> To be more specific, you can take a look at
>>>>> the testSlidingEventTimeWindowsApply[1], in which the RichSumReducer 
>>>>> window
>>>>> function has been tested.
>>>>>
>>>>> Best, Hequn
>>>>>
>>>>> [1]
>>>>> https://github.com/apache/flink/blob/master/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorTest.java#L213
>>>>>
>>>>>
>>>>> On Mon, Aug 13, 2018 at 7:10 AM, Chang Liu <fluency...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Dear all,
>>>>>>
>>>>>> I have some questions regarding testing in Flink. The more general
>>>>>> question is: is there any guideline, template, or best practices that we
>>>>>> can follow if we want to test our flink code (more in scala)?
>>>>>>
>>>>>> I know there is this page:
>>>>>> https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/testing.html
>>>>>>  but
>>>>>> not so much written there. And I also did not find a more comprehensive
>>>>>> documentation of this library: flink-test-utils_2.11.
>>>>>>
>>>>>> One detailed question: how do you test this WindowFunction below? The
>>>>>> return type is Unit right? We cannot do unit test on like, like how the
>>>>>> ReduceFunction was tested in the example link above. Then we only have 
>>>>>> the
>>>>>> option of doing integration testing on it?
>>>>>> <code.png>
>>>>>>
>>>>>>
>>>>>> Your ideas would be very helpful :) Thanks in advance !
>>>>>>
>>>>>> Best regards/祝好,
>>>>>>
>>>>>> Chang Liu 刘畅
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>

Reply via email to