Caizhi Weng created FLINK-17023:
---
Summary: The format checking of extractExecutionParams in
config.sh is incorrect
Key: FLINK-17023
URL: https://issues.apache.org/jira/browse/FLINK-17023
Project: Flink
Thanks for the explanation. Sounds good to me.
Best,
Jark
On Tue, 7 Apr 2020 at 14:45, Dawid Wysakowicz
wrote:
> Hi all,
>
> @Timo I'm fine with OpenContext.
>
> @Timo @Seth Sure we can combine all the parameters in a single object.
> Will update the FLIP
>
> @Jark I was aware of the implementa
Congratulations, Seth!
Best,
Congxian
Kurt Young 于2020年4月7日周二 下午2:53写道：
> Congratulations, Seth!
>
> Best,
> Kurt
>
>
> On Tue, Apr 7, 2020 at 2:51 PM Jingsong Li wrote:
>
> > Congratulations Seth!
> >
> > Best,
> > Jingsong Lee
> >
> > On Tue, Apr 7, 2020 at 2:46 PM Dawid Wysakowicz
> > wro
Congratulations, Seth!
Best,
Kurt
On Tue, Apr 7, 2020 at 2:51 PM Jingsong Li wrote:
> Congratulations Seth!
>
> Best,
> Jingsong Lee
>
> On Tue, Apr 7, 2020 at 2:46 PM Dawid Wysakowicz
> wrote:
>
> > Congratulations Seth. Happy to have you in the community!
> >
> > Best,
> >
> > Dawid
> >
> >
Congratulations Seth!
Best,
Jingsong Lee
On Tue, Apr 7, 2020 at 2:46 PM Dawid Wysakowicz
wrote:
> Congratulations Seth. Happy to have you in the community!
>
> Best,
>
> Dawid
>
> On 07/04/2020 08:43, Dian Fu wrote:
> > Congratulations!
> >
> >> 在 2020年4月7日，下午2:35，Konstantin Knauf 写道：
> >>
> >
Thank you all for the support!
Best,
Dawid
On 02/04/2020 04:33, godfrey he wrote:
> Congratulations to all of you~
>
> Best,
> Godfrey
>
> Ismaël Mejía 于2020年4月2日周四 上午6:42写道：
>
>> Congrats everyone!
>>
>> On Thu, Apr 2, 2020 at 12:16 AM Rong Rong wrote:
>>> Congratulations to all!!!
>>>
>>> --
xingoo created FLINK-17022:
--
Summary: Flink SQL ROW_NUMBER() Exception: TableException: This
calc has no useful projection and no filter. It should be removed by
CalcRemoveRule.
Key: FLINK-17022
URL: https://issues.apac
Congratulations, Seth!
Thanks,
Zhu Zhu
Dian Fu 于2020年4月7日周二 下午2:43写道：
> Congratulations!
>
> > 在 2020年4月7日，下午2:35，Konstantin Knauf 写道：
> >
> > Congratulations, Seth! Well deserved :)
> >
> > On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai
> > wrote:
> >
> >> Hi everyone!
> >>
> >> On behal
Congratulations Seth. Happy to have you in the community!
Best,
Dawid
On 07/04/2020 08:43, Dian Fu wrote:
> Congratulations!
>
>> 在 2020年4月7日，下午2:35，Konstantin Knauf 写道：
>>
>> Congratulations, Seth! Well deserved :)
>>
>> On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai
>> wrote:
>>
>>> Hi e
Hi all,
@Timo I'm fine with OpenContext.
@Timo @Seth Sure we can combine all the parameters in a single object.
Will update the FLIP
@Jark I was aware of the implementation of SinkFunction, but it was a
conscious choice to not do it that way.
Personally I am against giving a default implementat
Zhu Zhu created FLINK-17021:
---
Summary: Blink Planner set GlobalDataExchangeMode
Key: FLINK-17021
URL: https://issues.apache.org/jira/browse/FLINK-17021
Project: Flink
Issue Type: Sub-task
Congratulations!
> 在 2020年4月7日，下午2:35，Konstantin Knauf 写道：
>
> Congratulations, Seth! Well deserved :)
>
> On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai
> wrote:
>
>> Hi everyone!
>>
>> On behalf of the PMC, I’m very happy to announce Seth Wiesman as a new
>> Flink committer.
>>
>> Set
Zhu Zhu created FLINK-17020:
---
Summary: Introduce GlobalDataExchangeMode for JobGraph Generation
Key: FLINK-17020
URL: https://issues.apache.org/jira/browse/FLINK-17020
Project: Flink
Issue Type: Su
Zhu Zhu created FLINK-17019:
---
Summary: Implement FIFO Physical Slot Assignment in SlotPoolImpl
Key: FLINK-17019
URL: https://issues.apache.org/jira/browse/FLINK-17019
Project: Flink
Issue Type: Sub
Congratulations, Seth! Well deserved :)
On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai
wrote:
> Hi everyone!
>
> On behalf of the PMC, I’m very happy to announce Seth Wiesman as a new
> Flink committer.
>
> Seth started contributing to the project in March 2017. You may know him
> from sever
Hi everyone!
On behalf of the PMC, I’m very happy to announce Seth Wiesman as a new
Flink committer.
Seth started contributing to the project in March 2017. You may know him
from several contributions in the past.
He had helped a lot with Flink documentation, and had contributed the State
Process
Zhu Zhu created FLINK-17018:
---
Summary: Use Bulk Slot Allocation in DefaultExecutionSlotAllocator
Key: FLINK-17018
URL: https://issues.apache.org/jira/browse/FLINK-17018
Project: Flink
Issue Type: S
+1
Best,
Dawid
On 07/04/2020 07:44, godfrey he wrote:
> Hi, Kurt
>
> yes. `TableEnvironement#executeSql` also could execute `SELECT` statement,
> which is similar to `Table#execute`.
> I add this to the document.
>
> Best,
> Godfrey
>
> Kurt Young 于2020年4月7日周二 上午11:52写道：
>
>> +1 (binding)
>>
>>
Zhu Zhu created FLINK-17017:
---
Summary: Implement Bulk Slot Allocation in SchedulerImpl
Key: FLINK-17017
URL: https://issues.apache.org/jira/browse/FLINK-17017
Project: Flink
Issue Type: Sub-task
Zhu Zhu created FLINK-17016:
---
Summary: Use PipelinedRegionSchedulingStrategy in DefaultScheduler
(for Blink Planner)
Key: FLINK-17016
URL: https://issues.apache.org/jira/browse/FLINK-17016
Project: Flink
Hi Xingbo,
Thanks a lot for the great work. Big +1 to this feature. The performance
improvement is impressive.
Regards,
Dian
> 在 2020年4月7日，下午12:38，Robert Metzger 写道：
>
> Thank you for posting the FLIP.
>
> The proposed integration with Azure Pipelines looks good to me.
>
> On Tue, Mar 31, 2
Jark Wu created FLINK-17015:
---
Summary: Fix NPE from NullAwareMapIterator
Key: FLINK-17015
URL: https://issues.apache.org/jira/browse/FLINK-17015
Project: Flink
Issue Type: Bug
Components:
Zhu Zhu created FLINK-17014:
---
Summary: Implement PipelinedRegionSchedulingStrategy
Key: FLINK-17014
URL: https://issues.apache.org/jira/browse/FLINK-17014
Project: Flink
Issue Type: Sub-task
Hi, Kurt
yes. `TableEnvironement#executeSql` also could execute `SELECT` statement,
which is similar to `Table#execute`.
I add this to the document.
Best,
Godfrey
Kurt Young 于2020年4月7日周二 上午11:52写道：
> +1 (binding)
>
> The latest doc looks good to me. One minor comment is with the latest
> chang
The voting time has passed. Thank you for testing and voting everyone!
I'm happy to announce that we have unanimously approved this candidate as
the 2.0.0 release for Apache Flink Stateful Functions.
There are 10 approving votes, 3 of which are binding:
* Tzu-Li (Gordon) Tai (binding)
* Konstanti
Huang Xingbo created FLINK-17013:
Summary: Support Python UDTF in old planner under batch mode
Key: FLINK-17013
URL: https://issues.apache.org/jira/browse/FLINK-17013
Project: Flink
Issue Typ
Thank you for posting the FLIP.
The proposed integration with Azure Pipelines looks good to me.
On Tue, Mar 31, 2020 at 1:23 PM Xingbo Huang wrote:
> Hi everyone,
>
> I would like to start a discussion thread on "Support Cython Optimizing
> Python User Defined Function"
>
> Scalar Python UDF FL
Hi Dawid,
Thanks for driving this. This is a blocker to support Debezium CDC format
(FLIP-105). So big +1 from my side.
Regarding to emitting multiple records and checkpointing, I'm also in favor
of option#1: buffer all the records outside of the checkpoint lock.
I think most of the use cases wil
+1 (binding)
The latest doc looks good to me. One minor comment is with the latest
changes, it seems also very easy
to support running SELECT query in TableEnvironement#executeSql method.
Will this also be supported?
Best,
Kurt
On Mon, Apr 6, 2020 at 10:49 PM Timo Walther wrote:
> Thanks, for
Hi everyone,
Since this FLIP was proposed, the community has discussed a lot about the
first approach: introducing new TableSource and TableSink interfaces to
support changelog.
And yes, that is FLIP-95 which has been accepted last week. So most of the
work has been merged into FLIP-95.
In order
I'm fine to disable this feature by default and avoid
whitelisting/blacklisting. This simplifies a lot of things.
Regarding to TableSourceFactory#Context#getExecutionOptions, do we really
need this interface?
Should the connector factory be aware of the properties is merged with
hints or not?
What
+1 （non-binding)
- checked sums and signature: OK
- checked no binaries in source distribution: OK
- checked all POM files/README/Python SDK setup.py point to the same
version 2.0.0 OK
- execute `mvn clean install -Prun-e2e-tests`: OK
- checked quick start: ok
- run greeter example locally: ok
- r
+1 (non-binding)
Checked sums and signatures: OK
Checked no binaries in source distribution: OK
Checked RAT and end-to-end tests (8u101, 11.0.4): OK
Checked version in pom/README/setup.py files: OK
Checked quick start: OK
Checked Greeter local docker-compose examples: OK
Checked Ridesharing local
Thanks you all for the discussion. It seems that we have reached consensus on
the design. I will start a VOTE thread if there are no other feedbacks.
Regards,
Dian
> 在 2020年4月3日，下午2:58，Wei Zhong 写道：
>
> Hi Dian,
>
> Thanks for driving this. Big +1 for supporting from/to pandas in PyFlink!
>
+1 (non-binding)
- built from source with tests (mvn clean install)
- verified the checksum and signature
- checked the bundled licenses and notices
- verified that the source distribution doesn't container unnecessary binaries
- checked that the version pointed to the same version
- flink-web PR
Sounds like a reasonable compromise, disabling this feature by default is a
way to protect
the vulnerability, and we can simplify the design quite a lot. We can
gather some users'
feedback to see whether further protections are necessary in the future.
Best,
Kurt
On Mon, Apr 6, 2020 at 11:49 PM
Wenlong Lyu created FLINK-17012:
---
Summary: Expose cost of task initialization
Key: FLINK-17012
URL: https://issues.apache.org/jira/browse/FLINK-17012
Project: Flink
Issue Type: Improvement
Nope, it wouldn't work to have it in the root of the project; in a
practical sense IntelliJ can only really handle them in the standard
location.
Ironically, the PR currently only works in IntelliJ, because when you
build the jar with maven we exclude all log4j files via the
shade-plugin. Whi
Actually, I would first have to double-check whether this would work
within IntelliJ...
On 06/04/2020 20:40, Chesnay Schepler wrote:
We can also move the file to the root of the project, which should
make it easier to discover.
flink-test-utils-junit would then just be a distribution vehicle
We can also move the file to the root of the project, which should make
it easier to discover.
flink-test-utils-junit would then just be a distribution vehicle that
few would have to know about.
On 06/04/2020 13:31, Till Rohrmann wrote:
Hi Chesnay,
thanks for kicking this discussion off. I
Yun Tang created FLINK-17011:
Summary: Introduce builder to create
AbstractStreamOperatorTestHarness for testing
Key: FLINK-17011
URL: https://issues.apache.org/jira/browse/FLINK-17011
Project: Flink
I would be in favor of buffering data outside of the checkpoint lock. In my
experience, serialization is always the biggest performance killer in user
code and I have a hard time believing in practice that anyone is going to
buffer so many records that is causes real memory concerns.
To add to Tim
I agree with Aljoscha. The length of this thread shows that this is
highly controversal. I think nobody really likes this feature 100% but
we could not find a better solution. I would consider it as a
nice-to-have improvement during a notebook/debugging session.
I would accept avoiding whiteli
Robert Metzger created FLINK-17010:
--
Summary: Streaming File Sink s3 end-to-end test fails with "Output
hash mismatch"
Key: FLINK-17010
URL: https://issues.apache.org/jira/browse/FLINK-17010
Project:
Thanks, for the update.
+1 (binding) for this FLIP
Regards,
Timo
On 06.04.20 16:47, godfrey he wrote:
Hi Timo,
Sorry for late reply, and thanks for your correction. I have fixed the typo
and updated the document.
Best,
Godfrey
Timo Walther 于2020年4月6日周一 下午6:05写道：
Hi Godfrey,
did you see
Hi, all
Thanks a lot for this FLIP and all the fruitable discussion. I am not sure
whether the following questions are in the scope of this FLIP, but I still
expect your reply:
1. Which docker base image do we plan to use for Java? As far as I see,
openjdk:8-jre-alpine[1] is not officially
Hi Timo,
Sorry for late reply, and thanks for your correction. I have fixed the typo
and updated the document.
Best,
Godfrey
Timo Walther 于2020年4月6日周一 下午6:05写道：
> Hi Godfrey,
>
> did you see my remaining feedback in the discussion thread? We could
> finish this FLIP if this gets resolved.
>
>
Aljoscha Krettek created FLINK-17009:
Summary: Fold API-agnostic documentation into DataStream
documentation
Key: FLINK-17009
URL: https://issues.apache.org/jira/browse/FLINK-17009
Project: Flink
Hi Timo,
Sorry for the late reply, and thanks for your correction.
I missed DQL for job submission scenario.
I'll fix the document right away.
Best,
Godfrey
Timo Walther 于2020年4月3日周五 下午9:53写道：
> Hi Godfrey,
>
> I'm sorry to jump in again but I still need to clarify some things
> around TableRe
Thanks a lot for the new RC!
+1 (non-binding)
- Signatures and hash are correct.
- The source distribution contains no binaries.
- The source distribution is building properly with `-Prun-e2e-tests`
(JDK8).
- All POM files / README / Python SDK setup.py point to the same version.
- Verify license
+1 (non-binding)
legal / source
- checked sources for binary files
- checked license headers
functional
- built from source (mvn clean verify -Prun-e2e-tests)
- built python sdk and ran tests
- ran examples
- deployed mixed python / java application on k8s with checkpointing.
Failed TM's and watc
+1 (binding)
- contents of staging directory looks correct
- checked license / notice files of source distribution
- checked license of "statefun-flink-distribution"
- built from source, ran all tests successfully (WSL)
- built and checked the docs (WSL / Docker setup)
On Mon, Apr 6, 2
Canbin Zheng created FLINK-17008:
Summary: Handle null value for HADOOP_CONF_DIR/HADOOP_HOME env in
AbstractKubernetesParameters#getLocalHadoopConfigurationDirectory
Key: FLINK-17008
URL: https://issues.apache.org
Hi Chesnay,
thanks for kicking this discussion off. I agree that deduplicating code is
in general a good idea.
The main benefit seems to be that all modules inherit a
log4j2-test.properties file and that this file allows to control the
logging output for several modules.
The main drawback I see
+1 (non binding)
legal / source:
- downloaded and verified the signature
- verified that pom and versions in the docs match
- no binary files in the distribution
- built and run e2e test with Java 8 and Java 11
- created a project from a maven archetype.
functional:
- run all the examples
- deplo
Hello,
I discovered a handy trick that would allow us to share a single
log4j2-test.properties across all modules.
https://github.com/apache/flink/pull/11634
The file would exist in flink-test-utils-junit/src/main/resources, and
be used for all modules except the kafka connectors and yarn-te
Hi Godfrey,
did you see my remaining feedback in the discussion thread? We could
finish this FLIP if this gets resolved.
Thanks,
Timo
On 03.04.20 15:12, Terry Wang wrote:
+1 (non-binding)
Looks great to me, Thanks for driving on this.
Best,
Terry Wang
2020年4月3日 21:07，godfrey he 写道：
Hi
Hi all,
The voting time for FLIP-119 has passed. I am closing the vote now.
There were 6 +1 votes, 4 of which are binding:
- Till (binding)
- Zhijiang (binding)
- Xintong (non-binding)
- Yangze (non-binding)
- Kurt (binding)
- Zhu Zhu (binding)
There were no disapproving votes.
Thus, FLIP-119 h
Congxian Qiu(klion26) created FLINK-17007:
-
Summary: Add section "How to handle application parameters" in
DataStream documentation
Key: FLINK-17007
URL: https://issues.apache.org/jira/browse/FLINK-17007
Hi Dawid,
thanks for this FLIP. This solves a lot of issues with the current
design for both the Flink contributors and users. +1 for this.
Some minor suggestions from my side:
- How about finding something shorter for `InitializationContext`? Maybe
just `OpenContext`?
- While introducing def
Thanks for the feedback Niels. This is very helpful.
1. I agree `flink:latest` is nice to get started but in the long run people
will want to pin their dependencies to a specific Flink version. I think
the fix will happen as part of FLINK-15794.
2. SNAPSHOT docker images will be really helpful fo
Robert Metzger created FLINK-17006:
--
Summary: AggregateITCase.testDistinctGroupBy fails with
FileNotFoundException (in Rocksdb)
Key: FLINK-17006
URL: https://issues.apache.org/jira/browse/FLINK-17006
Dawid Wysakowicz created FLINK-17005:
Summary: Translate the CREATE TABLE ... LIKE syntax documentation
to chinese
Key: FLINK-17005
URL: https://issues.apache.org/jira/browse/FLINK-17005
Project:
Dawid Wysakowicz created FLINK-17004:
Summary: Document the CREATE TABLE ... LIKE syntax in english
Key: FLINK-17004
URL: https://issues.apache.org/jira/browse/FLINK-17004
Project: Flink
Dawid Wysakowicz created FLINK-17003:
Summary: Support parsing LIKE clause in CREATE TABLE statement
Key: FLINK-17003
URL: https://issues.apache.org/jira/browse/FLINK-17003
Project: Flink
Dawid Wysakowicz created FLINK-17002:
Summary: Support creating tables using other tables definition
Key: FLINK-17002
URL: https://issues.apache.org/jira/browse/FLINK-17002
Project: Flink
Dawid Wysakowicz created FLINK-17001:
Summary: Support LIKE clause in CREATE TABLE
Key: FLINK-17001
URL: https://issues.apache.org/jira/browse/FLINK-17001
Project: Flink
Issue Type: New F
Hi all,
The voting time for FLIP-110 has passed. I'm closing the vote now.
There were 5 +1 votes, 4 of which are binding:
- Timo (binding)
- Jingsong (binding)
- Danny (non-binding)
- Jark (binding)
- Aljosha (binding)
There were no disapproving votes.
Thus, FLIP-110 has been accepted.
T
Hi devs,
When working on improving the Table API/SQL connectors we faced a few
shortcomings of the DeserializationSchema and SerializationSchema
interfaces. Similar features were also mentioned by other users in the
past. The shortcomings I would like to address with the FLIP include:
* Emittin
Hi guys,
Thanks for more details Zhijiang.
It also looks to me that mapped memory size is mostly driven by OS limits
and bit-ness of JVM (32/64).
Thinking more about the 'Metrics' tab layout, couple of more things have
come into my mind.
# 'Metrics' tab -> 'Memory': 'Metrics' and 'Configuration'
Hi all,
Sorry for jumping in at this late point of the discussion.
I see a lot of things I really like and I would like to put my "needs" and
observations here too so you take them into account (where possible).
I suspect that there will be overlap with things you already have taken
into account.
Timo Walther created FLINK-17000:
Summary: Type information in sources should cover all data
structures
Key: FLINK-17000
URL: https://issues.apache.org/jira/browse/FLINK-17000
Project: Flink
Timo Walther created FLINK-16999:
Summary: Data structure should cover all conversions declared in
logical types
Key: FLINK-16999
URL: https://issues.apache.org/jira/browse/FLINK-16999
Project: Flink
Thanks a lot for preparing another RC!
+1 (binding)
- source archive looks fine (no binaries, copied sources are properly
reported)
- staging repository looks fine (bundled binaries seem documented, versions
are correct)
- *mvn clean install *(mvn clean verify fails, "install" is required) w/
e2e
Timo Walther created FLINK-16998:
Summary: Add a changeflag to Row type
Key: FLINK-16998
URL: https://issues.apache.org/jira/browse/FLINK-16998
Project: Flink
Issue Type: Sub-task
C
Timo Walther created FLINK-16997:
Summary: Add new factory interfaces and utilities
Key: FLINK-16997
URL: https://issues.apache.org/jira/browse/FLINK-16997
Project: Flink
Issue Type: Sub-task
The reason I'm saying it should be disabled by default is that this uses
hint syntax, and hints should really not change query semantics.
I'm quite strongly against hints that change query semantics, but if we
disable this by default I would be (reluctantly) OK with the feature.
Companies that
Timo Walther created FLINK-16996:
Summary: Refactor planner and connectors to use new data structures
Key: FLINK-16996
URL: https://issues.apache.org/jira/browse/FLINK-16996
Project: Flink
Is
Timo Walther created FLINK-16995:
Summary: Add new data structure interfaces in table-common
Key: FLINK-16995
URL: https://issues.apache.org/jira/browse/FLINK-16995
Project: Flink
Issue Type:
Timo Walther created FLINK-16994:
Summary: Support SupportsWatermarkPushDown in planner
Key: FLINK-16994
URL: https://issues.apache.org/jira/browse/FLINK-16994
Project: Flink
Issue Type: Sub-
Timo Walther created FLINK-16993:
Summary: Support SupportsComputedColumnPushDown in planner
Key: FLINK-16993
URL: https://issues.apache.org/jira/browse/FLINK-16993
Project: Flink
Issue Type:
Timo Walther created FLINK-16992:
Summary: Add ability interfaces for table source/sink
Key: FLINK-16992
URL: https://issues.apache.org/jira/browse/FLINK-16992
Project: Flink
Issue Type: Sub-
Timo Walther created FLINK-16991:
Summary: Support DynamicTableSink in planner
Key: FLINK-16991
URL: https://issues.apache.org/jira/browse/FLINK-16991
Project: Flink
Issue Type: Sub-task
Timo Walther created FLINK-16990:
Summary: Support LookupTableSource in planner
Key: FLINK-16990
URL: https://issues.apache.org/jira/browse/FLINK-16990
Project: Flink
Issue Type: Sub-task
Timo Walther created FLINK-16989:
Summary: Support ScanTableSource in planner
Key: FLINK-16989
URL: https://issues.apache.org/jira/browse/FLINK-16989
Project: Flink
Issue Type: Sub-task
FYI -
There are these open PRs to add blog posts and update the Flink website for
the Stateful Functions 2.0 release:
* https://github.com/apache/flink-web/pull/322
* https://github.com/apache/flink-web/pull/321
On Mon, Apr 6, 2020 at 2:53 PM Konstantin Knauf
wrote:
> +1 (non-binding)
>
> ** Fun
Timo Walther created FLINK-16988:
Summary: Add core table source/sink interfaces
Key: FLINK-16988
URL: https://issues.apache.org/jira/browse/FLINK-16988
Project: Flink
Issue Type: Sub-task
Timo Walther created FLINK-16987:
Summary: Add new table source and sink interfaces
Key: FLINK-16987
URL: https://issues.apache.org/jira/browse/FLINK-16987
Project: Flink
Issue Type: New Feat
88 matches
Mail list logo
