[jira] [Resolved] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

[ https://issues.apache.org/jira/browse/FLINK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11954. Resolution: Done Work is already done as part of FLINK-11953 > Provide unit tes

[jira] [Closed] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

[ https://issues.apache.org/jira/browse/FLINK-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11953. -- Resolution: Implemented Fix Version/s: 1.9.0 Merged in: master: c6307b5990

[jira] [Commented] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

[ https://issues.apache.org/jira/browse/FLINK-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817887#comment-16817887 ] Stefan Richter commented on FLINK-11955: [~yanghua] are you commited to working on this issue

[jira] [Comment Edited] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

[ https://issues.apache.org/jira/browse/FLINK-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817887#comment-16817887 ] Stefan Richter edited comment on FLINK-11955 at 4/15/19 11:43 AM

Re: Query on job restoration using relocated savepoint

Hi, the first case sounds like you made a mistake when editing the paths manually and deleted one ore more bytes that were not part of the path and thus corrupted the meta data. For the second approach, of course you also need to replace the paths after reading and before rewriting the

Re: Query on job restoration using relocated savepoint

Small correction, on the first case: more likely is that you changed the path string but I think those are prefixed by the string length, so that would require manual adjustment as well to not corrupt the metadata. > On 11. Apr 2019, at 14:42, Stefan Richter wrote: > > Hi, > >

[jira] [Comment Edited] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815161#comment-16815161 ] Stefan Richter edited comment on FLINK-11775 at 4/11/19 7:59 AM

[jira] [Comment Edited] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815161#comment-16815161 ] Stefan Richter edited comment on FLINK-11775 at 4/11/19 7:58 AM

[jira] [Commented] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815161#comment-16815161 ] Stefan Richter commented on FLINK-11775: [~StephanEwen] I found that the implementation

Re: Introducing Flink's Plugin mechanism

Thank you Piotr for bringing this discussion to the mailing list! As it was not explicitly mentioned in the first email, I wanted to add that there is also already an open PR[1] with my implementation of the basic plugin mechanism for FileSystem. Looking forward to some feedback from the

Re: [ANNOUNCE] Apache Flink 1.8.0 released

Congrats and thanks to Aljoscha for managing the release! Best, Stefan > On 10. Apr 2019, at 13:01, Biao Liu wrote: > > Great news! Thanks Aljoscha and all the contributors. > > Till Rohrmann mailto:trohrm...@apache.org>> > 于2019年4月10日周三 下午6:11写道： > Thanks a lot to Aljoscha for being our

Re: [ANNOUNCE] Apache Flink 1.8.0 released

Congrats and thanks to Aljoscha for managing the release! Best, Stefan > On 10. Apr 2019, at 13:01, Biao Liu wrote: > > Great news! Thanks Aljoscha and all the contributors. > > Till Rohrmann mailto:trohrm...@apache.org>> > 于2019年4月10日周三 下午6:11写道： > Thanks a lot to Aljoscha for being our

[jira] [Closed] (FLINK-10205) Batch Job: InputSplit Fault tolerant for DataSourceTask

[ https://issues.apache.org/jira/browse/FLINK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10205. -- Resolution: Implemented Fix Version/s: 1.9.0 Merged in: master: 4f689b1 > Batch

[jira] [Commented] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813295#comment-16813295 ] Stefan Richter commented on FLINK-11775: [~lzljs3620320] I think in general the performance

[jira] [Created] (FLINK-12143) Mechanism to ship plugin jars in the cluster

Stefan Richter created FLINK-12143: -- Summary: Mechanism to ship plugin jars in the cluster Key: FLINK-12143 URL: https://issues.apache.org/jira/browse/FLINK-12143 Project: Flink Issue Type

[jira] [Created] (FLINK-12143) Mechanism to ship plugin jars in the cluster

Stefan Richter created FLINK-12143: -- Summary: Mechanism to ship plugin jars in the cluster Key: FLINK-12143 URL: https://issues.apache.org/jira/browse/FLINK-12143 Project: Flink Issue Type

[jira] [Resolved] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

[ https://issues.apache.org/jira/browse/FLINK-11980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11980. Resolution: Fixed Fix Version/s: 1.9.0 1.8.0 Merged in: master

[jira] [Created] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

Stefan Richter created FLINK-11980: -- Summary: Improve efficiency of iterating KeySelectionListener on notification Key: FLINK-11980 URL: https://issues.apache.org/jira/browse/FLINK-11980 Project

[jira] [Created] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

Stefan Richter created FLINK-11980: -- Summary: Improve efficiency of iterating KeySelectionListener on notification Key: FLINK-11980 URL: https://issues.apache.org/jira/browse/FLINK-11980 Project

[jira] [Assigned] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

[ https://issues.apache.org/jira/browse/FLINK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11954: -- Assignee: Stefan Richter > Provide unit test(s) for new plugin infrastruct

[jira] [Assigned] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

[ https://issues.apache.org/jira/browse/FLINK-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11953: -- Assignee: Stefan Richter > Introduce Plugin/Loading system and integr

[jira] [Created] (FLINK-11956) Remove shading from filesystems build

Stefan Richter created FLINK-11956: -- Summary: Remove shading from filesystems build Key: FLINK-11956 URL: https://issues.apache.org/jira/browse/FLINK-11956 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11956) Remove shading from filesystems build

Stefan Richter created FLINK-11956: -- Summary: Remove shading from filesystems build Key: FLINK-11956 URL: https://issues.apache.org/jira/browse/FLINK-11956 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

Stefan Richter created FLINK-11955: -- Summary: Modify build to move filesystems from lib to plugins folder Key: FLINK-11955 URL: https://issues.apache.org/jira/browse/FLINK-11955 Project: Flink

[jira] [Created] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

Stefan Richter created FLINK-11955: -- Summary: Modify build to move filesystems from lib to plugins folder Key: FLINK-11955 URL: https://issues.apache.org/jira/browse/FLINK-11955 Project: Flink

[jira] [Created] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

Stefan Richter created FLINK-11954: -- Summary: Provide unit test(s) for new plugin infrastructure Key: FLINK-11954 URL: https://issues.apache.org/jira/browse/FLINK-11954 Project: Flink Issue

[jira] [Created] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

Stefan Richter created FLINK-11953: -- Summary: Introduce Plugin/Loading system and integrate it with FileSystem Key: FLINK-11953 URL: https://issues.apache.org/jira/browse/FLINK-11953 Project: Flink

[jira] [Created] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

Stefan Richter created FLINK-11954: -- Summary: Provide unit test(s) for new plugin infrastructure Key: FLINK-11954 URL: https://issues.apache.org/jira/browse/FLINK-11954 Project: Flink Issue

[jira] [Created] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

Stefan Richter created FLINK-11953: -- Summary: Introduce Plugin/Loading system and integrate it with FileSystem Key: FLINK-11953 URL: https://issues.apache.org/jira/browse/FLINK-11953 Project: Flink

[jira] [Created] (FLINK-11952) Introduce Plugin Architecture for loading FileSystems

Stefan Richter created FLINK-11952: -- Summary: Introduce Plugin Architecture for loading FileSystems Key: FLINK-11952 URL: https://issues.apache.org/jira/browse/FLINK-11952 Project: Flink

[jira] [Created] (FLINK-11952) Introduce Plugin Architecture for loading FileSystems

Stefan Richter created FLINK-11952: -- Summary: Introduce Plugin Architecture for loading FileSystems Key: FLINK-11952 URL: https://issues.apache.org/jira/browse/FLINK-11952 Project: Flink

[jira] [Resolved] (FLINK-11903) Improve FileStateBackendTest by using JUnit's Parameterized

[ https://issues.apache.org/jira/browse/FLINK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11903. Resolution: Implemented Merged in: master: 76b9f8b > Improve FileStateBackendT

[jira] [Resolved] (FLINK-11904) Improve MemoryStateBackendTest by using JUnit's Parameterized

[ https://issues.apache.org/jira/browse/FLINK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11904. Resolution: Implemented Merged in: master: 6c7ddf3 > Improve MemoryStateBackendT

[jira] [Resolved] (FLINK-11874) Split CheckpointStorage interface to distinguish JM and TM side

[ https://issues.apache.org/jira/browse/FLINK-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11874. Resolution: Implemented Merged in: master: b6b4baf > Split CheckpointStorage interf

Re: [PATCH] firewire: mark expected switch fall-throughs

ers/firewire/core-topology.c > index 7db234d3fbdd..82c67e900aad 100644 > --- a/drivers/firewire/core-topology.c > +++ b/drivers/firewire/core-topology.c > @@ -67,6 +67,7 @@ static u32 *count_ports(u32 *sid, int *total_port_count, > int *child_port_count) > switch (port_type) { >

Re: Migrating Existing TTL State to 1.8

Hi, If you are worried about old state, you can combine the compaction filter based TTL with other cleanup strategies (see docs). For example, setting `cleanupFullSnapshot` when you take a savepoint it will be cleared of any expired state and you can then use it to bring it into Flink 1.8.

Re: Partitions and the number of cores/executors

Hi, Your assumption is right. Parallel processing is based in splitting inputs and each split is only processed by one task instance at a time. Best, Stefan > On 13. Mar 2019, at 09:52, mbilalce@gmail.com wrote: > > Hi, > > I am working with Gelly graph library but I think the question

Re: Will state TTL support event time cleanup in 1.8?

TTL based on event time is not part or 1.8, but likely to be part of 1.9. > On 13. Mar 2019, at 13:17, Sergei Poganshev wrote: > > Do improvements introduced in > https://issues.apache.org/jira/browse/FLINK-10471 > add support for event >

Re: Understanding timestamp and watermark assignment errors

Hi, I think this looks like the same problem as in this issue: https://issues.apache.org/jira/browse/FLINK-11420 Best, Stefan > On 13. Mar 2019, at 09:41, Konstantin Knauf wrote: > > Hi Andrew, > > generally, this looks like a

[jira] [Resolved] (FLINK-11829) [checkpoint] FsCheckpointStateOutputStream might store state in files even state size below fileStateThreshold

[ https://issues.apache.org/jira/browse/FLINK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11829. Resolution: Fixed Merged in: master: 753bc10 > [checkpo

[jira] [Updated] (FLINK-11829) [checkpoint] FsCheckpointStateOutputStream might store state in files even state size below fileStateThreshold

[ https://issues.apache.org/jira/browse/FLINK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-11829: --- Fix Version/s: 1.9.0 > [checkpoint] FsCheckpointStateOutputStream might store st

[jira] [Resolved] (FLINK-11833) Cleanup unnecessary createKeyedStateBackend methods in StateBackend

[ https://issues.apache.org/jira/browse/FLINK-11833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11833. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: f10a7d8b release

[jira] [Resolved] (FLINK-11796) Remove Snapshotable interface

[ https://issues.apache.org/jira/browse/FLINK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11796. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: e8daa49a release

[jira] [Issue Comment Deleted] (FLINK-11729) Make all state backends follow builder pattern

[ https://issues.apache.org/jira/browse/FLINK-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-11729: --- Comment: was deleted (was: Merged in: master: 94f84a5c release-1.8: 2f62b890) > Make

[jira] [Resolved] (FLINK-11729) Make all state backends follow builder pattern

[ https://issues.apache.org/jira/browse/FLINK-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11729. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 94f84a5c release

[jira] [Resolved] (FLINK-11731) Make DefaultOperatorStateBackend follow the builder pattern

[ https://issues.apache.org/jira/browse/FLINK-11731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11731. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 94f84a5c release

[jira] [Resolved] (FLINK-11730) Make HeapKeyedStateBackend follow the builder pattern

[ https://issues.apache.org/jira/browse/FLINK-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11730. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 237d07c7 release

[jira] [Resolved] (FLINK-11804) Make sure the CloseableRegistry used in backend builder is registered with task

[ https://issues.apache.org/jira/browse/FLINK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11804. Resolution: Fixed Fix Version/s: 1.8.0 Merged in: master: eada52be release-1.8

[jira] [Closed] (FLINK-10912) Configurable RocksDBStateBackend options factory

[ https://issues.apache.org/jira/browse/FLINK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10912. -- Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: a8580ca08d release-1.8

[jira] [Closed] (FLINK-11743) Sticky E2E tests failed on travis

[ https://issues.apache.org/jira/browse/FLINK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11743. -- Resolution: Fixed Merged in: master: 7a078a632c release-1.8: 060d0e6837 > Sticky E2E te

[jira] [Assigned] (FLINK-11007) Update documentation to describe new checkpoint metadata file behavior

[ https://issues.apache.org/jira/browse/FLINK-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11007: -- Assignee: Stefan Richter > Update documentation to describe new checkpoint metad

[jira] [Closed] (FLINK-11744) Provide stable/final toHexString for AbstractID

[ https://issues.apache.org/jira/browse/FLINK-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11744. -- Resolution: Fixed Merged in: master: 435807e51c release-1.8: aa55d58734 > Provide sta

[jira] [Updated] (FLINK-11743) Sticky E2E tests failed on travis

[ https://issues.apache.org/jira/browse/FLINK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-11743: --- Priority: Blocker (was: Critical) > Sticky E2E tests failed on tra

[jira] [Created] (FLINK-11744) Provide stable/final toHexString for AbstractID

Stefan Richter created FLINK-11744: -- Summary: Provide stable/final toHexString for AbstractID Key: FLINK-11744 URL: https://issues.apache.org/jira/browse/FLINK-11744 Project: Flink Issue

[jira] [Created] (FLINK-11744) Provide stable/final toHexString for AbstractID

Stefan Richter created FLINK-11744: -- Summary: Provide stable/final toHexString for AbstractID Key: FLINK-11744 URL: https://issues.apache.org/jira/browse/FLINK-11744 Project: Flink Issue

[jira] [Assigned] (FLINK-11743) Sticky E2E tests failed on travis

[ https://issues.apache.org/jira/browse/FLINK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11743: -- Assignee: Stefan Richter > Sticky E2E tests failed on tra

[jira] [Closed] (FLINK-10044) Check proper RIA style and introduce it where missing

[ https://issues.apache.org/jira/browse/FLINK-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10044. -- Resolution: Fixed Assignee: (was: Stefan Richter) > Check proper RIA st

[jira] [Closed] (FLINK-11618) [state] Refactor operator state repartition mechanism

[ https://issues.apache.org/jira/browse/FLINK-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11618. -- Resolution: Fixed Merged in: master: bdb7760 > [state] Refactor operator state repartit

[jira] [Closed] (FLINK-10043) Refactor object construction/inititlization/restore code

[ https://issues.apache.org/jira/browse/FLINK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10043. -- Resolution: Implemented Merged in: master: 3bf06b9 > Refactor object construct

[jira] [Closed] (FLINK-11541) Heavy deployment E2E test failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11541. -- Resolution: Fixed Merged in: master: 42d9df8fa2 > Heavy deployment E2E test failed on Tra

[jira] [Closed] (FLINK-11704) Improve AbstractCheckpointStateOutputStreamTestBase with Parameterized

[ https://issues.apache.org/jira/browse/FLINK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11704. -- Resolution: Implemented Merged in: master: 5db40c3 > Impr

[jira] [Commented] (FLINK-9900) Failed to testRestoreBehaviourWithFaultyStateHandles (org.apache.flink.test.checkpointing.ZooKeeperHighAvailabilityITCase)

[ https://issues.apache.org/jira/browse/FLINK-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774231#comment-16774231 ] Stefan Richter commented on FLINK-9900: --- Saw another instance here: https://api.travis-ci.org/v3

[jira] [Reopened] (FLINK-11524) LeaderChangeClusterComponentsTest.testReelectionOfJobMaster failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-11524: It seems like this test is not fully fixed. I still observe failing instances, e.g. : https

[jira] [Commented] (FLINK-11541) Heavy deployment E2E test failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774149#comment-16774149 ] Stefan Richter commented on FLINK-11541: I analyzed it a bit more and it seems that the changes

[jira] [Closed] (FLINK-11041) ReinterpretDataStreamAsKeyedStreamITCase.testReinterpretAsKeyedStream failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11041. -- Resolution: Fixed Merged in: master: 178fe6b678 release-1.7: b9f78bbe68

[jira] [Commented] (FLINK-11552) Akka association issues in 1.7.x

[ https://issues.apache.org/jira/browse/FLINK-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773900#comment-16773900 ] Stefan Richter commented on FLINK-11552: [~wcummings] Do you think we can close this issue

[jira] [Commented] (FLINK-10944) EventTimeWindowCheckpointingITCase.testTumblingTimeWindow failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773885#comment-16773885 ] Stefan Richter commented on FLINK-10944: [~aljoscha] what was the result from the bombardment

[jira] [Commented] (FLINK-10775) Quarantined address [akka.tcp://flink@flink-jobmanager:6123] is still unreachable or has not been restarted. Keeping it quarantined.

[ https://issues.apache.org/jira/browse/FLINK-10775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773853#comment-16773853 ] Stefan Richter commented on FLINK-10775: [~till.rohrmann] can this issue be closed

[jira] [Resolved] (FLINK-11375) Concurrent modification to slot pool due to SlotSharingManager releaseSlot directly

[ https://issues.apache.org/jira/browse/FLINK-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11375. Resolution: Fixed This issue is already fixed as a byproduct of the changes in FLINK

[jira] [Closed] (FLINK-11691) Introduce ClassLoader in the methods of StateBackendFactory and ConfigurableStateBackend

[ https://issues.apache.org/jira/browse/FLINK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11691. -- Resolution: Implemented Merged in: master: c763c35 > Introduce ClassLoader in the meth

[jira] [Commented] (FLINK-11691) Introduce ClassLoader in the methods of StateBackendFactory and ConfigurableStateBackend

[ https://issues.apache.org/jira/browse/FLINK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773123#comment-16773123 ] Stefan Richter commented on FLINK-11691: I think this is a useful change for what ou

[jira] [Closed] (FLINK-10471) State TTL cleanup using RocksDb compaction filter

[ https://issues.apache.org/jira/browse/FLINK-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10471. -- Resolution: Implemented Merged in: master: 735b514 > State TTL cleanup using Rock

[jira] [Commented] (FLINK-11541) Heavy deployment E2E test failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771769#comment-16771769 ] Stefan Richter commented on FLINK-11541: I would assume it is a test instability. > He

[jira] [Closed] (FLINK-11121) Check and update licensing notes for Aliyun FS [FLINK-10865]

[ https://issues.apache.org/jira/browse/FLINK-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11121. -- Resolution: Fixed Assignee: Stefan Richter Merged in: master: 05a1dd2 > Ch

[jira] [Closed] (FLINK-10431) Extract scheduling-related code from SlotPool

[ https://issues.apache.org/jira/browse/FLINK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10431. -- Resolution: Implemented Merged in: master: c60995d60a > Extract scheduling-related code f

Re: [ANNOUNCE] New Flink PMC member Thomas Weise

Congrats Thomas!, Best, Stefan > Am 12.02.2019 um 11:20 schrieb Stephen Connolly > : > > Congratulations to Thomas. I see that this is not his first time in the PMC > rodeo... also somebody needs to update LDAP as he's not on > https://people.apache.org/phonebook.html?pmc=flink >

[jira] [Closed] (FLINK-11315) Make magic number in KvStateSerializer as a constant value to make more readable

[ https://issues.apache.org/jira/browse/FLINK-11315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11315. -- Resolution: Fixed Fix Version/s: 1.8.0 Merged in: master: e6a318c420 > Make ma

[jira] [Closed] (FLINK-11314) Reuse RocksDBWriteBatchWrapper in the flush method of RocksDBMapState

[ https://issues.apache.org/jira/browse/FLINK-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11314. -- Resolution: Fixed Fix Version/s: 1.8.0 Merged in: master: 1b71e447e0 > Re

[jira] [Closed] (FLINK-11311) StreamSource implements StreamOperator interface multiple times.

[ https://issues.apache.org/jira/browse/FLINK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11311. -- Resolution: Fixed Merged in: master: e354d0bf70 > StreamSource implements StreamOpera

Re: H-A Deployment : Job / task manager configuration

Hi, You only need to do the configuration in conf/flink-conf.yaml on the job manager. The configuration will be shipped to the TMs. Best, Stefan > On 5. Feb 2019, at 16:59, bastien dine wrote: > > Hello everyone, > > I would like to know what exactly I need to configure on my job / task >

Re: JDBCAppendTableSink on Data stream

Hi, That should be no problem, for example the `JDBCAppendTableSinkTest` is using it also with data stream. Best, Stefan > On 6. Feb 2019, at 07:29, Chirag Dewan wrote: > > Hi, > > In the documentation, the JDBC sink is mentioned as a source on Table > API/stream. > > Can I use the same

[jira] [Closed] (FLINK-11417) Make access to ExecutionGraph single threaded from JobMaster main thread

[ https://issues.apache.org/jira/browse/FLINK-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11417. -- Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 85bae44 > Make acc

[jira] [Closed] (FLINK-11469) fix Tuning Checkpoints and Large State doc

[ https://issues.apache.org/jira/browse/FLINK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11469. -- Resolution: Fixed Fix Version/s: 1.8.0 1.7.2

[jira] [Closed] (FLINK-10473) State TTL incremental cleanup using Heap backend key iterator

[ https://issues.apache.org/jira/browse/FLINK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10473. -- Resolution: Fixed Merged in: master: 592f3a9 > State TTL incremental cleanup using H

[jira] [Updated] (FLINK-10043) Refactor object construction/inititlization/restore code

[ https://issues.apache.org/jira/browse/FLINK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-10043: --- Description: Currently, the constructor of {{RocksDBKeyedStateBackend}} has the following

[jira] [Closed] (FLINK-11008) Speed up upload checkpoint files using multi-thread

[ https://issues.apache.org/jira/browse/FLINK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11008. -- Resolution: Implemented Merged in: master: 4c4ce451fc > Speed up upload checkpoint fi

[jira] [Created] (FLINK-11417) Make access to ExecutionGraph single threaded from JobMaster main thread

Stefan Richter created FLINK-11417: -- Summary: Make access to ExecutionGraph single threaded from JobMaster main thread Key: FLINK-11417 URL: https://issues.apache.org/jira/browse/FLINK-11417 Project

[jira] [Created] (FLINK-11417) Make access to ExecutionGraph single threaded from JobMaster main thread

Stefan Richter created FLINK-11417: -- Summary: Make access to ExecutionGraph single threaded from JobMaster main thread Key: FLINK-11417 URL: https://issues.apache.org/jira/browse/FLINK-11417 Project

Re: improper use of releaseJob() without a matching number of createTmpFiles() calls for jobId

Hi, Which version of Flink are you using? This issue https://issues.apache.org/jira/browse/FLINK-10283 shows that a similar problem was fixed in 1.6.1 and 1.7. If you use a newer version and still encounter the problem, you can reopen the

Re: [SURVEY] Custom RocksDB branch

+1 from me as well. > On 22. Jan 2019, at 10:47, aitozi wrote: > > +1 from my side, since we rely on this feature to implement the real state > ttl . > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[jira] [Closed] (FLINK-11012) Introduce abstract superclass for filesystem IT cases

[ https://issues.apache.org/jira/browse/FLINK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11012. -- Resolution: Implemented Merged in: master: c08db3fda3 > Introduce abstract supercl

Re: Subtask much slower than the others when creating checkpoints

Hi, I have seen a few cases where for certain jobs a small imbalance in the state partition assignment did cascade into a larger imbalance of the job. If your max parallelism mod parallelism is not 0, it means that some tasks have one partition more than others. Again, depending on how much

Re: Bug in RocksDB timer service

Hi, I have never seen this before. I would assume to see this exception because the write batch is flushed and contained a write against a column family that does not exist (anymore). However, we initialize everything relevant in RocksDBCachingPriorityQueueSet as final (CF handle) and never

Re: Flink Streaming Job Task is getting cancelled silently and causing job to restart

Hi, Could you also provide the job master log? Best, Stefan > On 9. Jan 2019, at 12:02, sohimankotia wrote: > > Hi, > > I am running Flink Streaming Job with 1.5.5 version. > > - Job is basically reading from Kafka , windowing on 2 minutes , and writing > to hdfs using AvroBucketing Sink .

Re: windowAll and AggregateFunction

Hi, I think your expectation about windowAll is wrong, from the method documentation: “Note: This operation is inherently non-parallel since all elements have to pass through the same operator instance” and I also cannot think of a way in which the windowing API would support your use case

Re: Can checkpoints be used to migrate jobs between Flink versions ?

Hi, I would assume that this should currently work because the format of basic savepoints and checkpoints is the same right now. The restriction in the doc is probably there in case that the checkpoint format will diverge more in the future. Best, Stefan > On 9. Jan 2019, at 13:12, Edward

Re: Zookeeper shared by Flink and Kafka

Hi, That is more a ZK question than a Flink question, but I don’t think there is a problem. Best, Stefan > On 9. Jan 2019, at 13:31, min@ubs.com wrote: > > Hi, > > I am new to Flink. > > I have a question: > Can a zookeeper cluster be shared by a flink cluster and a kafka cluster? >

[jira] [Closed] (FLINK-11273) Queryable state (rocksdb) end-to-end test fails

[ https://issues.apache.org/jira/browse/FLINK-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11273. -- Resolution: Fixed Merged in: master: 0b28bfd0d9 > Queryable state (rocksdb) end-to-end t

[jira] [Assigned] (FLINK-11273) Queryable state (rocksdb) end-to-end test fails

[ https://issues.apache.org/jira/browse/FLINK-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11273: -- Assignee: Stefan Richter > Queryable state (rocksdb) end-to-end test fa

[jira] [Closed] (FLINK-9702) Improvement in (de)serialization of keys and values for RocksDB state

[ https://issues.apache.org/jira/browse/FLINK-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9702. - Resolution: Fixed Merged in: master: 54ef382439 > Improvement in (de)serialization of k

<    1   2   3   4   5   6   7   8   9   10   >