Hi everyone,
I'm very happy and excited to announce that Danny Cranmer has joined the
Flink PMC!
Danny has been a committer since January 2021. He has been very active with
all Amazon-related connectors and projects in Flink, such as DynamoDB,
Kinesis (EFO, Firehose, ...) and the AsyncSinkBase. B
Thanks for discovering this problem, Qingsheng!
I'm also +1 for reverting the breaking changes.
IIUC, currently, the behavior of "numXXXOut" metrics of the new and old
sink is inconsistent.
We have to break one of them to have consistent behavior. Sink V2 is an
evolving API which is just introduc
Congratulations Danny!
Hong
On 10/10/2022, 08:06, "Robert Metzger" wrote:
CAUTION: This email originated from outside of the organization. Do not
click links or open attachments unless you can confirm the sender and know the
content is safe.
Hi everyone,
I'm very happy and e
Congratulations Danny!
Ahmed
On Mon, 10 Oct 2022, 08:12 Teoh, Hong, wrote:
> Congratulations Danny!
>
> Hong
>
> On 10/10/2022, 08:06, "Robert Metzger" wrote:
>
> CAUTION: This email originated from outside of the organization. Do
> not click links or open attachments unless you can confir
congratulations Danny!
On Mon, 10 Oct 2022 at 12:43 PM, Ahmed Hamdy wrote:
> Congratulations Danny!
> Ahmed
>
> On Mon, 10 Oct 2022, 08:12 Teoh, Hong,
> wrote:
>
> > Congratulations Danny!
> >
> > Hong
> >
> > On 10/10/2022, 08:06, "Robert Metzger" wrote:
> >
> > CAUTION: This email orig
Hang HOU created FLINK-29558:
Summary: Use select count(*) from xxx; and get SQL syntax
Key: FLINK-29558
URL: https://issues.apache.org/jira/browse/FLINK-29558
Project: Flink
Issue Type: Bug
Yunhong Zheng created FLINK-29559:
-
Summary: Disable Join Reorder for these tables whose statistics
are unavailable
Key: FLINK-29559
URL: https://issues.apache.org/jira/browse/FLINK-29559
Project: Fli
Hi Liwei,
I think it's indeed better to have a separate discussion thread on that.
Best regards,
Martijn
On Mon, Oct 10, 2022 at 7:22 AM liwei li wrote:
> Thanks for the discussion.
>
> Favor schemes that allow for custom committer parallelism. This will help
> us better use the new unified s
Thanks Qingsheng for starting this thread.
+1 on reverting sink metric name and releasing 1.15.3 to fix this inconsistent
behavior.
Best,
Leonard
> 2022年10月10日 下午3:06，Jark Wu 写道：
>
> Thanks for discovering this problem, Qingsheng!
>
> I'm also +1 for reverting the breaking changes.
>
Hi Qingsheng,
Do you have any idea what has happened in the process here? Do we know why
they were changed? I was under the impression that these metric names were
newly introduced due to the new interfaces and because it still depends on
each connector implementing these.
Sidenote: metric names
Hi everyone, FLIP-262 [1] has been accepted. There are 4 approving votes
which are all binding [2] - Binding: Martijn Visser
- Binding: Matthias Pohl
- Binding: Qingsheng Ren
- Binding: Leonard Xu
None against. Thanks again to everyone !
[1]
https://cwiki.apache.org/confluence/display/FLIN
+1 for reverting these changes in Flink 1.16.
For 1.15.3, can we make these metrics available via both names (numXXXOut
and numXXXSend)? In this way we don't break it for those who already
migrated to 1.15 and numXXXSend. That means we still need to change
SinkWriterOperator to use another metric
Martijn Visser created FLINK-29560:
--
Summary: Create a flink-connector-mongodb repository
Key: FLINK-29560
URL: https://issues.apache.org/jira/browse/FLINK-29560
Project: Flink
Issue Type: S
Hi everyone,
I'm opening a vote to change the minimal supported version of Hadoop to
2.10.2. The discussion thread can be found here [1].
The vote will be open for at least 72h.
Best regards,
Martijn
https://twitter.com/MartijnVisser82
https://github.com/MartijnVisser
[1] https://lists.apache.
Xin Hao created FLINK-29561:
---
Summary: Log the job id when clean up session job failed
Key: FLINK-29561
URL: https://issues.apache.org/jira/browse/FLINK-29561
Project: Flink
Issue Type: Improvement
Congratulations, Danny! :-)
On Mon, Oct 10, 2022 at 9:24 AM Samrat Deb wrote:
> congratulations Danny!
>
> On Mon, 10 Oct 2022 at 12:43 PM, Ahmed Hamdy wrote:
>
> > Congratulations Danny!
> > Ahmed
> >
> > On Mon, 10 Oct 2022, 08:12 Teoh, Hong,
> > wrote:
> >
> > > Congratulations Danny!
> >
Congrats, Danny!
Best,
Paul Lam
> 2022年10月10日 15:05，Robert Metzger 写道：
>
> Hi everyone,
>
> I'm very happy and excited to announce that Danny Cranmer has joined the
> Flink PMC!
>
> Danny has been a committer since January 2021. He has been very active with
> all Amazon-related connectors and
Chesnay Schepler created FLINK-29562:
Summary: JM/SQl gatewa OpenAPI specs should have different titles
Key: FLINK-29562
URL: https://issues.apache.org/jira/browse/FLINK-29562
Project: Flink
Etienne Chauchot created FLINK-29563:
Summary: SourceTestSuiteBase#testSourceMetrics enters an infinite
waiting loop in case the number of records counter is wrong
Key: FLINK-29563
URL: https://issues.apache.o
Jiabao Sun created FLINK-29564:
--
Summary: Migrate pull request to flink-connector-mongodb repository
Key: FLINK-29564
URL: https://issues.apache.org/jira/browse/FLINK-29564
Project: Flink
Issue
Thanks everyone for joining the discussion!
> Do you have any idea what has happened in the process here?
The discussion in this PR [1] shows some details and could be helpful to
understand the original motivation of the renaming. We do have a test case for
guarding metrics but unfortunaly the
wangshiwei created FLINK-29565:
--
Summary: flink per-job模式 webui上taskManager打印的日志不高亮，被注释，影响使用体验，详情请看图
Key: FLINK-29565
URL: https://issues.apache.org/jira/browse/FLINK-29565
Project: Flink
Issue
On 10/10/2022 11:24, Martijn Visser wrote:
Sidenote: metric names are not mentioned in the FLIP process as a
public API. Might make sense to have a separate follow-up to add that
to the list (I do think we should list them there).
That's a general issue we have. There's a lot of things we _ us
> I’m with Xintong’s idea to treat numXXXSend as an alias of numXXXOut
But that's not possible. If it were that simple there would have never
been a need to introduce another metric in the first place.
It's a rather fundamental issue with how the new sinks work, in that
they emit data to the
Xin Hao created FLINK-29566:
---
Summary: Reschedule the cleanup logic if cancel job failed
Key: FLINK-29566
URL: https://issues.apache.org/jira/browse/FLINK-29566
Project: Flink
Issue Type: Improveme
Qingsheng Ren created FLINK-29567:
-
Summary: Revert sink output metric names from numRecordsSend back
to numRecordsOut
Key: FLINK-29567
URL: https://issues.apache.org/jira/browse/FLINK-29567
Project:
Chesnay Schepler created FLINK-29568:
Summary: Remove unnecessary whitespace in request/response blocks
Key: FLINK-29568
URL: https://issues.apache.org/jira/browse/FLINK-29568
Project: Flink
+1 for reverting these changes in Flink 1.16, so I will cancel 1.16.0-rc1.
+1 for `numXXXSend` as the alias of `numXXXOut` in 1.15.3.
Best,
Xingbo
Chesnay Schepler 于2022年10月10日周一 19:13写道：
> > I’m with Xintong’s idea to treat numXXXSend as an alias of numXXXOut
>
> But that's not possible. If it
Hi everyone,
We have found a blocker issue
https://issues.apache.org/jira/browse/FLINK-29567, so the rc1 is officially
canceled. And I will prepare the next RC after the blocker issue is
resolved.
Best,
Xingbo
Congxian Qiu 于2022年10月10日周一 10:00写道：
> +1 (non-binding)
>
> - checked sha512 & gpg
>
Hi Abid,
Just to clarify does your suggestion mean that the Iceberg community would
like to remove the iceberg-flink connector from the Iceberg codebase and
maintain it under Flink instead? A new separate repo under the Flink
project umbrella given the current existing effort to extract connectors
Chesnay Schepler created FLINK-29569:
Summary: Replace usages of deprecated expand shortcode
Key: FLINK-29569
URL: https://issues.apache.org/jira/browse/FLINK-29569
Project: Flink
Issue T
Martijn Visser created FLINK-29570:
--
Summary: Bump org.jsoup:jsoup to v1.15.3
Key: FLINK-29570
URL: https://issues.apache.org/jira/browse/FLINK-29570
Project: Flink
Issue Type: Technical Deb
Hi everyone,
Now that the connector externalization effort ig going on, I think it is
definitely work to revisit the currently supported HBase versions for the Flink
connector. Currently, ther is an HBase 1.4 and HBase 2.2 connector versions,
although both of those versions are kind of outdated
Maximilian Michels created FLINK-29571:
--
Summary: Flink configuration only supports Map
Key: FLINK-29571
URL: https://issues.apache.org/jira/browse/FLINK-29571
Project: Flink
Issue Type:
Hey Gyula,
Is the Adaptive Scheduler limited to the Reactive mode? I agree that if we
move forward with the Adaptive Scheduler solution it should support all
deployment scenarios.
Thanks,
-Max
On Sun, Oct 9, 2022 at 6:10 AM Gyula Fóra wrote:
> Hi!
>
> I think we have to make sure that the Resc
Kevin Li created FLINK-29572:
Summary: Flink Task Manager skip loopback interface for resource
manager registration
Key: FLINK-29572
URL: https://issues.apache.org/jira/browse/FLINK-29572
Project: Flink
Hi,
I'm trying to deserialize avro messages from the kafka topic as a consumer.
As a kafka consumer, I do not want to hold the reader schema on my end.
Is there a way to deserialize avro messages to GenericRecord
without providing the reader schema ?
Regards,
Sucheth Shivakumar
website : https:
kris wang created FLINK-29573:
-
Summary: Flink does not work for windows if installing on other
drive except for C drive
Key: FLINK-29573
URL: https://issues.apache.org/jira/browse/FLINK-29573
Project: Fl
Hi Marton,
Yes, we are initiating this as part of the Externalize Flink Connectors effort.
Plan is to externalize the existing Flink connector from Iceberg repo into a
separate repo under the Flink umbrella.
Sorry about the doc permissions! I was able to create a FLIP-267:
https://cwiki.apache
Hong Liang Teoh created FLINK-29574:
---
Summary: Upgrade software.amazon.glue:schema-registry-common and
software.amazon.glue:schema-registry-serde dependency from 1.1.8 to 1.1.14
Key: FLINK-29574
URL: https://iss
Angelo Kastroulis created FLINK-29575:
-
Summary: Can't Add Temporary Function USING JAR
Key: FLINK-29575
URL: https://issues.apache.org/jira/browse/FLINK-29575
Project: Flink
Issue Type:
Congratulations Danny!
Best,
Lijie
Paul Lam 于2022年10月10日周一 18:15写道：
> Congrats, Danny!
>
> Best,
> Paul Lam
>
> > 2022年10月10日 15:05，Robert Metzger 写道：
> >
> > Hi everyone,
> >
> > I'm very happy and excited to announce that Danny Cranmer has joined the
> > Flink PMC!
> >
> > Danny has been a c
Thanks for the details Chesnay!
By “alias” I mean to respect the original definition made in FLIP-33 for
numRecordsOut, which is the number of records written to the external system,
and keep numRecordsSend as the same value as numRecordsOut for compatibility.
I think keeping numRecordsOut for
43 matches
Mail list logo
