Hello there!
I'm learning Beam and Flink. I made Flink is running on my PC, I installed Beam module (pip install apache-beam).
My first step is to execute simple script:
def run():
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
options
Hi meghajit,
I think it makes sense to extend the current metrics. Could you list all
metrics you need? Thanks!
Best regards,
Jing
On Fri, Jun 10, 2022 at 5:06 PM Lijie Wang wrote:
> Hi Meghajit,
>
> As far as I know, currently, the FileSource does not have the metrics you
> need. You can imp
Unsubscribe
Hi Meghajit,
As far as I know, currently, the FileSource does not have the metrics you
need. You can implement your own source, and register custom metrics via
`SplitEnumeratorContext#metricGroup` and `SourceReaderContext#metricGroup`.
Best,
Lijie
Meghajit Mazumdar 于2022年6月10日周五 16:36写道：
> He
Hello,
I have a flink table source working using
"""
create table source (
ts TIMESTAMP(3),
log_line STRING,
WATERMARK FOR ts AS ts - INTERVAL '1' SECOND
) with (
'connector'='lokitail', 'query'='blah', 'url'='blah'
)
""")
It uses a simple custom table
Hello,
We are working on a Flink project which uses FileSource to discover and
read Parquet Files from GCS. ( using Flink 1.14)
As part of this, we wanted to implement some health metrics around the
code.
I wanted to know whether Flink gathers some metrics by itself around
FileSource, e;g, number
