Hi,
We are trying to install Flink Kubernetes operator v1.1.0. Few questions
regarding the webhooks:
- Is it necessary to install webhooks? If not, what can be the
implications?
- What type of validations and mutations does it support?
Thanks
Prakhar Mathur
UI.
> Ideally, with detailed breakdown for the operators that seems problematic.
>
> Regards,
> Roman
>
> On Fri, Mar 4, 2022 at 8:48 AM Prakhar Mathur wrote:
> >
> > Hi,
> >
> > Can someone kindly help and take a look at this? It's a major blocker
&
Hi,
Can someone kindly help and take a look at this? It's a major blocker for
us.
Thanks,
Prakhar
On Wed, Mar 2, 2022 at 2:11 PM Prakhar Mathur wrote:
> Hello,
>
> We recently did a migration of our Flink jobs from version 1.9.0 to
> 1.14.3. These jobs consume from Kaf
due to lack of resources.
- Earlier in version 1.9.0, we were
using org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer and
now in 1.14.3 we have moved to the new Kafka Source.
Any help will be highly appreciated as these are production jobs.
Thanks
Prakhar Mathur
In another run you stated that it
> would take 10s.
>
> Have you tried whether the same behaviour is observable with the latest
> Flink version?
>
> Cheers,
> Till
>
> On Fri, Sep 4, 2020 at 6:44 AM Prakhar Mathur wrote:
>
>> Yes, I will check that, but any po
> Cheers,
> Till
>
> On Thu, Sep 3, 2020 at 6:23 PM Prakhar Mathur wrote:
>
>> We tried uploading the same blob from Job Manager k8s pod directly to GCS
>> using gsutils and it took 2 seconds. The upload speed was 166.8 MiB/s.
>> Thanks.
>>
>> On Wed, Sep
dth to your GCS bucket is from the machine you are running Flink on?
> It should be enough to generate a 200 MB file and write it to GCS. Thanks a
> lot for your help in debugging this matter.
>
> Cheers,
> Till
>
> On Wed, Sep 2, 2020 at 1:04 PM Prakhar Mathur wrote:
>
&
es which are not needed (e.g. Flink dependencies which are
> usually provided by the system). That way you could decrease the size of
> the jar a bit.
>
> Cheers,
> Till
>
> On Wed, Sep 2, 2020 at 9:48 AM Prakhar Mathur wrote:
>
>> Hi,
>>
>> We are curre
d
via tweaking any configuration?
Thank you. Regards
Prakhar Mathur
Hi Chesnay,
Thanks for the response, can you point me to some existing example for this?
On Wed, Oct 30, 2019 at 5:30 PM Chesnay Schepler wrote:
> Not possible, you'll have to extend the StatsDReporter yourself to add
> arbitrary tags.
>
> On 30/10/2019 12:52, Prakhar Mat
Prakhar Mathur
messages then the watermark of the operator does not advance
> (as it is the minimum across all partitions).
>
> You'll need to define a strategy for the watermark to advance even when no
> messages are received for a particular partition.
>
> Regards,
> Eduardo
>
>
&
Hi,
We are using flink v1.6. We are facing data loss issues while consuming
data from older offsets in Kafka with windowing. We are exploring per
partition watermarking strategy. But we noticed that when we are trying to
consume from multiple topics and if any of the partition is not receiving
dat
har,
>
> Sorry I could not find any abnormal message from your GC log and stack
> trace.
> Have you ever tried deploying the cluster in other ways? Not on
> Kubernetes. Like on YARN or standalone. Just for narrowing down the scope.
>
>
> On Tue, Jul 23, 2019 at 12:34 PM Prakhar
On Mon, Jul 22, 2019, 16:08 Prakhar Mathur wrote:
> Hi,
>
> We enabled GC logging, here are the logs
>
> [GC (Allocation Failure) [PSYoungGen: 6482015K->70303K(6776832K)]
> 6955827K->544194K(20823552K), 0.0591479 secs] [Times: user=0.09 sys=0.00,
> real=0.06 secs
metric for
some irregular interval. Even the Jobmanager pod keeps restarting because
it stops responding to the liveliness probe which results in Kubernetes
killing the pod. We tried increasing the resources given(CPU, RAM) but it
didn't help.
Regards
Prakhar Mathur
Product Engineer
GO-JEK
16 matches
Mail list logo