Thanks Anand and Robert. Using extra_packages and specifying it as list
worked.
Regards,
Sumit Desai
On Tue, Dec 19, 2023 at 11:45 PM Robert Bradshaw via user <
user@beam.apache.org> wrote:
> And should it be a list of strings, rather than a string?
>
> On Tue, Dec 19, 2023 at 10:10 AM Anand
Do you have a ticket?
And in the pubsublite metrics it show NO_CLIENT_TOKENS
On Tue, Dec 19, 2023 at 1:39 PM Nirav Patel wrote:
> we have. yes it is super slow. I tested python, java IO version as well
> besides beam IO. we reported to google about this problem.
>
> On Tue, Dec 19, 2023 at
we have. yes it is super slow. I tested python, java IO version as well
besides beam IO. we reported to google about this problem.
On Tue, Dec 19, 2023 at 10:17 AM hsy...@gmail.com wrote:
> Any one is using pubsublite? I find it super slow 5 messages/sec and there
> is no options for me to
Any one is using pubsublite? I find it super slow 5 messages/sec and there
is no options for me to tune the performance
And should it be a list of strings, rather than a string?
On Tue, Dec 19, 2023 at 10:10 AM Anand Inguva via user
wrote:
> Can you try passing `extra_packages` instead of `extra_package` when
> passing pipeline options as a dict?
>
> On Tue, Dec 19, 2023 at 12:26 PM Sumit Desai via user <
>
Can you try passing `extra_packages` instead of `extra_package` when
passing pipeline options as a dict?
On Tue, Dec 19, 2023 at 12:26 PM Sumit Desai via user
wrote:
> Hi all,
> I have created a Dataflow pipeline in batch mode using Apache beam Python
> SDK. I am using one non-public dependency
Hi all,
I have created a Dataflow pipeline in batch mode using Apache beam Python
SDK. I am using one non-public dependency 'uplight-telemetry'. I have
specified it using parameter extra_package while creating pipeline_options
object. However, the pipeline loading is failing with an error *No
I'm trying to read data from Kafka, make some processing and then write new
data to another Kafka topic.
The problem is that task is probably stucked on the processing stage.
In the logs I can see it reads data from kafka constantly. But no new data
appears in the sink Kafka topic
Could you help
