2019-04-18 09:11:05 UTC - Ali Ahmed: @Sébastien de Melo do you have any logs
from the broker ?
----
2019-04-18 09:19:01 UTC - Sébastien de Melo: @Ali Ahmed I don't have access to
the logs anymore but I'll take a look next time
----
2019-04-18 12:05:54 UTC - bhagesharora: Hello there,
In Reader Interface example for python
How we can get msg object for below code ??
Do we need to create any object from message class ??
# MessageId taken from a previously fetched message
msg_id = msg.message_id()
reader = client.create_reader('my-topic', msg_id)
while True:
msg = reader.receive()
print("Received message '{}' id='{}'".format(msg.data(), msg.message_id()))
# No acknowledgment
Reference URL - <https://pulsar.apache.org/docs/latest/clients/Python/>
----
2019-04-18 13:25:06 UTC - Sébastien de Melo: The problem occurred with a
querystate this time:
$ pulsar-admin-preprod functions querystate --name Router --key total
null
Reason: javax.ws.rs.ProcessingException: Request timeout to
lucky-star-pulsar-broker/192.168.124.46:8080 after 60000 ms
command terminated with exit code 1
----
2019-04-18 13:25:40 UTC - Sébastien de Melo: Here is the end of one of our
brokers log:
13:22:25.504 [bookkeeper-ml-scheduler-OrderedScheduler-3-0] WARN
org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl -
[public/default/persistent/mytopic-partition-1]-3842 read entry timeout for
3842:1122 after 120 sec
13:22:25.504 [bookkeeper-ml-scheduler-OrderedScheduler-3-0] WARN
org.apache.bookkeeper.mledger.impl.ManagedCursorImpl -
[public/default/persistent/mytopic-partition-1][public%2Fdefault%2FRouter]
Error while replaying entries
org.apache.bookkeeper.mledger.ManagedLedgerException: Bookie operation timeout
13:22:25.504 [bookkeeper-ml-scheduler-OrderedScheduler-3-0] ERROR
org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers
- [<persistent://public/default/mytopic-partition-1> / public/default/Router]
Error reading entries at 3842:1123 : Bookie operation timeout, Read Type Replay
- Retrying to read in 54.438 seconds
----
2019-04-18 15:53:27 UTC - Kai Levy: Hi. I'm trying to aggregate a list of
pulsar operations that write/read to/from zookeeper, so I can identify
potential bottlenecks there. For example, I am testing creating a lot of
subscriptions and seeing zk latency spike, because I believe that it doesn't
have enough IO to deal with the flood of requests. Does anybody know of an
existing list in this vein, or know how I could try to put one together? Thanks!
----
2019-04-18 16:30:08 UTC - David Kjerrumgaard: @bhagesharora Are you asking for
the API? <https://pulsar.apache.org/api/python/#pulsar.Message>
----
2019-04-18 16:36:34 UTC - Huzx: @Huzx has joined the channel
----
2019-04-18 22:11:56 UTC - Devin G. Bost: I noticed that the Java Admin API
exposes a `retainOrdering` property on the SinkConfig objects that are returned
by `adminClient.sink().getSink(tenant, namespace, sink)`; however, this
property is not available through the Admin CLI.
What does this property actually do?
I imagine that this property is also exposed on the FunctionConfig and
SourceConfig objects.
----
2019-04-18 22:41:16 UTC - Joe Francis: ZK manages metadata, and metadata has
details about topics, subscriptions, data storage. What's your use case?
----
2019-04-18 22:58:02 UTC - Devin G. Bost: Also, what happens if `retainOrdering`
is set to `true` when `parallelism` is set > 1 (e.g. `3`)?
----
2019-04-18 23:23:06 UTC - Jerry Peng: @Devin G. Bost when retainOrdering is
yet, the subscription type used among instances of a function is
Function.SubscriptionType.FAILOVER. Which means only one instance can consume
from a single partition. So in your example if you have a topic with one
partition only one instance will get data. Setting retainOrdering guarantees
the process ordering on a per partitions basis
----
2019-04-19 07:15:09 UTC - Wanwan Sun: @Wanwan Sun has joined the channel
----