2019-10-19 09:33:22 UTC - Retardust: first
```
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 5.0000051386719475,
"msgThroughputOut" : 2683020.607429712,
"averageMsgSize" : 0.0,
"storageSize" : 5163563135,
"publishers" : [ ],
"subscriptions" : {
"skdf4k" : {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 86576,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"msgRateExpired" : 0.0,
"consumers" : [ ],
"isReplicated" : false
},
"journal_consumer" : {
"msgRateOut" : 5.0000051386719475,
"msgThroughputOut" : 2683020.607429712,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 23007,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Failover",
"activeConsumerName" : "b0c6b",
"msgRateExpired" : 0.0,
"consumers" : [ {
"msgRateOut" : 5.0000051386719475,
"msgThroughputOut" : 2683020.607429712,
"msgRateRedeliver" : 0.0,
"consumerName" : "b0c6b",
"availablePermits" : 700,
"unackedMessages" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"metadata" : { },
"connectedSince" : "2019-10-19T09:11:49.833Z",
"clientVersion" : "2.4.1",
"address" : "/172.28.117.8:53762"
} ],
"isReplicated" : true
}
},
"replication" : { },
"deduplicationStatus" : "Disabled"
}
```
next one
```
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 14.999971181055368,
"msgThroughputOut" : 2603825.2973572505,
"averageMsgSize" : 0.0,
"storageSize" : 5163630949,
"publishers" : [ ],
"subscriptions" : {
"skdf4k" : {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 87403,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"msgRateExpired" : 0.0,
"consumers" : [ ],
"isReplicated" : false
},
"journal_consumer" : {
"msgRateOut" : 14.999971181055368,
"msgThroughputOut" : 2603825.2973572505,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 23834,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Failover",
"activeConsumerName" : "b0c6b",
"msgRateExpired" : 0.0,
"consumers" : [ {
"msgRateOut" : 14.999971181055368,
"msgThroughputOut" : 2603825.2973572505,
"msgRateRedeliver" : 0.0,
"consumerName" : "b0c6b",
"availablePermits" : 200,
"unackedMessages" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"metadata" : { },
"connectedSince" : "2019-10-19T09:11:49.833Z",
"clientVersion" : "2.4.1",
"address" : "/172.28.117.8:53762"
} ],
"isReplicated" : true
}
},
"replication" : { },
"deduplicationStatus" : "Disabled"
}
```
----
2019-10-19 09:34:46 UTC - Retardust: I think msgThroughputIn is wrong because
we are write to the topic
----
2019-10-19 09:35:44 UTC - Retardust: and storage size increasing)
----
2019-10-19 09:35:53 UTC - Retardust: 5163563135 -> 5163630949
----
2019-10-19 17:49:38 UTC - Karthik Ramasamy: Excellent blog by @Yuvaraj
Loganathan on why Nutanix chose Apache Pulsar -
<https://medium.com/@yuvarajl/why-nutanix-beam-went-ahead-with-apache-pulsar-instead-of-apache-kafka-1415f592dbbb>
----
2019-10-19 18:40:37 UTC - Joe Francis: Im curious to know the use case for
this... The namespace is part of the global topic id, and is linked to
everything associated with the topic, including replicated and external
linkages.
----
2019-10-19 21:21:24 UTC - Luke Lu: One of our use cases is to reorganize topics
for pulsar auth, which is applied at namespace level. If authorization can be
applied at topic level, this is less of an issue. Other use cases are simply
like file rename/move for fixing typos and general cleanup/reorganization for
OCD admins :slightly_smiling_face:. Ideally linking should use a simple topic
id (a la fs inode id, vs using portions of the id to encode namespace/partition
for marginal perf gains) that’s agnostic about it’s namespace hierarchy.
----
2019-10-19 21:58:55 UTC - Luke Lu: I had wished that pulsar api would be more
like an fs (api wise), where topics are just rolling append only files with
atomic read and write semantics, separate read-only indices for message/record
positions, and xattrs for topic attrs/stats, which makes a fuse mount trivial
to do to leverage all kinds of existing tools that could operate on regular
files, where mv would work as expected :slightly_smiling_face:
----
2019-10-19 22:52:53 UTC - Alex: I'm noticed that when I create
producer/consumer in Java client it throws PulsarClientException (even if I
don't sending anything yet) if it can't connect to cluster.
It's frustrating because naively-written application cannot start when Pulsar
is unavailable.
How am I expected to use it? Also is it expects that I will re-create
consumer/producer instances after disconnect?
----
2019-10-20 00:30:24 UTC - Matteo Merli: > If authorization can be applied
at topic level, this is less of an issue.
Yes, you can augment the permissions at topic level:
`bin/pulsar-admin topics grant-permission --actions consume --role $PRINCIPAL
$TOPIC`
----
2019-10-20 00:56:12 UTC - Poule: just published on HN by @Matteo Merli
----
2019-10-20 01:01:42 UTC - Matteo Merli: Did you upvote? :wink:
----
2019-10-20 01:08:52 UTC - Luke Lu: This is useful. Thanks! More useful would be
grant-permission for a topic prefix to alleviate the need for moving.
----
2019-10-20 04:44:02 UTC - Raman Gupta: What do you suggest if you don't have a
sequential value but only UUIDs? Is there some solution inside the Pulsar
ecosytem, or do I need to use something like Twitter Snowflake?
----
2019-10-20 05:04:39 UTC - Raman Gupta: Actually, even Snowflake wouldn't work.
It's ids are roughly sortable but not guaranteed to increase monotonically.
----
2019-10-20 05:09:25 UTC - Raman Gupta: Avoiding the difficulties of generating
sequential IDs in a distributed system is why people use UUIDs in the first
place... sucks to be limited to a sequence with Pulsar producers.
----
2019-10-20 06:00:33 UTC - J Mammen: @J Mammen has joined the channel
----
2019-10-20 06:37:35 UTC - Anand Prabhu: @Anand Prabhu has joined the channel
----
2019-10-20 07:01:48 UTC - Shivji Kumar Jha: Good one @Yuvaraj Loganathan
:grinning::+1: Also many thanks to the pulsar team on working with us while we
figured our way through the adoption. Amazing community :pray:
----
