2020-03-22 10:52:53 UTC - Abhilash Mandaliya: hi I am trying to setup bookkeeper cluster on my own. I have already setup the zookeeper cluster. On starting a bookkeeper, I am getting the following error. `10:21:43.939 [main] ERROR org.apache.bookkeeper.discover.ZKRegistrationManager - BookKeeper metadata doesn't exist in zookeeper. Has the cluster been initialized? Try running bin/bookkeeper shell metaformat` `10:21:43.941 [main] INFO org.apache.bookkeeper.proto.BookieNettyServer - Shutting down BookieNettyServer` `10:21:43.968 [main] ERROR org.apache.bookkeeper.server.Main - Failed to build bookie server` `org.apache.book`
There is no initialisation info for bookkeeper metadata in the doc. I am referring from this page: <https://pulsar.apache.org/docs/en/deploy-bare-metal/#deploy-a-bookkeeper-cluster> I have not done “Initialize cluster metadata” step as I haven’t deployed pulsar broker yet so I don’t have values for `--broker-service-url <pulsar://pulsar.us-west.example.com:6650>` ---- 2020-03-22 11:01:14 UTC - Abhilash Mandaliya: yeah. it worked. Thanks :slightly_smiling_face: ---- 2020-03-22 16:59:02 UTC - Fernando: Hey :wave: , in key shared mode, I understand each key is assigned to a unique consumer. But is it possible to have a separate pool of consumer (which autoscale) process different keys? Or is it better to just assign a separate topic to each pool of consumer in normal shared mode? ---- 2020-03-22 19:49:47 UTC - Antti Kaikkonen: When using a partitioned topic with "Key hash" routing mode, does increasing the number of partitions break "Per-key-bucket ordering"? I think it does but just wanted to make sure. ---- 2020-03-22 21:38:18 UTC - Vince Pergolizzi: Trying to run a local Pulsar setup via docker-compose: ```version: '3.5' services: pulsar: container_name: pulsar image: 'apachepulsar/pulsar:2.5.0' ports: - '8080:8080' - '6650:6650' expose: - 8080 - 6650 environment: PULSAR_MEM: " -Xms512m -Xmx512m -XX:MaxDirectMemorySize=1g" command: | /bin/bash -c "bin/apply-config-from-env.py conf/standalone.conf && bin/pulsar standalone"``` And some of the underlying commands made via a client (such as Topic lookup) appear to be failing due to a RestException It seems that the admin API does not initialize properly when running through this kind of setup, it does seem to work if I browse to `<http://localhost:8080/metrics>` in Chrome first but if I try to do that “priming” programmatically (either via curl or other methods) it returns me this: ```Vinces-MacBook-Pro:pulsar-dotpulsar vince$ curl -v localhost:8080/metrics/ -L * Trying ::1... * TCP_NODELAY set * Connected to localhost (::1) port 8080 (#0) > GET /metrics/ HTTP/1.1 > Host: localhost:8080 > User-Agent: curl/7.54.0 > Accept: */* > * Empty reply from server * Connection #0 to host localhost left intact curl: (52) Empty reply from server``` Has anyone experience such issues before? ---- 2020-03-22 22:18:12 UTC - Eric Simon: Has anyone had any luck creating a WindowFunction using the Java API? I am seeing the following exception : `Exception in thread "main" org.apache.pulsar.client.admin.PulsarAdminException: Function class com.example.Function does not implement the correct interface` but my function extends ` ```extends WindowFunction[Array[Byte], Void]``` ---- 2020-03-23 02:54:30 UTC - Vincent Ngan: I have a question about the Reader interface. Any performance difference between using Reader and Consumer if both suit my use case? ---- 2020-03-23 03:22:15 UTC - Dennis Yung: Have you did this step? <https://pulsar.apache.org/docs/en/deploy-bare-metal/#initialize-cluster-metadata> ---- 2020-03-23 03:23:06 UTC - Dennis Yung: How can I configure the number of partitions for the topics created by a pulsar io connector? debezium mysql specifically ---- 2020-03-23 03:58:05 UTC - Abhilash Mandaliya: no. because the broker deployment step is after bookkeeper deployment. Hence, I can’t have broker URL’s with me now because I will deploy them on docker container and IPs of them are not available ---- 2020-03-23 04:33:11 UTC - Dennis Yung: If you are using docker with dynamic IP, I think you may need service discovery..... If you are using docker, why not deploy with kubernetes? ---- 2020-03-23 07:27:46 UTC - Abhilash Mandaliya: okay. I resolved it with some other trick with my testing tool. Thanks for the help. ---- 2020-03-23 07:29:31 UTC - Abhilash Mandaliya: I have one more question. In the broker config, we can specify `advertisedAddress` . Why there is no provision to specify port number along with it? Because in this case, we can’t run multiple broker instances (on the same container) running on the different ports. ---- 2020-03-23 08:12:34 UTC - Vincent Ngan: Referring to my question about using Reader. My use case is that acknowledgement is not important to me, when an application starts, it always start reading from the latest message. It doesn't need to start reading from the position it left last time. I can do this using normal Consumer by creating an exclusive subscription with a randomly generated unique name and set the initial position to Latest, and when the application finishes, it removes this consumer using the admin API. However, it seems that the Reader interface is doing this already. So, my question is that should I use Reader instead of Consumer? And, if I change to Reader what is the performance impact? Will it make the performance worse or better? ----
