2019-03-19 09:25:32 UTC - bossbaby: When I upgrade and reboot, part of the data is lost, what is the reason? ---- 2019-03-19 09:25:37 UTC - bossbaby: @jia zhai ---- 2019-03-19 09:39:42 UTC - Sébastien de Melo: Hi guys! Is anyone using the simulation tools? We want to do a load test but the command fails and the following error message is displayed: ---- 2019-03-19 10:34:27 UTC - bossbaby: @Yuvaraj Loganathan Can you share step by step when upgrade pulsar old version to 2.3.0. I upgraded it and data be lost ---- 2019-03-19 11:03:51 UTC - Shivji Kumar Jha: @Sijie Guo Plan to merge this? <https://github.com/apache/pulsar/pull/3858> Jenkins is all green now! ---- 2019-03-19 11:04:06 UTC - Shivji Kumar Jha: And all the other pending PRs then :slightly_smiling_face: ---- 2019-03-19 11:04:24 UTC - Sijie Guo: cool ---- 2019-03-19 11:04:29 UTC - Sijie Guo: I will merge it :slightly_smiling_face: ---- 2019-03-19 11:04:34 UTC - Shivji Kumar Jha: Yay! ---- 2019-03-19 11:05:14 UTC - Sijie Guo: done merged :slightly_smiling_face: ---- 2019-03-19 11:34:34 UTC - Shivji Kumar Jha: thanks @Sijie Guo, whats the plan to merge pending ones now? I need this one for instance and also your couple of schema related changes ---- 2019-03-19 11:34:41 UTC - Shivji Kumar Jha: <https://github.com/apache/pulsar/pull/3840> ---- 2019-03-19 11:35:12 UTC - Sijie Guo: @Shivji Kumar Jha I am currently rebasing all the pull requests ready to merge to latest master. +1 : Shivji Kumar Jha ---- 2019-03-19 11:35:25 UTC - Sijie Guo: so they can pass CI to merge :slightly_smiling_face: ---- 2019-03-19 11:35:33 UTC - Shivji Kumar Jha: Great! ---- 2019-03-19 11:35:34 UTC - Sijie Guo: working through the list of pull requests ---- 2019-03-19 11:36:01 UTC - Shivji Kumar Jha: Thank you so much for prioritising this :slightly_smiling_face: ---- 2019-03-19 15:55:56 UTC - Grant Wu: I’m having issues downloading the apache-pulsar-client-dev debian package ---- 2019-03-19 15:56:15 UTC - Grant Wu: ``` --2019-03-19 15:44:37-- <https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=pulsar/pulsar-2.2.1/DEB/apache-pulsar-client-dev.deb> Resolving <http://www.apache.org|www.apache.org> (<http://www.apache.org|www.apache.org>)... 40.79.78.1, 95.216.24.32, 2a01:4f9:2a:185f::2 Connecting to <http://www.apache.org|www.apache.org> (<http://www.apache.org|www.apache.org>)|40.79.78.1|:443... connected. ``` ---- 2019-03-19 16:02:24 UTC - Grant Wu: It just hangs there for a while ---- 2019-03-19 16:02:33 UTC - Grant Wu: It seems like i’m not getting a response from `<http://apache.org|apache.org>`? ---- 2019-03-19 16:02:43 UTC - Grant Wu: I can’t reproduce on my local machine… this is only happening in CI… ---- 2019-03-19 16:14:05 UTC - Christophe Bornet: Something interesting : <https://medium.com/@lukasz.antoniak/apache-kafka-leaves-the-zoo-bef529ba82b7> . Have you thought about implementing a Raft consensus to get rid of Zookeeper ? ---- 2019-03-19 17:16:01 UTC - Yuvaraj Loganathan: there are discussion around using pulsar system topics to scale beyond one million topics ---- 2019-03-19 17:28:23 UTC - Sree Vaddi: how does it matter, if zookeeper or atomix or gossip .... ? ---- 2019-03-19 21:34:50 UTC - Daniel Ferreira Jorge: Hey team it's been a long time! Let me ask something. Are there any documentation on how to get an existing kafka connector and "clone" it into a pulsar io connector? +1 : Ali Ahmed ---- 2019-03-19 22:58:14 UTC - Matteo Merli: Getting there ---- 2019-03-19 22:58:26 UTC - Matteo Merli: Fixed one issue <https://github.com/apache/pulsar/pull/3864/files> ---- 2019-03-19 22:58:59 UTC - Matteo Merli: the white spaces where not ignored when reading the token from file ---- 2019-03-19 23:11:17 UTC - Matteo Merli: @Alexandre DUVAL I think the above issue was the only one ---- 2019-03-19 23:12:06 UTC - Matteo Merli: I tested with proxy and all. The auth is correctly passed from proxy to broker ---- 2019-03-19 23:15:22 UTC - Alexandre DUVAL: Hi, thanks but I tested with placing the token directly in the conf file and there is still issue on the pcap file on top of this thread. ---- 2019-03-19 23:15:38 UTC - Matteo Merli: Got it ---- 2019-03-19 23:15:45 UTC - Matteo Merli: can you recap the setup? ---- 2019-03-19 23:15:59 UTC - Matteo Merli: I tried to get from the chat history but not sure I got the same ---- 2019-03-19 23:16:17 UTC - Matteo Merli: I’m trying with :
client -> proxy -> standalone ---- 2019-03-19 23:23:06 UTC - Alexandre DUVAL: As a reminder (to ensure), the admin client doesn't bring the authorization header to query the next broker after received redirect to another broker. Same issue without proxy node between client and broker. ---- 2019-03-19 23:24:11 UTC - Matteo Merli: Yes, it’s working with standalone since there’s no redirection being issued ---- 2019-03-19 23:24:29 UTC - Alexandre DUVAL: Sure. ---- 2019-03-19 23:24:49 UTC - Matteo Merli: trying on real cluster now ---- 2019-03-19 23:24:57 UTC - Alexandre DUVAL: Thanks ---- 2019-03-20 01:08:34 UTC - David Kjerrumgaard: @Daniel Ferreira Jorge Have you tried <https://pulsar.apache.org/docs/latest/adaptors/KafkaWrapper/> ? ---- 2019-03-20 01:19:26 UTC - Sijie Guo: @Daniel Ferreira Jorge there is a kafka-connect-adaptor pulsar connector. you can just run any existing kafka connect as a pulsar IO connector. ---- 2019-03-20 01:20:35 UTC - Sijie Guo: <https://github.com/apache/pulsar/tree/master/pulsar-io/kafka-connect-adaptor> ---- 2019-03-20 01:20:53 UTC - Sijie Guo: this is how pulsar integrates with debezium ---- 2019-03-20 01:26:54 UTC - 勇敢的心: @勇敢的心 has joined the channel ---- 2019-03-20 02:00:17 UTC - bossbaby: Hi all, During the upgrade of pulsar from old version to 2.3.0, I lost data in geo-replication cluster, namely some topics and namespace has been replicated, part of the data in the topic has been lost. Is there a way for me to restore the old data? ---- 2019-03-20 05:49:48 UTC - Matteo Merli: @Alexandre DUVAL @Sijie Guo It appears that there’s some behavior change in Java 8 between 121 and 181 versions. With 121, the `Authorization` header is correctly passed when the client follows the redirect. From 181 on, the header is being stripped. The logic is in HttpUrlConnection which is what Jersey client is using. Tomorrow I’ll dig more into it. ---- 2019-03-20 05:50:43 UTC - Sijie Guo: @Matteo Merli from my initial investigation, the header was stripped during redirection for security concerns. ---- 2019-03-20 05:51:19 UTC - Sijie Guo: so I was trying to use filter to inject header, but based on @Alexandre DUVAL’s feedback. that approach doesn’t work ---- 2019-03-20 05:59:09 UTC - Matteo Merli: yes, the logic is all in HttpUrlConnection ---- 2019-03-20 05:59:39 UTC - Matteo Merli: the strange thing is the change in behavior between java8 patch releases ---- 2019-03-20 06:00:26 UTC - Matteo Merli: well.. and that following the paths in jersey code is a nightmare ---- 2019-03-20 06:39:26 UTC - Shivji Kumar Jha: Hi all, I am planning to do a pulsar presentation in my org to share my learnings. Are there some architecture/usage slides or any previous ppt stores that i can draw inspiration from? ---- 2019-03-20 06:40:40 UTC - Shivji Kumar Jha: something that you have prepared and are really proud of.. ---- 2019-03-20 06:43:36 UTC - Matteo Merli: For general slides: <https://www.slideshare.net/merlimat/pulsar-flexible-pubsub-for-internet-scale> ---- 2019-03-20 06:44:23 UTC - Shivji Kumar Jha: Thank you! ---- 2019-03-20 06:49:51 UTC - Matteo Merli: There are few others more specific in my account too ---- 2019-03-20 07:23:18 UTC - Shivji Kumar Jha: Yes I checked all of yours and sijie’s slides. They are helpful :slightly_smiling_face: ---- 2019-03-20 08:12:58 UTC - Matteo Merli: <https://github.com/apache/pulsar/pull/3869> ---- 2019-03-20 08:24:47 UTC - Christophe Bornet: With Atomix, that would be one component less to deploy and maintain as it would be embedded in the brokers ---- 2019-03-20 08:26:59 UTC - Sijie Guo: cool ----
