2020-08-08 14:26:01 UTC - Manju Priya A R: @Sijie Guo: Valgrind results show memory leak in CreateReader. PFB the valgrind results.
_==350498== 440 (160 direct, 280 indirect) bytes in 1 blocks are definitely lost in loss record 1,015 of 1,097_ _==350498== at 0x4C2A4C3: operator new(unsigned long) (vg_replace_malloc.c:344)_ _==350498== by 0x7D065EA: allocate (new_allocator.h:104)_ _==350498== by 0x7D065EA: allocate (alloc_traits.h:351)_ _==350498== by 0x7D065EA: __shared_count<pulsar::InternalState<pulsar::Result, pulsar::Reader>, std::allocator<pulsar::InternalState<pulsar::Result, pulsar::Reader> > > (shared_ptr_base.h:499)_ _==350498== by 0x7D065EA: __shared_ptr<std::allocator<pulsar::InternalState<pulsar::Result, pulsar::Reader> > > (shared_ptr_base.h:957)_ _==350498== by 0x7D065EA: shared_ptr<std::allocator<pulsar::InternalState<pulsar::Result, pulsar::Reader> > > (shared_ptr.h:316)_ _==350498== by 0x7D065EA: allocate_shared<pulsar::InternalState<pulsar::Result, pulsar::Reader>, std::allocator<pulsar::InternalState<pulsar::Result, pulsar::Reader> > > (shared_ptr.h:598)_ _==350498== by 0x7D065EA: make_shared<pulsar::InternalState<pulsar::Result, pulsar::Reader> > (shared_ptr.h:614)_ _==350498== by 0x7D065EA: Promise (Future.h:91)_ _==350498== by 0x7D065EA: pulsar::Client::createReader(std::string const&, pulsar::MessageId const&, pulsar::ReaderConfiguration const&, pulsar::Reader&) (<http://Client.cc:142|Client.cc:142>)_ ---- 2020-08-08 15:58:10 UTC - Axel Sirota: thanks! ---- 2020-08-08 16:03:10 UTC - harley albert: @harley albert has joined the channel ---- 2020-08-08 16:05:35 UTC - harley albert: Hello bro my name i harley, as devloper in smartfren i use in pulsar. i have a problem after add ram in server centos i get a Err Failed to load RocksDB JNI library can u help or have solution its my problem? I really hope there is detail log 22:42:29.496 [main] INFO org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage - - Number of directories: 1 22:42:29.496 [main] INFO org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage - - Write cache size: 1024 MB 22:42:29.496 [main] INFO org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage - - Read Cache: 1024 MB 22:42:29.499 [main] INFO org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage - Creating single directory db ledger storage on data/standalone/bookkeeper0/current 22:42:29.579 [main] INFO org.apache.bookkeeper.proto.BookieNettyServer - Shutting down BookieNettyServer 22:42:29.593 [main] ERROR org.apache.pulsar.PulsarStandaloneStarter - Failed to start pulsar service. <http://java.io|java.io>.IOException: Failed to load RocksDB JNI library at org.apache.bookkeeper.bookie.storage.ldb.KeyValueStorageRocksDB.<init>(KeyValueStorageRocksDB.java:91) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.KeyValueStorageRocksDB.<init>(KeyValueStorageRocksDB.java:83) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.KeyValueStorageRocksDB.lambda$static$0(KeyValueStorageRocksDB.java:58) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.LedgerMetadataIndex.<init>(LedgerMetadataIndex.java:69) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.SingleDirectoryDbLedgerStorage.<init>(SingleDirectoryDbLedgerStorage.java:161) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage.newSingleDirectoryDbLedgerStorage(DbLedgerStorage.java:149) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.storage.ldb.DbLedgerStorage.initialize(DbLedgerStorage.java:129) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.bookie.Bookie.<init>(Bookie.java:775) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.proto.BookieServer.newBookie(BookieServer.java:136) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.bookkeeper.proto.BookieServer.<init>(BookieServer.java:105) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] at org.apache.pulsar.zookeeper.LocalBookkeeperEnsemble.runBookies(LocalBookkeeperEnsemble.java:278) ~[org.apache.pulsar-pulsar-zookeeper-utils-2.5.0.jar:2.5.0] at org.apache.pulsar.zookeeper.LocalBookkeeperEnsemble.startStandalone(LocalBookkeeperEnsemble.java:403) ~[org.apache.pulsar-pulsar-zookeeper-utils-2.5.0.jar:2.5.0] at org.apache.pulsar.PulsarStandalone.start(PulsarStandalone.java:260) ~[org.apache.pulsar-pulsar-broker-2.5.0.jar:2.5.0] at org.apache.pulsar.PulsarStandaloneStarter.main(PulsarStandaloneStarter.java:119) [org.apache.pulsar-pulsar-broker-2.5.0.jar:2.5.0] Caused by: java.lang.UnsatisfiedLinkError: /tmp/librocksdbjni6980249218065389900.so: /tmp/librocksdbjni6980249218065389900.so: failed to map segment from shared object: Operation not permitted at java.lang.ClassLoader$NativeLibrary.load(Native Method) ~[?:1.8.0_241] at java.lang.ClassLoader.loadLibrary0(Unknown Source) ~[?:1.8.0_241] at java.lang.ClassLoader.loadLibrary(Unknown Source) ~[?:1.8.0_241] at java.lang.Runtime.load0(Unknown Source) ~[?:1.8.0_241] at java.lang.System.load(Unknown Source) ~[?:1.8.0_241] at org.rocksdb.NativeLibraryLoader.loadLibraryFromJar(NativeLibraryLoader.java:78) ~[org.rocksdb-rocksdbjni-5.13.3.jar:?] at org.rocksdb.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:56) ~[org.rocksdb-rocksdbjni-5.13.3.jar:?] at org.rocksdb.RocksDB.loadLibrary(RocksDB.java:64) ~[org.rocksdb-rocksdbjni-5.13.3.jar:?] at org.rocksdb.RocksDB.<clinit>(RocksDB.java:35) ~[org.rocksdb-rocksdbjni-5.13.3.jar:?] at org.apache.bookkeeper.bookie.storage.ldb.KeyValueStorageRocksDB.<init>(KeyValueStorageRocksDB.java:89) ~[org.apache.bookkeeper-bookkeeper-server-4.10.0.jar:4.10.0] ... 13 more 22:42:29.599 [Thread-1] ERROR org.apache.pulsar.PulsarStandaloneStarter - Shutdown failed: null ---- 2020-08-08 23:29:29 UTC - Rob: @Rob has joined the channel ---- 2020-08-08 23:53:33 UTC - Rob: Hey, we're seeing this as well. We have a `msgBacklog` of ~250 that doesn't go away with a `topics unload`, restarting the consumers, or restarting the brokers. `individuallyDeletedMessages` has a few entries in it. Not clear why those solutions didn't work. We're using the Node client. ----
