[
https://issues.apache.org/jira/browse/SAMZA-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304941#comment-15304941
]
Yi Pan (Data Infrastructure) commented on SAMZA-870:
----------------------------------------------------
[~staslos], thanks for confirming! I got a response from RocksDB community via
[issue-1127|https://github.com/facebook/rocksdb/issues/1127] that the later
versions after rocksdbjni-3.13.1 resolves this problem. I have opened SAMZA-955
to track the effort to upgrade to rocksdbjni-4.5.1.
> RocksDBException: Invalid argument: Compression type Snappy is not linked
> with the binary
> -----------------------------------------------------------------------------------------
>
> Key: SAMZA-870
> URL: https://issues.apache.org/jira/browse/SAMZA-870
> Project: Samza
> Issue Type: Bug
> Components: kv-store
> Affects Versions: 0.10.1
> Environment: RedHat Enterprise Linux 6.6, Java 8 (Oracle 1.8.0_40)
> Reporter: Edi Bice
> Assignee: Navina Ramesh
>
> I'm running latest from master with a small patch to allow for additional
> RocksDB configuration. All my jobs (which involve KV stores) fail with the
> following:
> org.apache.samza.SamzaException: Error opening RocksDB store
> xxx-store/Partition_6, received the following exception from RocksDB
> org.rocksdb.RocksDBException: Invalid argument: Compression type Snappy is
> not linked with the binary.
> at
> org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81)
> at
> org.apache.samza.storage.kv.RocksDbKeyValueStore.db$lzycompute(RocksDbKeyValueStore.scala:103)
> at
> org.apache.samza.storage.kv.RocksDbKeyValueStore.db(RocksDbKeyValueStore.scala:103)
> at
> org.apache.samza.storage.kv.RocksDbKeyValueStore.flush(RocksDbKeyValueStore.scala:195)
> at
> org.apache.samza.storage.kv.LoggedStore.flush(LoggedStore.scala:107)
> at
> org.apache.samza.storage.kv.SerializedKeyValueStore.flush(SerializedKeyValueStore.scala:117)
> at
> org.apache.samza.storage.kv.CachedStore.flush(CachedStore.scala:194)
> at
> org.apache.samza.storage.kv.NullSafeKeyValueStore.flush(NullSafeKeyValueStore.scala:82)
> at
> org.apache.samza.storage.kv.KeyValueStorageEngine.flush(KeyValueStorageEngine.scala:123)
> at
> org.apache.samza.storage.kv.KeyValueStorageEngine.close(KeyValueStorageEngine.scala:135)
> at
> org.apache.samza.storage.kv.KeyValueStorageEngine.stop(KeyValueStorageEngine.scala:129)
> at
> org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
> at
> org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
> at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> at
> scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
> at
> org.apache.samza.storage.TaskStorageManager.stopStores(TaskStorageManager.scala:193)
> at
> org.apache.samza.storage.TaskStorageManager.stop(TaskStorageManager.scala:197)
> at
> org.apache.samza.container.TaskInstance.shutdownStores(TaskInstance.scala:203)
> at
> org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
> at
> org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
> at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> at
> scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
> at
> org.apache.samza.container.SamzaContainer.shutdownStores(SamzaContainer.scala:689)
> at
> org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:568)
> at
> org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:93)
> at
> org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:67)
> at
> org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
