Thank you for the inputs! Yikun. Let's take these inputs when we are ready to have rocksdb state store in Spark SS.
Yikun Jiang wrote > I worked on some work about rocksdb multi-arch support and version upgrade > on > Kafka/Storm/Flink[1][2][3].To avoid these issues happened in spark again, > I > want to > give some inputs in here about rocksdb version selection from multi-arch > support > view. Hope it helps. > > The Rocksdb adds Arm64 support [4] since version 6.4.6, and also backports > all Arm64 > related commits to 5.18.4 and release a all platforms support version. > > So, from multi-arch support view, the better rocksdb version is the > version > since > v6.4.6, or 5.X version is v5.18.4. > > [1] https://issues.apache.org/jira/browse/STORM-3599 > [2] https://github.com/apache/kafka/pull/8284 > [3] https://issues.apache.org/jira/browse/FLINK-13598 > [4] https://github.com/facebook/rocksdb/pull/6250 > > Regards, > Yikun -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
