[
https://issues.apache.org/jira/browse/SPARK-35782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-35782:
----------------------------
Description:
leveldbjni doesn't contain the native library for Apple Silicon on macOS. We
will need to build native library for Apple Silicon on macOS, and cut a new
release so Spark can use it.
However, it is not maintained for a long time, and the last release was in
2016. Per
[discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/leveldbjni-dependency-td30146.html]
in spark dev mailing list, other platform also runs into the same support
issue. Perhaps, we should we consider racksdb as replacement.
Note, here is the rocksdb task to support Apple Silicon,
https://github.com/facebook/rocksdb/issues/7720
was:
leveldbjni doesn't contain the native library for Apple Silicon on macOS. We
will need to build native library for Apple Silicon on macOS, and cut a new
release so Spark can use it.
However, it is not maintained for a long time, and the last release was in
2016. Per
[discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/leveldbjni-dependency-td30146.html]
in spark dev mailing list, other platform also runs into the same support
issue. Perhaps, we should we consider racksdb as replacement.
> leveldbjni doesn't work in Apple Silicon on macOS
> -------------------------------------------------
>
> Key: SPARK-35782
> URL: https://issues.apache.org/jira/browse/SPARK-35782
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 3.1.2
> Reporter: DB Tsai
> Priority: Major
>
> leveldbjni doesn't contain the native library for Apple Silicon on macOS. We
> will need to build native library for Apple Silicon on macOS, and cut a new
> release so Spark can use it.
> However, it is not maintained for a long time, and the last release was in
> 2016. Per
> [discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/leveldbjni-dependency-td30146.html]
> in spark dev mailing list, other platform also runs into the same support
> issue. Perhaps, we should we consider racksdb as replacement.
> Note, here is the rocksdb task to support Apple Silicon,
> https://github.com/facebook/rocksdb/issues/7720
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
