[ https://issues.apache.org/jira/browse/SPARK-37272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-37272: ---------------------------------- Parent: SPARK-33772 Issue Type: Sub-task (was: Improvement) > Add `ExtendedRocksDBTest` and disable RocksDB tests on Apple Silicon > -------------------------------------------------------------------- > > Key: SPARK-37272 > URL: https://issues.apache.org/jira/browse/SPARK-37272 > Project: Spark > Issue Type: Sub-task > Components: SQL, Tests > Affects Versions: 3.3.0 > Reporter: Dongjoon Hyun > Assignee: Dongjoon Hyun > Priority: Major > Fix For: 3.3.0 > > > Javava 17 officially support Apple Silicon > - JEP 391: macOS/AArch64 Port > - https://bugs.openjdk.java.net/browse/JDK-8251280 > Oracle Java, Azul Zulu, and Eclipse Temurin Java 17 supports Apple Silicon > natively. > {code} > /Users/dongjoon/.jenv/versions/oracle17/bin/java: Mach-O 64-bit executable > arm64 > /Users/dongjoon/.jenv/versions/zulu17/bin/java: Mach-O 64-bit executable arm64 > /Users/dongjoon/.jenv/versions/temurin17/bin/java: Mach-O 64-bit executable > arm64 > {code} > Since RocksDBJNI still doesn't support Apple Silicon natively, the following > failures occur on M1. > {code} > $ build/sbt "sql/testOnly *RocksDB* *.StreamingSessionWindowSuite" > ... > [info] Run completed in 23 seconds, 281 milliseconds. > [info] Total number of tests run: 32 > [info] Suites: completed 2, aborted 2 > [info] Tests: succeeded 22, failed 10, canceled 0, ignored 0, pending 0 > [info] *** 2 SUITES ABORTED *** > [info] *** 10 TESTS FAILED *** > [error] Failed tests: > [error] org.apache.spark.sql.streaming.StreamingSessionWindowSuite > [error] > org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreIntegrationSuite > [error] Error during tests: > [error] org.apache.spark.sql.execution.streaming.state.RocksDBSuite > [error] > org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite > [error] (sql / Test / testOnly) sbt.TestsFailedException: Tests unsuccessful > [error] Total time: 43 s, completed Nov 10, 2021 4:29:50 PM > {code} > This issue aims to add ExtendedRocksDBTest to disable RocksDB selectively on > Apple Silicon. -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org