Hyukjin Kwon created SPARK-61587:
------------------------------------
Summary: Find the WASM UDF proc macro and the doc snippets'
dependencies in the build directory layout of Rust 1.100
Key: SPARK-61587
URL: https://issues.apache.org/jira/browse/SPARK-61587
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
Rust 1.100.0 (2026-11-09) changed the layout of cargo's build directory: there
is no target/<profile>/deps any more, and the artifacts of each unit are in a
directory of its own, target/<profile>/build/<package>/<hash>/out, which is
also the OUT_DIR of a build script.
Two places of spark-connect-rust assumed the old layout, and CI, which installs
the stable toolchain, fails since it got 1.100:
- crates/spark-connect-build (apache-spark-connect-build, the build.rs helper
of WASM UDFs) looked for the spark_connect_macros proc-macro dylib in
OUT_DIR/../../../deps, and panics with "could not find the spark_connect_macros
proc-macro dylib in .../target/debug/build/deps". This breaks the build of any
crate that calls embed_wasm_udf with Rust 1.100 (the WASM UDF feature and Rust
behavioral e2e jobs).
- scripts/check_doc_snippets.py compiled the doc snippets with -L
dependency=target/debug/deps, and every snippet fails with "can't find crate
for `spark_connect_core`" (the docs job).
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]