Samiflux opened a new issue, #8946: URL: https://github.com/apache/hop/issues/8946
### Apache Hop version? 2.19 ### Java version? 21 ### Operating system Windows ### What happened? ### Description I'm testing the Native Spark pipeline engine on Windows with Apache Hop 2.19, Java 21, and Spark 4.1.3. The Spark session starts successfully with `master=local[*]`, but the Spark File Output transform fails when writing to a local filesystem path. ### Error message ```text java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. ``` The stack trace points to Hadoop's `RawLocalFileSystem.setPermission` and `FileOutputCommitter.setupJob`. ### Expected behavior Spark File Output should be able to write to a local filesystem path when running with `master=local[*]`, provided the required configuration is available. ### Actual behavior The write operation fails with an error indicating that `HADOOP_HOME` and `hadoop.home.dir` are not set. ### Steps to reproduce 1. Configure the Native Spark pipeline engine. 2. Set the Spark master to `local[*]`. 3. Add a Spark File Output transform. 4. Set the output path to a local directory using a `file:///` URI. 5. Execute the pipeline. ### Environment - Apache Hop: 2.19 - Operating system: Windows - Java: 21 (Eclipse Temurin 21.0.12.1 LTS) - Spark: 4.1.3 - Hadoop client libraries: 3.4.2 - Pipeline engine: Native Spark I'm not sure whether this is a Windows-specific limitation, a Hadoop configuration requirement, or an issue with the transform's documentation. ### Documentation links I also noticed that the Help buttons for both Spark File Input and Spark File Output lead to pages returning 404 errors, while the Help buttons in other Spark transforms seem to work correctly. I'm not sure whether this is expected behavior on Windows or whether additional configuration is required, so any guidance would be appreciated. Thank you! <img width="1529" height="751" alt="Image" src="https://github.com/user-attachments/assets/99ef2afb-8b19-486e-a100-6fecfca0600d"; /> ### Issue Priority Priority: 2 ### Issue Component Component: Transforms -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
