[
https://issues.apache.org/jira/browse/SPARK-41894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17654823#comment-17654823
]
Yang Jie commented on SPARK-41894:
----------------------------------
The running environment is linux, I haven't found the specific case that
generated this file now, need more investigation
> sql/core module mvn clean failed
> --------------------------------
>
> Key: SPARK-41894
> URL: https://issues.apache.org/jira/browse/SPARK-41894
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming, Tests
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Priority: Major
>
> run the following commands:
> # mvn clean install -pl sql/core -am -DskipTests
> # mvn test -pl sql/core
> # mvn clean
>
> then following error:
>
> {code:java}
> [INFO] Spark Project Parent POM ........................... SUCCESS [ 0.133
> s]
> [INFO] Spark Project Tags ................................. SUCCESS [ 0.008
> s]
> [INFO] Spark Project Sketch ............................... SUCCESS [ 0.007
> s]
> [INFO] Spark Project Local DB ............................. SUCCESS [ 0.008
> s]
> [INFO] Spark Project Networking ........................... SUCCESS [ 0.015
> s]
> [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 0.020
> s]
> [INFO] Spark Project Unsafe ............................... SUCCESS [ 0.007
> s]
> [INFO] Spark Project Launcher ............................. SUCCESS [ 0.008
> s]
> [INFO] Spark Project Core ................................. SUCCESS [ 0.279
> s]
> [INFO] Spark Project ML Local Library ..................... SUCCESS [ 0.010
> s]
> [INFO] Spark Project GraphX ............................... SUCCESS [ 0.016
> s]
> [INFO] Spark Project Streaming ............................ SUCCESS [ 0.039
> s]
> [INFO] Spark Project Catalyst ............................. SUCCESS [ 0.262
> s]
> [INFO] Spark Project SQL .................................. FAILURE [ 1.305
> s]
> [INFO] Spark Project ML Library ........................... SKIPPED
> [INFO] Spark Project Tools ................................ SKIPPED
> [INFO] Spark Project Hive ................................. SKIPPED
> [INFO] Spark Project REPL ................................. SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................. SKIPPED
> [INFO] Spark Project YARN ................................. SKIPPED
> [INFO] Spark Project Mesos ................................ SKIPPED
> [INFO] Spark Project Kubernetes ........................... SKIPPED
> [INFO] Spark Project Hive Thrift Server ................... SKIPPED
> [INFO] Spark Ganglia Integration .......................... SKIPPED
> [INFO] Spark Project Hadoop Cloud Integration ............. SKIPPED
> [INFO] Spark Project Assembly ............................. SKIPPED
> [INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
> [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
> [INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
> [INFO] Spark Kinesis Integration .......................... SKIPPED
> [INFO] Spark Project Examples ............................. SKIPPED
> [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
> [INFO] Spark Avro ......................................... SKIPPED
> [INFO] Spark Project Connect Common ....................... SKIPPED
> [INFO] Spark Project Connect Server ....................... SKIPPED
> [INFO] Spark Project Connect Client ....................... SKIPPED
> [INFO] Spark Protobuf ..................................... SKIPPED
> [INFO] Spark Project Kinesis Assembly ..................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 2.896 s
> [INFO] Finished at: 2023-01-05T15:15:57+08:00
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-clean-plugin:3.1.0:clean (default-clean) on
> project spark-sql_2.13: Failed to clean project: Failed to delete
> /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc
> -> [Help 1]
> {code}
>
>
> run :
> * ll
> /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc
>
>
> {code:java}
> -rw-r--r-- 1 work work 12 Dec 28 16:06
> /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc{code}
>
>
> and current user(work) can't rm this file:
> * rm
> /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc
>
> {code:java}
> rm: cannot remove
> `/${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc':
> Permission denied {code}
> need to use root to clean this file
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
