L. C. Hsieh created SPARK-54704:
-----------------------------------
Summary: branch-3.5 CI pipeline pyspark-pandas-slow-connect is
failing
Key: SPARK-54704
URL: https://issues.apache.org/jira/browse/SPARK-54704
Project: Spark
Issue Type: Bug
Components: Tests
Affects Versions: 3.5.7
Reporter: L. C. Hsieh
I am backporting a fix to branch-3.5
(https://github.com/apache/spark/pull/53381) and noticing that the CI pipeline
pyspark-pandas-slow-connect always fails.
I opened another dummy PR (https://github.com/apache/spark/pull/53446) to test
it. It still failed the same error:
2025-12-14T09:12:14.9327441Z ERROR StatusConsoleListener Unable to write to
stream target/unit-tests.log for appender File
2025-12-14T09:12:14.9328480Z
org.apache.logging.log4j.core.appender.AppenderLoggingException: Error writing
to stream target/unit-tests.log
2025-12-14T09:12:14.9329725Z at
org.apache.logging.log4j.core.appender.OutputStreamManager.writeToDestination(OutputStreamManager.java:252)
2025-12-14T09:12:14.9331046Z at
org.apache.logging.log4j.core.appender.FileManager.writeToDestination(FileManager.java:278)
2025-12-14T09:12:14.9332307Z at
org.apache.logging.log4j.core.appender.OutputStreamManager.flushBuffer(OutputStreamManager.java:283)
2025-12-14T09:12:14.9333409Z at
org.apache.logging.log4j.core.appender.OutputStreamManager.flush(OutputStreamManager.java:294)
2025-12-14T09:12:14.9334718Z at
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:217)
2025-12-14T09:12:14.9336205Z at
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:208)
2025-12-14T09:12:14.9337582Z at
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:199)
2025-12-14T09:12:14.9338784Z at
org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:161)
2025-12-14T09:12:14.9339905Z at
org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:134)
2025-12-14T09:12:14.9341320Z at
org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:125)
2025-12-14T09:12:14.9342623Z at
org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:89)
2025-12-14T09:12:14.9343718Z at
org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:683)
2025-12-14T09:12:14.9344817Z at
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:641)
2025-12-14T09:12:14.9345830Z at
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:624)
2025-12-14T09:12:14.9346744Z at
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:560)
2025-12-14T09:12:14.9347997Z at
org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:82)
2025-12-14T09:12:14.9349134Z at
org.apache.logging.log4j.core.Logger.log(Logger.java:163)
2025-12-14T09:12:14.9349982Z at
org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2168)
2025-12-14T09:12:14.9351291Z at
org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2122)
2025-12-14T09:12:14.9352431Z at
org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2105)
2025-12-14T09:12:14.9353447Z at
org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:1985)
2025-12-14T09:12:14.9354437Z at
org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1838)
2025-12-14T09:12:14.9355309Z at
org.apache.logging.slf4j.Log4jLogger.debug(Log4jLogger.java:115)
2025-12-14T09:12:14.9356035Z at
org.apache.spark.internal.Logging.logDebug(Logging.scala:64)
2025-12-14T09:12:14.9356758Z at
org.apache.spark.internal.Logging.logDebug$(Logging.scala:63)
2025-12-14T09:12:14.9357749Z at
org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator.logDebug(CodeGenerator.scala:1345)
2025-12-14T09:12:14.9359114Z at
org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection$.create(GenerateUnsafeProjection.scala:376)
2025-12-14T09:12:14.9360795Z at
org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection$.generate(GenerateUnsafeProjection.scala:327)
2025-12-14T09:12:14.9362223Z at
org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.createCodeGeneratedObject(Projection.scala:124)
2025-12-14T09:12:14.9363710Z at
org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.createCodeGeneratedObject(Projection.scala:120)
2025-12-14T09:12:14.9365322Z at
org.apache.spark.sql.catalyst.expressions.CodeGeneratorWithInterpretedFallback.createObject(CodeGeneratorWithInterpretedFallback.scala:50)
2025-12-14T09:12:14.9366806Z at
org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.create(Projection.scala:151)
2025-12-14T09:12:14.9367853Z at
org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.create(Projection.scala:161)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
