[
https://issues.apache.org/jira/browse/SPARK-42658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venkata Sai Akhil Gudesa updated SPARK-42658:
-
Description:
We would need a retry mechanism on the client side to handle CRC failures
during artifact transfer because the server would discard data that fails CRC
and hence, may lead to missing artifacts during UDF execution.
We also require a timeout policy to prevent indefinitely waiting for the server
reply.
was:We would need a retry mechanism on the client side to handle CRC failures
during artifact transfer. The server would discard data that fails CRC and
hence, may lead to missing artifacts during UDF execution.
> Handle timeouts and CRC failures during artifact transfer
> -
>
> Key: SPARK-42658
> URL: https://issues.apache.org/jira/browse/SPARK-42658
> Project: Spark
> Issue Type: Improvement
> Components: Connect
>Affects Versions: 3.4.0
>Reporter: Venkata Sai Akhil Gudesa
>Priority: Major
>
> We would need a retry mechanism on the client side to handle CRC failures
> during artifact transfer because the server would discard data that fails CRC
> and hence, may lead to missing artifacts during UDF execution.
> We also require a timeout policy to prevent indefinitely waiting for the
> server reply.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
