[ 
https://issues.apache.org/jira/browse/SPARK-54441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated SPARK-54441:
-----------------------------------
    Labels: pull-request-available  (was: )

> Enable coverage data on workers
> -------------------------------
>
>                 Key: SPARK-54441
>                 URL: https://issues.apache.org/jira/browse/SPARK-54441
>             Project: Spark
>          Issue Type: Test
>          Components: PySpark
>    Affects Versions: 4.2.0
>            Reporter: Tian Gao
>            Priority: Minor
>              Labels: pull-request-available
>
> A big chunk of coverage data that we are missing is from workers. The 
> workers.py itself has 1400+ missing lines, more than 2%+ of our total code. 
> There are other functions that are executed by the worker which do not have 
> coverage data either.
> We have plenty of tests that uses those function, we just miss coverage data, 
> because the worker process is always brutally killed. We can hook the worker 
> process in coverage run so it dumps the data before it's too late.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to