Tian Gao created SPARK-54441:
--------------------------------
Summary: Enable coverage data on workers
Key: SPARK-54441
URL: https://issues.apache.org/jira/browse/SPARK-54441
Project: Spark
Issue Type: Test
Components: PySpark
Affects Versions: 4.2.0
Reporter: Tian Gao
A big chunk of coverage data that we are missing is from workers. The
workers.py itself has 1400+ missing lines, more than 2%+ of our total code.
There are other functions that are executed by the worker which do not have
coverage data either.
We have plenty of tests that uses those function, we just miss coverage data,
because the worker process is always brutally killed. We can hook the worker
process in coverage run so it dumps the data before it's too late.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
