Baunsgaard opened a new pull request #1320: URL: https://github.com/apache/systemds/pull/1320
This PR adds spark support back for CLA, with various tests for verifying that no crashes is experienced. Further work is to allow workload aware SP compression, but currently the support covers default compression instructions. Currently the main limitation is left multiplications where if the compressed side of a multiplication is smaller (in terms of cells) it is re blocked to be broadcasted, in that process the all blocks in that matrix RDD is decompressed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
