e-strauss opened a new pull request, #2031:
URL: https://github.com/apache/systemds/pull/2031
This patch fixes the binary cbind operation for the spark backend
(FrameAppendRSPInstruction) for the edge case when the inputs have different
block alignments.
The RHS input is aligned to the LHS by the following steps:
- collect on Index RDD of the LHS, sort the array of indices
- map each FrameBlock from RHS to the correct FrameBlock on the LHS by doing
binary search on the index array
- > if necessary slice block on the RHS and map it to multiple Blocks on
the LHS
Additionally, this patch adds test cases for different edge cases regarding
the alignment. E.g.
cbind
LHS RHS:
+-----+ +---------+
| | +---------+
+-----+ | |
| | +---------+
+-----+ | |
| | +---------+
+-----+ | |
+-----+ +---------+
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
