Baunsgaard opened a new pull request #931: URL: https://github.com/apache/systemml/pull/931
New ColGroupQuan :smiley: that internally changes all values to Byte. It is compressing by using the highest value (or Math.abs(lowest)) in the matrix block, and therefore the bucket sizes are dependent on that value. This implementation that does not exploit sparsity but it gives an alternative col group for columns that are previously uncompressed. The testing associated with this new lossy representation is based around either percentage deviation from ideal results (double precision) or loss threshold calculated from the worst rounding of values in that input matrix. (they currently show only few percent deviation in average results) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
