zuston commented on issue #313: URL: https://github.com/apache/incubator-uniffle/issues/313#issuecomment-1372010859
This problem will happen when enable ZSTD compression of uniffle in Spark 2.x, which is caused by the incompatible interface of different version ZSTD. In uniffle, ZSTD version is 1.5.2-3, but Spark 2.x built-in version is 1.3.2-2 (https://github.com/apache/spark/blob/807e0a484d1de767d1f02bd8a622da6450bdf940/pom.xml#L586). And I think this problem could be fixed by using the reflection to be compatible with older interface of ZSTD. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
