Baunsgaard commented on pull request #973: URL: https://github.com/apache/systemml/pull/973#issuecomment-643744787
well there are multiple issues with that. Switching to Hadoop 3.0 requires yes spark 3.0 but that is currently not in a stable release. (since December 2019). Also exploring that currently, we have some uses of the spark in paramserver rpc that does not work with spark 3.0 because: - SparkTransportConf & SparkPSProxy has changed. and Hadoop because they removed the function copyMerge. I have "taken" the original souce for the copyMerge method and included it in the merge, and made the rpc parts of Parameter server throw an NotImplementedException. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
