CodingCat commented on issue #9389: [SUBMODULE] Upgrade ps-lite to the latest version URL: https://github.com/apache/incubator-mxnet/pull/9389#issuecomment-358483940 most of changes would be on spark part, the following changes is planned to be made after this is merged or as you said do it together 1. spark specific changes to avoid forking process to start workers, 2. bunches of unit test to ensure the correctness of the current implementation (no unit test now because of the one-worker-per-process limitation, we cannot write a unit test due to the fact that spark requires start multiple workers in local mode, i.e. in the same process) 3. after we finished 1, 2, we would upgrade spark integration to Spark 2 (now spark 1.x, too old) and Spark ML pipeline
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
