Dose Yarn shared cache use memory ?

2019-07-03 Thread kevin su
specific data in memory, maybe it could let Mapreduce much faster. Thanks in advanced BR, Kevin Su

yarn launch docker error

2019-06-09 Thread kevin su
Hi all, I follow https://hadoop.apache.org/docs/r3.2.0/hadoop-yarn/hadoop-yarn-site/DockerContainers.html#Cluster_Configuration ,and try to launch applications using docker container, but I got this error I use * hadoop-3.2.0* with *library/openjdk:8* docker image Exception message: Launch

Can start two RM in one cluster

2019-06-07 Thread kevin su
Hi all, There is a way to start two Namenode, and request for both of them So can we start two RM as well ? Another question is every times if we want to allocate resource from RM, it will find which node manager has resources. Is RM send every request to all node manager, and get all NM

When workers >= 2 and ps == 0 worker should throw exception

2019-05-29 Thread kevin su
Hi all, I found that when workers >= 2 and ps == 0 worker just return false . private boolean determineIfDistributed(int nWorkers, int nPS) throws ParseException { // Check #workers and #ps. // When distributed training is required if (nWorkers >= 2 && nPS > 0) { return

Quick start on github can not use

2019-04-01 Thread kevin su
Hi user, Quick start on github can not use, Maybe the website address should be updated. Best Regards, Kevin