To deploy to a secure cluster, your appConfig.json needs to specify security related config parameters. e.g.: "site.hbase-site.hbase.regionserver.keytab.file": "${TODO-RS-KEYTAB}",
Cheers On Fri, Dec 26, 2014 at 1:53 AM, liujs3 <liu...@asiainfo.com> wrote: > no,I thought slider should be running like this . > > in fact ,I config the slider according to sliderwebsite, system required > need openssl,when I install openssl,slider didn’t work,it said: > > ERROR 2014-11-30 22:59:05,697 NetUtil.py:52 - [Errno 1] _ssl.c:510: > error:100AE081:elliptic curve routines:EC_GROUP_new_by_curve_name:unknown > group > ERROR 2014-11-30 22:59:05,697 NetUtil.py:54 - SSLError: Failed to connect. > Please check openssl library versions. > > So I update the openssl version : > openssl-devel-1.0.1e-15.el6_6.4.x86_64.rpm to > openssl-devel-1.0.1e-30.el6_6.4.x86_64.rpm , then slider work. > > In my cluster ,I doesn’t config the secure . how can confirm it used > secure cluster? > > -----邮件原件----- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2014年12月26日 12:33 > 收件人: dev@slider.incubator.apache.org > 主题: Re: when i run slider0.40+hadoop2.4 i found the error log in > slider-error.log > > bq. WARN security.SecurityUtils: Command openssl pkcs12 > > Are you deploying in a secure cluster ? > Can you try with 0.60.0 and hadoop 2.6.0 ? > > Cheers > > On Thu, Dec 25, 2014 at 7:17 PM, liujs3 <liu...@asiainfo.com> wrote: > > > 14/12/24 03:15:35 WARN util.NativeCodeLoader: Unable to load > > native-hadoop library for your platform... using builtin-java classes > > where applicable > > 14/12/24 03:15:35 INFO appmaster.SliderAppMaster: Login user is ocean > > (auth:SIMPLE) > > 14/12/24 03:15:35 INFO appmaster.SliderAppMaster: Slider Core-0.40 > > Built against commit# ${buildNumber} on Java 1.7.0_71 by ocean > > 14/12/24 03:15:35 INFO appmaster.SliderAppMaster: Compiled against > > Hadoop > > 2.4.0 > > 14/12/24 03:15:35 INFO appmaster.SliderAppMaster: Hadoop runtime > > version > > branch-2.4.0 with source checksum 375b2832a6641759c6eaf6e3e998147 and > > build date 2014-03-31T08:29Z > > 14/12/24 03:15:42 INFO appmaster.SliderAppMaster: Deploying cluster {, > > "internal": { > > "schema" : "http://example.org/specification/v2.0.0", > > "metadata" : { > > "create.hadoop.deployed.info" : "branch-2.4.0 > > @375b2832a6641759c6eaf6e3e998147", > > "create.application.build.info" : "Slider Core-0.40 Built against > > commit# ${buildNumber} on Java 1.7.0_71 by ocean", > > "create.hadoop.build.info" : "2.4.0", > > "create.time.millis" : "1419408918397", > > "create.time" : "24 Dec 2014 08:15:18 GMT" > > }, > > "global" : { > > "internal.tmp.dir" : > > "hdfs://OCNoSQLBJ/user/ocean/.slider/cluster/oceanzk3/tmp/appmaster", > > "internal.generated.conf.path" : > > "hdfs://OCNoSQLBJ/user/ocean/.slider/cluster/oceanzk3/generated", > > "internal.snapshot.conf.path" : > > "hdfs://OCNoSQLBJ/user/ocean/.slider/cluster/oceanzk3/snapshot", > > "internal.container.failure.shortlife" : "60000", > > "slider.data.directory.permissions" : "0770", > > "application.name" : "oceanzk3", > > "slider.cluster.directory.permissions" : "0770", > > "internal.provider.name" : "agent", > > "internal.application.image.path" : > > "hdfs://OCNoSQLBJ/slider/agent/slider-agent.tar.gz", > > "internal.container.failure.threshold" : "5", > > "internal.data.dir.path" : > > "hdfs://OCNoSQLBJ/user/ocean/.slider/cluster/oceanzk3/database" > > }, > > "components" : { > > } > > }, > > "resources": { > > "schema" : "http://example.org/specification/v2.0.0", > > "metadata" : { > > }, > > "global" : { > > }, > > "components" : { > > "HBASE_MASTER" : { > > "yarn.memory" : "256", > > "yarn.role.priority" : "1", > > "yarn.component.instances" : "1" > > }, > > "slider-appmaster" : { > > "yarn.memory" : "256", > > "yarn.vcores" : "1", > > "yarn.component.instances" : "1" > > }, > > "HBASE_REGIONSERVER" : { > > "yarn.memory" : "256", > > "yarn.role.priority" : "2", > > "yarn.component.instances" : "1" > > } > > } > > }, > > "appConf" :{ > > "schema" : "http://example.org/specification/v2.0.0", > > "metadata" : { > > }, > > "global" : { > > "site.global.security_enabled" : "false", > > "site.hbase-site.hbase.regionserver.global.memstore.upperLimit" : > > "0.4", > > "site.global.hbase_regionserver_heapsize" : "1024m", > > "site.global.monitor_protocol" : "http", > > "site.hbase-site.hbase.hregion.max.filesize" : "10737418240", > > "site.hbase-site.hbase.regionserver.port" : "0", > > "zookeeper.path" : "/services/slider/users/ocean/oceanzk3", > > "site.hbase-site.hbase.zookeeper.quorum" : "${ZK_HOST}", > > "site.global.hbase_root_password" : "secret", > > "site.core-site.fs.defaultFS" : "hdfs://OCNoSQLBJ", > > "site.global.hadoop_user" : "ocean", > > "site.hbase-site.hbase.tmp.dir" : "${AGENT_WORK_ROOT}/work/app/tmp", > > "site.hbase-site.hbase.hregion.memstore.mslab.enabled" : "true", > > "site.hbase-site.zookeeper.znode.parent" : "${DEF_ZK_PATH}", > > "site.global.app_install_dir" : "${AGENT_WORK_ROOT}/app/install", > > "site.hbase-site.zookeeper.session.timeout" : "30000", > > "site.fs.default.name" : "hdfs://OCNoSQLBJ", > > "site.global.app_user" : "ocean", > > "site.hdfs-site.dfs.ha.automatic-failover.enabled" : "true", > > "site.hbase-site.hbase.hregion.majorcompaction" : "86400000", > > "site.global.ganglia_server_id" : "Application1", > > "site.hbase-site.hbase.zookeeper.useMulti" : "true", > > "site.hdfs-site.dfs.dfs.namenode.rpc-address.OCNoSQLBJ.nn2" : > > "ocean00:8020", > > "site.hbase-site.hfile.block.cache.size" : "0.40", > > "site.hbase-site.hbase.cluster.distributed" : "true", > > "site.fs.defaultFS" : "hdfs://OCNoSQLBJ", > > "site.hbase-site.hbase.superuser" : "ocean", > > "site.hbase-site.hbase.client.scanner.caching" : "100", > > "site.hdfs-site.dfs.ha.namenodes.OCNoSQLBJ" : "nn1,nn2", > > "site.hbase-site.hbase.stagingdir" : "${DEFAULT_DATA_DIR}/staging", > > "site.hbase-site.hbase.master.info.port" : > > "${HBASE_MASTER.ALLOCATED_PORT}", > > "package_list" : "files/hbase-0.98.3-hadoop2-bin.tar.gz", > > "site.global.ganglia_server_host" : "${NN_HOST}", > > "site.hbase-site.hbase.regionserver.handler.count" : "60", > > "site.hbase-site.hbase.regionserver.global.memstore.lowerLimit" : > > "0.38", > > "site.hbase-site.hbase.zookeeper.property.clientPort" : "2383", > > "site.core-site.fs.default.name" : "hdfs://OCNoSQLBJ", > > "site.hbase-site.hbase.regionserver.info.port" : "0", > > "java_home" : "/jdk1.7.0_71", > > "site.hdfs-site.dfs.namenode.rpc-address.OCNoSQLBJ.nn1" : > > "ocean00:8020", > > "site.hbase-site.hbase.local.dir" : "${hbase.tmp.dir}/local", > > "site.global.hdfs_user" : "ocean", > > "site.global.user_group" : "ocean", > > "env.MALLOC_ARENA_MAX" : "4", > > "site.hbase-site.hbase.hstore.compactionThreshold" : "3", > > "site.global.ganglia_server_port" : "8667", > > "site.hbase-site.hbase.hregion.memstore.flush.size" : "134217728", > > "site.hbase-site.hbase.hstore.blockingStoreFiles" : "10", > > "site.global.app_root" : > > "${AGENT_WORK_ROOT}/app/install/hbase-0.98.3-hadoop2", > > "site.hdfs-site.dfs.namenode.shared.edits.dir" : > > "qjournal://ocean00:8338;ocean01:8338/OCNoSQLBJ", > > "site.hbase-site.hbase.rootdir" : "${DEFAULT_DATA_DIR}/data", > > "site.hdfs-site.dfs.nameservices" : "OCNoSQLBJ", > > "site.global.hbase_instance_name" : "instancename", > > "config_types" : "core-site,hdfs-site,hbase-site", > > "zookeeper.hosts" : "ocean00", > > "site.hbase-site.hbase.client.keyvalue.maxsize" : "10485760", > > "site.hbase-site.hbase.security.authorization" : "false", > > "site.hbase-site.hbase.security.authentication" : "simple", > > "create.default.zookeeper.node" : "true", > > "site.hdfs-site.dfs.client.failover.proxy.provider.OCNoSQLBJ" : > > > "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider", > > "zookeeper.quorum" : "ocean00:2383", > > "site.hbase-site.hbase.defaults.for.version.skip" : "true", > > "site.hbase-site.hbase.hregion.memstore.block.multiplier" : "2", > > "site.global.hbase_master_heapsize" : "1024m", > > "application.def" : "/slider/hbase0983s4.zip" > > }, > > "components" : { > > "HBASE_MASTER" : { > > }, > > "slider-appmaster" : { > > "ssl.server.keystore.location" : "/tmp/work/security/keystore.p12", > > "jvm.heapsize" : "256M" > > }, > > "HBASE_REGIONSERVER" : { > > } > > } > > }}: > > 14/12/24 03:15:42 INFO appmaster.SliderAppMaster: Conf dir > > /hdfs/data1/tmp/nm-local-dir/usercache/ocean/appcache/application_1419 > > 404028051_0003/container_1419404028051_0003_01_000001/propagatedconf > > does not exist. > > 14/12/24 03:15:42 INFO appmaster.SliderAppMaster: Parent dir > > > /hdfs/data1/tmp/nm-local-dir/usercache/ocean/appcache/application_1419404028051_0003/container_1419404028051_0003_01_000001: > > tmp > > launch_container.sh > > .container_tokens.crc > > expandedarchive > > lib > > container_tokens > > .default_container_executor.sh.crc > > .launch_container.sh.crc > > default_container_executor.sh > > > > 14/12/24 03:15:42 INFO appmaster.SliderAppMaster: Cluster provider > > type is agent > > 14/12/24 03:15:43 INFO appmaster.SliderAppMaster: RM is at ocean00/ > > 192.168.195.164:8030 > > 14/12/24 03:15:44 INFO appmaster.SliderAppMaster: AM for ID 3 > > 14/12/24 03:15:44 INFO appmaster.SliderAppMaster: Token > > YARN_AM_RM_TOKEN > > 14/12/24 03:15:46 INFO appmaster.SliderAppMaster: > HADOOP_USER_NAME='ocean' > > 14/12/24 03:15:46 INFO client.RMProxy: Connecting to ResourceManager > > at > > ocean00/192.168.195.164:8030 > > 14/12/24 03:15:46 INFO impl.NMClientAsyncImpl: Upper bound of the > > thread pool size is 500 > > 14/12/24 03:15:46 INFO impl.ContainerManagementProtocolProxy: > > yarn.client.max-nodemanagers-proxies : 500 > > 14/12/24 03:15:46 INFO ipc.CallQueueManager: Using callQueue class > > java.util.concurrent.LinkedBlockingQueue > > 14/12/24 03:15:46 INFO ipc.Server: Starting Socket Reader #1 for port > > 58401 > > 14/12/24 03:15:46 INFO ipc.Server: IPC Server listener on 58401: > > starting > > 14/12/24 03:15:46 INFO ipc.Server: IPC Server Responder: starting > > 14/12/24 03:15:46 INFO appmaster.SliderAppMaster: AM Server is > > listening at ocean01:58401 > > 14/12/24 03:15:47 INFO imps.CuratorFrameworkImpl: Starting > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 > > GMT > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:host.name > > =ocean01 > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.version=1.7.0_71 > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.vendor=Oracle Corporation > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.home=/jdk1.7.0_71/jre > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.class.path=lib/slider.jar:lib/curator-framework.jar:l > > ib/curator-client.jar:lib/jcommander.jar:lib/curator-x-discovery.jar:l > > ib/gson.jar:lib/curator-x-discovery-service.jar:lib/jetty-sslengine.ja > > r:lib/slider.jar:lib/curator-framework.jar:lib/curator-client.jar:lib/ > > jcommander.jar:lib/curator-x-discovery.jar:lib/gson.jar:lib/curator-x- > > discovery-service.jar:lib/jetty-sslengine.jar:$CLASSPATH:$HADOOP_CONF_ > > DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/shar > > e/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HD > > FS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*: > > $HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:/home/ocean/app/hadoop-2.4.0 > > /etc/hadoop:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/hadoop-co > > mmon-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/hadoop > > -common-2.4.0-tests.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/comm > > on/hadoop-nfs-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/comm > > on/lib/jaxb-impl-2.2.3-1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop > > /common/lib/jsp-api-2.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/ > > common/lib/commons-cli-1.2.jar:/home/ocean/app/hadoop-2.4.0/share/hado > > op/common/lib/commons-httpclient-3.1.jar:/home/ocean/app/hadoop-2.4.0/ > > share/hadoop/common/lib/xmlenc-0.52.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/common/lib/guava-11.0.2.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/ocean/app/hadoop- > > 2.4.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/ocean/app/hado > > op-2.4.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/ocean/a > > pp/hadoop-2.4.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/ocean/a > > pp/hadoop-2.4.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/common/lib/commons-codec-1.4.jar:/hom > > e/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/java-xmlbuilder-0.4.j > > ar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jackson-core-a > > sl-1.8.8.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jack > > son-mapper-asl-1.8.8.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/com > > mon/lib/snappy-java-1.0.4.1.jar:/home/ocean/app/hadoop-2.4.0/share/had > > oop/common/lib/slf4j-log4j12-1.7.5.jar:/home/ocean/app/hadoop-2.4.0/sh > > are/hadoop/common/lib/commons-logging-1.1.3.jar:/home/ocean/app/hadoop > > -2.4.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/ocean/app/hadoop-2 > > .4.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/ocean/app/hadoo > > p-2.4.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home > > /ocean/app/hadoop-2.4.0/share/hadoop/common/lib/xz-1.0.jar:/home/ocean > > /app/hadoop-2.4.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/common/lib/commons-digester-1.8.ja > > r:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/commons-io-2.4. > > jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/asm-3.2.jar:/ > > home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/paranamer-2.3.jar: > > /home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26 > > .jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/zookeeper-3. > > 4.5.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1 > > .26.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/httpcore- > > 4.2.5.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/activat > > ion-1.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jetti > > son-1.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/junit > > -4.8.2.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/servle > > t-api-2.5.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jas > > per-compiler-5.5.23.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/comm > > on/lib/commons-lang-2.6.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/ > > common/lib/hadoop-annotations-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/common/lib/hadoop-auth-2.4.0.jar:/home/ocean/app/hadoop-2. > > 4.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/ocean/ > > app/hadoop-2.4.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/ocean/a > > pp/hadoop-2.4.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/oc > > ean/app/hadoop-2.4.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/ho > > me/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jersey-core-1.9.jar: > > /home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/httpclient-4.2.5. > > jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jsr305-1.3.9. > > jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/jersey-json-1 > > .9.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/commons-co > > mpress-1.4.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/common/lib/ > > commons-collections-3.2.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoo > > p/common/lib/jets3t-0.9.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoo > > p/common/lib/jasper-runtime-5.5.23.jar:/home/ocean/app/hadoop-2.4.0/sh > > are/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/ocean/app/hadoop-2.4.0/ > > share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/ocean/app/ha > > doop-2.4.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/ocean > > /app/hadoop-2.4.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/o > > cean/app/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0.jar:/home/oc > > ean/app/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.0.jar:/home > > /ocean/app/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0-tests.jar: > > /home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/ho > > me/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/h > > ome/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home > > /ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/o > > cean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.ja > > r:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-mapper-as > > l-1.8.8.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/commons > > -logging-1.1.3.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/ > > jersey-server-1.9.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/l > > ib/commons-io-2.4.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/l > > ib/asm-3.2.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/jett > > y-util-6.1.26.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/lib/c > > ommons-daemon-1.0.13.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdf > > s/lib/jetty-6.1.26.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs/ > > lib/servlet-api-2.5.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hdfs > > /lib/commons-lang-2.6.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/hd > > fs/lib/netty-3.6.2.Final.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop > > /hdfs/lib/jersey-core-1.9.jar:/home/ocean/app/hadoop-2.4.0/share/hadoo > > p/hdfs/lib/jsr305-1.3.9.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/ > > hdfs/lib/jasper-runtime-5.5.23.jar:/home/ocean/app/hadoop-2.4.0/share/ > > hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/hdfs/lib/commons-el-1.0.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.0.jar:/home/ocean/ > > app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.0.jar: > > /home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-client-2.4. > > 0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-commo > > n-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn > > -applications-unmanaged-am-launcher-2.4.0.jar:/home/ocean/app/hadoop-2 > > .4.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.0 > > .jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server > > -common-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoo > > p-yarn-server-web-proxy-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/h > > adoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.0.jar:/hom > > e/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-resource > > manager-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/hadoo > > p-yarn-api-2.4.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/li > > b/jaxb-impl-2.2.3-1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn > > /lib/commons-cli-1.2.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yar > > n/lib/commons-httpclient-3.1.jar:/home/ocean/app/hadoop-2.4.0/share/ha > > doop/yarn/lib/guava-11.0.2.jar:/home/ocean/app/hadoop-2.4.0/share/hado > > op/yarn/lib/jackson-jaxrs-1.8.8.jar:/home/ocean/app/hadoop-2.4.0/share > > /hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/ocean/app/hadoop-2.4.0/s > > hare/hadoop/yarn/lib/jline-0.9.94.jar:/home/ocean/app/hadoop-2.4.0/sha > > re/hadoop/yarn/lib/log4j-1.2.17.jar:/home/ocean/app/hadoop-2.4.0/share > > /hadoop/yarn/lib/jackson-xc-1.8.8.jar:/home/ocean/app/hadoop-2.4.0/sha > > re/hadoop/yarn/lib/commons-codec-1.4.jar:/home/ocean/app/hadoop-2.4.0/ > > share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/ocean/app/hadoo > > p-2.4.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/ocean > > /app/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/oc > > ean/app/hadoop-2.4.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/ > > home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/ocean/a > > pp/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/ocea > > n/app/hadoop-2.4.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/home > > /ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/o > > cean/app/hadoop-2.4.0/share/hadoop/yarn/lib/activation-1.1.jar:/home/o > > cean/app/hadoop-2.4.0/share/hadoop/yarn/lib/jettison-1.1.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/oc > > ean/app/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/ > > ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/ocean > > /app/hadoop-2.4.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/oc > > ean/app/hadoop-2.4.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/home/ocea > > n/app/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/oce > > an/app/hadoop-2.4.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/ > > home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/commons-collections- > > 3.2.1.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-api- > > 2.2.2.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/protobuf- > > java-2.5.0.jar:/home/ocean/app/hadoop-2.4.0/share/hadoop/yarn/lib/stax > > -api-1.0-2.jar > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.library.path=:/home/ocean/app/hadoop-2.4.0/lib/native > > :/home/ocean/app/hadoop-2.4.0/lib/native:/usr/java/packages/lib/amd64: > > /usr/lib64:/lib64:/lib:/usr/lib > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.io.tmpdir=/tmp > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:java.compiler=<NA> > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client environment:os.name > > =Linux > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:os.arch=amd64 > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:os.version=2.6.32-358.el6.x86_64 > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:user.name =ocean > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:user.home=/home/ocean > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Client > > environment:user.dir=/hdfs/data1/tmp/nm-local-dir/usercache/ocean/appc > > ache/application_1419404028051_0003/container_1419404028051_0003_01_00 > > 0001 > > 14/12/24 03:15:47 INFO zookeeper.ZooKeeper: Initiating client > > connection, > > connectString=ocean00:2383 sessionTimeout=60000 > > watcher=org.apache.curator.ConnectionState@5378b9ed > > 14/12/24 03:15:47 INFO zookeeper.ClientCnxn: Opening socket connection > > to server ocean00/192.168.195.164:2383. Will not attempt to > > authenticate using SASL (unknown error) > > 14/12/24 03:15:47 INFO zookeeper.ClientCnxn: Socket connection > > established to ocean00/192.168.195.164:2383, initiating session > > 14/12/24 03:15:47 INFO security.SecurityUtils: Reading password from > > existing file > > 14/12/24 03:15:47 INFO zookeeper.ClientCnxn: Session establishment > > complete on server ocean00/192.168.195.164:2383, sessionid = > > 0x14a7b0b7ee70007, negotiated timeout = 40000 > > 14/12/24 03:15:47 INFO state.ConnectionStateManager: State change: > > CONNECTED > > 14/12/24 03:15:47 INFO security.CertificateManager: Initialization of > > root certificate > > 14/12/24 03:15:47 INFO security.CertificateManager: Certificate > > exists:false > > 14/12/24 03:15:47 INFO security.CertificateManager: Generation of > > server certificate > > 14/12/24 03:15:50 INFO security.SecurityUtils: Command openssl genrsa > > -des3 -passout pass:**** -out /tmp/work/security/ca.key 4096 was > > finished with exit code: 0 - the operation was completed successfully. > > 14/12/24 03:15:50 INFO security.SecurityUtils: Command openssl req > > -passin > > pass:**** -new -key /tmp/work/security/ca.key -out > > /tmp/work/security/ca.csr -batch was finished with exit code: 0 - the > > operation was completed successfully. > > 14/12/24 03:15:50 WARN security.SecurityUtils: Command open**** ca > > -create_serial -out /tmp/work/security/ca.crt -days 365 -keyfile > > /tmp/work/security/ca.key -key > > N7xVHprDQdCB1DfwO41wWs6cmYp83fzwL9o3o2LQp6dzgPRH1A -selfsign > > -extensions jdk7_ca -config /tmp/work/security/ca.config -batch > > -infiles /tmp/work/security/ca.csr was finished with exit code: 1 - an > > error occurred parsing the command options. > > 14/12/24 03:15:50 WARN security.SecurityUtils: Command openssl pkcs12 > > -export -in /tmp/work/security/ca.crt -inkey /tmp/work/security/ca.key > > -certfile /tmp/work/security/ca.crt -out > > /tmp/work/security/keystore.p12 -password pass:**** -passin pass:**** > > was finished with exit code: 1 - an error occurred parsing the command > > options. > > 14/12/24 03:15:50 INFO appmaster.SliderAppMaster: AM > > classpath:[Ljava.net.URL;@59a73c61 > > 14/12/24 03:15:50 INFO mortbay.log: Logging to > > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > > org.mortbay.log.Slf4jLog > > 14/12/24 03:15:50 INFO mortbay.log: jetty-6.1.26 Dec 24, 2014 3:15:51 > > AM com.sun.jersey.api.core.PackagesResourceConfig init > > INFO: Scanning for root resource and provider classes in the packages: > > org.apache.slider.server.appmaster.web.rest.agent > > Dec 24, 2014 3:15:51 AM com.sun.jersey.api.core.ScanningResourceConfig > > logClasses > > INFO: Root resource classes found: > > class > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebServices > > Dec 24, 2014 3:15:51 AM com.sun.jersey.api.core.ScanningResourceConfig > > init > > INFO: No provider classes found. > > Dec 24, 2014 3:15:51 AM > > com.sun.jersey.server.impl.application.WebApplicationImpl _initiate > > INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 > > 11:17 AM' > > 14/12/24 03:15:53 WARN mortbay.log: failed > > SslSelectChannelConnector@0.0.0.0:0: java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big. > > 14/12/24 03:15:53 WARN mortbay.log: failed > > SslSelectChannelConnector@0.0.0.0:0: java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big. > > 14/12/24 03:15:53 WARN mortbay.log: failed Server@64dcdb5a: > > org.mortbay.util.MultiException[java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big., java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big.] > > 14/12/24 03:15:53 ERROR agent.AgentWebApp: Unable to start agent > > server > > org.mortbay.util.MultiException[java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big., java.io.IOException: > > DerInputStream.getLength(): lengthTag=127, too big.] > > at org.mortbay.jetty.Server.doStart(Server.java:188) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at > > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebApp$Builder.start(AgentWebApp.java:102) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.startAgentWebApp(SliderAppMaster.java:755) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:605) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:421) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:186) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:474) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:405) > > at > > > org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:629) > > at > > org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaste > > r.java:1613) > > java.io.IOException: DerInputStream.getLength(): lengthTag=127, too big. > > at > sun.security.util.DerInputStream.getLength(DerInputStream.java:561) > > at sun.security.util.DerValue.init(DerValue.java:365) > > at sun.security.util.DerValue.<init>(DerValue.java:320) > > at > > sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:1220) > > at java.security.KeyStore.load(KeyStore.java:1214) > > at > > > org.mortbay.jetty.security.SslSelectChannelConnector.createSSLContext(SslSelectChannelConnector.java:626) > > at > > > org.mortbay.jetty.security.SslSelectChannelConnector.doStart(SslSelectChannelConnector.java:598) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at org.mortbay.jetty.Server.doStart(Server.java:235) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at > > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebApp$Builder.start(AgentWebApp.java:102) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.startAgentWebApp(SliderAppMaster.java:755) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:605) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:421) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:186) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:474) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:405) > > at > > > org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:629) > > at > > org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaste > > r.java:1613) > > java.io.IOException: DerInputStream.getLength(): lengthTag=127, too big. > > at > sun.security.util.DerInputStream.getLength(DerInputStream.java:561) > > at sun.security.util.DerValue.init(DerValue.java:365) > > at sun.security.util.DerValue.<init>(DerValue.java:320) > > at > > sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:1220) > > at java.security.KeyStore.load(KeyStore.java:1214) > > at > > > org.mortbay.jetty.security.SslSelectChannelConnector.createSSLContext(SslSelectChannelConnector.java:626) > > at > > > org.mortbay.jetty.security.SslSelectChannelConnector.doStart(SslSelectChannelConnector.java:598) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at org.mortbay.jetty.Server.doStart(Server.java:235) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at > > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebApp$Builder.start(AgentWebApp.java:102) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.startAgentWebApp(SliderAppMaster.java:755) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:605) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:421) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:186) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:474) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:405) > > at > > > org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:629) > > at > > org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaste > > r.java:1613) > > Exception: The connector is not bound to a port > > 14/12/24 03:15:53 ERROR main.ServiceLauncher: Exception: The connector > > is not bound to a port > > java.lang.IllegalStateException: The connector is not bound to a port > > at > > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebApp$Builder.getConnectorPort(AgentWebApp.java:167) > > at > > > org.apache.slider.server.appmaster.web.rest.agent.AgentWebApp$Builder.start(AgentWebApp.java:108) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.startAgentWebApp(SliderAppMaster.java:755) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:605) > > at > > > org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:421) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:186) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:474) > > at > > > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:405) > > at > > > org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:629) > > at > > org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaste > > r.java:1613) > > 14/12/24 03:15:53 INFO util.ExitUtil: Exiting with status 32 > > 14/12/24 03:15:53 INFO mortbay.log: Shutdown hook executing > > 14/12/24 03:15:53 INFO mortbay.log: Stopped > > SslSelectChannelConnector@0.0.0.0:0 > > 14/12/24 03:15:53 INFO mortbay.log: Stopped > > SslSelectChannelConnector@0.0.0.0:0 > > 14/12/24 03:15:53 INFO zookeeper.ClientCnxn: EventThread shut down > > 14/12/24 03:15:53 INFO zookeeper.ZooKeeper: Session: 0x14a7b0b7ee70007 > > closed > > 14/12/24 03:15:53 INFO ipc.Server: Stopping server on 58401 > > 14/12/24 03:15:53 INFO ipc.Server: Stopping IPC Server Responder > > 14/12/24 03:15:53 INFO ipc.Server: Stopping IPC Server listener on > > 58401 > > 14/12/24 03:15:53 INFO appmaster.SliderAppMaster: Process has exited > > with exit code 0 mapped to 0 -ignoring > > 14/12/24 03:15:53 INFO impl.AMRMClientAsyncImpl: Interrupted while > > waiting for queue java.lang.InterruptedException > > at > > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) > > at > > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) > > at > > > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) > > at > > org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$Callb > > ackHandlerThread.run(AMRMClientAsyncImpl.java:275) > > 14/12/24 03:15:53 INFO mortbay.log: Shutdown hook complete > > > > > > > > >