Hi Barometer team, Getting beyond the issues noted below (which still need to be addressed in the user guide):
* Setting the hostname in /etc/hosts prevented the kafka server from exiting Here are a couple of other issues that need to be addressed as well: * The "producer - consumer" test shown only works when you are installing interactively, as the "consumer" part does not automatically return control back to the shell or script. So when scripting this either we have to just assume that the kafka server is running properly, or we need a method of testing it that works in a script. * At "Install development tools:" the guide only references how to do this for Centos. It should also clarify for Ubuntu (there is no "group" operation in apt-get). Thanks, Bryan Sullivan | AT&T From: SULLIVAN, BRYAN L (BRYAN L) Sent: Friday, November 10, 2017 10:40 AM To: 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org> Subject: [barometer] Issues in VES Guide Hi Barometer team, Any help below is appreciated. I am scripting the setup for the new version of the VES plugin per http://docs.opnfv.org/en/latest/submodules/barometer/docs/release/userguide/collectd.ves.userguide.html I have found a couple of issues as below. Here are the steps I am using per the guide (note the additional step needed below, in bold): # TODO: Guide should reference use of "apt-get" vs "apt", per Ubuntu advice on which works better in scripts sudo apt-get install -y default-jre sudo apt-get install -y zookeeperd sudo apt-get install -y python-pip sudo pip install kafka-python wget "http://www-eu.apache.org/dist/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz"; tar -xvzf kafka_2.11-0.11.0.0.tgz sed -i -- 's/#delete.topic.enable=true/delete.topic.enable=true/' kafka_2.11-0.11.0.0/config/server.properties sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh \ kafka_2.11-0.11.0.0/config/server.properties > kafka_2.11-0.11.0.0/kafka.log 2>&1 & # TODO: missing step in guide: hostname must be in /etc/hosts echo "$(ip route get 8.8.8.8 | awk '{print $NF; exit}') $HOSTNAME" | sudo tee -a /etc/hosts sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh \ kafka_2.11-0.11.0.0/config/server.properties > kafka_2.11-0.11.0.0/kafka.log 2>&1 & kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic TopicTest --from-beginning When I run the server, it exits. I saw the note about the exit when I ran the "Producer" test per the guide, which complained that there was no Broker available (I guess due to the exit). After that I ran the "Consumer" test (I did not see the note about the server exit yet), which has hanged, and I can't quit that command. Any ideas for: * what I do now, to get my terminal prompt back (other than wipe the server and start again) * what may have caused the server to exit ubuntu@opnfv01:~$ sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh \ > kafka_2.11-0.11.0.0/config/server.properties > > kafka_2.11-0.11.0.0/kafka.log 2>&1 & [1] 6797 ubuntu@opnfv01:~$ ubuntu@opnfv01:~$ echo "Hello, World" | kafka_2.11-0.11.0.0/bin/kafka-console-producer.sh \ [1]+ Exit 1 sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh kafka_2.11-0.11.0.0/config/server.properties > kafka_2.11-0.11.0.0/kafka.log 2>&1 > --broker-list localhost:9092 --topic TopicTest > /dev/null [2017-11-10 18:22:18,189] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2017-11-10 18:22:18,241] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) ... ubuntu@opnfv01:~$ kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic TopicTest --from-beginning Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper]. [2017-11-10 18:25:34,303] WARN [console-consumer-18617_opnfv01-1510338334002-e1877230], no brokers found when trying to rebalance. (kafka.consumer.ZookeeperConsumerConnector) ^C ^C^C^C^C^C^C^C^C^C Thanks, Bryan Sullivan | AT&T
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
