Amir Sanjar created BIGTOP-2738: ----------------------------------- Summary: spark-worker fails to start Key: BIGTOP-2738 URL: https://issues.apache.org/jira/browse/BIGTOP-2738 Project: Bigtop Issue Type: Bug Components: spark Affects Versions: 1.2.0 Reporter: Amir Sanjar Priority: Blocker Fix For: 1.2.0
Problem is caused by BIGTOP-2490 that assumes only puppet managed orchestration. Thus, breaks other method of deployment . Cause of the problem: File bigtop-packages/src/common/spark/spark-worker.svc was changed to look for value $SPARK_MASTER_URL (line 47). This value is defined only in file spark-env.sh (bigtop-deploy/puppet/modules/spark/templates/spark-env.sh) that gets only initialized during puppet deployment. https://github.com/apache/bigtop/commit/f627c7868cb1123f6595380a7325f538ebdb8913#diff-90a09a528d21e12a96d209ffc4036f1e I propose to remove BIGTOP-2490 and update Bigtop 1.2 repository asap, Hopefully we will have a proper fix soon. -- This message was sent by Atlassian JIRA (v6.3.15#6346)