[
https://issues.apache.org/jira/browse/DLAB-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175506#comment-17175506
]
Vira Vitanska commented on DLAB-1823:
-------------------------------------
*Closed:*
Commit ID 4ca2620fe577f78690f1cd76bb011c5b401f99f9.
> [Branch-515][AWS][GCP][Zeppelin]: Playbooks flight/airbnb preparation
> Py2/Py3/R/Scala run with error for local/remote kernels
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: DLAB-1823
> URL: https://issues.apache.org/jira/browse/DLAB-1823
> Project: Apache DLab
> Issue Type: Bug
> Components: DLab Main
> Reporter: Vira Vitanska
> Assignee: Mykola Bodnar
> Priority: Major
> Labels: AWS, Debian, DevOps
> Attachments: AIRBNB local-remote.png, GCP Preparation airbnb py2.png,
> GCP preparation airbnb py3.png, Python 2 data preparation -local logs.txt,
> Python 2 data preparation-Spark-logs.txt, Python 2 data
> preparation-local.png, Python 2 data preparation-spark.png, R data
> preparation local remote logs.txt, Scala -py2-py3- local-remote.png, Scala
> py2-py3 remote-local logs.txt, Verified-AWS-Local-Fight-R-Py3.png,
> Verified-GCP-DP15-Flight-Prepare-Py2.png,
> Verified1-AWS-EMR530-AIRBNB-Prapare-Py2.png,
> Verified1-AWS-EMR530-AIRBNB-Prapare-Py3.png,
> Verified1-AWS-EMR530-Flight-preparetion-PY2.png,
> Verified1-AWS-EMR6-AIRBNB-Prapare-Py2-py3.png,
> Verified1-AWS-EMR6-Flight-Prepare-py2.png,
> Verified1-AWS-EMR6-Flight-R-Py2.png, Verified1-AWS-EMR6-Flight-R-Py3.png,
> Verified1-AWS-EMR6-Flight-Scala-Py2.png,
> Verified1-AWS-EMR6-Flight-Scala-Py3.png,
> Verified1-AWS-Scala-Flight-Prepare-Py2.png,
> Verified1-AWS-Scala-Flight-Prepare-Py3.png,
> Verified1-AWS-Spark-AIRBNB-Prepare-Py3.png,
> Verified1-AWS-Spark-Flight-Prapare-Py2.png,
> Verified1-AWS-Spark-Flight-Prepare-Py2.png,
> Verified1-AWS-Spark-Flight-Prepare-Py3.png,
> Verified1-AWS-Spark-Flight-Prepare-R-py3.png,
> Verified1-AWS-local-flight-prapare-Py2.png,
> Verified1-AWS-spark-flight-prepare-Scala-Py2.png,
> Verified1-GCP-DP13-Flight-prepare-Py2.jpg,
> Verified1-GCP-DP13-Flight-visualize-Py2.jpg,
> Verified1-GCP-DP15-AIRBNB-Prepare-py2.png,
> Verified1-GCP-DP15-Flight-prepare-py2-R.png,
> Verified1-GCP-DP15-Flight0Prepare-Scala.png,
> Verified1-GCP-local-AIRBNB-py2.jpg,
> Verified1-GCP-local-AirbNB-prepare-py3.jpg,
> Verifight-AWS-Spark-AIRBNB-Prepare-Py2.png,
> image-2020-06-16-10-20-51-231.png,
> verified1-GCP-DP13-Flight-prepare-R-py2.jpg,
> verified1-GCP-Spark-AIRBNB-Prapare-Py3.jpg
>
>
> *Preconditions:*
> 1. Zeppelin is created on AWS/GCP
> *Steps to reproduce:*
> 1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
> *Actual result:*
> 1. Playbooks run with error
> *Expected result:*
> 1. Playbooks run successful
> ------------------------------------------------------------------------------------------
> (i) For GCP Playbook preparation fails only for airbnb see attachments
> ----
> *AWS*
> +Flight preparation Py2+
> ||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +Flight preparation R+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
> +Flight preparation scala+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +AIRBNB+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
> ||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ----
> *GCP*
> +AIRBNB+
> ||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
> ||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color}
> (11/06/2020)|
> ||DP 1.3 py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.4 py2|{color:#de350b}*runs with error*{color} (11/06/2020) |
> ||DP 1.4 py3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.5 ubuntu py2|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||Spark py3|*{color:#de350b}runs with error -failed to start pyspark{color}*
> (11/06/2020)|
> +Flight preparation Py2+
> ||Local|{color:#00875a}*verfied*{color} (11/06/2020)|
> ||DP 1.3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.4|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP1.5 ubuntu|{color:#00875a}*runs with error* {color}(16/06/2020)|
> ||Spark|{color:#00875a}*verified*{color} (11/06/2020)|
> +Flight preparation R+
> ||Local py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Local py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.3 py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b} *runs with error*{color} (11/06/2020)|
> ||DP 1.4 py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.4 py3|*{color:#00875a}verified{color}* (11/06/2020)|
> ||DP 1.5 ubuntu py2|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with error* ** {color}(16/06/2020)|
> ||Spark py2| {color:#00875a}*verified*{color} (11/06/2020)|
> ||Spark py3|{color:#00875a}*verified* {color}(11/06/2020)|
> +Flight preparation scala+
> ||Local py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Local py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.3 py2| {color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b}*runs with error* {color}(11/06/2020)|
> ||DP 1.4 py2|*{color:#00875a}verified{color}* (11/06/2020)|
> ||DP 1.4 py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.5 ubuntu py2 |{color:#de350b}*runs with erro*{color}r (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with erro**r* {color}(16/06/2020)|
> ||Spark py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Spark py3|{color:#00875a}*verified*{color} (11/06/2020)|
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@dlab.apache.org
For additional commands, e-mail: dev-h...@dlab.apache.org
