[
https://issues.apache.org/jira/browse/DATALAB-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vira Vitanska updated DATALAB-2482:
-----------------------------------
Description:
Spark driver/executor memory is allocated according to the ticket
https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it
does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor
memory * 0/90
*Actual result:*
# Calculation is not equal to spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal to spark memory (sudo ps aux | grep java)
was:
Spark driver/executor memory is allocated according to the ticket
https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it
does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor
memory * 0/90
*Actual result:*
# Calculation is not equal spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal spark memory (sudo ps aux | grep java)
> [Apache Zeppelin] Spark drivers/executors memory are not allocated according
> to best practice
> ---------------------------------------------------------------------------------------------
>
> Key: DATALAB-2482
> URL: https://issues.apache.org/jira/browse/DATALAB-2482
> Project: Apache DataLab
> Issue Type: Bug
> Security Level: Public(Regular Issues)
> Components: DataLab Main
> Reporter: Vira Vitanska
> Assignee: Mykola Bodnar
> Priority: Minor
> Labels: AWS, AZURE, Debian, DevOps, GCP, RedHat
> Fix For: v.2.5
>
>
> Spark driver/executor memory is allocated according to the ticket
> https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin
> it does not work.
> *Preconditions:*
> # Zeppelin is in running status
> *Steps to reproduce:*
> # Run Playbook on Zeppelin
> # Run on notebook sudo ps aux | grep java
> # Calculate the memory by formula Spark executor memory = total executor
> memory * 0/90
> *Actual result:*
> # Calculation is not equal to spark memory (sudo ps aux | grep java)
> *Expected result:*
> # Calculation is equal to spark memory (sudo ps aux | grep java)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]