[jira] [Updated] (LIVY-750) Livy uploads local pyspark archives to Yarn distributed cache

2020-03-16 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-750: - Description: On Livy Server, even if we set pyspark archives to use local files: {code:bash} export PYSPA

[jira] [Commented] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2020-02-24 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043920#comment-17043920 ] shanyu zhao commented on LIVY-576: -- Thanks [~andrasbeni], yes LIVY-642 is basically a dupl

[jira] [Created] (LIVY-750) Livy uploads local pyspark archives to Yarn distributed cache

2020-02-16 Thread shanyu zhao (Jira)
shanyu zhao created LIVY-750: Summary: Livy uploads local pyspark archives to Yarn distributed cache Key: LIVY-750 URL: https://issues.apache.org/jira/browse/LIVY-750 Project: Livy Issue Type: B

[jira] [Updated] (LIVY-749) Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session

2020-02-14 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-749: - Issue Type: Bug (was: New Feature) > Datanucleus jars are uploaded to hdfs unnecessarily when starting a l

[jira] [Created] (LIVY-749) Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session

2020-02-14 Thread shanyu zhao (Jira)
shanyu zhao created LIVY-749: Summary: Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session Key: LIVY-749 URL: https://issues.apache.org/jira/browse/LIVY-749 Project: Livy

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-13 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17014723#comment-17014723 ] shanyu zhao commented on LIVY-718: -- [~jerryshao] the active-standby HA for Livy server is

[jira] [Created] (LIVY-743) Support Livy metrics based on dropwizard

2020-01-13 Thread shanyu zhao (Jira)
shanyu zhao created LIVY-743: Summary: Support Livy metrics based on dropwizard Key: LIVY-743 URL: https://issues.apache.org/jira/browse/LIVY-743 Project: Livy Issue Type: New Feature C

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-08 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010965#comment-17010965 ] shanyu zhao commented on LIVY-718: -- LIVY-11 aims at active-standby HA, user should be able

[jira] [Commented] (LIVY-547) Livy kills session after livy.server.session.timeout even if the session is active

2019-07-31 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897494#comment-16897494 ] shanyu zhao commented on LIVY-547: -- Created new PR and added new configuration to change t

[jira] [Created] (LIVY-617) Livy session leak on Yarn when creating session duplicated names

2019-07-30 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-617: Summary: Livy session leak on Yarn when creating session duplicated names Key: LIVY-617 URL: https://issues.apache.org/jira/browse/LIVY-617 Project: Livy Issue Type

[jira] [Commented] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2019-03-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803315#comment-16803315 ] shanyu zhao commented on LIVY-505: -- Root cause: SparkR uses SparkR env variable ".sparkRj

[jira] [Updated] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2019-03-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-505: - Attachment: LIVY-505.patch > sparkR.session failed with "invalid jobj 1" error in Spark 2.3 > -

[jira] [Updated] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-576: - Attachment: LIVY-576.patch > Unknown YARN state RUNNING for app with final status SUCCEEDED > -

[jira] [Updated] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-576: - Summary: Unknown YARN state RUNNING for app with final status SUCCEEDED (was: Unknown YARN state RUNNING F

[jira] [Created] (LIVY-576) Unknown YARN state RUNNING FOR app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-576: Summary: Unknown YARN state RUNNING FOR app with final status SUCCEEDED Key: LIVY-576 URL: https://issues.apache.org/jira/browse/LIVY-576 Project: Livy Issue Type:

[jira] [Commented] (LIVY-547) Livy kills session after livy.server.session.timeout even if the session is active

2019-02-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780032#comment-16780032 ] shanyu zhao commented on LIVY-547: -- [~Jassy] are you still working on this issue? > Livy

[jira] [Commented] (LIVY-266) Livy sessions/batches are not secured. Any user can stop another user session/batch

2018-11-29 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704312#comment-16704312 ] shanyu zhao commented on LIVY-266: -- [~tc0312] are you saying that all the requests are act

[jira] [Commented] (LIVY-231) Session recovery for batch sessions with multiple Livy servers

2018-11-14 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687299#comment-16687299 ] shanyu zhao commented on LIVY-231: -- Any update for this feature? Or should we implement an

[jira] [Created] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2018-08-28 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-505: Summary: sparkR.session failed with "invalid jobj 1" error in Spark 2.3 Key: LIVY-505 URL: https://issues.apache.org/jira/browse/LIVY-505 Project: Livy Issue Type:

[jira] [Commented] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594481#comment-16594481 ] shanyu zhao commented on LIVY-501: -- Thanks [~jerryshao]. Where does Livy mention the compa

[jira] [Commented] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594336#comment-16594336 ] shanyu zhao commented on LIVY-501: -- Spark 2.3 works except for SparkR. I just attached the

[jira] [Updated] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-501: - Attachment: LIVY-501.patch > Support Spark 2.3 SparkR backend > > >

[jira] [Created] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-501: Summary: Support Spark 2.3 SparkR backend Key: LIVY-501 URL: https://issues.apache.org/jira/browse/LIVY-501 Project: Livy Issue Type: Bug Components: Inter