[jira] [Created] (SPARK-19868) conflict TasksetManager lead to spark stopped

liujianhui created SPARK-19868: -- Summary: conflict TasksetManager lead to spark stopped Key: SPARK-19868 URL: https://issues.apache.org/jira/browse/SPARK-19868 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810519#comment-15810519 ] liujianhui edited comment on SPARK-18806 at 1/9/17 3:15 AM: Hi, Sean Owen, I

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810519#comment-15810519 ] liujianhui commented on SPARK-18806: Hi, Sean Owen, I found the root cause, when start the

[jira] [Updated] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

[ https://issues.apache.org/jira/browse/SPARK-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-19001: --- Description: h2. scene worker will submit multiply task of SendHeartbeat and CleanWorkDir if the

[jira] [Created] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

liujianhui created SPARK-19001: -- Summary: Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response Key: SPARK-19001 URL: https://issues.apache.org/jira/browse/SPARK-19001

[jira] [Commented] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15777821#comment-15777821 ] liujianhui commented on SPARK-18976: thanks for your attention, I found the root cause, the reason is

[jira] [Created] (SPARK-18994) worker clean up app directory block the heartbeat sending

liujianhui created SPARK-18994: -- Summary: worker clean up app directory block the heartbeat sending Key: SPARK-18994 URL: https://issues.apache.org/jira/browse/SPARK-18994 Project: Spark Issue

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: h2. scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: **scene** when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Attachment: screenshot-3.png > in standlone mode,executor expired by HeartbeanReceiver that still

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: **scene** when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Attachment: screenshot-2.png > in standlone mode,executor expired by HeartbeanReceiver that still

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Attachment: screenshot-1.png > in standlone mode,executor expired by HeartbeanReceiver that still

[jira] [Updated] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18976: --- Description: scene when executor expired by HeartbeatReceiver in driver, driver will mark that

[jira] [Created] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

liujianhui created SPARK-18976: -- Summary: in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to Key: SPARK-18976 URL:

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740792#comment-15740792 ] liujianhui commented on SPARK-18806: no， it's a problem, sometimes there are exist two same driver!

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736943#comment-15736943 ] liujianhui commented on SPARK-18806: when you stop worker by ssh from the client machine, if the

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736941#comment-15736941 ] liujianhui commented on SPARK-18806: when you stop worker by ssh from the client machine, if the

[jira] [Issue Comment Deleted] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18806: --- Comment: was deleted (was: when you stop worker by ssh from the client machine, if the driverwrapper

[jira] [Created] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

liujianhui created SPARK-18806: -- Summary: driverwrapper and executor doesn't exit when worker killed Key: SPARK-18806 URL: https://issues.apache.org/jira/browse/SPARK-18806 Project: Spark Issue

[jira] [Created] (SPARK-18554) leader master lost the leadership, when the slave become master, the perivious app's state display as waitting

liujianhui created SPARK-18554: -- Summary: leader master lost the leadership, when the slave become master, the perivious app's state display as waitting Key: SPARK-18554 URL:

[jira] [Commented] (SPARK-18225) job will miss when driver removed by master in spark streaming

[ https://issues.apache.org/jira/browse/SPARK-18225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643319#comment-15643319 ] liujianhui commented on SPARK-18225: yes,saisai shao,you know what i mean. I agree with you that it

[jira] [Commented] (SPARK-18225) job will miss when driver removed by master in spark streaming

[ https://issues.apache.org/jira/browse/SPARK-18225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635261#comment-15635261 ] liujianhui commented on SPARK-18225: we provide a platform for user to submit their streaming app, at

[jira] [Commented] (SPARK-18225) job will miss when driver removed by master in spark streaming

[ https://issues.apache.org/jira/browse/SPARK-18225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635252#comment-15635252 ] liujianhui commented on SPARK-18225: it still doCheckpoint even killed by UI because the

[jira] [Created] (SPARK-18225) job will miss when driver removed by master in spark streaming

liujianhui created SPARK-18225: -- Summary: job will miss when driver removed by master in spark streaming Key: SPARK-18225 URL: https://issues.apache.org/jira/browse/SPARK-18225 Project: Spark

[jira] [Updated] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18116: --- Description: run a streaming application which souce from kafka.There are many batchs queued in the

[jira] [Created] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint

liujianhui created SPARK-18116: -- Summary: spark streaming ui show 0 events when recovering from checkpoint Key: SPARK-18116 URL: https://issues.apache.org/jira/browse/SPARK-18116 Project: Spark