[jira] [Commented] (SPARK-21691) Accessing canonicalized plan for query with limit throws exception

[ https://issues.apache.org/jira/browse/SPARK-21691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139656#comment-16139656 ] Fei Shao commented on SPARK-21691: -- [~aokolnychyi] About the *"override def output: Seq[Attribute] = if

[jira] [Issue Comment Deleted] (SPARK-20971) Purge the metadata log for FileStreamSource

[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Shao updated SPARK-20971: - Comment: was deleted (was: Hi Zhu, What does metadata logs stands for please?) > Purge the metadata log

[jira] [Comment Edited] (SPARK-19341) Bucketing support for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-19341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058590#comment-16058590 ] Fei Shao edited comment on SPARK-19341 at 7/6/17 11:57 AM: --- [~tanejagagan]

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072315#comment-16072315 ] Fei Shao commented on SPARK-21206: -- [~srowen] Thanks for your time.I will check the code again. > the

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071640#comment-16071640 ] Fei Shao commented on SPARK-21206: -- About the concept of oldRDDs and newRDDs,I agree with you. About

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071229#comment-16071229 ] Fei Shao commented on SPARK-21206: -- The window size is correct. The oldRDDs and newRDDs is incorrect. >

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071110#comment-16071110 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 9:33 AM: -- [~srowen] This issue

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071110#comment-16071110 ] Fei Shao commented on SPARK-21206: -- [~srowen] Here is the case I want to express: !screenshot-2.png!

[jira] [Updated] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Shao updated SPARK-21206: - Attachment: screenshot-2.png > the window slice of Dstream is wrong >

[jira] [Updated] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Shao updated SPARK-21206: - Attachment: screenshot-1.png > the window slice of Dstream is wrong >

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 8:38 AM: -- [~srowen] I am

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 8:30 AM: -- [~srowen] I am

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao edited comment on SPARK-21206 at 6/25/17 10:57 AM: Hi Sean Owen, I

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao commented on SPARK-21206: -- Hi Sean Owen, I am sorry, I did not give enough message about this

[jira] [Created] (SPARK-21206) the window slice of Dstream is wrong

Fei Shao created SPARK-21206: Summary: the window slice of Dstream is wrong Key: SPARK-21206 URL: https://issues.apache.org/jira/browse/SPARK-21206 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19341) Bucketing support for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-19341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058590#comment-16058590 ] Fei Shao commented on SPARK-19341: -- @gagan taneia Would you like add more info about this issue please?

[jira] [Created] (SPARK-21147) the schema of socket source can not be set.

Fei Shao created SPARK-21147: Summary: the schema of socket source can not be set. Key: SPARK-21147 URL: https://issues.apache.org/jira/browse/SPARK-21147 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053871#comment-16053871 ] Fei Shao commented on SPARK-20568: -- I also do not support this feature too. If we delete files

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043877#comment-16043877 ] Fei Shao commented on SPARK-20589: -- Tasks are assigned to executors. If we set the number of executors

[jira] [Commented] (SPARK-20971) Purge the metadata log for FileStreamSource

[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042427#comment-16042427 ] Fei Shao commented on SPARK-20971: -- Hi Zhu, What does metadata logs stands for please? > Purge the

[jira] [Commented] (SPARK-15678) Not use cache on appends and overwrites

[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877618#comment-15877618 ] Fei Shao commented on SPARK-15678: -- I checked code with refreshByPath, it worked well. But I do not