[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210072#comment-17210072 ] Jungtaek Lim commented on SPARK-28025: -- [~ste...@apache.org] Sorry to ping you on

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920706#comment-16920706 ] Gabor Somogyi commented on SPARK-28025: --- [~ste...@apache.org] I think adding "file

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920018#comment-16920018 ] Jungtaek Lim commented on SPARK-28025: -- FYI, I just submitted a patch for HADOOP-16

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919583#comment-16919583 ] Stavros Kontopoulos commented on SPARK-28025: - Thanks I will have a look :)

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919580#comment-16919580 ] Gabor Somogyi commented on SPARK-28025: --- [~skonto], this one: [https://github.com/

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919577#comment-16919577 ] Stavros Kontopoulos commented on SPARK-28025: - [~kabhwan] which PR? > HDFSB

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919514#comment-16919514 ] Steve Loughran commented on SPARK-28025: Has anyone considered enhancing org.apa

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919507#comment-16919507 ] Jungtaek Lim commented on SPARK-28025: -- [~skonto] Please take a look at my PR as m

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919471#comment-16919471 ] Stavros Kontopoulos commented on SPARK-28025: - @[~dongjoon] [~zsxwing] this

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909912#comment-16909912 ] Jungtaek Lim commented on SPARK-28025: -- I still think it should rename crc file as

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892875#comment-16892875 ] Tomas Bartalos commented on SPARK-28025: I'm also affected by performance issue 

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862908#comment-16862908 ] Stavros Kontopoulos commented on SPARK-28025: - I just found out that the fol

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862548#comment-16862548 ] Stavros Kontopoulos commented on SPARK-28025: - [~kabhwan] yes we discussed t

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862449#comment-16862449 ] Jungtaek Lim commented on SPARK-28025: -- Personally I would respect the reporter and

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862339#comment-16862339 ] Stavros Kontopoulos commented on SPARK-28025: - There is a workaround by sett

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862227#comment-16862227 ] Steve Loughran commented on SPARK-28025: looking at the previous patch, you don'

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862065#comment-16862065 ] Jungtaek Lim commented on SPARK-28025: -- [~gmaas] Nice finding. Would you like to s

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861991#comment-16861991 ] Gerard Maas commented on SPARK-28025: - I reproduced  the issue in a  spark-shell ses