[jira] [Commented] (SPARK-24036) Stateful operators in continuous processing

2019-10-16 Thread Ladislav Jech (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953304#comment-16953304 ] Ladislav Jech commented on SPARK-24036: --- Hi [~joseph.torres] - any update on this work guys? >

[jira] [Created] (SPARK-28092) Spark cannot load files with COLON(:) char if not specified full path

2019-06-18 Thread Ladislav Jech (JIRA)
Ladislav Jech created SPARK-28092: - Summary: Spark cannot load files with COLON(:) char if not specified full path Key: SPARK-28092 URL: https://issues.apache.org/jira/browse/SPARK-28092 Project:

[jira] [Comment Edited] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847787#comment-16847787 ] Ladislav Jech edited comment on SPARK-27593 at 5/24/19 6:15 PM: Ok,

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847787#comment-16847787 ] Ladislav Jech commented on SPARK-27593: --- Ok, sorry, this was my misunderstanding of some options

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847734#comment-16847734 ] Ladislav Jech commented on SPARK-27593: --- I cannot get this working, I have following code:

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847340#comment-16847340 ] Ladislav Jech commented on SPARK-27593: --- What is the behavior when you load multiple files, I need

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847338#comment-16847338 ] Ladislav Jech commented on SPARK-27593: --- [~hyukjin.kwon] - I got the point, thx for information

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-01 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830894#comment-16830894 ] Ladislav Jech commented on SPARK-27593: --- But you don't know if NULL is actually coming from data

[jira] [Comment Edited] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-30 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830596#comment-16830596 ] Ladislav Jech edited comment on SPARK-27593 at 4/30/19 7:12 PM:

[jira] [Reopened] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-30 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ladislav Jech reopened SPARK-27593: --- As per comment, please review again. > CSV Parser returns 2 DataFrame - Valid and Malformed

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-30 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830596#comment-16830596 ] Ladislav Jech commented on SPARK-27593: --- [~hyukjin.kwon] - Then return optionally just an array of

[jira] [Updated] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-29 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ladislav Jech updated SPARK-27593: -- Issue Type: New Feature (was: Improvement) > CSV Parser returns 2 DataFrame - Valid and

[jira] [Updated] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-29 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ladislav Jech updated SPARK-27593: -- Description: When we process CSV in any kind of data warehouse, its common procedure to

[jira] [Updated] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-29 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ladislav Jech updated SPARK-27593: -- Description: When we process CSV in any kind of data warehouse, its common procedure to

[jira] [Created] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-04-29 Thread Ladislav Jech (JIRA)
Ladislav Jech created SPARK-27593: - Summary: CSV Parser returns 2 DataFrame - Valid and Malformed DFs Key: SPARK-27593 URL: https://issues.apache.org/jira/browse/SPARK-27593 Project: Spark

[jira] [Commented] (SPARK-11197) Run SQL query on files directly without create a table

2017-03-02 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892706#comment-15892706 ] Ladislav Jech commented on SPARK-11197: --- Grat stuff! > Run SQL query on files directly without