[jira] [Comment Edited] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2020-01-26 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023935#comment-17023935 ] Jorge Machado edited comment on SPARK-23148 at 1/27/20 7:22 AM: --

[jira] [Updated] (SPARK-30647) When creating a custom datasource File NotFoundExpection happens

2020-01-26 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-30647: -- Issue Type: Bug (was: Improvement) > When creating a custom datasource File NotFoundExpection

[jira] [Created] (SPARK-30647) When creating a custom datasource File NotFoundExpection happens

2020-01-26 Thread Jorge Machado (Jira)
Jorge Machado created SPARK-30647: - Summary: When creating a custom datasource File NotFoundExpection happens Key: SPARK-30647 URL: https://issues.apache.org/jira/browse/SPARK-30647 Project: Spark

[jira] [Created] (SPARK-30646) transform_keys function throws exception as "Cannot use null as map key", but there isn't any null key in the map

2020-01-26 Thread Arun Jijo (Jira)
Arun Jijo created SPARK-30646: - Summary: transform_keys function throws exception as "Cannot use null as map key", but there isn't any null key in the map Key: SPARK-30646 URL: https://issues.apache.org/jira/browse/S

[jira] [Comment Edited] (SPARK-30643) Add support for embedding Hive 3

2020-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024062#comment-17024062 ] Dongjoon Hyun edited comment on SPARK-30643 at 1/27/20 2:36 AM: --

[jira] [Comment Edited] (SPARK-30643) Add support for embedding Hive 3

2020-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024062#comment-17024062 ] Dongjoon Hyun edited comment on SPARK-30643 at 1/27/20 2:28 AM: --

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024062#comment-17024062 ] Dongjoon Hyun commented on SPARK-30643: --- It sounds like a misunderstanding on the

[jira] [Resolved] (SPARK-30640) Prevent unnessary copies of data in Arrow to Pandas conversion with Timestamps

2020-01-26 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-30640. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27358 [https://gi

[jira] [Assigned] (SPARK-30640) Prevent unnessary copies of data in Arrow to Pandas conversion with Timestamps

2020-01-26 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-30640: Assignee: Bryan Cutler > Prevent unnessary copies of data in Arrow to Pandas conversion w

[jira] [Comment Edited] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2020-01-26 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023935#comment-17023935 ] Jorge Machado edited comment on SPARK-23148 at 1/26/20 9:29 PM: --

[jira] [Comment Edited] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2020-01-26 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023935#comment-17023935 ] Jorge Machado edited comment on SPARK-23148 at 1/26/20 9:29 PM: --

[jira] [Commented] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2020-01-26 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023935#comment-17023935 ] Jorge Machado commented on SPARK-23148: --- So I have the same problem if I create a

[jira] [Resolved] (SPARK-30314) Add identifier and catalog information to DataSourceV2Relation

2020-01-26 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30314. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by [https://github.com/apache/spark/pull/

[jira] [Assigned] (SPARK-30314) Add identifier and catalog information to DataSourceV2Relation

2020-01-26 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30314: --- Assignee: Yuchen Huo > Add identifier and catalog information to DataSourceV2Relation > ---

[jira] [Commented] (SPARK-16483) Unifying struct fields and columns

2020-01-26 Thread fqaiser94 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023920#comment-17023920 ] fqaiser94 commented on SPARK-16483: --- This is very similar to  [SPARK-22231|https://iss

[jira] [Comment Edited] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2020-01-26 Thread fqaiser94 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023919#comment-17023919 ] fqaiser94 edited comment on SPARK-22231 at 1/26/20 8:35 PM:

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2020-01-26 Thread fqaiser94 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023919#comment-17023919 ] fqaiser94 commented on SPARK-22231: --- @rxin no problems, take your time. Apparently Sp