[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783885#comment-16783885 ] Hyukjin Kwon commented on SPARK-26016: -- BTW, IIRC some codes assume other ascii compatible

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783878#comment-16783878 ] Sean Owen commented on SPARK-26016: --- It's "Fixed" in the sense that at least we plugged the

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783513#comment-16783513 ] Sean Owen commented on SPARK-26016: --- [~maxgekk] yeah I'm thinking of parts like

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-03 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782778#comment-16782778 ] Maxim Gekk commented on SPARK-26016: > nothing reinterprets the bytes according to a different

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782774#comment-16782774 ] Sean Owen commented on SPARK-26016: --- [~maxgekk] I see, but am I correct that in the text source,

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-02 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782542#comment-16782542 ] Maxim Gekk commented on SPARK-26016: [~srowen] JSON datasource uses Text datasource in schema

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-03-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782520#comment-16782520 ] Sean Owen commented on SPARK-26016: --- Yeah, the TL;DR from reading the code is that it writes UTF-8,

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2019-02-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766690#comment-16766690 ] Hyukjin Kwon commented on SPARK-26016: -- Okay, can you make the input / output in JIRA's

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

2018-11-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688932#comment-16688932 ] Hyukjin Kwon commented on SPARK-26016: -- Let's avoid to ask investigation in JIRA. It sounds more