[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520007#comment-16520007
]
Hyukjin Kwon commented on SPARK-13184:
--
I think it's rather almost close to an obsolete one because
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507476#comment-16507476
]
Felix Cheung commented on SPARK-13184:
--
what's the next step?
> Support minPartitions parameter
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301727#comment-15301727
]
Takeshi Yamamuro commented on SPARK-13184:
--
okay, I got your point.
I'll fix my pr according to
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301724#comment-15301724
]
Reynold Xin commented on SPARK-13184:
-
No you can't do that (that will break APIs). You can just
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301717#comment-15301717
]
Takeshi Yamamuro commented on SPARK-13184:
--
If `SQLConf` is directly passed into these kinds of
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301697#comment-15301697
]
Reynold Xin commented on SPARK-13184:
-
I was thinking we can just add a new method to SQLConf that
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301692#comment-15301692
]
Takeshi Yamamuro commented on SPARK-13184:
--
[~rxin] You intended to add these kinds of data
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301643#comment-15301643
]
Apache Spark commented on SPARK-13184:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301208#comment-15301208
]
Takeshi Yamamuro commented on SPARK-13184:
--
okay
> Support minPartitions parameter for JSON and
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301205#comment-15301205
]
Reynold Xin commented on SPARK-13184:
-
Please go for it.
> Support minPartitions parameter for JSON
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301202#comment-15301202
]
Takeshi Yamamuro commented on SPARK-13184:
--
[~rxin] Is this ticket worth a try? If so, I'll take
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301114#comment-15301114
]
koert kuipers commented on SPARK-13184:
---
agreed, there should be a general way for data sources to
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301058#comment-15301058
]
Reynold Xin commented on SPARK-13184:
-
I'm moving this out of the CSV umbrella ticket.
> Support
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301057#comment-15301057
]
Reynold Xin commented on SPARK-13184:
-
Rather than doing this specifically for JSON or CSV, it might
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262299#comment-15262299
]
koert kuipers commented on SPARK-13184:
---
my only reservation is that these are spark-wide settings,
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228676#comment-15228676
]
Koert Kuipers commented on SPARK-13184:
---
i think these would work for me
On Tue, Apr 5, 2016 at
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227671#comment-15227671
]
Takeshi Yamamuro commented on SPARK-13184:
--
Yeah, lowering `maxPartitionBytes` increases
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227657#comment-15227657
]
koert kuipers commented on SPARK-13184:
---
i am not familiar with those settings.
are they respected
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227435#comment-15227435
]
Takeshi Yamamuro commented on SPARK-13184:
--
Seems we can handle this by
[
https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132711#comment-15132711
]
koert kuipers commented on SPARK-13184:
---
thanks for creating this! i think the issue is to
20 matches
Mail list logo
