[jira] [Commented] (SPARK-7001) Partitions for a long single line file

2015-04-20 Thread Victor Bashurov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504452#comment-14504452 ] Victor Bashurov commented on SPARK-7001: Need to try InputFormat then or just chan

[jira] [Commented] (SPARK-7001) Partitions for a long single line file

2015-04-20 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502645#comment-14502645 ] Tom White commented on SPARK-7001: -- I agree that it looks like there may be an edge case

[jira] [Commented] (SPARK-7001) Partitions for a long single line file

2015-04-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502603#comment-14502603 ] Sean Owen commented on SPARK-7001: -- Yes, the issue is the `sc.textFile(...)` RDD itself.

[jira] [Commented] (SPARK-7001) Partitions for a long single line file

2015-04-19 Thread Victor Bashurov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502335#comment-14502335 ] Victor Bashurov commented on SPARK-7001: Thanks for your answer, please see my com

[jira] [Commented] (SPARK-7001) Partitions for a long single line file

2015-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502314#comment-14502314 ] Sean Owen commented on SPARK-7001: -- First, it's probably important to note that this is n