[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432459#comment-15432459 ] Ben Teeuwen commented on SPARK-12072: - [~holdenk] we haven't been able to test the pa

[jira] [Closed] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Teeuwen closed SPARK-13939. --- Resolution: Not A Bug > Kafka createDirectStream not parallelizing properly > ---

[jira] [Commented] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209901#comment-15209901 ] Ben Teeuwen commented on SPARK-13939: - Thanks a lot Cody for narrowing the search spa

[jira] [Updated] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Teeuwen updated SPARK-13939: Attachment: 0CEAF9A0-6637-44BB-95B2-2529992723A2.png ECBE2DFF-6B35-48C5-B692-B9A80FC

[jira] [Updated] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Teeuwen updated SPARK-13939: Attachment: screenshot-1.png > Kafka createDirectStream not parallelizing properly > --

[jira] [Updated] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Teeuwen updated SPARK-13939: Attachment: 4E119936-14E3-490E-A885-7D2E2CB2940F.png 215B28E2-638B-494C-8084-FD46E99

[jira] [Commented] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205983#comment-15205983 ] Ben Teeuwen commented on SPARK-13939: - - YARN is used. - The 4 brokers listed in kafk

[jira] [Commented] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204597#comment-15204597 ] Ben Teeuwen commented on SPARK-13939: - Simplifying code: Changed it to http://pastebi

[jira] [Commented] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204006#comment-15204006 ] Ben Teeuwen commented on SPARK-13939: - Changed code to http://pastebin.com/mwYGBLk2.

[jira] [Created] (SPARK-13939) Kafka createDirectStream not parallelizing properly

Ben Teeuwen created SPARK-13939: --- Summary: Kafka createDirectStream not parallelizing properly Key: SPARK-13939 URL: https://issues.apache.org/jira/browse/SPARK-13939 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Teeuwen updated SPARK-13939: Description: I’m trying to get a streaming app running using pyspark (1.6.0), Kafka and the receiv

[jira] [Commented] (SPARK-13939) Kafka createDirectStream not parallelizing properly

[ https://issues.apache.org/jira/browse/SPARK-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199847#comment-15199847 ] Ben Teeuwen commented on SPARK-13939: - I don't know what you mean by printing to exec