[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971893#comment-15971893 ] Stephane Maarek commented on SPARK-20287: - [~c...@koeninger.org] It makes sense. I didn't

[jira] [Closed] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek closed SPARK-20287. --- Resolution: Not A Problem > Kafka Consumer should be able to subscribe to more than one

[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966973#comment-15966973 ] Stephane Maarek commented on SPARK-20287: - [~c...@koeninger.org] How about using the subscribe

[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-11 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963939#comment-15963939 ] Stephane Maarek commented on SPARK-20287: - The other issue I can see is the coordinator work that

[jira] [Commented] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-11 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963938#comment-15963938 ] Stephane Maarek commented on SPARK-20287: - [~srowen] those are good points. In the case of 100

[jira] [Created] (SPARK-20287) Kafka Consumer should be able to subscribe to more than one topic partition

2017-04-10 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-20287: --- Summary: Kafka Consumer should be able to subscribe to more than one topic partition Key: SPARK-20287 URL: https://issues.apache.org/jira/browse/SPARK-20287

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604903#comment-15604903 ] Stephane Maarek commented on SPARK-18068: - Thanks for the links guys! Really helpful > Spark

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604443#comment-15604443 ] Stephane Maarek commented on SPARK-18068: - Would be awesome to expose it in the only docs! >

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604400#comment-15604400 ] Stephane Maarek commented on SPARK-18068: - [~hyukjin.kwon] Thanks! Didn't see this option, where

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600732#comment-15600732 ] Stephane Maarek commented on SPARK-18068: - I see TimestampType is a wrapper for

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Priority: Major (was: Critical) > Spark SQL doesn't parse some ISO 8601 formatted dates >

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Description: The following fail, but shouldn't according to the ISO 8601 standard (seconds

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Description: The following fail, but shouldn't according to the ISO 8601 standard (seconds

[jira] [Created] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-18068: --- Summary: Spark SQL doesn't parse some ISO 8601 formatted dates Key: SPARK-18068 URL: https://issues.apache.org/jira/browse/SPARK-18068 Project: Spark

[jira] [Commented] (SPARK-11374) skip.header.line.count is ignored in HiveContext

2016-08-14 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420491#comment-15420491 ] Stephane Maarek commented on SPARK-11374: - Hi, Thanks for the PR. Can you also test for the

[jira] [Commented] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244986#comment-15244986 ] Stephane Maarek commented on SPARK-14586: - Hi [~tsuresh], thanks for your reply. It makes sense!

[jira] [Updated] (SPARK-14583) SparkSQL doesn't apply TBLPROPERTIES('serialization.null.format'='') when Hive Table has partitions

2016-04-14 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14583: Summary: SparkSQL doesn't apply TBLPROPERTIES('serialization.null.format'='') when Hive

[jira] [Updated] (SPARK-14583) SparkSQL doesn't read TBLPROPERTIES('serialization.null.format'='') when Hive Table has partitions

2016-04-14 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14583: Summary: SparkSQL doesn't read TBLPROPERTIES('serialization.null.format'='') when Hive

[jira] [Commented] (SPARK-12741) DataFrame count method return wrong size.

2016-04-14 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242132#comment-15242132 ] Stephane Maarek commented on SPARK-12741: - Hi Sean, What do you mean by the behavior on master?

[jira] [Commented] (SPARK-12741) DataFrame count method return wrong size.

2016-04-13 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238723#comment-15238723 ] Stephane Maarek commented on SPARK-12741: - can we please re-open the issue? > DataFrame count

[jira] [Commented] (SPARK-11374) skip.header.line.count is ignored in HiveContext

2016-04-13 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238689#comment-15238689 ] Stephane Maarek commented on SPARK-11374: - any updates on this? Just some log: {code} CREATE

[jira] [Issue Comment Deleted] (SPARK-11374) skip.header.line.count is ignored in HiveContext

2016-04-13 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-11374: Comment: was deleted (was: I may add that more metadata isn't processed, namely

[jira] [Updated] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14586: Description: create a test_data.csv with the following {code:none} a, 2.0 ,3.0 {code}

[jira] [Updated] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14586: Description: create a test_data.csv with the following {code:none} a, 2.0 ,3.0 {code}

[jira] [Updated] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14586: Description: create a test_data.csv with the following {code:none} a, 2.0 ,3.0 {code}

[jira] [Updated] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14586: Description: create a test_data.csv with the following {code:none} a, 2.0 ,3.0 {code}

[jira] [Updated] (SPARK-14583) SparkSQL doesn't read hive table properly after MSCK REPAIR

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14583: Summary: SparkSQL doesn't read hive table properly after MSCK REPAIR (was: Spark doesn't

[jira] [Updated] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14586: Description: create a test_data.csv with the following {code:none} a, 2.0 ,3.0 {code}

[jira] [Created] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-12 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-14586: --- Summary: SparkSQL doesn't parse decimal like Hive Key: SPARK-14586 URL: https://issues.apache.org/jira/browse/SPARK-14586 Project: Spark Issue Type:

[jira] [Updated] (SPARK-14583) Spark doesn't read hive table properly after MSCK REPAIR

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14583: Description: it seems that Spark forgets or fails to read the metadata tblproperties after

[jira] [Updated] (SPARK-14583) Spark doesn't read hive table properly after MSCK REPAIR

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-14583: Description: it seems that Spark forgets or fails to read the metadata tblproperties after

[jira] [Commented] (SPARK-14583) Spark doesn't read hive table properly after MSCK REPAIR

2016-04-12 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238352#comment-15238352 ] Stephane Maarek commented on SPARK-14583: - pretty much the same behavior if instead of MSCK

[jira] [Created] (SPARK-14583) Spark doesn't read hive table properly after MSCK REPAIR

2016-04-12 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-14583: --- Summary: Spark doesn't read hive table properly after MSCK REPAIR Key: SPARK-14583 URL: https://issues.apache.org/jira/browse/SPARK-14583 Project: Spark

[jira] [Commented] (SPARK-11374) skip.header.line.count is ignored in HiveContext

2016-04-06 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229401#comment-15229401 ] Stephane Maarek commented on SPARK-11374: - I may add that more metadata isn't processed, namely

[jira] [Commented] (SPARK-12741) DataFrame count method return wrong size.

2016-04-05 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227688#comment-15227688 ] Stephane Maarek commented on SPARK-12741: - Hi, May be related to:

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-02-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324349#comment-14324349 ] Stephane Maarek commented on SPARK-5480: Hi Sean, We have included the following

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-02-05 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307628#comment-14307628 ] Stephane Maarek commented on SPARK-5480: It happened once after one of my server

[jira] [Created] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-01-29 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-5480: -- Summary: GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException: Key: SPARK-5480 URL: https://issues.apache.org/jira/browse/SPARK-5480 Project: Spark