[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297099#comment-14297099 ] DeepakVohra commented on SPARK-5483: The following statement generates the error.

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297102#comment-14297102 ] Sean Owen commented on SPARK-5483: -- This typically means you are running against a

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-29 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297105#comment-14297105 ] Tor Myklebust commented on SPARK-5472: -- Not sure what you mean by essentially here.

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297134#comment-14297134 ] Sean Owen commented on SPARK-5472: -- Sounds like a reasonable suggestion to me; I was

[jira] [Created] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread DeepakVohra (JIRA)
DeepakVohra created SPARK-5483: -- Summary: java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object; Key: SPARK-5483 URL: https://issues.apache.org/jira/browse/SPARK-5483

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297143#comment-14297143 ] DeepakVohra commented on SPARK-5483: Just using the following dependencies with no

[jira] [Commented] (SPARK-3298) [SQL] registerAsTable / registerTempTable overwrites old tables

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297152#comment-14297152 ] Apache Spark commented on SPARK-3298: - User 'OopsOutOfMemory' has created a pull

[jira] [Commented] (SPARK-5476) SQLContext.createDataFrame shouldn't be an implicit function

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296553#comment-14296553 ] Apache Spark commented on SPARK-5476: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296623#comment-14296623 ] Sean Owen commented on SPARK-5475: -- Eh, wait a sec, those tests are for testing Java 8

[jira] [Commented] (SPARK-4114) Use stable Hive API (if one exists) for communication with Metastore

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296562#comment-14296562 ] Patrick Wendell commented on SPARK-4114: Dropping target version 1.3 becasue we

[jira] [Updated] (SPARK-4628) Put external projects and examples behind a build flag

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4628: --- Priority: Major (was: Blocker) Put external projects and examples behind a build flag

[jira] [Updated] (SPARK-4114) Use stable Hive API (if one exists) for communication with Metastore

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4114: --- Target Version/s: (was: 1.3.0) Use stable Hive API (if one exists) for communication with

[jira] [Updated] (SPARK-4628) Put external projects and examples behind a build flag

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4628: --- Target Version/s: (was: 1.3.0) Put external projects and examples behind a build flag

[jira] [Commented] (SPARK-5062) Pregel use aggregateMessage instead of mapReduceTriplets function

2015-01-29 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296601#comment-14296601 ] sjk commented on SPARK-5062: is any one care? Pregel use aggregateMessage instead of

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296630#comment-14296630 ] Sean Owen commented on SPARK-5466: -- I saw the same error without zinc. I was doing a

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296618#comment-14296618 ] Sean Owen commented on SPARK-5472: -- Aren't these what JdbcRDD and the ThriftServer2

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Fix Version/s: 1.3.0 Add Developer API to REPL to allow re-publishing the REPL jar

[jira] [Updated] (SPARK-5264) Support `drop temporary table [if exists]` DDL command

2015-01-29 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5264: --- Summary: Support `drop temporary table [if exists]` DDL command (was: support `drop temporary table [if

[jira] [Updated] (SPARK-5264) support `drop temporary table [if exists]` DDL command

2015-01-29 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5264: --- Summary: support `drop temporary table [if exists]` DDL command (was: support `drop table` DDL command )

[jira] [Updated] (SPARK-5264) support `drop temporary table [if exists]` DDL command

2015-01-29 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5264: --- Description: Support `drop table` DDL command i.e DROP [TEMPORARY] TABLE [IF EXISTS]tbl_name

[jira] [Commented] (SPARK-5477) Refactor stat.py in order to expand mllib.stat

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296594#comment-14296594 ] Apache Spark commented on SPARK-5477: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-5477) Refactor stat.py in order to expand mllib.stat

2015-01-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5477: Summary: Refactor stat.py in order to expand mllib.stat Key: SPARK-5477 URL: https://issues.apache.org/jira/browse/SPARK-5477 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296573#comment-14296573 ] Patrick Wendell commented on SPARK-5466: Okay Maven is reproducing this now even

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296651#comment-14296651 ] Lianhui Wang commented on SPARK-5162: - [~vgrigor] I have created JIRE:SPARK-5479 for

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296661#comment-14296661 ] Bilna P commented on SPARK-5466: I too had the same exception while doing build with mvn

[jira] [Comment Edited] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296661#comment-14296661 ] Bilna P edited comment on SPARK-5466 at 1/29/15 10:29 AM: -- I too

[jira] [Comment Edited] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296661#comment-14296661 ] Bilna P edited comment on SPARK-5466 at 1/29/15 10:29 AM: -- I too

[jira] [Comment Edited] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296652#comment-14296652 ] Lianhui Wang edited comment on SPARK-5162 at 1/29/15 11:20 AM:

[jira] [Updated] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

2015-01-29 Thread Grzegorz Dubicki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grzegorz Dubicki updated SPARK-5403: Summary: Ignore UserKnownHostsFile in SSH calls (was: Avoid spark-ec2 hanging on Waiting

[jira] [Created] (SPARK-5478) Add miss right parenthesis in Stage page Pending stages label

2015-01-29 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-5478: -- Summary: Add miss right parenthesis in Stage page Pending stages label Key: SPARK-5478 URL: https://issues.apache.org/jira/browse/SPARK-5478 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilna P updated SPARK-5466: --- Comment: was deleted (was: I too had the same exception while doing build with { mvn -DskipTests clean

[jira] [Updated] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5479: Description: In SPARK-5162 [~vgrigor] report it: Now following code cannot work: aws emr add-steps

[jira] [Updated] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5479: Description: In SPARK-5162 [~vgrigor] reports this: Now following code cannot work: aws emr

[jira] [Updated] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5479: Description: In SPARK-5162 [~vgrigor] reports it: Now following code cannot work: aws emr

[jira] [Updated] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5479: Description: In SPARK-5162 [~vgrigor] reports this: Now following code cannot work: aws emr

[jira] [Comment Edited] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296652#comment-14296652 ] Lianhui Wang edited comment on SPARK-5162 at 1/29/15 10:03 AM:

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296674#comment-14296674 ] Bilna P commented on SPARK-5466: I too had the same exception while doing build with

[jira] [Created] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-29 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-5479: --- Summary: PySpark on yarn mode need to support non-local python files Key: SPARK-5479 URL: https://issues.apache.org/jira/browse/SPARK-5479 Project: Spark

[jira] [Comment Edited] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296652#comment-14296652 ] Lianhui Wang edited comment on SPARK-5162 at 1/29/15 11:24 AM:

[jira] [Issue Comment Deleted] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5162: Comment: was deleted (was: [~vgrigor] I have created JIRE:SPARK-5479 for support non-local files.

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

2015-01-29 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296652#comment-14296652 ] Lianhui Wang commented on SPARK-5162: - Vladimir Grigor I have created JIRE:SPARK-5479

[jira] [Created] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-01-29 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-5480: -- Summary: GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException: Key: SPARK-5480 URL: https://issues.apache.org/jira/browse/SPARK-5480 Project: Spark

[jira] [Commented] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-01-29 Thread vijay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296838#comment-14296838 ] vijay commented on SPARK-5481: -- Legacy databases that have tons of data and are still in use;

[jira] [Commented] (SPARK-5478) Add miss right parenthesis in Stage page Pending stages label

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296649#comment-14296649 ] Apache Spark commented on SPARK-5478: - User 'jerryshao' has created a pull request for

[jira] [Comment Edited] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296661#comment-14296661 ] Bilna P edited comment on SPARK-5466 at 1/29/15 10:19 AM: -- I too

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2015-01-29 Thread vijay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296775#comment-14296775 ] vijay commented on SPARK-2356: -- This is how I worked around this in Windows: * Download and

[jira] [Updated] (SPARK-5482) Allow individual test suites in python/run-tests

2015-01-29 Thread Katsunori Kanda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Katsunori Kanda updated SPARK-5482: --- Description: Add options to run individual test suites in python/run-tests. The usage is as

[jira] [Created] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-01-29 Thread vijay (JIRA)
vijay created SPARK-5481: Summary: JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers Key: SPARK-5481 URL: https://issues.apache.org/jira/browse/SPARK-5481 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296784#comment-14296784 ] Sean Owen commented on SPARK-5481: -- Spark requires Java 6, and Java 6 includes JDBC 4.

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Bilna P (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296799#comment-14296799 ] Bilna P commented on SPARK-4631: For me it works fine. Still I am trying to reproduce the

[jira] [Commented] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296798#comment-14296798 ] Sean Owen commented on SPARK-5481: -- Given that JDBC 4 was introduced 9 years ago, are

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Ye Xianjin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296811#comment-14296811 ] Ye Xianjin commented on SPARK-4631: --- [~dragos], Thread.sleep(50) do pass the test on my

[jira] [Issue Comment Deleted] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Ye Xianjin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ye Xianjin updated SPARK-4631: -- Comment: was deleted (was: [~dragos], Thread.sleep(50) do pass the test on my machine. ) Add real

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Ye Xianjin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296812#comment-14296812 ] Ye Xianjin commented on SPARK-4631: --- [~dragos], Thread.sleep(50) do pass the test on my

[jira] [Commented] (SPARK-5482) Allow individual test suites in python/run-tests

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296843#comment-14296843 ] Apache Spark commented on SPARK-5482: - User 'potix2' has created a pull request for

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296790#comment-14296790 ] Iulian Dragos commented on SPARK-4631: -- [~advancedxy], I see the same exception in

[jira] [Commented] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-01-29 Thread vijay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296789#comment-14296789 ] vijay commented on SPARK-5481: -- JDBC 4 is an API. Drivers implement the API, or parts

[jira] [Created] (SPARK-5482) Allow individual test suites in python/run-tests

2015-01-29 Thread Katsunori Kanda (JIRA)
Katsunori Kanda created SPARK-5482: -- Summary: Allow individual test suites in python/run-tests Key: SPARK-5482 URL: https://issues.apache.org/jira/browse/SPARK-5482 Project: Spark Issue

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296840#comment-14296840 ] Iulian Dragos commented on SPARK-4631: -- [~Bilna], do you also see the

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297277#comment-14297277 ] Apache Spark commented on SPARK-5466: - User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297202#comment-14297202 ] DeepakVohra commented on SPARK-5483: Run a s Java application. The scala version in

[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-29 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297202#comment-14297202 ] DeepakVohra edited comment on SPARK-5483 at 1/29/15 5:37 PM: -

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297210#comment-14297210 ] Marcelo Vanzin commented on SPARK-5466: --- Ok, I can reproduce it locally with the

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297198#comment-14297198 ] Marcelo Vanzin commented on SPARK-5466: --- Let me try that and see if I figure what's

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297223#comment-14297223 ] Reynold Xin commented on SPARK-5472: If done well, this should probably replace

[jira] [Updated] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5472: --- Description: It would be nice to be able to make a table in a JDBC database appear as a table in

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-01-29 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296948#comment-14296948 ] Manoj Kumar commented on SPARK-5021: Sorry for being dense, but how do I access the

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297081#comment-14297081 ] Iulian Dragos commented on SPARK-4631: -- I opened [PR

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297080#comment-14297080 ] Apache Spark commented on SPARK-4631: - User 'dragos' has created a pull request for

[jira] [Commented] (SPARK-5461) Graph should have isCheckpointed, getCheckpointFiles methods

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297326#comment-14297326 ] Joseph K. Bradley commented on SPARK-5461: -- [~ankurdave] Do you have thoughts

[jira] [Commented] (SPARK-5461) Graph should have isCheckpointed, getCheckpointFiles methods

2015-01-29 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297370#comment-14297370 ] Ankur Dave commented on SPARK-5461: --- [~josephkb] I'm not too familiar with how

[jira] [Created] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2015-01-29 Thread Ankur Dave (JIRA)
Ankur Dave created SPARK-5484: - Summary: Pregel should checkpoint periodically to avoid StackOverflowError Key: SPARK-5484 URL: https://issues.apache.org/jira/browse/SPARK-5484 Project: Spark

[jira] [Commented] (SPARK-4133) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

2015-01-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297404#comment-14297404 ] Tathagata Das commented on SPARK-4133: -- [~derrickburns] Any thoughts? If there arent

[jira] [Commented] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297407#comment-14297407 ] Apache Spark commented on SPARK-5484: - User 'ankurdave' has created a pull request for

[jira] [Updated] (SPARK-4133) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

2015-01-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4133: - Priority: Major (was: Blocker) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

[jira] [Updated] (SPARK-4707) Reliable Kafka Receiver can lose data if the block generator fails to store data

2015-01-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4707: - Priority: Blocker (was: Critical) Reliable Kafka Receiver can lose data if the block generator

[jira] [Updated] (SPARK-4707) Reliable Kafka Receiver can lose data if the block generator fails to store data

2015-01-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4707: - Priority: Critical (was: Blocker) Reliable Kafka Receiver can lose data if the block generator

[jira] [Updated] (SPARK-4707) Reliable Kafka Receiver can lose data if the block generator fails to store data

2015-01-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4707: - Target Version/s: 1.3.0 (was: 1.2.1) Reliable Kafka Receiver can lose data if the block

[jira] [Commented] (SPARK-3975) Block Matrix addition and multiplication

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297441#comment-14297441 ] Apache Spark commented on SPARK-3975: - User 'brkyvz' has created a pull request for

[jira] [Created] (SPARK-5485) typo in spark streaming configuration parameter

2015-01-29 Thread Wing Yew Poon (JIRA)
Wing Yew Poon created SPARK-5485: Summary: typo in spark streaming configuration parameter Key: SPARK-5485 URL: https://issues.apache.org/jira/browse/SPARK-5485 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5485) typo in spark streaming configuration parameter

2015-01-29 Thread Wing Yew Poon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297449#comment-14297449 ] Wing Yew Poon commented on SPARK-5485: -- It should be

[jira] [Created] (SPARK-5487) Dockerfile to build spark's custom akka.

2015-01-29 Thread jay vyas (JIRA)
jay vyas created SPARK-5487: --- Summary: Dockerfile to build spark's custom akka. Key: SPARK-5487 URL: https://issues.apache.org/jira/browse/SPARK-5487 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5487) Dockerfile to build spark's custom akka.

2015-01-29 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jay vyas updated SPARK-5487: Description: Building spark's custom shaed akka version is tricky. The code is in

[jira] [Comment Edited] (SPARK-5487) Dockerfile to build spark's custom akka.

2015-01-29 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297458#comment-14297458 ] jay vyas edited comment on SPARK-5487 at 1/29/15 7:57 PM: -- To

[jira] [Commented] (SPARK-5487) Dockerfile to build spark's custom akka.

2015-01-29 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297458#comment-14297458 ] jay vyas commented on SPARK-5487: - To reproduce this, you can use the following

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297652#comment-14297652 ] Joseph K. Bradley commented on SPARK-5021: -- You can also generate the

[jira] [Created] (SPARK-5488) SPARK_LOCAL_IP not read by mesos scheduler

2015-01-29 Thread Martin Tapp (JIRA)
Martin Tapp created SPARK-5488: -- Summary: SPARK_LOCAL_IP not read by mesos scheduler Key: SPARK-5488 URL: https://issues.apache.org/jira/browse/SPARK-5488 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-01-29 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297634#comment-14297634 ] Travis Galoppo commented on SPARK-5021: --- [~josephkb] This ticket is marked as

[jira] [Commented] (SPARK-5400) Rename GaussianMixtureEM to GaussianMixture

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297648#comment-14297648 ] Joseph K. Bradley commented on SPARK-5400: -- Thanks! Could you also please change

[jira] [Resolved] (SPARK-5466) Build Error caused by Guava shading in Spark

2015-01-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5466. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Marcelo Vanzin Thanks

[jira] [Commented] (SPARK-5445) Make sure DataFrame expressions are usable in Java

2015-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297714#comment-14297714 ] Apache Spark commented on SPARK-5445: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5192) Parquet fails to parse schema contains '\r'

2015-01-29 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297710#comment-14297710 ] Rekha Joshi commented on SPARK-5192: I have made a parquet patch on it.thanks

[jira] [Commented] (SPARK-5400) Rename GaussianMixtureEM to GaussianMixture

2015-01-29 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297613#comment-14297613 ] Travis Galoppo commented on SPARK-5400: --- Please assign to me and I will make the

[jira] [Commented] (SPARK-5461) Graph should have isCheckpointed, getCheckpointFiles methods

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297663#comment-14297663 ] Joseph K. Bradley commented on SPARK-5461: -- That sounds great if partitionsRDD

[jira] [Updated] (SPARK-5151) Parquet Predicate Pushdown Does Not Work with Nested Structures.

2015-01-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5151: -- Component/s: SQL Parquet Predicate Pushdown Does Not Work with Nested Structures.

[jira] [Updated] (SPARK-5151) Parquet Predicate Pushdown Does Not Work with Nested Structures.

2015-01-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5151: -- Component/s: (was: Spark Core) Parquet Predicate Pushdown Does Not Work with Nested Structures.

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-01-29 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297622#comment-14297622 ] Travis Galoppo commented on SPARK-5021: --- [~MechCoder] The documentation for GMM is

[jira] [Updated] (SPARK-5400) Rename GaussianMixtureEM to GaussianMixture

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5400: - Assignee: Travis Galoppo Rename GaussianMixtureEM to GaussianMixture

[jira] [Updated] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5021: - Affects Version/s: (was: 1.2.0) 1.3.0 GaussianMixtureEM

[jira] [Assigned] (SPARK-5464) Calling help() on a Python DataFrame fails with cannot resolve column name __name__ error

2015-01-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-5464: - Assignee: Josh Rosen Calling help() on a Python DataFrame fails with cannot resolve column name

  1   2   >