[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990006#comment-14990006 ] Glenn Strycker commented on SPARK-3789: --- I posted a similar question on stackoverflow about a year

[jira] [Commented] (SPARK-4122) Add library to write data back to Kafka

2015-11-04 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990007#comment-14990007 ] Hari Shreedharan commented on SPARK-4122: - I kept it updated for a while and didn't get reviews.

[jira] [Created] (SPARK-11503) SQL API audit for Spark 1.6

2015-11-04 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11503: --- Summary: SQL API audit for Spark 1.6 Key: SPARK-11503 URL: https://issues.apache.org/jira/browse/SPARK-11503 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-11502: - Priority: Minor (was: Major) > Word2VecSuite needs appropriate checks >

[jira] [Resolved] (SPARK-11235) Support streaming data using network library

2015-11-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11235. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > Support

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2015-11-04 Thread Pierre Beauvois (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990013#comment-14990013 ] Pierre Beauvois commented on SPARK-11472: - Thanks for the reply Sean. I'm going to give you an

[jira] [Commented] (SPARK-10656) select(df(*)) fails when a column has special characters

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989162#comment-14989162 ] Apache Spark commented on SPARK-10656: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11263: Assignee: Apache Spark > lintr Throws Warnings on Commented Code in Documentation >

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989174#comment-14989174 ] Apache Spark commented on SPARK-11263: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11263: Assignee: (was: Apache Spark) > lintr Throws Warnings on Commented Code in

[jira] [Commented] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989203#comment-14989203 ] Sean Owen commented on SPARK-11500: --- Dumb question, but why does the ordering of columns matter here --

[jira] [Commented] (SPARK-11474) Options to jdbc load are lower cased

2015-11-04 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989094#comment-14989094 ] Huaxin Gao commented on SPARK-11474: Did PR https://github.com/apache/spark/pull/9461 Somehow it

[jira] [Issue Comment Deleted] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11478: Comment: was deleted (was: I will try to find some clues.) > ML StringIndexer return inconsistent

[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989091#comment-14989091 ] Yanbo Liang commented on SPARK-11478: - I have found the cause of this bug, but not figured out a way

[jira] [Commented] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

2015-11-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990050#comment-14990050 ] Yin Huai commented on SPARK-4849: - oh, actually SPARK-5354. SPARK-11410 adds APIs to specify how to

[jira] [Created] (SPARK-11505) Break aggregate functions into multiple files

2015-11-04 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11505: --- Summary: Break aggregate functions into multiple files Key: SPARK-11505 URL: https://issues.apache.org/jira/browse/SPARK-11505 Project: Spark Issue Type:

[jira] [Created] (SPARK-11504) API audit for distributeBy and localSort

2015-11-04 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11504: --- Summary: API audit for distributeBy and localSort Key: SPARK-11504 URL: https://issues.apache.org/jira/browse/SPARK-11504 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-11504) API audit for distributeBy and localSort

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990048#comment-14990048 ] Apache Spark commented on SPARK-11504: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11504) API audit for distributeBy and localSort

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11504: Assignee: Apache Spark (was: Reynold Xin) > API audit for distributeBy and localSort >

[jira] [Assigned] (SPARK-11504) API audit for distributeBy and localSort

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11504: Assignee: Reynold Xin (was: Apache Spark) > API audit for distributeBy and localSort >

[jira] [Assigned] (SPARK-11505) Break aggregate functions into multiple files

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11505: Assignee: Apache Spark (was: Reynold Xin) > Break aggregate functions into multiple

[jira] [Commented] (SPARK-11505) Break aggregate functions into multiple files

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990140#comment-14990140 ] Apache Spark commented on SPARK-11505: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11505) Break aggregate functions into multiple files

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11505: Assignee: Reynold Xin (was: Apache Spark) > Break aggregate functions into multiple

[jira] [Commented] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

2015-11-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990040#comment-14990040 ] Reynold Xin commented on SPARK-4849: This has been fixed in SPARK-11410. > Pass partitioning

[jira] [Resolved] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

2015-11-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4849. Resolution: Fixed Assignee: Nong Li Fix Version/s: 1.6.0 > Pass partitioning

[jira] [Commented] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990172#comment-14990172 ] Yin Huai commented on SPARK-11500: -- cc [~lian cheng] > Not deterministic order of columns when using

[jira] [Commented] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989211#comment-14989211 ] Sean Owen commented on SPARK-11484: --- Yeah, the PR is what I'm really looking for. I thought there had

[jira] [Commented] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989273#comment-14989273 ] Yanbo Liang commented on SPARK-11494: - I think we should support R-like summary statistics with

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989276#comment-14989276 ] Sean Owen commented on SPARK-11472: --- What would you like to see changed in the docs? they're correct,

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2015-11-04 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989280#comment-14989280 ] Iulian Dragos commented on SPARK-11327: --- I think this is related to (possibly a duplicate of)

[jira] [Comment Edited] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989273#comment-14989273 ] Yanbo Liang edited comment on SPARK-11494 at 11/4/15 10:34 AM: --- I think we

[jira] [Updated] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2960: - Assignee: Saisai Shao > Spark executables fail to start via symlinks >

[jira] [Resolved] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2960. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8669

[jira] [Updated] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11442: -- Assignee: Ted Yu > Reduce numSlices for local metrics test of SparkListenerSuite >

[jira] [Resolved] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11442. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9384

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 10:54 AM: It is

[jira] [Commented] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989325#comment-14989325 ] Hyukjin Kwon commented on SPARK-11500: -- It is non-deterministic and also incorrect in the output,

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 10:59 AM: It is

[jira] [Updated] (SPARK-11498) TreeNodeException under very special condition

2015-11-04 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-11498: Description: {code:title=/tmp/bug.py} from pyspark import SparkContext from pyspark.sql import

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 11:03 AM: It is

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989353#comment-14989353 ] Apache Spark commented on SPARK-10946: -- User 'somideshmukh' has created a pull request for this

[jira] [Assigned] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10946: Assignee: Apache Spark > JDBC - Use Statement.executeUpdate instead of

[jira] [Assigned] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10946: Assignee: (was: Apache Spark) > JDBC - Use Statement.executeUpdate instead of

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989356#comment-14989356 ] somil deshmukh commented on SPARK-10946: https://github.com/apache/spark/pull/9465 here is new

[jira] [Commented] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989368#comment-14989368 ] Apache Spark commented on SPARK-11265: -- User 'steveloughran' has created a pull request for this

<    1   2   3