[jira] [Resolved] (SPARK-10180) JDBCRDD does not process EqualNullSafe filter.

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10180. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > JDBCRDD does not

[jira] [Commented] (SPARK-12421) Fix copy() method of GenericRow

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076501#comment-15076501 ] Apache Spark commented on SPARK-12421: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Reopened] (SPARK-12601) worker output a large number of log when size RollingPolicy shouldRollover method use loginfo

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12601: --- > worker output a large number of log when size RollingPolicy shouldRollover > method use loginfo >

[jira] [Resolved] (SPARK-12601) worker output a large number of log when size RollingPolicy shouldRollover method use loginfo

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12601. --- Resolution: Invalid Fix Version/s: (was: 1.6.1) (was:

[jira] [Updated] (SPARK-12604) Java count(AprroxDistinct)ByKey methods return Scala Long not Java

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12604: -- Description: Another minor API problem I noticed while digging around. The following Java API methods

[jira] [Resolved] (SPARK-12481) Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12481. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10446

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12582: Assignee: Apache Spark (was: yucai) > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12582: Assignee: yucai (was: Apache Spark) > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Updated] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12546: -- Component/s: SQL > Writing to partitioned parquet table can fail with OOM >

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Commented] (SPARK-8555) Online Variational Inference for the Hierarchical Dirichlet Process

2016-01-02 Thread Tu Dinh Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076492#comment-15076492 ] Tu Dinh Nguyen commented on SPARK-8555: --- Oh, I see. Thank you for pointing this out! > Online

[jira] [Updated] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12334: -- Target Version/s: (was: 1.6.1) > Support read from multiple input paths for orc file in

[jira] [Updated] (SPARK-11259) Params.validateParams() should be called automatically

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11259: -- Target Version/s: (was: 1.6.1) Priority: Minor (was: Major) Issue Type:

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8447: - Target Version/s: (was: 1.6.1) > Test external shuffle service with all shuffle managers >

[jira] [Updated] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11834: -- Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Ignore thresholds in LogisticRegression and update

[jira] [Updated] (SPARK-529) Have a single file that controls the environmental variables and spark config options

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-529: Priority: Major Component/s: Spark Core > Have a single file that controls the environmental

[jira] [Updated] (SPARK-12586) Wrong answer with registerTempTable and union sql query

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12586: -- Component/s: SQL > Wrong answer with registerTempTable and union sql query >

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11262: -- Target Version/s: (was: 1.6.1, 2.0.0) > Unit test for gradient, loss layers, memory management for

[jira] [Updated] (SPARK-12286) Support UnsafeRow in all SparkPlan (if possible)

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12286: -- Fix Version/s: (was: 2.0.0) > Support UnsafeRow in all SparkPlan (if possible) >

[jira] [Reopened] (SPARK-12601) worker output a large number of log when size RollingPolicy shouldRollover method use loginfo

2016-01-02 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang reopened SPARK-12601: please check this issue need repair > worker output a large number of log when size RollingPolicy

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2016-01-02 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076510#comment-15076510 ] Cazen Lee commented on SPARK-12537: --- Happy New Year! The situation seemed to require further discussion

[jira] [Updated] (SPARK-12598) Bug in setMinPartitions function of StreamFileInputFormat

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12598: -- Component/s: Spark Core > Bug in setMinPartitions function of StreamFileInputFormat >

[jira] [Commented] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076478#comment-15076478 ] Apache Spark commented on SPARK-12603: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12603: Assignee: Apache Spark > PySpark MLlib GaussianMixtureModel should support single

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Assigned] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12603: Assignee: (was: Apache Spark) > PySpark MLlib GaussianMixtureModel should support

[jira] [Commented] (SPARK-8555) Online Variational Inference for the Hierarchical Dirichlet Process

2016-01-02 Thread Tu Dinh Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076482#comment-15076482 ] Tu Dinh Nguyen commented on SPARK-8555: --- Hi Sean, Thank you for you reply! Would you mind if I ask

[jira] [Assigned] (SPARK-12598) Bug in setMinPartitions function of StreamFileInputFormat

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12598: Assignee: (was: Apache Spark) > Bug in setMinPartitions function of

[jira] [Commented] (SPARK-12598) Bug in setMinPartitions function of StreamFileInputFormat

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076509#comment-15076509 ] Apache Spark commented on SPARK-12598: -- User 'datafarmer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12598) Bug in setMinPartitions function of StreamFileInputFormat

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12598: Assignee: Apache Spark > Bug in setMinPartitions function of StreamFileInputFormat >

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Description: PySpark MLlib GaussianMixtureModel should support single instance

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Summary: PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12603: Component/s: PySpark > PySpark MLlib GaussianMixtureModel should support single instance >

[jira] [Commented] (SPARK-8555) Online Variational Inference for the Hierarchical Dirichlet Process

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076488#comment-15076488 ] Sean Owen commented on SPARK-8555: -- Have a look at

[jira] [Assigned] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12453: Assignee: (was: Apache Spark) > Spark Streaming Kinesis Example broken due to wrong

[jira] [Assigned] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12453: Assignee: Apache Spark > Spark Streaming Kinesis Example broken due to wrong AWS Java SDK

[jira] [Created] (SPARK-12604) Java countByKey, zipWith*, etc methods return Scala Long not Java

2016-01-02 Thread Sean Owen (JIRA)
Sean Owen created SPARK-12604: - Summary: Java countByKey, zipWith*, etc methods return Scala Long not Java Key: SPARK-12604 URL: https://issues.apache.org/jira/browse/SPARK-12604 Project: Spark

[jira] [Resolved] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8119. -- Resolution: Fixed Target Version/s: (was: 1.4.2) I don't think this will be back-ported to

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8119: - Labels: (was: backport-needed) > HeartbeatReceiver should not adjust application executor resources >

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8447: - Issue Type: Improvement (was: Bug) > Test external shuffle service with all shuffle managers >

[jira] [Resolved] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6197. -- Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: (was: 1.3.2, 1.4.2) >

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6197: - Labels: (was: backport-needed) I don't think this will ever be back-ported to 1.3.x at this point >

[jira] [Created] (SPARK-12603) MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-02 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12603: --- Summary: MLlib GaussianMixtureModel should support single instance predict/predictSoft Key: SPARK-12603 URL: https://issues.apache.org/jira/browse/SPARK-12603 Project:

[jira] [Commented] (SPARK-6416) RDD.fold() requires the operator to be commutative

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076474#comment-15076474 ] Sean Owen commented on SPARK-6416: -- That's an interesting example, in that I wouldn't have though the 3rd

[jira] [Closed] (SPARK-12597) Use udf to replace callUDF for ML

2016-01-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-12597. --- Resolution: Duplicate > Use udf to replace callUDF for ML > - > >

[jira] [Commented] (SPARK-12604) Java count(AprroxDistinct)ByKey methods return Scala Long not Java

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076513#comment-15076513 ] Apache Spark commented on SPARK-12604: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12604) Java count(AprroxDistinct)ByKey methods return Scala Long not Java

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12604: Assignee: Sean Owen (was: Apache Spark) > Java count(AprroxDistinct)ByKey methods return

[jira] [Assigned] (SPARK-12604) Java count(AprroxDistinct)ByKey methods return Scala Long not Java

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12604: Assignee: Apache Spark (was: Sean Owen) > Java count(AprroxDistinct)ByKey methods return

[jira] [Updated] (SPARK-12478) Dataset fields of product types can't be null

2016-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12478: -- Target Version/s: 1.6.1, 2.0.0 (was: 2.0.0) > Dataset fields of product types can't be null >

[jira] [Commented] (SPARK-12578) Parser should not silently ignore the distinct keyword used in an aggregate function when OVER clause is used

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076631#comment-15076631 ] Apache Spark commented on SPARK-12578: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12578) Parser should not silently ignore the distinct keyword used in an aggregate function when OVER clause is used

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12578: Assignee: (was: Apache Spark) > Parser should not silently ignore the distinct

[jira] [Assigned] (SPARK-12578) Parser should not silently ignore the distinct keyword used in an aggregate function when OVER clause is used

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12578: Assignee: Apache Spark > Parser should not silently ignore the distinct keyword used in

[jira] [Commented] (SPARK-10963) Make KafkaCluster api public

2016-01-02 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076536#comment-15076536 ] Cody Koeninger commented on SPARK-10963: There's a nonzero chance that the 0.9 integration will

[jira] [Assigned] (SPARK-12605) Pushing Join Predicates Through Union All

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12605: Assignee: (was: Apache Spark) > Pushing Join Predicates Through Union All >

[jira] [Commented] (SPARK-12605) Pushing Join Predicates Through Union All

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076595#comment-15076595 ] Apache Spark commented on SPARK-12605: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12605) Pushing Join Predicates Through Union All

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12605: Assignee: Apache Spark > Pushing Join Predicates Through Union All >

[jira] [Issue Comment Deleted] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

2016-01-02 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-7683: -- Comment: was deleted (was: [~srowen] Do you have any example how it could break

[jira] [Commented] (SPARK-12528) Make Apache Spark’s gateway hidden REST API (in standalone cluster mode) public API

2016-01-02 Thread Jim Lohse (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076572#comment-15076572 ] Jim Lohse commented on SPARK-12528: --- This PR is relevant:

[jira] [Created] (SPARK-12605) Pushing Join Predicates Through Union All

2016-01-02 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12605: --- Summary: Pushing Join Predicates Through Union All Key: SPARK-12605 URL: https://issues.apache.org/jira/browse/SPARK-12605 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12606) Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ?

2016-01-02 Thread Andrew Davidson (JIRA)
Andrew Davidson created SPARK-12606: --- Summary: Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ? Key: SPARK-12606 URL:

[jira] [Commented] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

2016-01-02 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076650#comment-15076650 ] Maciej Szymkiewicz commented on SPARK-7683: --- [~srowen] Do you have any example how it could

[jira] [Updated] (SPARK-12602) Join Reordering: Pushing Inner Join Through Outer Join

2016-01-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12602: Description: If applicable, we can push Inner Join through Outer Join. The basic idea is built on the

[jira] [Commented] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076684#comment-15076684 ] Apache Spark commented on SPARK-10359: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-6416) RDD.fold() requires the operator to be commutative

2016-01-02 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076704#comment-15076704 ] Mark Hamstra commented on SPARK-6416: - I still don't see RDD#fold as being out of bounds with what

[jira] [Commented] (SPARK-10963) Make KafkaCluster api public

2016-01-02 Thread Youcef HILEM (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076669#comment-15076669 ] Youcef HILEM commented on SPARK-10963: -- Cloudera Oryx project uses KafkaCluster API :

[jira] [Created] (SPARK-12607) spark-class produced null command strings for "exec"

2016-01-02 Thread SM Wang (JIRA)
SM Wang created SPARK-12607: --- Summary: spark-class produced null command strings for "exec" Key: SPARK-12607 URL: https://issues.apache.org/jira/browse/SPARK-12607 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12528) Make Apache Spark’s gateway hidden REST API (in standalone cluster mode) public API

2016-01-02 Thread Youcef HILEM (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076662#comment-15076662 ] Youcef HILEM commented on SPARK-12528: -- You mean : This PR is relevant:

[jira] [Assigned] (SPARK-12579) User-specified JDBC driver should always take precedence

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12579: Assignee: Josh Rosen (was: Apache Spark) > User-specified JDBC driver should always take

[jira] [Assigned] (SPARK-12579) User-specified JDBC driver should always take precedence

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12579: Assignee: Apache Spark (was: Josh Rosen) > User-specified JDBC driver should always take

[jira] [Resolved] (SPARK-12599) Remove the use of the deprecated callUDF in MLlib

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12599. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove the use of the deprecated callUDF in

[jira] [Updated] (SPARK-12597) Use udf to replace callUDF for ML

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12597: Fix Version/s: 2.0.0 > Use udf to replace callUDF for ML > - > >

[jira] [Commented] (SPARK-12600) Remove deprecated methods in SQL / DataFrames

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076772#comment-15076772 ] Apache Spark commented on SPARK-12600: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-12608) Remove submitJobThreadPool since submitJob doesn't create a separate thread to wait for the job result

2016-01-02 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12608: Summary: Remove submitJobThreadPool since submitJob doesn't create a separate thread to wait for the job result Key: SPARK-12608 URL:

[jira] [Assigned] (SPARK-12608) Remove submitJobThreadPool since submitJob doesn't create a separate thread to wait for the job result

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12608: Assignee: (was: Apache Spark) > Remove submitJobThreadPool since submitJob doesn't

[jira] [Commented] (SPARK-12608) Remove submitJobThreadPool since submitJob doesn't create a separate thread to wait for the job result

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076777#comment-15076777 ] Apache Spark commented on SPARK-12608: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12608) Remove submitJobThreadPool since submitJob doesn't create a separate thread to wait for the job result

2016-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12608: Assignee: Apache Spark > Remove submitJobThreadPool since submitJob doesn't create a

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076769#comment-15076769 ] Reynold Xin commented on SPARK-12537: - I don't really care as much whether the default value should

[jira] [Commented] (SPARK-12286) Support UnsafeRow in all SparkPlan (if possible)

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076770#comment-15076770 ] Reynold Xin commented on SPARK-12286: - [~davies] can you close the rest if they no longer apply?

[jira] [Resolved] (SPARK-12286) Support UnsafeRow in all SparkPlan (if possible)

2016-01-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12286. - Resolution: Fixed Fix Version/s: 2.0.0 > Support UnsafeRow in all SparkPlan (if possible)