[jira] [Comment Edited] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-12-07 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010353#comment-15010353 ] hujiayin edited comment on SPARK-4036 at 12/7/15 8:10 AM: -- Hi Sas

[jira] [Resolved] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

2015-12-07 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12106. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > Flaky Test: Ba

[jira] [Created] (SPARK-12175) Add new flag to Spark that identify if the driver run on application servers.

2015-12-07 Thread Sasi (JIRA)
Sasi created SPARK-12175: Summary: Add new flag to Spark that identify if the driver run on application servers. Key: SPARK-12175 URL: https://issues.apache.org/jira/browse/SPARK-12175 Project: Spark

[jira] [Resolved] (SPARK-12175) Add new flag to Spark that identify if the driver run on application servers.

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12175. --- Resolution: Duplicate [~sasi2103] this is the same issue that you already opened. Please just keep t

[jira] [Commented] (SPARK-12175) Add new flag to Spark that identify if the driver run on application servers.

2015-12-07 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044624#comment-15044624 ] Sasi commented on SPARK-12175: -- Are you guys think of fix it or added implemented for such c

[jira] [Created] (SPARK-12176) SparkLauncher's setConf() does not support configs with spaces in their typing

2015-12-07 Thread Yuhang Chen (JIRA)
Yuhang Chen created SPARK-12176: --- Summary: SparkLauncher's setConf() does not support configs with spaces in their typing Key: SPARK-12176 URL: https://issues.apache.org/jira/browse/SPARK-12176 Project:

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Summary: SparkLauncher's setConf() does not support configs containing spaces (was: SparkLauncher'

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Flags: Important > SparkLauncher's setConf() does not support configs containing spaces > -

[jira] [Commented] (SPARK-12175) Add new flag to Spark that identify if the driver run on application servers.

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044640#comment-15044640 ] Sean Owen commented on SPARK-12175: --- [~sasi2103] I don't know that this is something to

[jira] [Commented] (SPARK-12175) Add new flag to Spark that identify if the driver run on application servers.

2015-12-07 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044644#comment-15044644 ] Sasi commented on SPARK-12175: -- Yes my driver runs on JBoss. I search same issues, and the f

[jira] [Commented] (SPARK-12124) Spark Sql MongoDB Cross Join Not Working

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044653#comment-15044653 ] Sean Owen commented on SPARK-12124: --- [~himanshu.techsk...@gmail.com] are you using this

[jira] [Commented] (SPARK-11938) Expose numFeatures in all ML PredictionModel for PySpark

2015-12-07 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044673#comment-15044673 ] Kai Sasaki commented on SPARK-11938: [~mengxr] [~yanboliang] Sorry for bothering you,

[jira] [Issue Comment Deleted] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-07 Thread R. H. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] R. H. updated SPARK-12048: -- Comment: was deleted (was: Thanks for including that fix so fast. I have just tested to fix in the master succ

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-07 Thread R. H. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044697#comment-15044697 ] R. H. commented on SPARK-12048: --- Thanks for including that fix so fast. I have just tested

[jira] [Closed] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-07 Thread R. H. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] R. H. closed SPARK-12048. - Thanks for including that fix so fast. I have just tested to fix in the master successfully. > JDBCRDD calls close(

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Fix Version/s: (was: 1.4.2) > KafkaUtils createStream with multiple topics -- does not work as expe

[jira] [Commented] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-07 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044726#comment-15044726 ] Sasi commented on SPARK-12162: -- Yes my driver runs on JBoss. > Embedded Spark on JBoss serv

[jira] [Created] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Nikita Tarasenko (JIRA)
Nikita Tarasenko created SPARK-12177: Summary: Update KafkaDStreams to new Kafka 0.9 Consumer API Key: SPARK-12177 URL: https://issues.apache.org/jira/browse/SPARK-12177 Project: Spark Is

[jira] [Assigned] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12177: Assignee: (was: Apache Spark) > Update KafkaDStreams to new Kafka 0.9 Consumer API > -

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044799#comment-15044799 ] Apache Spark commented on SPARK-12177: -- User 'ntarasenko' has created a pull request

[jira] [Assigned] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12177: Assignee: Apache Spark > Update KafkaDStreams to new Kafka 0.9 Consumer API >

[jira] [Created] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

2015-12-07 Thread Rodrigo Boavida (JIRA)
Rodrigo Boavida created SPARK-12178: --- Summary: Expose reporting of StreamInputInfo for custom made streams Key: SPARK-12178 URL: https://issues.apache.org/jira/browse/SPARK-12178 Project: Spark

[jira] [Commented] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044829#comment-15044829 ] Sean Owen commented on SPARK-12178: --- What is the use case for this? > Expose reporting

[jira] [Closed] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Nikita Tarasenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Tarasenko closed SPARK-12177. Resolution: Later This kind of change would have to wait for Spark 2.x. > Update KafkaDStr

[jira] [Reopened] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12177: --- This can stay open as an item targeted for 2.0.0. Your PR can stay closed for now but can be revived lat

[jira] [Updated] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12177: -- Target Version/s: 2.0.0 > Update KafkaDStreams to new Kafka 0.9 Consumer API >

[jira] [Commented] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

2015-12-07 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044846#comment-15044846 ] Rodrigo Boavida commented on SPARK-12178: - For any new implementation of a custom

[jira] [Commented] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

2015-12-07 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044850#comment-15044850 ] Rodrigo Boavida commented on SPARK-12178: - This is probably the first step onto t

[jira] [Commented] (SPARK-9184) spark.task.cpus under Mesos should accept floating point numbers (partial CPU)

2015-12-07 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044851#comment-15044851 ] Brandon Bradley commented on SPARK-9184: Hello! Can we have some discussion? We c

[jira] [Updated] (SPARK-9184) spark.task.cpus under Mesos should accept floating point numbers (partial CPU)

2015-12-07 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Bradley updated SPARK-9184: --- Priority: Major (was: Minor) > spark.task.cpus under Mesos should accept floating point numbe

[jira] [Created] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
Tao Li created SPARK-12179: -- Summary: Spark SQL get different result with the same code Key: SPARK-12179 URL: https://issues.apache.org/jira/browse/SPARK-12179 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Description: I run the sql in yarn-client mode, but get different result each time. As you can see the examp

[jira] [Updated] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Description: I run the sql in yarn-client mode, but get different result each time. As you can see the examp

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044864#comment-15044864 ] Tao Li commented on SPARK-12179: [~liancheng] [~sowen ][~andrewor14] [~rxin] > Spark SQL

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: [~liancheng] [~sowen ][~andrewor14] [~rxin]) > Spark SQL get different result wit

[jira] [Updated] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12179: -- Priority: Minor (was: Major) What's the problem here? you're not actually getting different *query* re

[jira] [Commented] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044996#comment-15044996 ] Apache Spark commented on SPARK-7727: - User 'stephankessler' has created a pull reques

[jira] [Commented] (SPARK-12124) Spark Sql MongoDB Cross Join Not Working

2015-12-07 Thread himanshu singhal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045008#comment-15045008 ] himanshu singhal commented on SPARK-12124: -- I am using the hadoop mongo dependen

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045010#comment-15045010 ] Tao Li commented on SPARK-12179: [~srowen] In this case, there is no task failures and I

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045012#comment-15045012 ] Tao Li commented on SPARK-12179: In the same stage with the same shuffle read, I think it

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045014#comment-15045014 ] Tao Li commented on SPARK-12179: [~sowen] My sql and command line param is like this: DA

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045015#comment-15045015 ] Sean Owen commented on SPARK-12179: --- I don't see that you've shown results at all. What

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045024#comment-15045024 ] Tao Li commented on SPARK-12179: For example: 1. First Time Run, I got: 20151204main

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045028#comment-15045028 ] Sean Owen commented on SPARK-12179: --- Yes, that's the critical information. I think it's

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045053#comment-15045053 ] Tao Li commented on SPARK-12179: The query is on a hive table and the hive data is not ch

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045053#comment-15045053 ] Tao Li edited comment on SPARK-12179 at 12/7/15 3:21 PM: - The que

[jira] [Created] (SPARK-12180) DataFrame.join() in PySpark gives misleading exception when column name exists on both side

2015-12-07 Thread Daniel Thomas (JIRA)
Daniel Thomas created SPARK-12180: - Summary: DataFrame.join() in PySpark gives misleading exception when column name exists on both side Key: SPARK-12180 URL: https://issues.apache.org/jira/browse/SPARK-12180

[jira] [Comment Edited] (SPARK-8855) Python API for Association Rules

2015-12-07 Thread Caique Rodrigues Marques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037211#comment-15037211 ] Caique Rodrigues Marques edited comment on SPARK-8855 at 12/7/15 4:10 PM: --

[jira] [Commented] (SPARK-5095) Support launching multiple mesos executors in coarse grained mesos mode

2015-12-07 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045281#comment-15045281 ] YONG FENG commented on SPARK-5095: -- My team is now working on [MESOS-938]. After that, we

[jira] [Created] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Ted Yu (JIRA)
Ted Yu created SPARK-12181: -- Summary: Check Cached unaligned-access capability before using Unsafe Key: SPARK-12181 URL: https://issues.apache.org/jira/browse/SPARK-12181 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045309#comment-15045309 ] Ted Yu commented on SPARK-12181: We can add method to Platform which performs check on th

[jira] [Commented] (SPARK-7101) Spark SQL should support java.sql.Time

2015-12-07 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045318#comment-15045318 ] kevin yu commented on SPARK-7101: - I will work on this. > Spark SQL should support java.s

[jira] [Commented] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

2015-12-07 Thread Justin Bailey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045325#comment-15045325 ] Justin Bailey commented on SPARK-8118: -- Did some research and Parquet uses java.util.

[jira] [Commented] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

2015-12-07 Thread Jerry Lam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045354#comment-15045354 ] Jerry Lam commented on SPARK-8118: -- Hi Justin, thanks for sharing this. Do you know if yo

[jira] [Commented] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

2015-12-07 Thread Justin Bailey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045363#comment-15045363 ] Justin Bailey commented on SPARK-8118: -- I didn't know about that option but I bet it

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6518: - Shepherd: Joseph K. Bradley > Add example code and user guide for bisecting k-means >

[jira] [Updated] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-12181: --- Component/s: Spark Core > Check Cached unaligned-access capability before using Unsafe >

[jira] [Commented] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045433#comment-15045433 ] Marcelo Vanzin commented on SPARK-12176: Do you have a code example and environme

[jira] [Resolved] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-12-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12032. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10073 [https://github.

[jira] [Updated] (SPARK-12034) Eliminate warnings in SparkR test cases

2015-12-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12034: -- Assignee: Sun Rui > Eliminate warnings in SparkR test cases > -

[jira] [Resolved] (SPARK-12034) Eliminate warnings in SparkR test cases

2015-12-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12034. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12132) Cltr-C should clear current line in pyspark shell

2015-12-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12132. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull reque

[jira] [Resolved] (SPARK-11932) trackStateByKey throws java.lang.IllegalArgumentException: requirement failed on restarting from checkpoint

2015-12-07 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11932. --- Resolution: Fixed Fix Version/s: 1.6.0 > trackStateByKey throws java.lang.IllegalArgum

[jira] [Resolved] (SPARK-10232) Decide whether spark.ml Decision Tree and Random Forest can replace spark.mllib implementation

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10232. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: (was: ) I

[jira] [Updated] (SPARK-7131) Move tree,forest implementation from spark.mllib to spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7131: - Description: We want to change and improve the spark.ml API for trees and ensembles, but w

[jira] [Commented] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045556#comment-15045556 ] Apache Spark commented on SPARK-12181: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12181: Assignee: Apache Spark > Check Cached unaligned-access capability before using Unsafe > --

[jira] [Assigned] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12181: Assignee: (was: Apache Spark) > Check Cached unaligned-access capability before using

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-12-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1504#comment-1504 ] Michael Armbrust commented on SPARK-12045: -- Our general policy for exceptions is

[jira] [Updated] (SPARK-7131) Move tree,forest implementation from spark.mllib to spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7131: - Description: We want to change and improve the spark.ml API for trees and ensembles, but w

[jira] [Commented] (SPARK-7131) Move tree,forest implementation from spark.mllib to spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045546#comment-15045546 ] Joseph K. Bradley commented on SPARK-7131: -- Thanks for pinging! I think I lost t

[jira] [Created] (SPARK-12183) Remove spark.mllib tree, forest implementations and use spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-12183: - Summary: Remove spark.mllib tree, forest implementations and use spark.ml Key: SPARK-12183 URL: https://issues.apache.org/jira/browse/SPARK-12183 Project: S

[jira] [Created] (SPARK-12182) Distributed binning for trees in spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-12182: - Summary: Distributed binning for trees in spark.ml Key: SPARK-12182 URL: https://issues.apache.org/jira/browse/SPARK-12182 Project: Spark Issue Typ

[jira] [Commented] (SPARK-7131) Move tree,forest implementation from spark.mllib to spark.ml

2015-12-07 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045559#comment-15045559 ] Seth Hendrickson commented on SPARK-7131: - Great. I'd love to take a crack at step

[jira] [Commented] (SPARK-12183) Remove spark.mllib tree, forest implementations and use spark.ml

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045564#comment-15045564 ] Joseph K. Bradley commented on SPARK-12183: --- [~sethah] Feel free to work on thi

[jira] [Resolved] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

2015-12-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12060. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: (was: 1.6.0) > Avoi

[jira] [Resolved] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

2015-12-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12101. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 > Fix thread pools that

[jira] [Created] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Andrew Ray (JIRA)
Andrew Ray created SPARK-12184: -- Summary: Make python api doc for pivot consistant with scala doc Key: SPARK-12184 URL: https://issues.apache.org/jira/browse/SPARK-12184 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12184: Assignee: (was: Apache Spark) > Make python api doc for pivot consistant with scala do

[jira] [Commented] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045613#comment-15045613 ] Apache Spark commented on SPARK-12184: -- User 'aray' has created a pull request for t

[jira] [Assigned] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12184: Assignee: Apache Spark > Make python api doc for pivot consistant with scala doc > ---

[jira] [Updated] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-12181: --- Attachment: spark-12181.txt > Check Cached unaligned-access capability before using Unsafe >

[jira] [Commented] (SPARK-12074) Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045642#comment-15045642 ] Apache Spark commented on SPARK-12074: -- User 'tedyu' has created a pull request for

[jira] [Created] (SPARK-12185) Add Histogram support to Spark SQL/DataFrames

2015-12-07 Thread holdenk (JIRA)
holdenk created SPARK-12185: --- Summary: Add Histogram support to Spark SQL/DataFrames Key: SPARK-12185 URL: https://issues.apache.org/jira/browse/SPARK-12185 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10393) use ML pipeline in LDA example

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10393: -- Shepherd: Joseph K. Bradley Assignee: yuhao yang Component/s: Examples >

[jira] [Commented] (SPARK-12185) Add Histogram support to Spark SQL/DataFrames

2015-12-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045665#comment-15045665 ] holdenk commented on SPARK-12185: - Possibly related too https://issues.apache.org/jira/br

[jira] [Commented] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045703#comment-15045703 ] Apache Spark commented on SPARK-11937: -- User 'holdenk' has created a pull request fo

[jira] [Issue Comment Deleted] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11937: -- Comment: was deleted (was: User 'holdenk' has created a pull request for this issue: ht

[jira] [Assigned] (SPARK-10509) Excessive param boiler plate code

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10509: Assignee: Apache Spark > Excessive param boiler plate code > -

[jira] [Commented] (SPARK-10509) Excessive param boiler plate code

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045707#comment-15045707 ] Apache Spark commented on SPARK-10509: -- User 'holdenk' has created a pull request fo

[jira] [Commented] (SPARK-11520) RegressionMetrics should support instance weights

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045704#comment-15045704 ] Joseph K. Bradley commented on SPARK-11520: --- Working towards it! But we need t

[jira] [Assigned] (SPARK-10509) Excessive param boiler plate code

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10509: Assignee: (was: Apache Spark) > Excessive param boiler plate code > --

[jira] [Commented] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit"

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045713#comment-15045713 ] Joseph K. Bradley commented on SPARK-4846: -- This sounds like a limitation of usin

[jira] [Commented] (SPARK-11964) Create user guide section explaining export/import

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045718#comment-15045718 ] Joseph K. Bradley commented on SPARK-11964: --- No, if they are not resolved by no

[jira] [Commented] (SPARK-11964) Create user guide section explaining export/import

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045740#comment-15045740 ] Apache Spark commented on SPARK-11964: -- User 'anabranch' has created a pull request

[jira] [Assigned] (SPARK-11964) Create user guide section explaining export/import

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11964: Assignee: Apache Spark > Create user guide section explaining export/import >

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045741#comment-15045741 ] Apache Spark commented on SPARK-6725: - User 'anabranch' has created a pull request for

[jira] [Assigned] (SPARK-11964) Create user guide section explaining export/import

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11964: Assignee: (was: Apache Spark) > Create user guide section explaining export/import > -

[jira] [Resolved] (SPARK-11963) User guide section for QuantileDiscretizer transformer

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11963. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9962 [ht

  1   2   3   >