[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Description: Running the following code (in Zeppelin, or spark-shell), I get different results,

[jira] [Created] (SPARK-20493) De-deuplicate parse logics for DDL-like type string in R

2017-04-27 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-20493: Summary: De-deuplicate parse logics for DDL-like type string in R Key: SPARK-20493 URL: https://issues.apache.org/jira/browse/SPARK-20493 Project: Spark

[jira] [Updated] (SPARK-20493) De-deuplicate parse logics for DDL-like type string in R

2017-04-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20493: - Description: It seems we are using SQLUtils.getSQLDataType[1] for type string in structField.

[jira] [Assigned] (SPARK-20490) Add eqNullSafe, not and ! to SparkR

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20490: Assignee: Apache Spark > Add eqNullSafe, not and ! to SparkR >

[jira] [Assigned] (SPARK-20490) Add eqNullSafe, not and ! to SparkR

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20490: Assignee: (was: Apache Spark) > Add eqNullSafe, not and ! to SparkR >

[jira] [Created] (SPARK-20492) Do not print empty parentheses for invalid primitive types in parser

2017-04-27 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-20492: Summary: Do not print empty parentheses for invalid primitive types in parser Key: SPARK-20492 URL: https://issues.apache.org/jira/browse/SPARK-20492 Project: Spark

[jira] [Commented] (SPARK-20492) Do not print empty parentheses for invalid primitive types in parser

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986768#comment-15986768 ] Apache Spark commented on SPARK-20492: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-20490) Add eqNullSafe, not and ! to SparkR

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986689#comment-15986689 ] Apache Spark commented on SPARK-20490: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20492) Do not print empty parentheses for invalid primitive types in parser

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20492: Assignee: (was: Apache Spark) > Do not print empty parentheses for invalid primitive

[jira] [Assigned] (SPARK-20492) Do not print empty parentheses for invalid primitive types in parser

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20492: Assignee: Apache Spark > Do not print empty parentheses for invalid primitive types in

[jira] [Commented] (SPARK-20493) De-deuplicate parse logics for DDL-like type string in R

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986818#comment-15986818 ] Apache Spark commented on SPARK-20493: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-20493) De-deuplicate parse logics for DDL-like type string in R

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20493: Assignee: (was: Apache Spark) > De-deuplicate parse logics for DDL-like type string

[jira] [Assigned] (SPARK-20493) De-deuplicate parse logics for DDL-like type string in R

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20493: Assignee: Apache Spark > De-deuplicate parse logics for DDL-like type string in R >

[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-27 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986101#comment-15986101 ] Miao Wang commented on SPARK-20478: --- R programming guide and vignettes have linear svm document. What

[jira] [Commented] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

2017-04-27 Thread Jiasheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986378#comment-15986378 ] Jiasheng Wang commented on SPARK-19688: --- [~jerryshao] In yarn-cluster mode,

[jira] [Commented] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986093#comment-15986093 ] Apache Spark commented on SPARK-20476: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986153#comment-15986153 ] Felix Cheung commented on SPARK-20478: -- where in

[jira] [Commented] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-27 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986072#comment-15986072 ] Miao Wang commented on SPARK-20477: --- OK. I will add it. > Document R bisecting k-means in R

[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-27 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986071#comment-15986071 ] Miao Wang commented on SPARK-20478: --- OK. I will add it. > Document LinearSVC in R programming guide >

[jira] [Updated] (SPARK-20488) how to create a dataframe or dataset in a streaming context spark 2.1.0 on mesos 1.0,1

2017-04-27 Thread SiddharthRam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SiddharthRam updated SPARK-20488: - Description: Please suggest the right way below is one attempt from my end : i`m using spark

[jira] [Updated] (SPARK-20312) query optimizer calls udf with null values when it doesn't expect them

2017-04-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-20312: - Fix Version/s: 2.3.0 2.2.0 2.1.1 > query optimizer

[jira] [Commented] (SPARK-20312) query optimizer calls udf with null values when it doesn't expect them

2017-04-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986189#comment-15986189 ] Takeshi Yamamuro commented on SPARK-20312: -- I checked there was no issue in the current master.

[jira] [Closed] (SPARK-20312) query optimizer calls udf with null values when it doesn't expect them

2017-04-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-20312. Resolution: Fixed > query optimizer calls udf with null values when it doesn't expect them

[jira] [Assigned] (SPARK-20075) Support classifier, packaging in Maven coordinates

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20075: - Assignee: (was: Sean Owen) > Support classifier, packaging in Maven coordinates >

[jira] [Resolved] (SPARK-20488) how to create a dataframe or dataset in a streaming context spark 2.1.0 on mesos 1.0,1

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20488. --- Resolution: Invalid Please ask questions on u...@spark.apache.org > how to create a dataframe or

[jira] [Closed] (SPARK-20468) Refactor the ALS code

2017-04-27 Thread Daniel Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Li closed SPARK-20468. - Resolution: Won't Fix > Refactor the ALS code > - > > Key:

[jira] [Commented] (SPARK-20468) Refactor the ALS code

2017-04-27 Thread Daniel Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986259#comment-15986259 ] Daniel Li commented on SPARK-20468: --- Great, thanks Sean. How should I go forward with the

[jira] [Created] (SPARK-20488) how to create a dataframe or dataset in a streaming context spark 2.1.0 on mesos 1.0,1

2017-04-27 Thread SiddharthRam (JIRA)
SiddharthRam created SPARK-20488: Summary: how to create a dataframe or dataset in a streaming context spark 2.1.0 on mesos 1.0,1 Key: SPARK-20488 URL: https://issues.apache.org/jira/browse/SPARK-20488

[jira] [Commented] (SPARK-20468) Refactor the ALS code

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986191#comment-15986191 ] Sean Owen commented on SPARK-20468: --- OK, then this should be closed. Documentation is probably always a

[jira] [Commented] (SPARK-20312) query optimizer calls udf with null values when it doesn't expect them

2017-04-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986190#comment-15986190 ] Takeshi Yamamuro commented on SPARK-20312: -- I'll close this because the issue has already been

[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Description: Running the following code (in Zeppelin, but I assume spark-shell would be the

[jira] [Created] (SPARK-20491) Synonym handling replacement issue in Apache Spark

2017-04-27 Thread Nishanth J (JIRA)
Nishanth J created SPARK-20491: -- Summary: Synonym handling replacement issue in Apache Spark Key: SPARK-20491 URL: https://issues.apache.org/jira/browse/SPARK-20491 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20028) Implement NGrams aggregate function

2017-04-27 Thread Chenzhao Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986646#comment-15986646 ] Chenzhao Guo commented on SPARK-20028: -- N-gram is a popular concept in NLP field, while Spark

[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Description: Running the following code (in Zeppelin, or spark-shell), I get different results,

[jira] [Created] (SPARK-20490) Add eqNullSafe, not and ! to SparkR

2017-04-27 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-20490: -- Summary: Add eqNullSafe, not and ! to SparkR Key: SPARK-20490 URL: https://issues.apache.org/jira/browse/SPARK-20490 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20028) Implement NGrams aggregate function

2017-04-27 Thread Chenzhao Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenzhao Guo updated SPARK-20028: - Description: This is the implementation of `ngrams` aggregate expression which is also

[jira] [Created] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
Rick Moritz created SPARK-20489: --- Summary: Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?) Key: SPARK-20489 URL:

[jira] [Commented] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

2017-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986546#comment-15986546 ] Saisai Shao commented on SPARK-19688: - Does this issue exist in the latest master code, from the PR

[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Environment: yarn-client mode in Zeppelin, Cloudera Spark2-distribution (was: yarn-client mode in

[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-27 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Description: Running the following code (in Zeppelin, or spark-shell), I get different results,

[jira] [Commented] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987042#comment-15987042 ] Apache Spark commented on SPARK-20483: -- User 'dgshep' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20483: Assignee: Apache Spark (was: Davis Shepherd) > Mesos Coarse mode may starve other Mesos

[jira] [Assigned] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20483: Assignee: Davis Shepherd (was: Apache Spark) > Mesos Coarse mode may starve other Mesos

[jira] [Created] (SPARK-20494) Implement UDF array_unique in Spark with codegen

2017-04-27 Thread jane (JIRA)
jane created SPARK-20494: Summary: Implement UDF array_unique in Spark with codegen Key: SPARK-20494 URL: https://issues.apache.org/jira/browse/SPARK-20494 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-20494) Implement UDF array_unique in Spark with codegen

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987059#comment-15987059 ] Apache Spark commented on SPARK-20494: -- User 'janewangfb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20494) Implement UDF array_unique in Spark with codegen

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20494: Assignee: (was: Apache Spark) > Implement UDF array_unique in Spark with codegen >

[jira] [Assigned] (SPARK-20494) Implement UDF array_unique in Spark with codegen

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20494: Assignee: Apache Spark > Implement UDF array_unique in Spark with codegen >

[jira] [Created] (SPARK-20495) Add StorageLevel to cacheTable API

2017-04-27 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20495: --- Summary: Add StorageLevel to cacheTable API Key: SPARK-20495 URL: https://issues.apache.org/jira/browse/SPARK-20495 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987273#comment-15987273 ] Apache Spark commented on SPARK-20496: -- User 'anabranch' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20496: Assignee: Apache Spark > KafkaWriter Uses Unanalyzed Logical Plan >

[jira] [Assigned] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20496: Assignee: (was: Apache Spark) > KafkaWriter Uses Unanalyzed Logical Plan >

[jira] [Resolved] (SPARK-20426) OneForOneStreamManager occupies too much memory.

2017-04-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-20426. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 >

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20483: -- Fix Version/s: (was: 3.0.0) (was: 2.2.0) 2.2.1 > Mesos

[jira] [Updated] (SPARK-20426) OneForOneStreamManager occupies too much memory.

2017-04-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-20426: -- Fix Version/s: 2.2.1 > OneForOneStreamManager occupies too much memory. >

[jira] [Commented] (SPARK-20497) Unhelpful error messages when trying to load data from file.

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987441#comment-15987441 ] Sean Owen commented on SPARK-20497: --- What's the NPE? that's an important detail. I'm not clear that's a

[jira] [Updated] (SPARK-15572) ML persistence in R format: compatibility with other languages

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15572: -- Target Version/s: 2.3.0 (was: 2.2.0) > ML persistence in R format: compatibility with

[jira] [Commented] (SPARK-15572) ML persistence in R format: compatibility with other languages

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987592#comment-15987592 ] Joseph K. Bradley commented on SPARK-15572: --- Retargeting since 2.2 has been cut > ML

[jira] [Created] (SPARK-20502) CLONE - ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20502: - Summary: CLONE - ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit Key: SPARK-20502 URL: https://issues.apache.org/jira/browse/SPARK-20502

[jira] [Created] (SPARK-20501) CLONE - ML, Graph 2.1 QA: API: New Scala APIs, docs

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20501: - Summary: CLONE - ML, Graph 2.1 QA: API: New Scala APIs, docs Key: SPARK-20501 URL: https://issues.apache.org/jira/browse/SPARK-20501 Project: Spark

[jira] [Created] (SPARK-20499) Spark MLlib, GraphX 2.2 QA umbrella

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20499: - Summary: Spark MLlib, GraphX 2.2 QA umbrella Key: SPARK-20499 URL: https://issues.apache.org/jira/browse/SPARK-20499 Project: Spark Issue Type:

[jira] [Created] (SPARK-20500) CLONE - ML, Graph 2.1 QA: API: Binary incompatible changes

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20500: - Summary: CLONE - ML, Graph 2.1 QA: API: Binary incompatible changes Key: SPARK-20500 URL: https://issues.apache.org/jira/browse/SPARK-20500 Project: Spark

[jira] [Updated] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-27 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-20496: -- Description: Right now we use the unanalyzed logical plan for writing to Kafka, we should use

[jira] [Updated] (SPARK-20426) OneForOneStreamManager occupies too much memory.

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20426: -- Fix Version/s: (was: 2.2.0) 2.2.1 > OneForOneStreamManager occupies too much

[jira] [Commented] (SPARK-18348) Improve tree ensemble model summary

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987594#comment-15987594 ] Joseph K. Bradley commented on SPARK-18348: --- Retargeting since 2.2 has been cut > Improve tree

[jira] [Updated] (SPARK-18348) Improve tree ensemble model summary

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18348: -- Target Version/s: 2.3.0 (was: 2.2.0) > Improve tree ensemble model summary >

[jira] [Updated] (SPARK-20498) RandomForestRegressionModel should expose getMaxDepth in PySpark

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20498: -- Target Version/s: 2.3.0 (was: 2.2.0) > RandomForestRegressionModel should expose

[jira] [Resolved] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth in R

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-19282. --- Resolution: Fixed Fix Version/s: 2.2.0 > RandomForestRegressionModel should

[jira] [Created] (SPARK-20498) RandomForestRegressionModel should expose getMaxDepth in PySpark

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20498: - Summary: RandomForestRegressionModel should expose getMaxDepth in PySpark Key: SPARK-20498 URL: https://issues.apache.org/jira/browse/SPARK-20498 Project:

[jira] [Updated] (SPARK-20421) Mark JobProgressListener (and related classes) as deprecated

2017-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20421: --- Fix Version/s: (was: 2.2.0) 2.2.1 > Mark JobProgressListener (and

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth in R

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19282: -- Summary: RandomForestRegressionModel should expose getMaxDepth in R (was:

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth in R

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19282: -- Description: Currently it isn't clear hot to get the max depth of a

[jira] [Updated] (SPARK-20498) RandomForestRegressionModel should expose getMaxDepth in PySpark

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20498: -- Component/s: (was: SparkR) > RandomForestRegressionModel should expose getMaxDepth

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth in R

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19282: -- Component/s: (was: PySpark) > RandomForestRegressionModel should expose

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987601#comment-15987601 ] Joseph K. Bradley commented on SPARK-19282: --- Since 2.2 has been cut, I cloned this JIRA to make

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth in R

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19282: -- Description: Currently it isn't clear hot to get the max depth of a

[jira] [Created] (SPARK-20503) CLONE - ML 2.1 QA: API: Python API coverage

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20503: - Summary: CLONE - ML 2.1 QA: API: Python API coverage Key: SPARK-20503 URL: https://issues.apache.org/jira/browse/SPARK-20503 Project: Spark Issue

[jira] [Created] (SPARK-20505) CLONE - ML, Graph 2.1 QA: Update user guide for new features & APIs

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20505: - Summary: CLONE - ML, Graph 2.1 QA: Update user guide for new features & APIs Key: SPARK-20505 URL: https://issues.apache.org/jira/browse/SPARK-20505

[jira] [Updated] (SPARK-20500) ML, Graph 2.2 QA: API: Binary incompatible changes

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20500: -- Target Version/s: 2.2.0 (was: 2.1.0) > ML, Graph 2.2 QA: API: Binary incompatible

[jira] [Updated] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20501: -- Summary: ML, Graph 2.2 QA: API: New Scala APIs, docs (was: CLONE - ML, Graph 2.1 QA:

[jira] [Updated] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20501: -- Target Version/s: (was: 2.1.0) > ML, Graph 2.2 QA: API: New Scala APIs, docs >

[jira] [Created] (SPARK-20507) CLONE - Update MLlib, GraphX websites for 2.1

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20507: - Summary: CLONE - Update MLlib, GraphX websites for 2.1 Key: SPARK-20507 URL: https://issues.apache.org/jira/browse/SPARK-20507 Project: Spark

[jira] [Created] (SPARK-20504) CLONE - ML 2.1 QA: API: Java compatibility, docs

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20504: - Summary: CLONE - ML 2.1 QA: API: Java compatibility, docs Key: SPARK-20504 URL: https://issues.apache.org/jira/browse/SPARK-20504 Project: Spark

[jira] [Created] (SPARK-20506) CLONE - ML, Graph 2.1 QA: Programming guide update and migration guide

2017-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20506: - Summary: CLONE - ML, Graph 2.1 QA: Programming guide update and migration guide Key: SPARK-20506 URL: https://issues.apache.org/jira/browse/SPARK-20506

[jira] [Updated] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15784: -- Target Version/s: 2.3.0 (was: 2.2.0) > Add Power Iteration Clustering to spark.ml >

[jira] [Updated] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15767: -- Target Version/s: 2.3.0 (was: 2.2.0) > Decision Tree Regression wrapper in SparkR >

[jira] [Commented] (SPARK-18618) SparkR GLM model predict should support type as a argument

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987591#comment-15987591 ] Joseph K. Bradley commented on SPARK-18618: --- Retargeting since 2.2 has been cut > SparkR GLM

[jira] [Updated] (SPARK-18618) SparkR GLM model predict should support type as a argument

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18618: -- Target Version/s: 2.3.0 (was: 2.2.0) > SparkR GLM model predict should support type

[jira] [Commented] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987588#comment-15987588 ] Joseph K. Bradley commented on SPARK-15784: --- Retargeting since 2.2 has been cut > Add Power

[jira] [Created] (SPARK-20497) Unhelpful error messages when trying to load data from file.

2017-04-27 Thread Brandon Barker (JIRA)
Brandon Barker created SPARK-20497: -- Summary: Unhelpful error messages when trying to load data from file. Key: SPARK-20497 URL: https://issues.apache.org/jira/browse/SPARK-20497 Project: Spark

[jira] [Updated] (SPARK-20482) Resolving Casts is too strict on having time zone set

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20482: -- Fix Version/s: (was: 2.2.0) 2.2.1 > Resolving Casts is too strict on having

[jira] [Updated] (SPARK-20497) Unhelpful error messages when trying to load data from file.

2017-04-27 Thread Brandon Barker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Barker updated SPARK-20497: --- Description: I'm attempting to do the simple task of reproducing the results from the linear

[jira] [Updated] (SPARK-20426) OneForOneStreamManager occupies too much memory.

2017-04-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-20426: -- Fix Version/s: (was: 2.2.1) > OneForOneStreamManager occupies too much memory. >

[jira] [Updated] (SPARK-18727) Support schema evolution as new files are inserted into table

2017-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18727: -- Target Version/s: (was: 2.2.0) > Support schema evolution as new files are inserted into table >

[jira] [Updated] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20502: -- Summary: ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit (was:

[jira] [Updated] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20502: -- Fix Version/s: (was: 2.1.0) > ML, Graph 2.2 QA: API: Experimental, DeveloperApi,

[jira] [Updated] (SPARK-20503) ML 2.2 QA: API: Python API coverage

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20503: -- Fix Version/s: (was: 2.1.0) > ML 2.2 QA: API: Python API coverage >

[jira] [Assigned] (SPARK-20503) ML 2.2 QA: API: Python API coverage

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-20503: - Assignee: (was: Seth Hendrickson) > ML 2.2 QA: API: Python API coverage >

[jira] [Updated] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20502: -- Target Version/s: 2.2.0 (was: 2.1.0) > ML, Graph 2.2 QA: API: Experimental,

[jira] [Assigned] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-20502: - Assignee: (was: yuhao yang) > ML, Graph 2.2 QA: API: Experimental,

[jira] [Updated] (SPARK-20503) ML 2.2 QA: API: Python API coverage

2017-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20503: -- Summary: ML 2.2 QA: API: Python API coverage (was: CLONE - ML 2.1 QA: API: Python API

  1   2   3   >