[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Created] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11944: --- Summary: Python API for mllib.clustering.BisectingKMeans Key: SPARK-11944 URL: https://issues.apache.org/jira/browse/SPARK-11944 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-11943) Rapidly starting and stopping SparkContexts in local-cluster mode may cause JVM to exit

2015-11-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11943: -- Summary: Rapidly starting and stopping SparkContexts in local-cluster mode may cause JVM to exit Key: SPARK-11943 URL: https://issues.apache.org/jira/browse/SPARK-11943 P

[jira] [Commented] (SPARK-11234) What's cooking classification

2015-11-23 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023916#comment-15023916 ] Xusen Yin commented on SPARK-11234: --- 1. Thanks for pointing it out, it solves the probl

[jira] [Commented] (SPARK-11942) fix encoder life cycle for CoGroup

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023907#comment-15023907 ] Apache Spark commented on SPARK-11942: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11942) fix encoder life cycle for CoGroup

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11942: Assignee: Apache Spark > fix encoder life cycle for CoGroup >

[jira] [Assigned] (SPARK-11942) fix encoder life cycle for CoGroup

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11942: Assignee: (was: Apache Spark) > fix encoder life cycle for CoGroup > -

[jira] [Updated] (SPARK-11942) fix encoder life cycle for CoGroup

2015-11-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-11942: Issue Type: Sub-task (was: Bug) Parent: SPARK- > fix encoder life cycle for CoGroup >

[jira] [Created] (SPARK-11942) fix encoder life cycle for CoGroup

2015-11-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11942: --- Summary: fix encoder life cycle for CoGroup Key: SPARK-11942 URL: https://issues.apache.org/jira/browse/SPARK-11942 Project: Spark Issue Type: Bug Co

[jira] [Resolved] (SPARK-10707) Set operation output columns may have incorrect nullability

2015-11-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10707. - Resolution: Fixed Fix Version/s: 1.6.0 > Set operation output columns may have incorrect n

[jira] [Updated] (SPARK-10707) Set operation output columns may have incorrect nullability

2015-11-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10707: Assignee: Mikhail Bautin (was: Mark Hamstra) > Set operation output columns may have incorrect nul

[jira] [Resolved] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11903. - Resolution: Fixed Assignee: Nicholas Chammas Fix Version/s: 1.7.0 > Deprecate mak

[jira] [Resolved] (SPARK-11933) Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups

2015-11-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11933. - Resolution: Fixed Fix Version/s: 1.6.0 > Rename mapGroup -> mapGroups and flatMapGroup ->

[jira] [Commented] (SPARK-11521) LinearRegressionSummary needs to clarify which metrics are weighted in the documentation

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023842#comment-15023842 ] Apache Spark commented on SPARK-11521: -- User 'jkbradley' has created a pull request

[jira] [Commented] (SPARK-8276) NPE in YarnClientSchedulerBackend.stop

2015-11-23 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023790#comment-15023790 ] Devaraj K commented on SPARK-8276: -- I think it is duplicate of SPARK-8754. > NPE in Yarn

[jira] [Commented] (SPARK-4117) Spark on Yarn handle AM being told command from RM

2015-11-23 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023785#comment-15023785 ] Devaraj K commented on SPARK-4117: -- In YARN, now AM commands(AM_RESYNC, AM_SHUTDOWN) are

[jira] [Created] (SPARK-11941) JSON representation of nested StructTypes is incorrect

2015-11-23 Thread Henri DF (JIRA)
Henri DF created SPARK-11941: Summary: JSON representation of nested StructTypes is incorrect Key: SPARK-11941 URL: https://issues.apache.org/jira/browse/SPARK-11941 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Created] (SPARK-11940) Python API for ml.clustering.LDA

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11940: --- Summary: Python API for ml.clustering.LDA Key: SPARK-11940 URL: https://issues.apache.org/jira/browse/SPARK-11940 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Created] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11939: --- Summary: PySpark support model export/import for Pipeline API Key: SPARK-11939 URL: https://issues.apache.org/jira/browse/SPARK-11939 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-10022) Scala-Python method/parameter inconsistency check for ML during 1.5 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023712#comment-15023712 ] Yanbo Liang edited comment on SPARK-10022 at 11/24/15 3:39 AM:

[jira] [Comment Edited] (SPARK-10022) Scala-Python method/parameter inconsistency check for ML during 1.5 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023712#comment-15023712 ] Yanbo Liang edited comment on SPARK-10022 at 11/24/15 3:36 AM:

[jira] [Commented] (SPARK-10022) Scala-Python method/parameter inconsistency check for ML during 1.5 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023712#comment-15023712 ] Yanbo Liang commented on SPARK-10022: - Close this one, new found issues please link t

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Created] (SPARK-11938) Expose numFeatures in all ML PredictionModel for PySpark

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11938: --- Summary: Expose numFeatures in all ML PredictionModel for PySpark Key: SPARK-11938 URL: https://issues.apache.org/jira/browse/SPARK-11938 Project: Spark Issue

[jira] [Commented] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-11-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023694#comment-15023694 ] yuhao yang commented on SPARK-11602: It's started. I'll finish the API audit today an

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Updated] (SPARK-11815) PySpark DecisionTreeClassifier & DecisionTreeRegressor should support setSeed

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11815: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > PySpark DecisionTreeClassifi

[jira] [Updated] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11923: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > Python API for ml.feature.Ch

[jira] [Comment Edited] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023659#comment-15023659 ] Yanbo Liang edited comment on SPARK-11604 at 11/24/15 3:15 AM:

[jira] [Updated] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11925: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > Add PySpark missing methods

[jira] [Updated] (SPARK-11820) PySpark LiR & LoR should support weightCol

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11820: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > PySpark LiR & LoR should sup

[jira] [Updated] (SPARK-11922) Python API for ml.feature.QuantileDiscretizer

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11922: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > Python API for ml.feature.Q

[jira] [Updated] (SPARK-11875) Update doc for PySpark HasCheckpointInterval

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11875: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11937 > Update doc for PySpark HasCh

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and compa

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues * Inconsistency: * Docs: ** ml.clas

[jira] [Updated] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11937: Description: Here is the todo list of SPARK-11604 found issues: * Inconsistency: * Docs: ** ml.cla

[jira] [Created] (SPARK-11937) Python API coverage check found issues for ML during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11937: --- Summary: Python API coverage check found issues for ML during 1.6 QA Key: SPARK-11937 URL: https://issues.apache.org/jira/browse/SPARK-11937 Project: Spark Is

[jira] [Commented] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023659#comment-15023659 ] Yanbo Liang commented on SPARK-11604: - [~josephkb] Got it. I think I can finish the c

[jira] [Updated] (SPARK-11613) Kinesis ASL should allow caller to set ClientConfiguration for socket timeouts and other connection setting

2015-11-23 Thread Heji Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heji Kim updated SPARK-11613: - Description: Currently the Kinesis ASL does not allow configuration of Kinesis settings such as maxRecor

[jira] [Created] (SPARK-11936) Logs are flooded with HiveMetaStore warnings in 2.0.0-mr1-cdh4.1.2 Jenkins builds

2015-11-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11936: -- Summary: Logs are flooded with HiveMetaStore warnings in 2.0.0-mr1-cdh4.1.2 Jenkins builds Key: SPARK-11936 URL: https://issues.apache.org/jira/browse/SPARK-11936 Project

[jira] [Updated] (SPARK-11613) Kinesis ASL should allow caller to set ClientConfiguration for socket timeouts and other connection settings

2015-11-23 Thread Heji Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heji Kim updated SPARK-11613: - Description: Currently the Kinesis ASL does not allow configuration of connection settings on AmazonKine

[jira] [Assigned] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11686: Assignee: (was: Apache Spark) > Issue WARN when dynamic allocation is disabled due to

[jira] [Assigned] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11686: Assignee: Apache Spark > Issue WARN when dynamic allocation is disabled due to > spark.dy

[jira] [Commented] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023625#comment-15023625 ] Apache Spark commented on SPARK-11686: -- User 'ashwinswaroop' has created a pull requ

[jira] [Commented] (SPARK-7286) Precedence of operator not behaving properly

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023569#comment-15023569 ] Apache Spark commented on SPARK-7286: - User 'jodersky' has created a pull request for

[jira] [Assigned] (SPARK-7286) Precedence of operator not behaving properly

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7286: --- Assignee: Apache Spark > Precedence of operator not behaving properly > -

[jira] [Assigned] (SPARK-7286) Precedence of operator not behaving properly

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7286: --- Assignee: (was: Apache Spark) > Precedence of operator not behaving properly > --

[jira] [Assigned] (SPARK-11521) LinearRegressionSummary needs to clarify which metrics are weighted in the documentation

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-11521: - Assignee: Joseph K. Bradley > LinearRegressionSummary needs to clarify which met

[jira] [Commented] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023538#comment-15023538 ] Joseph K. Bradley commented on SPARK-11604: --- [~yanboliang] What's the status of

[jira] [Commented] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023536#comment-15023536 ] Joseph K. Bradley commented on SPARK-11602: --- Ping: I just wanted to check in on

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023537#comment-15023537 ] Joseph K. Bradley commented on SPARK-11605: --- Ping: I just wanted to check in on

[jira] [Resolved] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10560. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9141 [ht

[jira] [Updated] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10560: -- Target Version/s: 1.6.0 > Make StreamingLogisticRegressionWithSGD Python API equals wit

[jira] [Updated] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10560: -- Assignee: Bryan Cutler > Make StreamingLogisticRegressionWithSGD Python API equals with

[jira] [Resolved] (SPARK-9866) VersionsSuite is unnecessarily slow in Jenkins

2015-11-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9866. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9624 [https://github.com/

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023464#comment-15023464 ] Apache Spark commented on SPARK-11903: -- User 'nchammas' has created a pull request f

[jira] [Assigned] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11903: Assignee: Apache Spark > Deprecate make-distribution.sh --skip-java-test > ---

[jira] [Assigned] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11903: Assignee: (was: Apache Spark) > Deprecate make-distribution.sh --skip-java-test >

[jira] [Assigned] (SPARK-11563) Use RpcEnv to transfer generated classes in spark-shell

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11563: Assignee: (was: Apache Spark) > Use RpcEnv to transfer generated classes in spark-shel

[jira] [Commented] (SPARK-11563) Use RpcEnv to transfer generated classes in spark-shell

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023452#comment-15023452 ] Apache Spark commented on SPARK-11563: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11563) Use RpcEnv to transfer generated classes in spark-shell

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11563: Assignee: Apache Spark > Use RpcEnv to transfer generated classes in spark-shell > ---

[jira] [Closed] (SPARK-10960) SQL with windowing function cannot reference column in inner select block

2015-11-23 Thread David Wong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Wong closed SPARK-10960. -- I can confirm both queries I logged are working in 1.5.2 now. Thanks! > SQL with windowing function cannot

[jira] [Updated] (SPARK-11935) Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

2015-11-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11935: - Component/s: (was: Streaming) PySpark > Send the Python exceptions in Transf

[jira] [Commented] (SPARK-11935) Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023411#comment-15023411 ] Apache Spark commented on SPARK-11935: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11935) Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11935: Assignee: (was: Apache Spark) > Send the Python exceptions in TransformFunction and >

[jira] [Assigned] (SPARK-11935) Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11935: Assignee: Apache Spark > Send the Python exceptions in TransformFunction and > TransformF

[jira] [Commented] (SPARK-11329) Expand Star when creating a struct

2015-11-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023365#comment-15023365 ] Yin Huai commented on SPARK-11329: -- [~maver1ck] What version of spark are you using? If

[jira] [Created] (SPARK-11935) Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

2015-11-23 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11935: Summary: Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java Key: SPARK-11935 URL: https://issues.apache.org/jira/browse/SPARK-11935

[jira] [Commented] (SPARK-11934) [SQL] Adding joinType into joinWith

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023308#comment-15023308 ] Apache Spark commented on SPARK-11934: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-11934) [SQL] Adding joinType into joinWith

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11934: Assignee: Apache Spark > [SQL] Adding joinType into joinWith > --

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023309#comment-15023309 ] Apache Spark commented on SPARK-11569: -- User 'jliwork' has created a pull request fo

[jira] [Assigned] (SPARK-11934) [SQL] Adding joinType into joinWith

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11934: Assignee: (was: Apache Spark) > [SQL] Adding joinType into joinWith > ---

[jira] [Created] (SPARK-11934) [SQL] Adding joinType into joinWith

2015-11-23 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11934: --- Summary: [SQL] Adding joinType into joinWith Key: SPARK-11934 URL: https://issues.apache.org/jira/browse/SPARK-11934 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11894) Incorrect results are returned when using null

2015-11-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11894: - Assignee: Wenchen Fan > Incorrect results are returned when using null >

[jira] [Assigned] (SPARK-11933) Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11933: Assignee: Apache Spark (was: Reynold Xin) > Rename mapGroup -> mapGroups and flatMapGroup

[jira] [Commented] (SPARK-11933) Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023266#comment-15023266 ] Apache Spark commented on SPARK-11933: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11933) Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11933: Assignee: Reynold Xin (was: Apache Spark) > Rename mapGroup -> mapGroups and flatMapGroup

[jira] [Created] (SPARK-11933) Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups

2015-11-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11933: --- Summary: Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups Key: SPARK-11933 URL: https://issues.apache.org/jira/browse/SPARK-11933 Project: Spark

[jira] [Updated] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11847: -- Shepherd: Joseph K. Bradley > Model export/import for spark.ml: LDA > -

[jira] [Updated] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11847: -- Target Version/s: 1.6.0 > Model export/import for spark.ml: LDA > -

[jira] [Commented] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023257#comment-15023257 ] Joseph K. Bradley commented on SPARK-11847: --- Hm, just told by [~mengxr] that he

[jira] [Commented] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023243#comment-15023243 ] Xiao Li commented on SPARK-: Thank you! I think the users might need to understand t

[jira] [Issue Comment Deleted] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-: --- Comment: was deleted (was: Thank you! I think the users might need to understand the potential performance d

[jira] [Commented] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023241#comment-15023241 ] Xiao Li commented on SPARK-: Thank you! I think the users might need to understand t

[jira] [Issue Comment Deleted] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-: --- Comment: was deleted (was: Thank you! I think the users might need to understand the potential performance d

[jira] [Commented] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023242#comment-15023242 ] Xiao Li commented on SPARK-: Thank you! I think the users might need to understand t

[jira] [Comment Edited] (SPARK-11826) Subtract BlockMatrix

2015-11-23 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15022954#comment-15022954 ] Ehsan Mohyedin Kermani edited comment on SPARK-11826 at 11/23/15 10:33 PM:

[jira] [Assigned] (SPARK-11897) Add @scala.annotations.varargs to sql functions that don't have it

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11897: Assignee: (was: Apache Spark) > Add @scala.annotations.varargs to sql functions that d

[jira] [Assigned] (SPARK-11897) Add @scala.annotations.varargs to sql functions that don't have it

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11897: Assignee: Apache Spark > Add @scala.annotations.varargs to sql functions that don't have i

[jira] [Commented] (SPARK-11897) Add @scala.annotations.varargs to sql functions that don't have it

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023237#comment-15023237 ] Apache Spark commented on SPARK-11897: -- User 'xguo27' has created a pull request for

[jira] [Assigned] (SPARK-11866) RpcEnv RPC timeouts can lead to errors, leak in transport library.

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11866: Assignee: (was: Apache Spark) > RpcEnv RPC timeouts can lead to errors, leak in transp

[jira] [Commented] (SPARK-11866) RpcEnv RPC timeouts can lead to errors, leak in transport library.

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023212#comment-15023212 ] Apache Spark commented on SPARK-11866: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11866) RpcEnv RPC timeouts can lead to errors, leak in transport library.

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11866: Assignee: Apache Spark > RpcEnv RPC timeouts can lead to errors, leak in transport library

[jira] [Updated] (SPARK-11932) trackStateByKey throws java.lang.IllegalArgumentException: requirement failed on restarting from checkpoint

2015-11-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11932: -- Description: Code {code} StreamingContext.getOrCreate(".", () => createContext(args)) ...

[jira] [Updated] (SPARK-11932) trackStateByKey throws java.lang.IllegalArgumentException: requirement failed on restarting from checkpoint

2015-11-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11932: -- Description: Code {{{ StreamingContext.getOrCreate(".", () => createContext(args)) ...

  1   2   3   >