[jira] [Updated] (SPARK-7415) Flaky test: o.a.s.DriverSuite

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7415: - Summary: Flaky test: o.a.s.DriverSuite (was: Flaky test: o.a.s.deploy.DriverSuite) Flaky test:

[jira] [Closed] (SPARK-7414) Flaky test: o.a.s.deploy.SparkSubmitSuite --jars

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7414. Resolution: Duplicate Flaky test: o.a.s.deploy.SparkSubmitSuite --jars

[jira] [Created] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear received block data too soon

2015-05-06 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7420: Summary: Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear received block data too soon Key: SPARK-7420 URL: https://issues.apache.org/jira/browse/SPARK-7420

[jira] [Assigned] (SPARK-7421) Online LDA cleanups

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7421: --- Assignee: Apache Spark (was: Joseph K. Bradley) Online LDA cleanups ---

[jira] [Commented] (SPARK-7421) Online LDA cleanups

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531819#comment-14531819 ] Apache Spark commented on SPARK-7421: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-7396) Update Producer in Kafka example to use new API of Kafka 0.8.2

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7396: - Fix Version/s: 1.4.0 Update Producer in Kafka example to use new API of Kafka 0.8.2

[jira] [Updated] (SPARK-7396) Update Producer in Kafka example to use new API of Kafka 0.8.2

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7396: - Issue Type: Improvement (was: Bug) Update Producer in Kafka example to use new API of Kafka

[jira] [Created] (SPARK-7423) spark.ml Classifier predict should not convert vectors to dense format

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7423: Summary: spark.ml Classifier predict should not convert vectors to dense format Key: SPARK-7423 URL: https://issues.apache.org/jira/browse/SPARK-7423

[jira] [Created] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7425: Summary: spark.ml Predictor should support other numeric types for label Key: SPARK-7425 URL: https://issues.apache.org/jira/browse/SPARK-7425 Project: Spark

[jira] [Commented] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531875#comment-14531875 ] Joseph K. Bradley commented on SPARK-7424: -- I started a little work on this. It

[jira] [Assigned] (SPARK-7429) Cleanups: Params.setDefault varargs, CrossValidatorModel transformSchema

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7429: --- Assignee: Joseph K. Bradley (was: Apache Spark) Cleanups: Params.setDefault varargs,

[jira] [Commented] (SPARK-7430) General improvements to streaming tests to increase debuggability

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531906#comment-14531906 ] Apache Spark commented on SPARK-7430: - User 'tdas' has created a pull request for this

[jira] [Closed] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2015-05-06 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng closed SPARK-7008. --- Resolution: Fixed An implementation of Factorization Machine (LibFM)

[jira] [Created] (SPARK-7431) cvModel does not have uid in Python doc test

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7431: Summary: cvModel does not have uid in Python doc test Key: SPARK-7431 URL: https://issues.apache.org/jira/browse/SPARK-7431 Project: Spark Issue

[jira] [Resolved] (SPARK-6799) Add dataframe examples for SparkR

2015-05-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6799. Resolution: Fixed Fix Version/s: 1.4.0 Add dataframe examples for SparkR

[jira] [Comment Edited] (SPARK-6824) Fill the docs for DataFrame API in SparkR

2015-05-06 Thread Qian Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531788#comment-14531788 ] Qian Huang edited comment on SPARK-6824 at 5/7/15 12:40 AM:

[jira] [Updated] (SPARK-7405) Fix the bug that ReceiverInputDStream doesn't report InputInfo

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7405: - Assignee: Shixiong Zhu Fix the bug that ReceiverInputDStream doesn't report InputInfo

[jira] [Updated] (SPARK-7347) DAG visualization: add tooltips to RDDs on job page

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7347: - Summary: DAG visualization: add tooltips to RDDs on job page (was: DAG visualization: add hover to RDDs

[jira] [Updated] (SPARK-7347) DAG visualization: add tooltips to RDDs on job page

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7347: - Attachment: tooltip.png DAG visualization: add tooltips to RDDs on job page

[jira] [Assigned] (SPARK-7391) DAG visualization: open viz on stage page if from job page

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7391: --- Assignee: Andrew Or (was: Apache Spark) DAG visualization: open viz on stage page if from

[jira] [Commented] (SPARK-7391) DAG visualization: open viz on stage page if from job page

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531876#comment-14531876 ] Apache Spark commented on SPARK-7391: - User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7427: Summary: Make sharedParams match in Scala, Python Key: SPARK-7427 URL: https://issues.apache.org/jira/browse/SPARK-7427 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7429) Cleanups: Params.setDefault varargs, CrossValidatorModel transformSchema

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7429: --- Assignee: Apache Spark (was: Joseph K. Bradley) Cleanups: Params.setDefault varargs,

[jira] [Commented] (SPARK-7429) Cleanups: Params.setDefault varargs, CrossValidatorModel transformSchema

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531893#comment-14531893 ] Apache Spark commented on SPARK-7429: - User 'jkbradley' has created a pull request for

[jira] [Created] (SPARK-7430) General improvements to streaming tests to increase debuggability

2015-05-06 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7430: Summary: General improvements to streaming tests to increase debuggability Key: SPARK-7430 URL: https://issues.apache.org/jira/browse/SPARK-7430 Project: Spark

[jira] [Created] (SPARK-7429) Cleanups: Params.setDefault varargs, CrossValidatorModel transformSchema

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7429: Summary: Cleanups: Params.setDefault varargs, CrossValidatorModel transformSchema Key: SPARK-7429 URL: https://issues.apache.org/jira/browse/SPARK-7429

[jira] [Resolved] (SPARK-7335) Submitting a query to Thrift Server occurs error: java.lang.IllegalStateException: unread block data

2015-05-06 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula resolved SPARK-7335. - Resolution: Not A Problem Submitting a query to Thrift Server occurs error:

[jira] [Updated] (SPARK-7116) Intermediate RDD cached but never unpersisted

2015-05-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7116: Target Version/s: 1.4.0 Intermediate RDD cached but never unpersisted

[jira] [Commented] (SPARK-6824) Fill the docs for DataFrame API in SparkR

2015-05-06 Thread Qian Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531788#comment-14531788 ] Qian Huang commented on SPARK-6824: --- @ Fill the docs for DataFrame API in SparkR

[jira] [Closed] (SPARK-7408) DAG visualization: move style from JS to CSS

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7408. Resolution: Fixed Fix Version/s: 1.4.0 DAG visualization: move style from JS to CSS

[jira] [Closed] (SPARK-7377) DAG visualization: JS error when there is only 1 RDD

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7377. Resolution: Fixed Fix Version/s: 1.4.0 DAG visualization: JS error when there is only 1 RDD

[jira] [Closed] (SPARK-7371) DAG visualization: put less emphasis on RDDs on stage page

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7371. Resolution: Fixed Fix Version/s: 1.4.0 DAG visualization: put less emphasis on RDDs on stage page

[jira] [Closed] (SPARK-7397) Add missing input information report back to ReceiverInputDStream due to SPARK-7139

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-7397. Resolution: Duplicate Add missing input information report back to ReceiverInputDStream due to

[jira] [Updated] (SPARK-7396) Update Producer in Kafka example to use new API of Kafka 0.8.2

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7396: - Assignee: Saisai Shao Update Producer in Kafka example to use new API of Kafka 0.8.2

[jira] [Assigned] (SPARK-7421) Online LDA cleanups

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7421: --- Assignee: Joseph K. Bradley (was: Apache Spark) Online LDA cleanups ---

[jira] [Resolved] (SPARK-7405) Fix the bug that ReceiverInputDStream doesn't report InputInfo

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7405. -- Resolution: Fixed Fix Version/s: 1.4.0 Fix the bug that ReceiverInputDStream doesn't

[jira] [Created] (SPARK-7422) Add argmax to Vector, SparseVector

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7422: Summary: Add argmax to Vector, SparseVector Key: SPARK-7422 URL: https://issues.apache.org/jira/browse/SPARK-7422 Project: Spark Issue Type: New

[jira] [Created] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7424: Summary: spark.ml classification, regression abstractions should add metadata to output column Key: SPARK-7424 URL: https://issues.apache.org/jira/browse/SPARK-7424

[jira] [Updated] (SPARK-7422) Add argmax to Vector, SparseVector

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7422: - Labels: starter (was: ) Add argmax to Vector, SparseVector

[jira] [Created] (SPARK-7426) spark.ml AttributeFactory.fromStructField should allow other NumericTypes

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7426: Summary: spark.ml AttributeFactory.fromStructField should allow other NumericTypes Key: SPARK-7426 URL: https://issues.apache.org/jira/browse/SPARK-7426

[jira] [Updated] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7424: - Assignee: (was: Joseph K. Bradley) spark.ml classification, regression abstractions

[jira] [Commented] (SPARK-7407) Use uid and param name to identify a parameter instead of the param object

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531898#comment-14531898 ] Joseph K. Bradley commented on SPARK-7407: -- I hope we can make this change

[jira] [Updated] (SPARK-7430) General improvements to streaming tests to increase debuggability

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7430: - Priority: Critical (was: Major) General improvements to streaming tests to increase

[jira] [Assigned] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7432: --- Assignee: Apache Spark (was: Xiangrui Meng) Flaky test in PySpark CrossValidator doc test

[jira] [Assigned] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7432: --- Assignee: Xiangrui Meng (was: Apache Spark) Flaky test in PySpark CrossValidator doc test

[jira] [Commented] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531934#comment-14531934 ] Apache Spark commented on SPARK-7432: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-7419) Flaky test: o.a.s.streaming.CheckpointSuite

2015-05-06 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7419: Summary: Flaky test: o.a.s.streaming.CheckpointSuite Key: SPARK-7419 URL: https://issues.apache.org/jira/browse/SPARK-7419 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7116) Intermediate RDD cached but never unpersisted

2015-05-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531763#comment-14531763 ] Michael Armbrust commented on SPARK-7116: - [~kalle], it seems reasonable to remove

[jira] [Resolved] (SPARK-7396) Update Producer in Kafka example to use new API of Kafka 0.8.2

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7396. -- Resolution: Fixed Update Producer in Kafka example to use new API of Kafka 0.8.2

[jira] [Created] (SPARK-7421) Online LDA cleanups

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7421: Summary: Online LDA cleanups Key: SPARK-7421 URL: https://issues.apache.org/jira/browse/SPARK-7421 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-7347) DAG visualization: add hover to RDDs on job page

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7347: - Attachment: (was: job-page-hover.png) DAG visualization: add hover to RDDs on job page

[jira] [Commented] (SPARK-7347) DAG visualization: add tooltips to RDDs on job page

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531866#comment-14531866 ] Apache Spark commented on SPARK-7347: - User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7284: - Description: Things to update (continuously updated list) - Python API for Kafka Direct -

[jira] [Updated] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7427: - Issue Type: Documentation (was: Improvement) Make sharedParams match in Scala, Python

[jira] [Assigned] (SPARK-7391) DAG visualization: open viz on stage page if from job page

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7391: --- Assignee: Apache Spark (was: Andrew Or) DAG visualization: open viz on stage page if from

[jira] [Updated] (SPARK-6943) Graphically show the RDD DAG on the UI

2015-05-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6943: - Attachment: new-stage-page-5-6-15.png new-job-page-5-6-15.png Graphically show the RDD

[jira] [Updated] (SPARK-6656) Allow the application name to be passed in versus pulling from SparkContext.getAppName()

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6656: - Assignee: Chris Fregly Allow the application name to be passed in versus pulling from

[jira] [Updated] (SPARK-7217) Add configuration to control the default behavior of StreamingContext.stop() implicitly calling SparkContext.stop()

2015-05-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7217: - Priority: Blocker (was: Major) Target Version/s: 1.4.0 Add configuration to control

[jira] [Created] (SPARK-7428) DataFrame.join() could create a new df with duplicate column name

2015-05-06 Thread yan tianxing (JIRA)
yan tianxing created SPARK-7428: --- Summary: DataFrame.join() could create a new df with duplicate column name Key: SPARK-7428 URL: https://issues.apache.org/jira/browse/SPARK-7428 Project: Spark

[jira] [Updated] (SPARK-7411) CTAS parser is incomplete

2015-05-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7411: Assignee: Cheng Hao CTAS parser is incomplete - Key: SPARK-7411

[jira] [Commented] (SPARK-7431) cvModel does not have uid in Python doc test

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531929#comment-14531929 ] Joseph K. Bradley commented on SPARK-7431: -- I'm working on this cvModel does

[jira] [Created] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7432: Summary: Flaky test in PySpark CrossValidator doc test Key: SPARK-7432 URL: https://issues.apache.org/jira/browse/SPARK-7432 Project: Spark Issue

[jira] [Reopened] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2015-05-06 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li reopened SPARK-7008: This jira should not be closed.. An implementation of Factorization Machine (LibFM)

[jira] [Updated] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7432: - Assignee: Xiangrui Meng Flaky test in PySpark CrossValidator doc test

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2015-05-06 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531945#comment-14531945 ] meiyoula commented on SPARK-1867: - I have resolved my problem. Actually, the primary

[jira] [Commented] (SPARK-7335) Submitting a query to Thrift Server occurs error: java.lang.IllegalStateException: unread block data

2015-05-06 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531944#comment-14531944 ] meiyoula commented on SPARK-7335: - I have resolved my problem. Actually, the primary

[jira] [Closed] (SPARK-4732) All application progress on the standalone scheduler can be halted by one systematically faulty node

2015-05-06 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harry Brundage closed SPARK-4732. - Resolution: Duplicate All application progress on the standalone scheduler can be halted by one

[jira] [Assigned] (SPARK-7411) CTAS parser is incomplete

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7411: --- Assignee: Cheng Hao (was: Apache Spark) CTAS parser is incomplete

[jira] [Commented] (SPARK-5213) Pluggable SQL Parser Support

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531988#comment-14531988 ] Apache Spark commented on SPARK-5213: - User 'chenghao-intel' has created a pull

[jira] [Created] (SPARK-7433) How to pass the parameters to spark SQL backend and set its value to the environment variable through the simba ODBC driver.

2015-05-06 Thread vincent zhao (JIRA)
vincent zhao created SPARK-7433: --- Summary: How to pass the parameters to spark SQL backend and set its value to the environment variable through the simba ODBC driver. Key: SPARK-7433 URL:

[jira] [Commented] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-06 Thread Tijo Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532062#comment-14532062 ] Tijo Thomas commented on SPARK-7399: Raised a pull request

[jira] [Commented] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532061#comment-14532061 ] Apache Spark commented on SPARK-7399: - User 'tijoparacka' has created a pull request

[jira] [Assigned] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7399: --- Assignee: (was: Apache Spark) Master fails on 2.11 with compilation error

[jira] [Assigned] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7399: --- Assignee: Apache Spark Master fails on 2.11 with compilation error

[jira] [Resolved] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6812. -- Resolution: Fixed filter() on DataFrame does not work as expected

[jira] [Updated] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-05-06 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7262: --- Summary: Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package (was:

[jira] [Issue Comment Deleted] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-06 Thread Tijo Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tijo Thomas updated SPARK-7399: --- Comment: was deleted (was: Raised a pull request https://github.com/apache/spark/pull/5966) Master

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532057#comment-14532057 ] Shivaram Venkataraman commented on SPARK-6812: -- Fixed by

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-05-06 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532054#comment-14532054 ] Eron Wright commented on SPARK-5874: - I suggest providing a fluent syntax or dsl for

[jira] [Commented] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

2015-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531969#comment-14531969 ] Apache Spark commented on SPARK-7308: - User 'squito' has created a pull request for

[jira] [Commented] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-05-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532017#comment-14532017 ] Joseph K. Bradley commented on SPARK-7432: -- It happened again:

[jira] [Commented] (SPARK-7393) How to improve Spark SQL performance?

2015-05-06 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532044#comment-14532044 ] Liang Lee commented on SPARK-7393: -- Dear Dennis, Thank you very much for your kind help.

[jira] [Updated] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-05-06 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7262: --- Description: 1) Handle scaling and addBias internally. 2) L1/L2 elasticnet using OWLQN optimizer. was: 1)

[jira] [Created] (SPARK-7434) DSL for Pipeline assembly

2015-05-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7434: Summary: DSL for Pipeline assembly Key: SPARK-7434 URL: https://issues.apache.org/jira/browse/SPARK-7434 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7400) PortableDataStream UDT

2015-05-06 Thread Eron Wright (JIRA)
Eron Wright created SPARK-7400: --- Summary: PortableDataStream UDT Key: SPARK-7400 URL: https://issues.apache.org/jira/browse/SPARK-7400 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-06 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530783#comment-14530783 ] Eron Wright commented on SPARK-7400: - I am thinking about ML scenarios here, with the

<    1   2   3