[jira] [Assigned] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7490: --- Assignee: Apache Spark MapOutputTracker: close input streams to free native memory

[jira] [Commented] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535264#comment-14535264 ] Apache Spark commented on SPARK-7490: - User 'evanj' has created a pull request for

[jira] [Assigned] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7490: --- Assignee: (was: Apache Spark) MapOutputTracker: close input streams to free native

[jira] [Assigned] (SPARK-7488) Python API for ml.recommendation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7488: --- Assignee: Apache Spark Python API for ml.recommendation

[jira] [Commented] (SPARK-7488) Python API for ml.recommendation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535284#comment-14535284 ] Apache Spark commented on SPARK-7488: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7488) Python API for ml.recommendation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7488: --- Assignee: (was: Apache Spark) Python API for ml.recommendation

[jira] [Updated] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-7492: --- Description: Having a method like, {code: java} Matrices.fromDataFrame(df) {code} would provide

[jira] [Created] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-7492: -- Summary: Convert LocalDataFrame to LocalMatrix Key: SPARK-7492 URL: https://issues.apache.org/jira/browse/SPARK-7492 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-05-08 Thread Alex Rovner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535113#comment-14535113 ] Alex Rovner commented on SPARK-5480: We are running Spark 1.3.0 on Hadoop

[jira] [Updated] (SPARK-5980) Add GradientBoostedTrees Python examples to ML guide

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5980: - Target Version/s: 1.3.0 Add GradientBoostedTrees Python examples to ML guide

[jira] [Resolved] (SPARK-5980) Add GradientBoostedTrees Python examples to ML guide

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5980. -- Resolution: Fixed Fix Version/s: 1.3.0 Add GradientBoostedTrees Python examples

[jira] [Updated] (SPARK-7469) DAG visualization: show operators for SQL

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7469: - Attachment: after.png before.png DAG visualization: show operators for SQL

[jira] [Closed] (SPARK-7489) Spark shell crashes when compiled with scala 2.11 and SPARK_PREPEND_CLASSES=true

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7489. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Vinod KC Target Version/s:

[jira] [Commented] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

2015-05-08 Thread Prasanna Gautam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535557#comment-14535557 ] Prasanna Gautam commented on SPARK-2572: This is still happening as of Spark-1.3.0

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535577#comment-14535577 ] Joseph K. Bradley commented on SPARK-7483: -- Does it fix anything if you give Kryo

[jira] [Commented] (SPARK-7137) Add checkInputColumn back to Params and print more info

2015-05-08 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535624#comment-14535624 ] Rekha Joshi commented on SPARK-7137: Sorry [~gweidner] , [~josephkb] just saw it was

[jira] [Closed] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7486. Resolution: Duplicate Add the streaming implementation for estimating quantiles and median

[jira] [Updated] (SPARK-7461) Remove spark.ml Model, and have all Transformers have parent

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7461: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-5874 Remove spark.ml

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-1517: -- Assignee: (was: Nicholas Chammas) Publish nightly snapshots of documentation, maven artifacts, and

[jira] [Comment Edited] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-05-08 Thread Rangarajan Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534629#comment-14534629 ] Rangarajan Sreenivasan edited comment on SPARK-5928 at 5/8/15 5:52 PM:

[jira] [Commented] (SPARK-7479) SparkR can not work

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535108#comment-14535108 ] Shivaram Venkataraman commented on SPARK-7479: -- Just to add more light - the

[jira] [Updated] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-7492: --- Description: Having a method like, {code:java} Matrices.fromDataFrame(df) {code} would provide users

[jira] [Created] (SPARK-7495) Improve ML attribute documentation

2015-05-08 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7495: Summary: Improve ML attribute documentation Key: SPARK-7495 URL: https://issues.apache.org/jira/browse/SPARK-7495 Project: Spark Issue Type:

[jira] [Created] (SPARK-7496) Update Programming guide with Online LDA

2015-05-08 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7496: Summary: Update Programming guide with Online LDA Key: SPARK-7496 URL: https://issues.apache.org/jira/browse/SPARK-7496 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7490. -- Resolution: Fixed Fix Version/s: 1.4.0 1.2.3 1.3.2 Issue

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-05-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535563#comment-14535563 ] Tathagata Das commented on SPARK-6613: -- Any update with 1.3.1? Starting stream from

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535562#comment-14535562 ] Joseph K. Bradley commented on SPARK-7483: -- I believe this is because it would

[jira] [Updated] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7390: - Assignee: Liang-Chi Hsieh CovarianceCounter in StatFunctions might calculate incorrect result

[jira] [Updated] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7490: - Assignee: Evan Jones MapOutputTracker: close input streams to free native memory

[jira] [Closed] (SPARK-7466) DAG visualization: orphaned nodes are not rendered correctly

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7466. Resolution: Fixed Fix Version/s: 1.4.0 DAG visualization: orphaned nodes are not rendered correctly

[jira] [Closed] (SPARK-7378) HistoryServer does not handle deep link when lazy loading app

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7378. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 HistoryServer does not

[jira] [Closed] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7483. Resolution: Not A Problem [MLLib] Using Kryo with FPGrowth fails with an exception

[jira] [Reopened] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-7483: -- [MLLib] Using Kryo with FPGrowth fails with an exception

[jira] [Comment Edited] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535562#comment-14535562 ] Joseph K. Bradley edited comment on SPARK-7483 at 5/8/15 9:24 PM:

[jira] [Commented] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535586#comment-14535586 ] Joseph K. Bradley commented on SPARK-7486: -- Ping [~brkyvz] Aren't you looking at

[jira] [Resolved] (SPARK-7399) Master fails on 2.11 with compilation error

2015-05-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7399. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Tijo Thomas Master fails on 2.11 with

[jira] [Reopened] (SPARK-7245) Spearman correlation for DataFrames

2015-05-08 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reopened SPARK-7245: Sorry, mixed this with Pearson correlation Spearman correlation for DataFrames

[jira] [Resolved] (SPARK-7245) Spearman correlation for DataFrames

2015-05-08 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-7245. Resolution: Done Fix Version/s: 1.4.0 Spearman correlation for DataFrames

[jira] [Commented] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-08 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535614#comment-14535614 ] Rekha Joshi commented on SPARK-7435: Thank you [~shivaram] and [~sunrui] for quick

[jira] [Commented] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

2015-05-08 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535616#comment-14535616 ] Burak Yavuz commented on SPARK-7486: Yes, this is a clone of SPARK-6760 and SPARK-7246

[jira] [Resolved] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

2015-05-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2572. -- Resolution: Duplicate Can't delete local dir on executor automatically when running spark over

[jira] [Resolved] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7390. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5931

[jira] [Commented] (SPARK-7407) Use uid and param name to identify a parameter instead of the param object

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535754#comment-14535754 ] Apache Spark commented on SPARK-7407: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2015-05-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4699. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5806

[jira] [Updated] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7231: - Fix Version/s: 1.4.0 Make SparkR DataFrame API more dplyr friendly

[jira] [Assigned] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7427: --- Assignee: Apache Spark Make sharedParams match in Scala, Python

[jira] [Assigned] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7427: --- Assignee: (was: Apache Spark) Make sharedParams match in Scala, Python

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536108#comment-14536108 ] Apache Spark commented on SPARK-7427: - User 'gweidner' has created a pull request for

[jira] [Updated] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7490: - Fix Version/s: (was: 1.2.3) (was: 1.3.2) MapOutputTracker: close input

[jira] [Closed] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7490. Resolution: Fixed Target Version/s: 1.4.0 MapOutputTracker: close input streams to free native

[jira] [Reopened] (SPARK-7490) MapOutputTracker: close input streams to free native memory

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-7490: -- MapOutputTracker: close input streams to free native memory

[jira] [Created] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

2015-05-08 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7500: Summary: DAG visualization: cluster name bleeds beyond the cluster Key: SPARK-7500 URL: https://issues.apache.org/jira/browse/SPARK-7500 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7500: - Attachment: long names.png DAG visualization: cluster name bleeds beyond the cluster

[jira] [Resolved] (SPARK-7375) Avoid defensive copying in SQL exchange operator when sort-based shuffle buffers data in serialized form

2015-05-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7375. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5948

[jira] [Created] (SPARK-7501) DAG visualization: show DStream operations for Streaming

2015-05-08 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7501: Summary: DAG visualization: show DStream operations for Streaming Key: SPARK-7501 URL: https://issues.apache.org/jira/browse/SPARK-7501 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7501) DAG visualization: show DStream operations for Streaming

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7501: - Description: Similar to SQL in SPARK-7469, we should show higher level constructs that the user is more

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

2015-05-08 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536114#comment-14536114 ] Yana Kadiyska commented on SPARK-3928: -- [~tkyaw] Your suggested workaround does work.

[jira] [Created] (SPARK-7502) DAG visualization: handle removed stages gracefully

2015-05-08 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7502: Summary: DAG visualization: handle removed stages gracefully Key: SPARK-7502 URL: https://issues.apache.org/jira/browse/SPARK-7502 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-3928) Support wildcard matches on Parquet files

2015-05-08 Thread Thu Kyaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534582#comment-14534582 ] Thu Kyaw edited comment on SPARK-3928 at 5/8/15 9:52 PM: - New

[jira] [Comment Edited] (SPARK-3928) Support wildcard matches on Parquet files

2015-05-08 Thread Thu Kyaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534582#comment-14534582 ] Thu Kyaw edited comment on SPARK-3928 at 5/8/15 9:50 PM: - New

[jira] [Created] (SPARK-7497) test_count_by_value_and_window is flaky

2015-05-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7497: Summary: test_count_by_value_and_window is flaky Key: SPARK-7497 URL: https://issues.apache.org/jira/browse/SPARK-7497 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-08 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7498: Summary: Params.setDefault should not use varargs annotation Key: SPARK-7498 URL: https://issues.apache.org/jira/browse/SPARK-7498 Project: Spark

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Glenn Weidner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535701#comment-14535701 ] Glenn Weidner commented on SPARK-7427: -- I've also generated the scaladoc by running

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535800#comment-14535800 ] Joseph K. Bradley commented on SPARK-7427: -- Each parameter has built-in

[jira] [Resolved] (SPARK-5913) Python API for ChiSqSelector

2015-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5913. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5939

[jira] [Created] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created SPARK-7484: --- Summary: Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC Key: SPARK-7484 URL: https://issues.apache.org/jira/browse/SPARK-7484

[jira] [Commented] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534433#comment-14534433 ] Apache Spark commented on SPARK-7484: - User 'gvramana' has created a pull request for

[jira] [Assigned] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7484: --- Assignee: Apache Spark Support passing jdbc connection properties for

[jira] [Assigned] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7484: --- Assignee: (was: Apache Spark) Support passing jdbc connection properties for

[jira] [Commented] (SPARK-7459) Add Java example for ElementwiseProduct in programming guide

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534399#comment-14534399 ] Apache Spark commented on SPARK-7459: - User 'ogeagla' has created a pull request for

[jira] [Commented] (SPARK-7459) Add Java example for ElementwiseProduct in programming guide

2015-05-08 Thread Octavian Geagla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534398#comment-14534398 ] Octavian Geagla commented on SPARK-7459: https://github.com/apache/spark/pull/6008

[jira] [Assigned] (SPARK-7459) Add Java example for ElementwiseProduct in programming guide

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7459: --- Assignee: Octavian Geagla (was: Apache Spark) Add Java example for ElementwiseProduct in

[jira] [Updated] (SPARK-7463) Dag visualization improvements

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7463: - Target Version/s: 1.4.0, 1.5.0 (was: 1.5.0) Dag visualization improvements

[jira] [Updated] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7262: - Assignee: DB Tsai Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML

[jira] [Resolved] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7498. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6021

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536227#comment-14536227 ] Apache Spark commented on SPARK-3928: - User 'tkyaw' has created a pull request for

[jira] [Resolved] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7262. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5967

[jira] [Created] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-08 Thread Tomasz Bartczak (JIRA)
Tomasz Bartczak created SPARK-7483: -- Summary: [MLLib] Using Kryo with FPGrowth fails with an exception Key: SPARK-7483 URL: https://issues.apache.org/jira/browse/SPARK-7483 Project: Spark

[jira] [Assigned] (SPARK-7459) Add Java example for ElementwiseProduct in programming guide

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7459: --- Assignee: Apache Spark (was: Octavian Geagla) Add Java example for ElementwiseProduct in

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-08 Thread Glenn Weidner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535905#comment-14535905 ] Glenn Weidner commented on SPARK-7427: -- Thank you! I see mismatch now - for example:

[jira] [Created] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-05-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-7499: Summary: Investigate how to specify columns in SparkR without $ or strings Key: SPARK-7499 URL: https://issues.apache.org/jira/browse/SPARK-7499

[jira] [Updated] (SPARK-7488) Python API for ml.recommendation

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7488: - Assignee: Burak Yavuz Python API for ml.recommendation

[jira] [Assigned] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7498: --- Assignee: Joseph K. Bradley (was: Apache Spark) Params.setDefault should not use varargs

[jira] [Assigned] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7498: --- Assignee: Apache Spark (was: Joseph K. Bradley) Params.setDefault should not use varargs

[jira] [Resolved] (SPARK-7488) Python API for ml.recommendation

2015-05-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7488. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6015

[jira] [Assigned] (SPARK-7485) Remove python artifacts from the assembly jar

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7485: --- Assignee: (was: Apache Spark) Remove python artifacts from the assembly jar

[jira] [Commented] (SPARK-7485) Remove python artifacts from the assembly jar

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536026#comment-14536026 ] Apache Spark commented on SPARK-7485: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-7485) Remove python artifacts from the assembly jar

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7485: --- Assignee: Apache Spark Remove python artifacts from the assembly jar

[jira] [Commented] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536058#comment-14536058 ] Apache Spark commented on SPARK-7473: - User 'AiHe' has created a pull request for this

[jira] [Commented] (SPARK-7497) test_count_by_value_and_window is flaky

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536060#comment-14536060 ] Shivaram Venkataraman commented on SPARK-7497: -- I've seen this a couple of

[jira] [Assigned] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7473: --- Assignee: Apache Spark Use reservoir sample in RandomForest when choosing features per node

[jira] [Assigned] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7473: --- Assignee: (was: Apache Spark) Use reservoir sample in RandomForest when choosing

[jira] [Closed] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

2015-05-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6955. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Aaron Davidson (was: SaintBacchus) Do

[jira] [Commented] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536019#comment-14536019 ] Apache Spark commented on SPARK-7498: - User 'jkbradley' has created a pull request for

[jira] [Resolved] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7231. -- Resolution: Fixed Make SparkR DataFrame API more dplyr friendly

[jira] [Commented] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536091#comment-14536091 ] Shivaram Venkataraman commented on SPARK-7231: -- Fixed by

[jira] [Created] (SPARK-7494) spark.ml Model should call copyValues in construction

2015-05-08 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7494: Summary: spark.ml Model should call copyValues in construction Key: SPARK-7494 URL: https://issues.apache.org/jira/browse/SPARK-7494 Project: Spark

[jira] [Assigned] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7492: --- Assignee: (was: Apache Spark) Convert LocalDataFrame to LocalMatrix

[jira] [Commented] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535515#comment-14535515 ] Apache Spark commented on SPARK-7492: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

2015-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7492: --- Assignee: Apache Spark Convert LocalDataFrame to LocalMatrix

<    1   2   3   >