[jira] [Resolved] (SPARK-7228) SparkR public API for 1.4 release

[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7228. -- Resolution: Fixed Resolving as all the sub-tasks have been now resolved > Spark

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536227#comment-14536227 ] Apache Spark commented on SPARK-3928: - User 'tkyaw' has created a pull request for thi

[jira] [Closed] (SPARK-7468) DAG visualization: certain action operators should not be scopes

[ https://issues.apache.org/jira/browse/SPARK-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7468. Resolution: Won't Fix It's hard to apply a general rule that decides whether an operation should be marked

[jira] [Resolved] (SPARK-7498) Params.setDefault should not use varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7498. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6021 [https://githu

[jira] [Updated] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7262: - Assignee: DB Tsai > Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML > pa

[jira] [Resolved] (SPARK-7262) Binary LogisticRegression with L1/L2 (elastic net) using OWLQN in new ML package

[ https://issues.apache.org/jira/browse/SPARK-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7262. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5967 [https://githu

[jira] [Updated] (SPARK-7463) Dag visualization improvements

[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7463: - Target Version/s: 1.4.0, 1.5.0 (was: 1.5.0) > Dag visualization improvements > --

[jira] [Created] (SPARK-7502) DAG visualization: handle removed stages gracefully

Andrew Or created SPARK-7502: Summary: DAG visualization: handle removed stages gracefully Key: SPARK-7502 URL: https://issues.apache.org/jira/browse/SPARK-7502 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536114#comment-14536114 ] Yana Kadiyska commented on SPARK-3928: -- [~tkyaw] Your suggested workaround does work.

[jira] [Updated] (SPARK-7501) DAG visualization: show DStream operations for Streaming

[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7501: - Description: Similar to SQL in SPARK-7469, we should show higher level constructs that the user is more fa

[jira] [Created] (SPARK-7501) DAG visualization: show DStream operations for Streaming

Andrew Or created SPARK-7501: Summary: DAG visualization: show DStream operations for Streaming Key: SPARK-7501 URL: https://issues.apache.org/jira/browse/SPARK-7501 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

[ https://issues.apache.org/jira/browse/SPARK-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7500: - Attachment: long names.png > DAG visualization: cluster name bleeds beyond the cluster > -

[jira] [Resolved] (SPARK-7375) Avoid defensive copying in SQL exchange operator when sort-based shuffle buffers data in serialized form

[ https://issues.apache.org/jira/browse/SPARK-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7375. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5948 [https://github.com/apac

[jira] [Created] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

Andrew Or created SPARK-7500: Summary: DAG visualization: cluster name bleeds beyond the cluster Key: SPARK-7500 URL: https://issues.apache.org/jira/browse/SPARK-7500 Project: Spark Issue Type: B

[jira] [Closed] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7490. Resolution: Fixed Target Version/s: 1.4.0 > MapOutputTracker: close input streams to free native m

[jira] [Reopened] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-7490: -- > MapOutputTracker: close input streams to free native memory >

[jira] [Updated] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7490: - Fix Version/s: (was: 1.2.3) (was: 1.3.2) > MapOutputTracker: close input stream

[jira] [Assigned] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7427: --- Assignee: (was: Apache Spark) > Make sharedParams match in Scala, Python > --

[jira] [Assigned] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7427: --- Assignee: Apache Spark > Make sharedParams match in Scala, Python > -

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536108#comment-14536108 ] Apache Spark commented on SPARK-7427: - User 'gweidner' has created a pull request for

[jira] [Updated] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7231: - Fix Version/s: 1.4.0 > Make SparkR DataFrame API more dplyr friendly > ---

[jira] [Commented] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536091#comment-14536091 ] Shivaram Venkataraman commented on SPARK-7231: -- Fixed by https://github.com/a

[jira] [Resolved] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7231. -- Resolution: Fixed > Make SparkR DataFrame API more dplyr friendly >

[jira] [Commented] (SPARK-7497) test_count_by_value_and_window is flaky

[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536060#comment-14536060 ] Shivaram Venkataraman commented on SPARK-7497: -- I've seen this a couple of ti

[jira] [Assigned] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7473: --- Assignee: (was: Apache Spark) > Use reservoir sample in RandomForest when choosing featur

[jira] [Commented] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536058#comment-14536058 ] Apache Spark commented on SPARK-7473: - User 'AiHe' has created a pull request for this

[jira] [Assigned] (SPARK-7473) Use reservoir sample in RandomForest when choosing features per node

[ https://issues.apache.org/jira/browse/SPARK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7473: --- Assignee: Apache Spark > Use reservoir sample in RandomForest when choosing features per node

[jira] [Commented] (SPARK-7485) Remove python artifacts from the assembly jar

[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536026#comment-14536026 ] Apache Spark commented on SPARK-7485: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-7485) Remove python artifacts from the assembly jar

[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7485: --- Assignee: (was: Apache Spark) > Remove python artifacts from the assembly jar > -

[jira] [Assigned] (SPARK-7485) Remove python artifacts from the assembly jar

[ https://issues.apache.org/jira/browse/SPARK-7485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7485: --- Assignee: Apache Spark > Remove python artifacts from the assembly jar >

[jira] [Resolved] (SPARK-7488) Python API for ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7488. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6015 [https://githu

[jira] [Assigned] (SPARK-7498) Params.setDefault should not use varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7498: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Params.setDefault should not use varargs a

[jira] [Assigned] (SPARK-7498) Params.setDefault should not use varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7498: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Params.setDefault should not use varargs a

[jira] [Commented] (SPARK-7498) Params.setDefault should not use varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536019#comment-14536019 ] Apache Spark commented on SPARK-7498: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-7488) Python API for ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7488: - Assignee: Burak Yavuz > Python API for ml.recommendation > > >

[jira] [Created] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

Shivaram Venkataraman created SPARK-7499: Summary: Investigate how to specify columns in SparkR without $ or strings Key: SPARK-7499 URL: https://issues.apache.org/jira/browse/SPARK-7499 Proje

[jira] [Closed] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

[ https://issues.apache.org/jira/browse/SPARK-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6955. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Aaron Davidson (was: SaintBacchus) > Do no

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535905#comment-14535905 ] Glenn Weidner commented on SPARK-7427: -- Thank you! I see mismatch now - for example:

[jira] [Created] (SPARK-7498) Params.setDefault should not use varargs annotation

Joseph K. Bradley created SPARK-7498: Summary: Params.setDefault should not use varargs annotation Key: SPARK-7498 URL: https://issues.apache.org/jira/browse/SPARK-7498 Project: Spark Iss

[jira] [Resolved] (SPARK-5913) Python API for ChiSqSelector

[ https://issues.apache.org/jira/browse/SPARK-5913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5913. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5939 [https

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535800#comment-14535800 ] Joseph K. Bradley commented on SPARK-7427: -- Each parameter has built-in documenta

[jira] [Created] (SPARK-7497) test_count_by_value_and_window is flaky

Xiangrui Meng created SPARK-7497: Summary: test_count_by_value_and_window is flaky Key: SPARK-7497 URL: https://issues.apache.org/jira/browse/SPARK-7497 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4699. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5806 [https:/

[jira] [Commented] (SPARK-7407) Use uid and param name to identify a parameter instead of the param object

[ https://issues.apache.org/jira/browse/SPARK-7407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535754#comment-14535754 ] Apache Spark commented on SPARK-7407: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-7427) Make sharedParams match in Scala, Python

[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535701#comment-14535701 ] Glenn Weidner commented on SPARK-7427: -- I've also generated the scaladoc by running b

[jira] [Comment Edited] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534582#comment-14534582 ] Thu Kyaw edited comment on SPARK-3928 at 5/8/15 9:52 PM: - New parq

[jira] [Comment Edited] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534582#comment-14534582 ] Thu Kyaw edited comment on SPARK-3928 at 5/8/15 9:50 PM: - New parq

[jira] [Closed] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7486. Resolution: Duplicate > Add the streaming implementation for estimating quantiles and median

[jira] [Commented] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535642#comment-14535642 ] Joseph K. Bradley commented on SPARK-7486: -- OK, I'll close it as a duplicate > A

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-1517: -- Assignee: (was: Nicholas Chammas) > Publish nightly snapshots of documentation, maven artifacts, and

[jira] [Updated] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7390: - Assignee: Liang-Chi Hsieh > CovarianceCounter in StatFunctions might calculate incorrect result >

[jira] [Resolved] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7390. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5931 [https://githu

[jira] [Commented] (SPARK-7137) Add checkInputColumn back to Params and print more info

[ https://issues.apache.org/jira/browse/SPARK-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535624#comment-14535624 ] Rekha Joshi commented on SPARK-7137: Sorry [~gweidner] , [~josephkb] just saw it was u

[jira] [Resolved] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2572. -- Resolution: Duplicate > Can't delete local dir on executor automatically when running spark over > Meso

[jira] [Commented] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535616#comment-14535616 ] Burak Yavuz commented on SPARK-7486: Yes, this is a clone of SPARK-6760 and SPARK-7246

[jira] [Resolved] (SPARK-7245) Spearman correlation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-7245. Resolution: Done Fix Version/s: 1.4.0 > Spearman correlation for DataFrames > ---

[jira] [Resolved] (SPARK-7399) Master fails on 2.11 with compilation error

[ https://issues.apache.org/jira/browse/SPARK-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7399. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Tijo Thomas > Master fails on 2.11 with

[jira] [Reopened] (SPARK-7245) Spearman correlation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reopened SPARK-7245: Sorry, mixed this with Pearson correlation > Spearman correlation for DataFrames >

[jira] [Commented] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535614#comment-14535614 ] Rekha Joshi commented on SPARK-7435: Thank you [~shivaram] and [~sunrui] for quick rep

[jira] [Commented] (SPARK-7486) Add the streaming implementation for estimating quantiles and median

[ https://issues.apache.org/jira/browse/SPARK-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535586#comment-14535586 ] Joseph K. Bradley commented on SPARK-7486: -- Ping [~brkyvz] Aren't you looking at

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535577#comment-14535577 ] Joseph K. Bradley commented on SPARK-7483: -- Does it fix anything if you give Kryo

[jira] [Reopened] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-7483: -- > [MLLib] Using Kryo with FPGrowth fails with an exception > ---

[jira] [Comment Edited] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535562#comment-14535562 ] Joseph K. Bradley edited comment on SPARK-7483 at 5/8/15 9:24 PM: --

[jira] [Closed] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7483. Resolution: Not A Problem > [MLLib] Using Kryo with FPGrowth fails with an exception > -

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535562#comment-14535562 ] Joseph K. Bradley commented on SPARK-7483: -- I believe this is because it would ne

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535563#comment-14535563 ] Tathagata Das commented on SPARK-6613: -- Any update with 1.3.1? > Starting stream fro

[jira] [Commented] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535557#comment-14535557 ] Prasanna Gautam commented on SPARK-2572: This is still happening as of Spark-1.3.0

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7398: --- Issue Type: Improvement (was: Bug) > Add back-pressure to Spark Streaming > -

[jira] [Closed] (SPARK-7378) HistoryServer does not handle "deep" link when lazy loading app

[ https://issues.apache.org/jira/browse/SPARK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7378. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 > HistoryServer does not han

[jira] [Closed] (SPARK-7466) DAG visualization: orphaned nodes are not rendered correctly

[ https://issues.apache.org/jira/browse/SPARK-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7466. Resolution: Fixed Fix Version/s: 1.4.0 > DAG visualization: orphaned nodes are not rendered correctly

[jira] [Closed] (SPARK-7489) Spark shell crashes when compiled with scala 2.11 and SPARK_PREPEND_CLASSES=true

[ https://issues.apache.org/jira/browse/SPARK-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7489. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Vinod KC Target Version/s: 1.4.

[jira] [Updated] (SPARK-7443) MLlib 1.4 QA plan

[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7443: - Description: TODO: create JIRAs for each task and assign them accordingly. h2. API * Check API c

[jira] [Updated] (SPARK-7456) Perf test for linear regression and logistic regression with elastic-net

[ https://issues.apache.org/jira/browse/SPARK-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7456: - Summary: Perf test for linear regression and logistic regression with elastic-net (was: Perf test

[jira] [Updated] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7490: - Assignee: Evan Jones > MapOutputTracker: close input streams to free native memory > -

[jira] [Resolved] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7490. -- Resolution: Fixed Fix Version/s: 1.4.0 1.2.3 1.3.2 Issue re

[jira] [Assigned] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7492: --- Assignee: Apache Spark > Convert LocalDataFrame to LocalMatrix >

[jira] [Assigned] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7492: --- Assignee: (was: Apache Spark) > Convert LocalDataFrame to LocalMatrix > -

[jira] [Commented] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535515#comment-14535515 ] Apache Spark commented on SPARK-7492: - User 'brkyvz' has created a pull request for th

[jira] [Created] (SPARK-7496) Update Programming guide with Online LDA

Joseph K. Bradley created SPARK-7496: Summary: Update Programming guide with Online LDA Key: SPARK-7496 URL: https://issues.apache.org/jira/browse/SPARK-7496 Project: Spark Issue Type: Do

[jira] [Updated] (SPARK-7469) DAG visualization: show operators for SQL

[ https://issues.apache.org/jira/browse/SPARK-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7469: - Attachment: after.png before.png > DAG visualization: show operators for SQL > ---

[jira] [Created] (SPARK-7495) Improve ML attribute documentation

Joseph K. Bradley created SPARK-7495: Summary: Improve ML attribute documentation Key: SPARK-7495 URL: https://issues.apache.org/jira/browse/SPARK-7495 Project: Spark Issue Type: Document

[jira] [Updated] (SPARK-7461) Remove spark.ml Model, and have all Transformers have parent

[ https://issues.apache.org/jira/browse/SPARK-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7461: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-5874 > Remove spark.ml Mode

[jira] [Created] (SPARK-7494) spark.ml Model should call copyValues in construction

Joseph K. Bradley created SPARK-7494: Summary: spark.ml Model should call copyValues in construction Key: SPARK-7494 URL: https://issues.apache.org/jira/browse/SPARK-7494 Project: Spark I

[jira] [Updated] (SPARK-5980) Add GradientBoostedTrees Python examples to ML guide

[ https://issues.apache.org/jira/browse/SPARK-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5980: - Target Version/s: 1.3.0 > Add GradientBoostedTrees Python examples to ML guide > -

[jira] [Resolved] (SPARK-5980) Add GradientBoostedTrees Python examples to ML guide

[ https://issues.apache.org/jira/browse/SPARK-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5980. -- Resolution: Fixed Fix Version/s: 1.3.0 > Add GradientBoostedTrees Python examples

[jira] [Commented] (SPARK-7410) Add option to avoid broadcasting configuration with newAPIHadoopFile

[ https://issues.apache.org/jira/browse/SPARK-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535386#comment-14535386 ] Josh Rosen commented on SPARK-7410: --- We should confirm this, but if I recall the reason

[jira] [Created] (SPARK-7493) ALTER TABLE statement

Sergey Semichev created SPARK-7493: -- Summary: ALTER TABLE statement Key: SPARK-7493 URL: https://issues.apache.org/jira/browse/SPARK-7493 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-7492: --- Description: Having a method like, {code:java} Matrices.fromDataFrame(df) {code} would provide users

[jira] [Updated] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-7492: --- Description: Having a method like, {code: java} Matrices.fromDataFrame(df) {code} would provide users

[jira] [Created] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

Burak Yavuz created SPARK-7492: -- Summary: Convert LocalDataFrame to LocalMatrix Key: SPARK-7492 URL: https://issues.apache.org/jira/browse/SPARK-7492 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-7491) Handle drivers for Metastore JDBC

Michael Armbrust created SPARK-7491: --- Summary: Handle drivers for Metastore JDBC Key: SPARK-7491 URL: https://issues.apache.org/jira/browse/SPARK-7491 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7487) Python API for ml.regression

[ https://issues.apache.org/jira/browse/SPARK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535324#comment-14535324 ] Apache Spark commented on SPARK-7487: - User 'brkyvz' has created a pull request for th

[jira] [Assigned] (SPARK-7487) Python API for ml.regression

[ https://issues.apache.org/jira/browse/SPARK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7487: --- Assignee: (was: Apache Spark) > Python API for ml.regression > --

[jira] [Assigned] (SPARK-7487) Python API for ml.regression

[ https://issues.apache.org/jira/browse/SPARK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7487: --- Assignee: Apache Spark > Python API for ml.regression > > >

[jira] [Commented] (SPARK-7448) Implement custom bye array serializer for use in PySpark shuffle

[ https://issues.apache.org/jira/browse/SPARK-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535316#comment-14535316 ] Josh Rosen commented on SPARK-7448: --- This is a change that would be nice to performance

[jira] [Updated] (SPARK-7448) Implement custom bye array serializer for use in PySpark shuffle

[ https://issues.apache.org/jira/browse/SPARK-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7448: -- Priority: Minor (was: Major) > Implement custom bye array serializer for use in PySpark shuffle > -

[jira] [Assigned] (SPARK-7488) Python API for ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7488: --- Assignee: (was: Apache Spark) > Python API for ml.recommendation > --

[jira] [Commented] (SPARK-7488) Python API for ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535284#comment-14535284 ] Apache Spark commented on SPARK-7488: - User 'brkyvz' has created a pull request for th

[jira] [Assigned] (SPARK-7488) Python API for ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7488: --- Assignee: Apache Spark > Python API for ml.recommendation >

[jira] [Commented] (SPARK-7490) MapOutputTracker: close input streams to free native memory

[ https://issues.apache.org/jira/browse/SPARK-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535264#comment-14535264 ] Apache Spark commented on SPARK-7490: - User 'evanj' has created a pull request for thi

  1   2   3   >