[jira] [Commented] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934717#comment-14934717 ] Hiroshi Takahashi commented on SPARK-10263: --- I'll work on this issue. > Add @Since annotation

[jira] [Comment Edited] (SPARK-9776) Another instance of Derby may have already booted the database

2015-09-29 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934588#comment-14934588 ] KaiXinXIaoLei edited comment on SPARK-9776 at 9/29/15 6:14 AM: --- In security

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934724#comment-14934724 ] Saisai Shao commented on SPARK-10858: - [~tgraves], I assume you're using yarn-cluster mode to submit

[jira] [Commented] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935178#comment-14935178 ] Apache Spark commented on SPARK-10851: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10851: Assignee: Apache Spark > Exception not failing R applications (in yarn cluster mode) >

[jira] [Assigned] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10851: Assignee: (was: Apache Spark) > Exception not failing R applications (in yarn cluster

[jira] [Commented] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935181#comment-14935181 ] Sun Rui commented on SPARK-10851: - [~ztoth] does this PR fix your problem? > Exception not failing R

[jira] [Commented] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-29 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934706#comment-14934706 ] Hiroshi Takahashi commented on SPARK-10268: --- I think there are no public classes or methods

[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-09-29 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934731#comment-14934731 ] Dilip Biswal commented on SPARK-8654: - I would like to work on this issue.. > Analysis exception

[jira] [Assigned] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10263: Assignee: (was: Apache Spark) > Add @Since annotation to ml.param and ml.* >

[jira] [Commented] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934751#comment-14934751 ] Apache Spark commented on SPARK-10263: -- User 'taishi-oss' has created a pull request for this issue:

[jira] [Created] (SPARK-10867) df.write.partitionBy With Two Columns Collapses first Column

2015-09-29 Thread Bryan Rivera (JIRA)
Bryan Rivera created SPARK-10867: Summary: df.write.partitionBy With Two Columns Collapses first Column Key: SPARK-10867 URL: https://issues.apache.org/jira/browse/SPARK-10867 Project: Spark

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935129#comment-14935129 ] Thomas Graves commented on SPARK-10858: --- yes its a bad thing as users don't know when # works. It

[jira] [Comment Edited] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935129#comment-14935129 ] Thomas Graves edited comment on SPARK-10858 at 9/29/15 1:06 PM: yes its a

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935134#comment-14935134 ] Thomas Graves commented on SPARK-10858: --- Note the # is the name that we give it on the yarn side

[jira] [Created] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
Julien Genini created SPARK-10869: - Summary: Auto-normalization of semi-structured schema from a dataframe Key: SPARK-10869 URL: https://issues.apache.org/jira/browse/SPARK-10869 Project: Spark

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML,

[jira] [Comment Edited] (SPARK-7135) Expression for monotonically increasing IDs

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934947#comment-14934947 ] Martin Senne edited comment on SPARK-7135 at 9/29/15 10:04 AM: --- @[~rxin]:

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Summary: monotonicallyIncreasingId() supports offset for indexing (was:

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-29 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935043#comment-14935043 ] Chris Heller commented on SPARK-8734: - I agree on the goal. Without a total redesign of the Spark

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-09-29 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935054#comment-14935054 ] David Sabater commented on SPARK-3862: -- Thanks Reynold - I am really interested in this feature and

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Description: With SPARK-7135 and https://github.com/apache/spark/pull/5709

[jira] [Commented] (SPARK-7135) Expression for monotonically increasing IDs

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934947#comment-14934947 ] Martin Senne commented on SPARK-7135: - @[~rxin]: First, great feature. Unfortunately, there seems to

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset to start indexing at

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Description: With SPARK-7135 and https://github.com/apache/spark/pull/5709

[jira] [Created] (SPARK-10868) monotonicallyIncreasingId() supports offset to start indexing at

2015-09-29 Thread Martin Senne (JIRA)
Martin Senne created SPARK-10868: Summary: monotonicallyIncreasingId() supports offset to start indexing at Key: SPARK-10868 URL: https://issues.apache.org/jira/browse/SPARK-10868 Project: Spark

[jira] [Commented] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934897#comment-14934897 ] Apache Spark commented on SPARK-10490: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10490: Assignee: Apache Spark > Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

[jira] [Assigned] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10490: Assignee: (was: Apache Spark) > Consolidate the Cholesky solvers in

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-29 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934952#comment-14934952 ] Hans van den Bogert commented on SPARK-10474: - I should note that I can reproduce this easily

[jira] [Commented] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934985#comment-14934985 ] Apache Spark commented on SPARK-10736: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10736: Assignee: (was: Apache Spark) > Use 1 for all ratings if $(ratingCol) = "" >

[jira] [Assigned] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10736: Assignee: Apache Spark > Use 1 for all ratings if $(ratingCol) = "" >

[jira] [Commented] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935278#comment-14935278 ] Apache Spark commented on SPARK-10871: -- User 'ryan-williams' has created a pull request for this

[jira] [Updated] (SPARK-10870) Criteo Display Advertising Challenge dataset

2015-09-29 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-10870: -- Description: Very useful dataset to test pipeline because of: # "Big data" dataset - original

[jira] [Created] (SPARK-10870) Criteo Display Advertising Challenge dataset

2015-09-29 Thread Peter Rudenko (JIRA)
Peter Rudenko created SPARK-10870: - Summary: Criteo Display Advertising Challenge dataset Key: SPARK-10870 URL: https://issues.apache.org/jira/browse/SPARK-10870 Project: Spark Issue Type:

[jira] [Created] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-10871: - Summary: Specify number of failed executors in ApplicationMaster error message Key: SPARK-10871 URL: https://issues.apache.org/jira/browse/SPARK-10871 Project:

[jira] [Updated] (SPARK-10870) Criteo Display Advertising Challenge

2015-09-29 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-10870: -- Summary: Criteo Display Advertising Challenge (was: Criteo Display Advertising Challenge

[jira] [Assigned] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10871: Assignee: Apache Spark > Specify number of failed executors in ApplicationMaster error

[jira] [Assigned] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10871: Assignee: (was: Apache Spark) > Specify number of failed executors in

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML,

[jira] [Created] (SPARK-10874) add Search box to History Page

2015-09-29 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10874: - Summary: add Search box to History Page Key: SPARK-10874 URL: https://issues.apache.org/jira/browse/SPARK-10874 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935371#comment-14935371 ] Thomas Graves commented on SPARK-10873: --- Note if there isn't a jira filed to fix the issue we

[jira] [Created] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10873: - Summary: can't sort columns on history page Key: SPARK-10873 URL: https://issues.apache.org/jira/browse/SPARK-10873 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935369#comment-14935369 ] Thomas Graves commented on SPARK-10172: --- Was there another jira filed to really fix this problem

[jira] [Commented] (SPARK-1493) Apache RAT excludes don't work with file path (instead of file name)

2015-09-29 Thread Sandhya Sundaresan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935437#comment-14935437 ] Sandhya Sundaresan commented on SPARK-1493: --- Erik's proposal would certainly help us in the

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML,

[jira] [Closed] (SPARK-6508) error handling issue running python in yarn cluster mode

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-6508. Resolution: Duplicate > error handling issue running python in yarn cluster mode >

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935370#comment-14935370 ] Thomas Graves commented on SPARK-10873: --- evidentally this was explicitly disabled by SPARK-10172.

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935359#comment-14935359 ] Thomas Graves commented on SPARK-6951: -- I'm still seeing history server startup really slow in

[jira] [Created] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2015-09-29 Thread Dmytro Bielievtsov (JIRA)
Dmytro Bielievtsov created SPARK-10872: -- Summary: Derby error (XSDB6) when creating new HiveContext after restarting SparkContext Key: SPARK-10872 URL: https://issues.apache.org/jira/browse/SPARK-10872

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML,

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-29 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935352#comment-14935352 ] Alan Braithwaite commented on SPARK-8734: - I like this method and it's consistent with most other

[jira] [Created] (SPARK-10877) Assertions fail straightforward DataFrame job

2015-09-29 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10877: -- Summary: Assertions fail straightforward DataFrame job Key: SPARK-10877 URL: https://issues.apache.org/jira/browse/SPARK-10877 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10877: --- Summary: Assertions fail straightforward DataFrame job due to word alignment (was: Assertions fail

[jira] [Updated] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10877: --- Attachment: SparkFilterByKeyTest.scala I've attached the Scala script that manifests the problem on

[jira] [Resolved] (SPARK-6919) Add .asDict method to StatCounter

2015-09-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6919. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5516

[jira] [Assigned] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10875: Assignee: (was: Apache Spark) > RowMatrix.computeCovariance() result is not exactly

[jira] [Commented] (SPARK-7245) Spearman correlation for DataFrames

2015-09-29 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936059#comment-14936059 ] Narine Kokhlikyan commented on SPARK-7245: -- Thanks for your comment ~Xiangrui Meng Let me know if

[jira] [Commented] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935827#comment-14935827 ] Apache Spark commented on SPARK-9835: - User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9835: --- Assignee: Xiangrui Meng (was: Apache Spark) > Iteratively reweighted least squares solver

[jira] [Assigned] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9835: --- Assignee: Apache Spark (was: Xiangrui Meng) > Iteratively reweighted least squares solver

[jira] [Commented] (SPARK-10671) Calling a UDF with insufficient number of input arguments should throw an analysis error

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935857#comment-14935857 ] Apache Spark commented on SPARK-10671: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

2015-09-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10058: -- Assignee: Shixiong Zhu (was: Andrew Or) > Flaky test: HeartbeatReceiverSuite: normal

[jira] [Updated] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10782: -- Assignee: Asoka Diggs > Duplicate examples for drop_duplicates and DropDuplicates >

[jira] [Assigned] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10875: Assignee: Apache Spark > RowMatrix.computeCovariance() result is not exactly symmetric >

[jira] [Resolved] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10782. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8930

[jira] [Commented] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935837#comment-14935837 ] Apache Spark commented on SPARK-10875: -- User 'pnpritchard' has created a pull request for this

[jira] [Comment Edited] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936317#comment-14936317 ] Saisai Shao edited comment on SPARK-10858 at 9/30/15 5:49 AM: -- So basically

[jira] [Commented] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

2015-09-29 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936219#comment-14936219 ] Seth Hendrickson commented on SPARK-10788: -- [~josephkb] I'm interested in working on this issue,

[jira] [Created] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2015-09-29 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-10878: - Summary: Race condition when resolving Maven coordinates via Ivy Key: SPARK-10878 URL: https://issues.apache.org/jira/browse/SPARK-10878 Project: Spark

[jira] [Resolved] (SPARK-10800) Flaky test: org.apache.spark.deploy.StandaloneDynamicAllocationSuite

2015-09-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10800. --- Resolution: Duplicate > Flaky test: org.apache.spark.deploy.StandaloneDynamicAllocationSuite

[jira] [Commented] (SPARK-10515) When killing executor, the pending replacement executors will be lost

2015-09-29 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936306#comment-14936306 ] KaiXinXIaoLei commented on SPARK-10515: --- If the heartbeat receiver kills executors (and new ones

[jira] [Commented] (SPARK-9472) Consistent hadoop config for streaming

2015-09-29 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936293#comment-14936293 ] Russell Alexander Spitzer commented on SPARK-9472: -- Any thoughts on back-porting this to

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936317#comment-14936317 ] Saisai Shao commented on SPARK-10858: - So basically I think the problem is do we need to treat this

[jira] [Issue Comment Deleted] (SPARK-10030) Managed memory leak detected when cache table

2015-09-29 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-10030: - Comment: was deleted (was: Such use case issue (maybe rather question) should go to user mailing

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936313#comment-14936313 ] Saisai Shao commented on SPARK-10858: - Hi [~tgraves], I tested again with Mac and Linux (centos),

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-09-29 Thread Sen Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936268#comment-14936268 ] Sen Fang commented on SPARK-: - Another idea is do something similar to F# TypeProvider approach:

[jira] [Created] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Yun Zhao (JIRA)
Yun Zhao created SPARK-10879: Summary: spark on yarn support priority option Key: SPARK-10879 URL: https://issues.apache.org/jira/browse/SPARK-10879 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10515) When killing executor, the pending replacement executors will be lost

2015-09-29 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-10515: -- Target Version/s: 1.6.0 Fix Version/s: 1.6.0 > When killing executor, the pending

[jira] [Issue Comment Deleted] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-10858: Comment: was deleted (was: The error I got in the failed case is the same as you mentioned above,

[jira] [Assigned] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10473: Assignee: Apache Spark > EventLog will loss message in the long-running security

[jira] [Assigned] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10473: Assignee: (was: Apache Spark) > EventLog will loss message in the long-running

[jira] [Commented] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936270#comment-14936270 ] Apache Spark commented on SPARK-10473: -- User 'SaintBacchus' has created a pull request for this

[jira] [Updated] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Yun Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Zhao updated SPARK-10879: - Component/s: YARN Spark Submit > spark on yarn support priority option >

[jira] [Comment Edited] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936313#comment-14936313 ] Saisai Shao edited comment on SPARK-10858 at 9/30/15 3:50 AM: -- Hi

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936176#comment-14936176 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same as you

[jira] [Issue Comment Deleted] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-10858: Comment: was deleted (was: The error I got in the failed case is the same as you mentioned above,

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936174#comment-14936174 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same as you

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936175#comment-14936175 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same as you

[jira] [Commented] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936290#comment-14936290 ] Apache Spark commented on SPARK-10879: -- User 'xiaowen147' has created a pull request for this issue:

[jira] [Updated] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-10473: - Affects Version/s: 1.6.0 > EventLog will loss message in the long-running security application >

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936259#comment-14936259 ] Matt Cheah commented on SPARK-10877: Also the error doesn't occur if I turn code-generation off

[jira] [Assigned] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10879: Assignee: (was: Apache Spark) > spark on yarn support priority option >

[jira] [Assigned] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10879: Assignee: Apache Spark > spark on yarn support priority option >

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935518#comment-14935518 ] Josh Rosen commented on SPARK-10857: Spark 1.5.0+ requires Java 7+, so it should be fine to use Java

[jira] [Commented] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935548#comment-14935548 ] Sean Owen commented on SPARK-10875: --- Makes sense to me, do you want to try a PR? >

[jira] [Created] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-10875: -- Summary: RowMatrix.computeCovariance() result is not exactly symmetric Key: SPARK-10875 URL: https://issues.apache.org/jira/browse/SPARK-10875 Project: Spark

[jira] [Commented] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-09-29 Thread Evan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935572#comment-14935572 ] Evan Chen commented on SPARK-10779: --- I can work on this Jira > Set initialModel for KMeans model in

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935571#comment-14935571 ] Marcelo Vanzin commented on SPARK-10873: To fix this properly we'd have to change the library

[jira] [Updated] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10875: -- Priority: Minor (was: Major) > RowMatrix.computeCovariance() result is not exactly symmetric >

  1   2   >