[jira] [Assigned] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10263: Assignee: Apache Spark > Add @Since annotation to ml.param and ml.* >

[jira] [Assigned] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10263: Assignee: (was: Apache Spark) > Add @Since annotation to ml.param and ml.* > -

[jira] [Commented] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934751#comment-14934751 ] Apache Spark commented on SPARK-10263: -- User 'taishi-oss' has created a pull request

[jira] [Created] (SPARK-10867) df.write.partitionBy With Two Columns Collapses first Column

2015-09-29 Thread Bryan Rivera (JIRA)
Bryan Rivera created SPARK-10867: Summary: df.write.partitionBy With Two Columns Collapses first Column Key: SPARK-10867 URL: https://issues.apache.org/jira/browse/SPARK-10867 Project: Spark

[jira] [Assigned] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10490: Assignee: (was: Apache Spark) > Consolidate the Cholesky solvers in WeightedLeastSquar

[jira] [Commented] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934897#comment-14934897 ] Apache Spark commented on SPARK-10490: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10490) Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10490: Assignee: Apache Spark > Consolidate the Cholesky solvers in WeightedLeastSquares and ALS

[jira] [Commented] (SPARK-7135) Expression for monotonically increasing IDs

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934947#comment-14934947 ] Martin Senne commented on SPARK-7135: - @[~rxin]: First, great feature. Unfortunately,

[jira] [Comment Edited] (SPARK-7135) Expression for monotonically increasing IDs

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934947#comment-14934947 ] Martin Senne edited comment on SPARK-7135 at 9/29/15 10:04 AM: -

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-29 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934952#comment-14934952 ] Hans van den Bogert commented on SPARK-10474: - I should note that I can repro

[jira] [Created] (SPARK-10868) monotonicallyIncreasingId() supports offset to start indexing at

2015-09-29 Thread Martin Senne (JIRA)
Martin Senne created SPARK-10868: Summary: monotonicallyIncreasingId() supports offset to start indexing at Key: SPARK-10868 URL: https://issues.apache.org/jira/browse/SPARK-10868 Project: Spark

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset to start indexing at

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Description: With SPARK-7135 and https://github.com/apache/spark/pull/5709 `monotonicallyIncreas

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Summary: monotonicallyIncreasingId() supports offset for indexing (was: monotonicallyIncreasingI

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-09-29 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Description: With SPARK-7135 and https://github.com/apache/spark/pull/5709 `monotonicallyIncreas

[jira] [Commented] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934985#comment-14934985 ] Apache Spark commented on SPARK-10736: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10736: Assignee: (was: Apache Spark) > Use 1 for all ratings if $(ratingCol) = "" > -

[jira] [Assigned] (SPARK-10736) Use 1 for all ratings if $(ratingCol) = ""

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10736: Assignee: Apache Spark > Use 1 for all ratings if $(ratingCol) = "" >

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-29 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935043#comment-14935043 ] Chris Heller commented on SPARK-8734: - I agree on the goal. Without a total redesign o

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-09-29 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935054#comment-14935054 ] David Sabater commented on SPARK-3862: -- Thanks Reynold - I am really interested in th

[jira] [Comment Edited] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935129#comment-14935129 ] Thomas Graves edited comment on SPARK-10858 at 9/29/15 1:06 PM: ---

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935129#comment-14935129 ] Thomas Graves commented on SPARK-10858: --- yes its a bad thing as users don't know wh

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935134#comment-14935134 ] Thomas Graves commented on SPARK-10858: --- Note the # is the name that we give it on

[jira] [Created] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
Julien Genini created SPARK-10869: - Summary: Auto-normalization of semi-structured schema from a dataframe Key: SPARK-10869 URL: https://issues.apache.org/jira/browse/SPARK-10869 Project: Spark

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML, J

[jira] [Commented] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935178#comment-14935178 ] Apache Spark commented on SPARK-10851: -- User 'sun-rui' has created a pull request fo

[jira] [Assigned] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10851: Assignee: (was: Apache Spark) > Exception not failing R applications (in yarn cluster

[jira] [Assigned] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10851: Assignee: Apache Spark > Exception not failing R applications (in yarn cluster mode) > ---

[jira] [Commented] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-29 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935181#comment-14935181 ] Sun Rui commented on SPARK-10851: - [~ztoth] does this PR fix your problem? > Exception n

[jira] [Created] (SPARK-10870) Criteo Display Advertising Challenge dataset

2015-09-29 Thread Peter Rudenko (JIRA)
Peter Rudenko created SPARK-10870: - Summary: Criteo Display Advertising Challenge dataset Key: SPARK-10870 URL: https://issues.apache.org/jira/browse/SPARK-10870 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-10870) Criteo Display Advertising Challenge dataset

2015-09-29 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-10870: -- Description: Very useful dataset to test pipeline because of: # "Big data" dataset - original K

[jira] [Created] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-10871: - Summary: Specify number of failed executors in ApplicationMaster error message Key: SPARK-10871 URL: https://issues.apache.org/jira/browse/SPARK-10871 Project: Spar

[jira] [Assigned] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10871: Assignee: Apache Spark > Specify number of failed executors in ApplicationMaster error mes

[jira] [Assigned] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10871: Assignee: (was: Apache Spark) > Specify number of failed executors in ApplicationMaste

[jira] [Commented] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935278#comment-14935278 ] Apache Spark commented on SPARK-10871: -- User 'ryan-williams' has created a pull requ

[jira] [Updated] (SPARK-10870) Criteo Display Advertising Challenge

2015-09-29 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-10870: -- Summary: Criteo Display Advertising Challenge (was: Criteo Display Advertising Challenge datas

[jira] [Created] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2015-09-29 Thread Dmytro Bielievtsov (JIRA)
Dmytro Bielievtsov created SPARK-10872: -- Summary: Derby error (XSDB6) when creating new HiveContext after restarting SparkContext Key: SPARK-10872 URL: https://issues.apache.org/jira/browse/SPARK-10872

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML, J

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML, J

[jira] [Updated] (SPARK-10869) Auto-normalization of semi-structured schema from a dataframe

2015-09-29 Thread Julien Genini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Genini updated SPARK-10869: -- Description: today, you can get a multi-depth schema from a semi-structured dataframe. (XML, J

[jira] [Closed] (SPARK-6508) error handling issue running python in yarn cluster mode

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-6508. Resolution: Duplicate > error handling issue running python in yarn cluster mode >

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-29 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935352#comment-14935352 ] Alan Braithwaite commented on SPARK-8734: - I like this method and it's consistent

[jira] [Created] (SPARK-10874) add Search box to History Page

2015-09-29 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10874: - Summary: add Search box to History Page Key: SPARK-10874 URL: https://issues.apache.org/jira/browse/SPARK-10874 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935371#comment-14935371 ] Thomas Graves commented on SPARK-10873: --- Note if there isn't a jira filed to fix th

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935370#comment-14935370 ] Thomas Graves commented on SPARK-10873: --- evidentally this was explicitly disabled b

[jira] [Created] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10873: - Summary: can't sort columns on history page Key: SPARK-10873 URL: https://issues.apache.org/jira/browse/SPARK-10873 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935369#comment-14935369 ] Thomas Graves commented on SPARK-10172: --- Was there another jira filed to really fix

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935359#comment-14935359 ] Thomas Graves commented on SPARK-6951: -- I'm still seeing history server startup reall

[jira] [Commented] (SPARK-1493) Apache RAT excludes don't work with file path (instead of file name)

2015-09-29 Thread Sandhya Sundaresan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935437#comment-14935437 ] Sandhya Sundaresan commented on SPARK-1493: --- Erik's proposal would certainly hel

[jira] [Created] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-10875: -- Summary: RowMatrix.computeCovariance() result is not exactly symmetric Key: SPARK-10875 URL: https://issues.apache.org/jira/browse/SPARK-10875 Project: Spark

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935518#comment-14935518 ] Josh Rosen commented on SPARK-10857: Spark 1.5.0+ requires Java 7+, so it should be f

[jira] [Updated] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10875: -- Priority: Minor (was: Major) > RowMatrix.computeCovariance() result is not exactly symmetric > ---

[jira] [Commented] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935548#comment-14935548 ] Sean Owen commented on SPARK-10875: --- Makes sense to me, do you want to try a PR? > Row

[jira] [Commented] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-09-29 Thread Evan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935572#comment-14935572 ] Evan Chen commented on SPARK-10779: --- I can work on this Jira > Set initialModel for KM

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935571#comment-14935571 ] Marcelo Vanzin commented on SPARK-10873: To fix this properly we'd have to change

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-09-29 Thread Richard Marscher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935614#comment-14935614 ] Richard Marscher commented on SPARK-2243: - To add another potential use case. We r

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

2015-09-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Labels: flaky-test (was: ) > Flaky test: StandaloneDynamicAllocationSuite > --

[jira] [Resolved] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

2015-09-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10825. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

2015-09-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Priority: Critical (was: Major) > Flaky test: StandaloneDynamicAllocationSuite > -

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

2015-09-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Summary: Flaky test: StandaloneDynamicAllocationSuite (was: Fix race conditions in StandaloneDynamicAl

[jira] [Closed] (SPARK-10735) CatalystTypeConverters MatchError converting RDD with custom object to dataframe

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-10735. - Resolution: Invalid user changed their code. > CatalystTypeConverters MatchError converting RDD

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935677#comment-14935677 ] Thomas Graves commented on SPARK-10873: --- it might be ok to leave if we implement se

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935682#comment-14935682 ] Marcelo Vanzin commented on SPARK-10873: No argument about searching - it would b

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-09-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935688#comment-14935688 ] Thomas Graves commented on SPARK-10873: --- Yeah it should sort all the data also.. >

[jira] [Closed] (SPARK-10867) df.write.partitionBy With Two Columns Collapses first Column

2015-09-29 Thread Bryan Rivera (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Rivera closed SPARK-10867. Resolution: Not A Problem Disregard this bug report. > df.write.partitionBy With Two Columns Colla

[jira] [Created] (SPARK-10876) display total application time in spark history UI

2015-09-29 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10876: - Summary: display total application time in spark history UI Key: SPARK-10876 URL: https://issues.apache.org/jira/browse/SPARK-10876 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

2015-09-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10871. --- Resolution: Fixed Assignee: Ryan Williams Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10415. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8571 [https://github.c

[jira] [Resolved] (SPARK-6919) Add .asDict method to StatCounter

2015-09-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6919. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5516 [https://github.com/

[jira] [Assigned] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9835: --- Assignee: Xiangrui Meng (was: Apache Spark) > Iteratively reweighted least squares solver fo

[jira] [Commented] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935827#comment-14935827 ] Apache Spark commented on SPARK-9835: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9835: --- Assignee: Apache Spark (was: Xiangrui Meng) > Iteratively reweighted least squares solver fo

[jira] [Commented] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935837#comment-14935837 ] Apache Spark commented on SPARK-10875: -- User 'pnpritchard' has created a pull reques

[jira] [Assigned] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10875: Assignee: (was: Apache Spark) > RowMatrix.computeCovariance() result is not exactly sy

[jira] [Assigned] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10875: Assignee: Apache Spark > RowMatrix.computeCovariance() result is not exactly symmetric > -

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

2015-09-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10058: -- Assignee: Shixiong Zhu (was: Andrew Or) > Flaky test: HeartbeatReceiverSuite: normal heartbeat

[jira] [Commented] (SPARK-10671) Calling a UDF with insufficient number of input arguments should throw an analysis error

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935857#comment-14935857 ] Apache Spark commented on SPARK-10671: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10782: -- Assignee: Asoka Diggs > Duplicate examples for drop_duplicates and DropDuplicates > ---

[jira] [Resolved] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10782. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8930 [https://github.com

[jira] [Commented] (SPARK-7245) Spearman correlation for DataFrames

2015-09-29 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936059#comment-14936059 ] Narine Kokhlikyan commented on SPARK-7245: -- Thanks for your comment ~Xiangrui Men

[jira] [Created] (SPARK-10877) Assertions fail straightforward DataFrame job

2015-09-29 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10877: -- Summary: Assertions fail straightforward DataFrame job Key: SPARK-10877 URL: https://issues.apache.org/jira/browse/SPARK-10877 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10877: --- Summary: Assertions fail straightforward DataFrame job due to word alignment (was: Assertions fail s

[jira] [Updated] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10877: --- Attachment: SparkFilterByKeyTest.scala I've attached the Scala script that manifests the problem on m

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936176#comment-14936176 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936175#comment-14936175 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936174#comment-14936174 ] Saisai Shao commented on SPARK-10858: - The error I got in the failed case is the same

[jira] [Issue Comment Deleted] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-10858: Comment: was deleted (was: The error I got in the failed case is the same as you mentioned above,

[jira] [Issue Comment Deleted] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-10858: Comment: was deleted (was: The error I got in the failed case is the same as you mentioned above,

[jira] [Commented] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

2015-09-29 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936219#comment-14936219 ] Seth Hendrickson commented on SPARK-10788: -- [~josephkb] I'm interested in workin

[jira] [Updated] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-10473: - Affects Version/s: 1.6.0 > EventLog will loss message in the long-running security application >

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-09-29 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936259#comment-14936259 ] Matt Cheah commented on SPARK-10877: Also the error doesn't occur if I turn code-gene

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-09-29 Thread Sen Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936268#comment-14936268 ] Sen Fang commented on SPARK-: - Another idea is do something similar to F# TypeProvider

[jira] [Assigned] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10473: Assignee: Apache Spark > EventLog will loss message in the long-running security applicati

[jira] [Commented] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936270#comment-14936270 ] Apache Spark commented on SPARK-10473: -- User 'SaintBacchus' has created a pull reque

[jira] [Assigned] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10473: Assignee: (was: Apache Spark) > EventLog will loss message in the long-running securit

[jira] [Created] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2015-09-29 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-10878: - Summary: Race condition when resolving Maven coordinates via Ivy Key: SPARK-10878 URL: https://issues.apache.org/jira/browse/SPARK-10878 Project: Spark Iss

[jira] [Created] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Yun Zhao (JIRA)
Yun Zhao created SPARK-10879: Summary: spark on yarn support priority option Key: SPARK-10879 URL: https://issues.apache.org/jira/browse/SPARK-10879 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936290#comment-14936290 ] Apache Spark commented on SPARK-10879: -- User 'xiaowen147' has created a pull request

[jira] [Assigned] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10879: Assignee: Apache Spark > spark on yarn support priority option > -

[jira] [Assigned] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10879: Assignee: (was: Apache Spark) > spark on yarn support priority option > --

[jira] [Updated] (SPARK-10879) spark on yarn support priority option

2015-09-29 Thread Yun Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Zhao updated SPARK-10879: - Component/s: YARN Spark Submit > spark on yarn support priority option > ---

  1   2   >