[jira] [Updated] (SPARK-14452) Explicit APIs in Scala for specifying encoders

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14452: Summary: Explicit APIs in Scala for specifying encoders (was: Provide ways to specify encoders in

[jira] [Assigned] (SPARK-14452) Provide ways to specify encoders in Scala without implicits

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14452: Assignee: Apache Spark (was: Reynold Xin) > Provide ways to specify encoders in Scala

[jira] [Assigned] (SPARK-14452) Provide ways to specify encoders in Scala without implicits

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14452: Assignee: Reynold Xin (was: Apache Spark) > Provide ways to specify encoders in Scala

[jira] [Commented] (SPARK-14452) Provide ways to specify encoders in Scala without implicits

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229733#comment-15229733 ] Apache Spark commented on SPARK-14452: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-14452) Provide ways to specify encoders in Scala without implicits

2016-04-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14452: --- Summary: Provide ways to specify encoders in Scala without implicits Key: SPARK-14452 URL: https://issues.apache.org/jira/browse/SPARK-14452 Project: Spark

[jira] [Commented] (SPARK-14451) Move encoder definition into Aggregator interface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229716#comment-15229716 ] Apache Spark commented on SPARK-14451: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14451) Move encoder definition into Aggregator interface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14451: Assignee: Reynold Xin (was: Apache Spark) > Move encoder definition into Aggregator

[jira] [Assigned] (SPARK-14451) Move encoder definition into Aggregator interface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14451: Assignee: Apache Spark (was: Reynold Xin) > Move encoder definition into Aggregator

[jira] [Created] (SPARK-14451) Move encoder definition into Aggregator interface

2016-04-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14451: --- Summary: Move encoder definition into Aggregator interface Key: SPARK-14451 URL: https://issues.apache.org/jira/browse/SPARK-14451 Project: Spark Issue Type:

[jira] [Updated] (SPARK-14451) Move encoder definition into Aggregator interface

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14451: Issue Type: Sub-task (was: Improvement) Parent: SPARK- > Move encoder definition into

[jira] [Assigned] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13783: Assignee: (was: Apache Spark) > Model export/import for spark.ml: GBTs >

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229700#comment-15229700 ] Apache Spark commented on SPARK-13783: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13783: Assignee: Apache Spark > Model export/import for spark.ml: GBTs >

[jira] [Closed] (SPARK-8413) DirectParquetOutputCommitter doesn't clean up the file on task failure

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-8413. -- Resolution: Not A Problem Closing this as we are removing the direct output committer due to

[jira] [Assigned] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10063: Assignee: Reynold Xin (was: Apache Spark) > Remove DirectParquetOutputCommitter >

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229679#comment-15229679 ] Apache Spark commented on SPARK-10063: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10063: Assignee: Apache Spark (was: Reynold Xin) > Remove DirectParquetOutputCommitter >

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229675#comment-15229675 ] Reynold Xin commented on SPARK-10063: - Note that since this is a problem when there are multiple

[jira] [Reopened] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-10063: - Assignee: Reynold Xin (was: Yin Huai) > Remove DirectParquetOutputCommitter >

[jira] [Updated] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10063: Target Version/s: 2.0.0 (was: 1.5.0) > Remove DirectParquetOutputCommitter >

[jira] [Comment Edited] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229562#comment-15229562 ] Josh Rosen edited comment on SPARK-8815 at 4/7/16 2:35 AM: --- This issue should be

[jira] [Resolved] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8815. --- Resolution: Fixed Fix Version/s: 2.0.0 > illegal java package names in jar >

[jira] [Resolved] (SPARK-14134) SQLListenerSuite fails on maven builds

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14134. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11941

[jira] [Reopened] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-8815: --- Assignee: Marcelo Vanzin This issue should be fixed by

[jira] [Updated] (SPARK-14134) SQLListenerSuite fails on maven builds

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14134: --- Assignee: Marcelo Vanzin > SQLListenerSuite fails on maven builds >

[jira] [Created] (SPARK-14450) Python OneVsRest should train multiple models at once

2016-04-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14450: - Summary: Python OneVsRest should train multiple models at once Key: SPARK-14450 URL: https://issues.apache.org/jira/browse/SPARK-14450 Project: Spark

[jira] [Resolved] (SPARK-12610) Add Anti Join Operators

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12610. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Add Anti

[jira] [Assigned] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14357: Assignee: Apache Spark > Tasks that fail due to CommitDeniedException (a side-effect of

[jira] [Commented] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229537#comment-15229537 ] Apache Spark commented on SPARK-14357: -- User 'jasonmoore2k' has created a pull request for this

[jira] [Assigned] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14357: Assignee: (was: Apache Spark) > Tasks that fail due to CommitDeniedException (a

[jira] [Commented] (SPARK-14449) SparkContext should use SparkListenerInterface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229519#comment-15229519 ] Apache Spark commented on SPARK-14449: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14449) SparkContext should use SparkListenerInterface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14449: Assignee: Michael Armbrust (was: Apache Spark) > SparkContext should use

[jira] [Assigned] (SPARK-14449) SparkContext should use SparkListenerInterface

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14449: Assignee: Apache Spark (was: Michael Armbrust) > SparkContext should use

[jira] [Commented] (SPARK-14222) Remove jackson-module-scala dependency or cross-publish Jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229512#comment-15229512 ] Josh Rosen commented on SPARK-14222: Decided to cross-publish instead since I think we want to keep

[jira] [Commented] (SPARK-14428) [SQL] Allow more flexibility when parsing dates and timestamps in json datasources

2016-04-06 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229506#comment-15229506 ] Hyukjin Kwon commented on SPARK-14428: -- I can work on this if it is decided to be supported. (I am

[jira] [Created] (SPARK-14449) SparkContext should use SparkListenerInterface

2016-04-06 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-14449: Summary: SparkContext should use SparkListenerInterface Key: SPARK-14449 URL: https://issues.apache.org/jira/browse/SPARK-14449 Project: Spark Issue

[jira] [Resolved] (SPARK-14446) ReplSuite fails on Scala 2.10

2016-04-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14446. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229485#comment-15229485 ] Apache Spark commented on SPARK-14103: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14103: Assignee: Apache Spark > Python DataFrame CSV load on large file is writing to console in

[jira] [Assigned] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14103: Assignee: (was: Apache Spark) > Python DataFrame CSV load on large file is writing to

[jira] [Assigned] (SPARK-14448) Improvements to ColumnVector

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14448: Assignee: Apache Spark > Improvements to ColumnVector > > >

[jira] [Commented] (SPARK-14448) Improvements to ColumnVector

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229465#comment-15229465 ] Apache Spark commented on SPARK-14448: -- User 'tedyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14448) Improvements to ColumnVector

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14448: Assignee: (was: Apache Spark) > Improvements to ColumnVector >

[jira] [Created] (SPARK-14448) Improvements to ColumnVector

2016-04-06 Thread Ted Yu (JIRA)
Ted Yu created SPARK-14448: -- Summary: Improvements to ColumnVector Key: SPARK-14448 URL: https://issues.apache.org/jira/browse/SPARK-14448 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14447) Integrate AggregateHashMap in Aggregates with Keys

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14447: Assignee: Apache Spark > Integrate AggregateHashMap in Aggregates with Keys >

[jira] [Commented] (SPARK-14447) Integrate AggregateHashMap in Aggregates with Keys

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229428#comment-15229428 ] Apache Spark commented on SPARK-14447: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-14447) Integrate AggregateHashMap in Aggregates with Keys

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14447: Assignee: (was: Apache Spark) > Integrate AggregateHashMap in Aggregates with Keys >

[jira] [Created] (SPARK-14447) Integrate AggregateHashMap in Aggregates with Keys

2016-04-06 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14447: -- Summary: Integrate AggregateHashMap in Aggregates with Keys Key: SPARK-14447 URL: https://issues.apache.org/jira/browse/SPARK-14447 Project: Spark Issue

[jira] [Resolved] (SPARK-12555) Datasets: data is corrupted when input data is reordered

2016-04-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-12555. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11623

[jira] [Resolved] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-04-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13589. Resolution: Resolved Fixed by SPARK-13537 > Flaky test: ParquetHadoopFsRelationSuite.test all

[jira] [Resolved] (SPARK-12382) Remove spark.mllib GBT implementation and wrap spark.ml

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12382. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12050

[jira] [Commented] (SPARK-11374) skip.header.line.count is ignored in HiveContext

2016-04-06 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229401#comment-15229401 ] Stephane Maarek commented on SPARK-11374: - I may add that more metadata isn't processed, namely

[jira] [Assigned] (SPARK-14446) ReplSuite fails on Scala 2.10

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14446: Assignee: Apache Spark > ReplSuite fails on Scala 2.10 > - >

[jira] [Assigned] (SPARK-14446) ReplSuite fails on Scala 2.10

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14446: Assignee: (was: Apache Spark) > ReplSuite fails on Scala 2.10 >

[jira] [Commented] (SPARK-14446) ReplSuite fails on Scala 2.10

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229397#comment-15229397 ] Apache Spark commented on SPARK-14446: -- User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-14446) ReplSuite fails on Scala 2.10

2016-04-06 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-14446: -- Summary: ReplSuite fails on Scala 2.10 Key: SPARK-14446 URL: https://issues.apache.org/jira/browse/SPARK-14446 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14209) Application failure during preemption.

2016-04-06 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229394#comment-15229394 ] Miles Crawford commented on SPARK-14209: I have not forgotten this, worked on getting a cleaner

[jira] [Updated] (SPARK-10884) Support prediction on single instance for regression and classification related models

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10884: -- Description: Support prediction on single instance for regression and classification

[jira] [Updated] (SPARK-10413) Model should support prediction on single instance

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10413: -- Description: Currently models in the pipeline API only implement transform(DataFrame).

[jira] [Assigned] (SPARK-14445) Support native execution of SHOW COLUMNS and SHOW PARTITIONS command

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14445: Assignee: (was: Apache Spark) > Support native execution of SHOW COLUMNS and SHOW

[jira] [Assigned] (SPARK-14445) Support native execution of SHOW COLUMNS and SHOW PARTITIONS command

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14445: Assignee: Apache Spark > Support native execution of SHOW COLUMNS and SHOW PARTITIONS

[jira] [Comment Edited] (SPARK-12566) GLM model family, link function support in SparkR:::glm

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229368#comment-15229368 ] Joseph K. Bradley edited comment on SPARK-12566 at 4/6/16 11:54 PM:

[jira] [Commented] (SPARK-14445) Support native execution of SHOW COLUMNS and SHOW PARTITIONS command

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229386#comment-15229386 ] Apache Spark commented on SPARK-14445: -- User 'dilipbiswal' has created a pull request for this

[jira] [Resolved] (SPARK-14436) Illegal access error when running tests that extend JavaDatasetAggregatorSuiteBase

2016-04-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14436. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 > Illegal

[jira] [Comment Edited] (SPARK-12566) GLM model family, link function support in SparkR:::glm

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229368#comment-15229368 ] Joseph K. Bradley edited comment on SPARK-12566 at 4/6/16 11:47 PM:

[jira] [Commented] (SPARK-12566) GLM model family, link function support in SparkR:::glm

2016-04-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229368#comment-15229368 ] Joseph K. Bradley commented on SPARK-12566: --- Here's my preferred design. I prefer to abstract

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229365#comment-15229365 ] Josh Rosen commented on SPARK-14439: Using vanilla Jackson (or Jackson Jr.) instead of json4s would

[jira] [Comment Edited] (SPARK-14443) parse_url() does not escape query parameters

2016-04-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229345#comment-15229345 ] Dongjoon Hyun edited comment on SPARK-14443 at 4/6/16 11:37 PM: It seems

[jira] [Commented] (SPARK-14443) parse_url() does not escape query parameters

2016-04-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229345#comment-15229345 ] Dongjoon Hyun commented on SPARK-14443: --- I seems that the root cause is the third `key` parameter:

[jira] [Closed] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

2016-04-06 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-14442. --- Resolution: Not A Problem Chatted with [~sthota] and the issue seemed to be some spaces

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229334#comment-15229334 ] Josh Rosen commented on SPARK-14439: How much work will it be to remove our {{json4s}} dependency? >

[jira] [Assigned] (SPARK-14130) [Table related commands] Alter column

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14130: - Assignee: Andrew Or > [Table related commands] Alter column >

[jira] [Resolved] (SPARK-13112) CoarsedExecutorBackend register to driver should wait Executor was ready

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13112. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-14290) Fully utilize the network bandwidth for Netty RPC by avoid significant underlying memory copy

2016-04-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14290. Resolution: Fixed Assignee: Zhang, Liye Fix Version/s: 2.0.0 > Fully

[jira] [Resolved] (SPARK-14444) Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-1. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-14424) spark-class and related (spark-shell, etc.) no longer work with sbt build as documented

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14424. --- Resolution: Fixed Assignee: holdenk Fix Version/s: 2.0.0 Target

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2016-04-06 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229285#comment-15229285 ] Seth Hendrickson commented on SPARK-7129: - I have amended [~meihuawu]'s design document with some

[jira] [Updated] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14391: -- Fix Version/s: (was: 1.6.2) > Flaky Test

[jira] [Updated] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14391: -- Target Version/s: 2.0.0 (was: 1.6.2, 2.0.0) > Flaky Test

[jira] [Commented] (SPARK-14444) Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229278#comment-15229278 ] Apache Spark commented on SPARK-1: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14444) Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: (was: Apache Spark) > Add a new scalastyle `NoScalaDoc` to prevent

[jira] [Resolved] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14391. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0

[jira] [Assigned] (SPARK-14444) Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Apache Spark > Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style

[jira] [Updated] (SPARK-14127) [Table related commands] Describe table

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14127: -- Assignee: (was: Andrew Or) > [Table related commands] Describe table >

[jira] [Resolved] (SPARK-14384) Remove alterFunction from SessionCatalog

2016-04-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14384. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove alterFunction from SessionCatalog >

[jira] [Created] (SPARK-14444) Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments

2016-04-06 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-1: - Summary: Add a new scalastyle `NoScalaDoc` to prevent ScalaDoc-style multiline comments Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1

[jira] [Resolved] (SPARK-14223) Cannot project all columns from a parquet files with ~1,100 columns

2016-04-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14223. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12047

[jira] [Resolved] (SPARK-14310) Fix scan whole stage codegen to determine if batches are produced based on schema

2016-04-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14310. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12047

[jira] [Resolved] (SPARK-14224) Cannot project all columns from a table with ~1,100 columns

2016-04-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14224. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12047

[jira] [Commented] (SPARK-14132) [Table related commands] Alter partition

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229258#comment-15229258 ] Apache Spark commented on SPARK-14132: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14132) [Table related commands] Alter partition

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14132: Assignee: Andrew Or (was: Apache Spark) > [Table related commands] Alter partition >

[jira] [Commented] (SPARK-14133) [Table related commands] Others

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229259#comment-15229259 ] Apache Spark commented on SPARK-14133: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14132) [Table related commands] Alter partition

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14132: Assignee: Apache Spark (was: Andrew Or) > [Table related commands] Alter partition >

[jira] [Commented] (SPARK-14433) PySpark ml GaussianMixture

2016-04-06 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229246#comment-15229246 ] Miao Wang commented on SPARK-14433: --- Can I work on this one? Miao > PySpark ml GaussianMixture >

[jira] [Created] (SPARK-14443) parse_url() does not escape query parameters

2016-04-06 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-14443: --- Summary: parse_url() does not escape query parameters Key: SPARK-14443 URL: https://issues.apache.org/jira/browse/SPARK-14443 Project: Spark Issue

[jira] [Updated] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

2016-04-06 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-14442: --- Attachment: simple-project_2.10-1.0.jar Jar file I am using. > Error: Cannot load main

[jira] [Commented] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

2016-04-06 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229139#comment-15229139 ] Sudhakar Thota commented on SPARK-14442: The similar I found with this JIRA too.

[jira] [Commented] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

2016-04-06 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229161#comment-15229161 ] Sudhakar Thota commented on SPARK-14442: These are the details: 1. Error I am facing: Cannot

[jira] [Created] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

2016-04-06 Thread Sudhakar Thota (JIRA)
Sudhakar Thota created SPARK-14442: -- Summary: Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar Key: SPARK-14442 URL:

[jira] [Assigned] (SPARK-14408) Update RDD.treeAggregate not to use reduce

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14408: Assignee: Apache Spark (was: Joseph K. Bradley) > Update RDD.treeAggregate not to use

  1   2   3   >