[jira] [Assigned] (SPARK-7832) Always run SQL tests in master build.

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7832: --- Assignee: Apache Spark (was: Yin Huai) > Always run SQL tests in master build. > ---

[jira] [Commented] (SPARK-7832) Always run SQL tests in master build.

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557661#comment-14557661 ] Apache Spark commented on SPARK-7832: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-7832) Always run SQL tests in master build.

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7832: --- Assignee: Yin Huai (was: Apache Spark) > Always run SQL tests in master build. > ---

[jira] [Assigned] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7845: --- Assignee: Apache Spark (was: Yin Huai) > Bump "Hadoop 1" tests to version 1.2.1 > --

[jira] [Assigned] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7845: --- Assignee: Yin Huai (was: Apache Spark) > Bump "Hadoop 1" tests to version 1.2.1 > --

[jira] [Commented] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557660#comment-14557660 ] Apache Spark commented on SPARK-7845: - User 'yhuai' has created a pull request for thi

[jira] [Updated] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7845: Summary: Bump "Hadoop 1" tests to version 1.2.1 (was: Bump "Hadoop 1" tests to version 1.2.0) > Bump "Hado

[jira] [Updated] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7845: Description: A small number of API's in Hadoop were added between 1.0.4 and 1.2.1. It appears this is one c

[jira] [Updated] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.0

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7845: --- Assignee: Yin Huai > Bump "Hadoop 1" tests to version 1.2.0 >

[jira] [Updated] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.0

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7845: --- Description: A small number of API's in Hadoop were added between 1.0.4 and 1.2.0. It appears

[jira] [Created] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.0

2015-05-23 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7845: -- Summary: Bump "Hadoop 1" tests to version 1.2.0 Key: SPARK-7845 URL: https://issues.apache.org/jira/browse/SPARK-7845 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-7844) Broken tests in KernelDensity

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557651#comment-14557651 ] Apache Spark commented on SPARK-7844: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-7844) Broken tests in KernelDensity

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7844: --- Assignee: Apache Spark > Broken tests in KernelDensity > - > >

[jira] [Assigned] (SPARK-7844) Broken tests in KernelDensity

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7844: --- Assignee: (was: Apache Spark) > Broken tests in KernelDensity > -

[jira] [Commented] (SPARK-7844) Broken tests in KernelDensity

2015-05-23 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557650#comment-14557650 ] Manoj Kumar commented on SPARK-7844: ping [~josephkb] > Broken tests in KernelDensity

[jira] [Created] (SPARK-7844) Broken tests in KernelDensity

2015-05-23 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-7844: -- Summary: Broken tests in KernelDensity Key: SPARK-7844 URL: https://issues.apache.org/jira/browse/SPARK-7844 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7843: Attachment: 12a345adcbaee359199ddfed4f41bf0e19d66d48 This https://github.com/apache/spark/commit/12a345adcb

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-23 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557631#comment-14557631 ] Burak Yavuz commented on SPARK-7287: I don't understand why that's failing. It's not r

[jira] [Assigned] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4723: --- Assignee: Apache Spark > To abort the stages which have attempted some times > --

[jira] [Assigned] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4723: --- Assignee: (was: Apache Spark) > To abort the stages which have attempted some times > ---

[jira] [Commented] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557630#comment-14557630 ] Josh Rosen commented on SPARK-4723: --- I think the original PR here was closed because rev

[jira] [Updated] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-790: - Component/s: Mesos > Implement the reregistered() callback in MesosScheduler to support master > failover

[jira] [Resolved] (SPARK-912) Take stage breakdown functionality and runLocally out of the main event loop in DAGScheduler

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-912. -- Resolution: Fixed It looks like the task result deserialization code was moved out of the main loop in S

[jira] [Updated] (SPARK-7655) Akka timeout exception from ask and table broadcast

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7655: -- Component/s: Scheduler > Akka timeout exception from ask and table broadcast > -

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-05-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557628#comment-14557628 ] Cheolsoo Park commented on SPARK-6910: -- I don't know what's the best way to fix this,

[jira] [Commented] (SPARK-7829) SortShuffleWriter writes inconsistent data & index files on stage retry

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557624#comment-14557624 ] Josh Rosen commented on SPARK-7829: --- Thanks for splitting this off as a sub-issue from S

[jira] [Commented] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557622#comment-14557622 ] Apache Spark commented on SPARK-6391: - User 'calvinjia' has created a pull request for

[jira] [Assigned] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6391: --- Assignee: (was: Apache Spark) > Update Tachyon version compatibility documentation >

[jira] [Assigned] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6391: --- Assignee: Apache Spark > Update Tachyon version compatibility documentation > ---

[jira] [Commented] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557620#comment-14557620 ] Josh Rosen commented on SPARK-7308: --- I think that properly fixing this set of issues wil

[jira] [Updated] (SPARK-7392) Kryo buffer size can not be larger than 2M

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7392: -- Affects Version/s: 1.4.0 > Kryo buffer size can not be larger than 2M >

[jira] [Commented] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557617#comment-14557617 ] Yin Huai commented on SPARK-7843: - I think that the change in 117 does not affect the test

[jira] [Commented] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557616#comment-14557616 ] Yin Huai commented on SPARK-7843: - In thrift server log, I see {code} 15/05/23 19:49:47 IN

[jira] [Comment Edited] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557615#comment-14557615 ] Yin Huai edited comment on SPARK-7843 at 5/24/15 2:57 AM: -- I am a

[jira] [Updated] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7843: Attachment: HiveThriftBinaryServerSuite-spark-yhuai-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2

[jira] [Created] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-7843: --- Summary: Several thrift server failures in Spark 1.4 sbt build with hadoop 1 Key: SPARK-7843 URL: https://issues.apache.org/jira/browse/SPARK-7843 Project: Spark Issu

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557610#comment-14557610 ] Patrick Wendell commented on SPARK-7287: [~brkyvz] I am going to disable this test

[jira] [Updated] (SPARK-4823) rowSimilarities

2015-05-23 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-4823: Attachment: MovieLensSimilarity Comparisons.pdf The attached file shows the runtime comparison of ro

[jira] [Assigned] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7786: --- Assignee: Apache Spark > Allow StreamingListener to be specified in SparkConf and loaded when

[jira] [Assigned] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7786: --- Assignee: (was: Apache Spark) > Allow StreamingListener to be specified in SparkConf and

[jira] [Commented] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557597#comment-14557597 ] Apache Spark commented on SPARK-7786: - User 'His-name-is-Joof' has created a pull requ

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557581#comment-14557581 ] Patrick Wendell commented on SPARK-7820: Since this only affects tests I'm de-esca

[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7820: --- Priority: Critical (was: Blocker) > Java8-tests suite compile error under SBT > -

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-05-23 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557550#comment-14557550 ] Eron Wright commented on SPARK-5874: - A suggestion, please pass the DataFrame (or at

[jira] [Commented] (SPARK-6086) Exceptions in DAGScheduler.updateAccumulators

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557548#comment-14557548 ] Josh Rosen commented on SPARK-6086: --- Is this still an issue? Can this be reproduced det

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2015-05-23 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557549#comment-14557549 ] Peng Cheng commented on SPARK-7481: --- I've tried to do it but I get a lot of headaches, a

[jira] [Commented] (SPARK-2456) Scheduler refactoring

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557547#comment-14557547 ] Josh Rosen commented on SPARK-2456: --- Before we begin code-changing refactorings, I would

[jira] [Resolved] (SPARK-2647) DAGScheduler plugs others when processing one JobSubmitted event

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2647. --- Resolution: Incomplete To help keep the Scheduler component JIRAs tidy, I'm going to close this issue

[jira] [Commented] (SPARK-4653) DAGScheduler refactoring and cleanup

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557544#comment-14557544 ] Josh Rosen commented on SPARK-4653: --- Before we begin code-changing refactorings, I would

[jira] [Updated] (SPARK-7826) Suppress extra calling getCacheLocs.

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7826: -- Component/s: Scheduler > Suppress extra calling getCacheLocs. > > >

[jira] [Updated] (SPARK-7826) Suppress extra calling getCacheLocs.

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7826: -- Assignee: Takuya Ueshin > Suppress extra calling getCacheLocs. > >

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557464#comment-14557464 ] Joseph K. Bradley commented on SPARK-5981: -- I think it would be nice at some poin

[jira] [Commented] (SPARK-6784) Make sure values of partitioning columns are correctly converted based on their data types

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557424#comment-14557424 ] Yin Huai commented on SPARK-6784: - Seems the issue for partitioning columns is that we did

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2015-05-23 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557416#comment-14557416 ] Debasish Das commented on SPARK-2426: - [~mengxr] Should I add the PR to spark packages

[jira] [Updated] (SPARK-7791) Set user for executors in standalone-mode

2015-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Früboes updated SPARK-7791: -- Issue Type: Wish (was: New Feature) > Set user for executors in standalone-mode > -

[jira] [Updated] (SPARK-7840) Move Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7840: -- Summary: Move Python DataFrame.insertInto into DataFrameWriter (was: Movie Python DataFrame.insertInto

[jira] [Resolved] (SPARK-7840) Move Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7840. --- Resolution: Fixed Fix Version/s: 1.4.0 > Move Python DataFrame.insertInto into DataFrameWriter

[jira] [Updated] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7119: -- Description: {code:sql} from (from src select transform(key, value) using 'cat' as (thing1 int, thing2

[jira] [Resolved] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7822. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-7322) Window function support in Scala/Java DataFrame DSL

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557386#comment-14557386 ] Yin Huai commented on SPARK-7322: - It has been resolved by https://github.com/apache/spark

[jira] [Resolved] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7836. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557351#comment-14557351 ] Apache Spark commented on SPARK-7842: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7842: --- Assignee: Cheng Lian (was: Apache Spark) > For InsertIntoHadoopFsRelation, if an exception i

[jira] [Assigned] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7842: --- Assignee: Apache Spark (was: Cheng Lian) > For InsertIntoHadoopFsRelation, if an exception i

[jira] [Created] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-7842: - Summary: For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted Key: SPARK-7842 URL: https://issues.apache.org/jira/browse/SPARK-7842

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-05-23 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557324#comment-14557324 ] Manoj Kumar commented on SPARK-5981: [~josephkb] Coming back to this. Do you think thi

[jira] [Created] (SPARK-7841) Spark build should not use lib_managed for dependencies

2015-05-23 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-7841: Summary: Spark build should not use lib_managed for dependencies Key: SPARK-7841 URL: https://issues.apache.org/jira/browse/SPARK-7841 Project: Spark Issue T

[jira] [Resolved] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7779. -- Resolution: Fixed Fix Version/s: 1.4.0 > Dynamic allocation: confusing message when canceling req

[jira] [Resolved] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-. -- Resolution: Fixed Fix Version/s: 1.4.0 > Fix a flaky test: org.apache.spark.streaming.Bas

[jira] [Resolved] (SPARK-5090) The improvement of python converter for hbase

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-5090. --- Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Gen TANG > The improvement of python

[jira] [Resolved] (SPARK-6811) Building binary R packages for SparkR

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6811. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 637

[jira] [Resolved] (SPARK-6806) SparkR examples in programming guide

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6806. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 544