[jira] [Created] (SPARK-2715) ExternalAppendOnlyMap adds max limit of times and max limit of disk bytes written for spilling

YanTang Zhai created SPARK-2715: --- Summary: ExternalAppendOnlyMap adds max limit of times and max limit of disk bytes written for spilling Key: SPARK-2715 URL: https://issues.apache.org/jira/browse/SPARK-2715

[jira] [Updated] (SPARK-2692) Decision Tree API update

[ https://issues.apache.org/jira/browse/SPARK-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2692: - Target Version/s: 1.1.0 Affects Version/s: 1.0.0 > Decision Tree API update > --

[jira] [Updated] (SPARK-2692) Decision Tree API update

[ https://issues.apache.org/jira/browse/SPARK-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2692: - Assignee: Joseph K. Bradley > Decision Tree API update > > >

[jira] [Commented] (SPARK-2510) word2vec: Distributed Representation of Words

[ https://issues.apache.org/jira/browse/SPARK-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075951#comment-14075951 ] Xiangrui Meng commented on SPARK-2510: -- Had an offline discussion with [~liquanpei] a

[jira] [Closed] (SPARK-2613) CLONE - word2vec: Distributed Representation of Words

[ https://issues.apache.org/jira/browse/SPARK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-2613. Assignee: Xiangrui Meng (was: Liquan Pei) > CLONE - word2vec: Distributed Representation of Words

[jira] [Created] (SPARK-2714) DAGScheduler logs jobid when runJob finishes

YanTang Zhai created SPARK-2714: --- Summary: DAGScheduler logs jobid when runJob finishes Key: SPARK-2714 URL: https://issues.apache.org/jira/browse/SPARK-2714 Project: Spark Issue Type: Document

[jira] [Resolved] (SPARK-1550) Successive creation of spark context fails in pyspark, if the previous initialization of spark context had failed.

[ https://issues.apache.org/jira/browse/SPARK-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1550. -- Resolution: Fixed Fix Version/s: 1.1.0 > Successive creation of spark context fails in p

[jira] [Updated] (SPARK-2484) Build should not run hive compatibility tests by default.

[ https://issues.apache.org/jira/browse/SPARK-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2484: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-2487 > Build should not run hi

[jira] [Commented] (SPARK-2713) Executors of same application in same host should only download files & jars once

[ https://issues.apache.org/jira/browse/SPARK-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075916#comment-14075916 ] Apache Spark commented on SPARK-2713: - User 'li-zhihui' has created a pull request for

[jira] [Commented] (SPARK-2713) Executors of same application in same host should only download files & jars once

[ https://issues.apache.org/jira/browse/SPARK-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075914#comment-14075914 ] Zhihui commented on SPARK-2713: --- PR https://github.com/apache/spark/pull/1616 > Executors o

[jira] [Updated] (SPARK-2713) Executors of same application in same host should only download files & jars once

[ https://issues.apache.org/jira/browse/SPARK-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihui updated SPARK-2713: -- Description: If Spark lunched multiple executors in one host for one application, every executor would downloa

[jira] [Commented] (SPARK-1860) Standalone Worker cleanup should not clean up running applications

[ https://issues.apache.org/jira/browse/SPARK-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075911#comment-14075911 ] Mingyu Kim commented on SPARK-1860: --- Friendly ping? [~pwendell] Can you let me know if t

[jira] [Created] (SPARK-2713) Executors of same application in same host should only download files & jars once

Zhihui created SPARK-2713: - Summary: Executors of same application in same host should only download files & jars once Key: SPARK-2713 URL: https://issues.apache.org/jira/browse/SPARK-2713 Project: Spark

[jira] [Commented] (SPARK-2712) Add a small note that mvn "package" must happen before "test"

[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075901#comment-14075901 ] Apache Spark commented on SPARK-2712: - User 'javadba' has created a pull request for t

[jira] [Updated] (SPARK-1777) Pass "cached" blocks directly to disk if memory is not large enough

[ https://issues.apache.org/jira/browse/SPARK-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1777: - Description: Currently in Spark we entirely unroll a partition and then check whether it will cause us t

[jira] [Created] (SPARK-2712) Add a small note that mvn "package" must happen before "test"

Stephen Boesch created SPARK-2712: - Summary: Add a small note that mvn "package" must happen before "test" Key: SPARK-2712 URL: https://issues.apache.org/jira/browse/SPARK-2712 Project: Spark

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075865#comment-14075865 ] Michael Yannakopoulos commented on SPARK-2550: -- PR: [https://github.com/apach

[jira] [Issue Comment Deleted] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Yannakopoulos updated SPARK-2550: - Comment: was deleted (was: PR: [https://github.com/apache/spark/pull/1613]) > Su

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075856#comment-14075856 ] Apache Spark commented on SPARK-2550: - User 'miccagiann' has created a pull request fo

[jira] [Resolved] (SPARK-2651) Add maven scalastyle plugin

[ https://issues.apache.org/jira/browse/SPARK-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2651. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1550 [https://

[jira] [Updated] (SPARK-2651) Add maven scalastyle plugin

[ https://issues.apache.org/jira/browse/SPARK-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2651: --- Assignee: Rahul Singhal > Add maven scalastyle plugin > --- > >

[jira] [Reopened] (SPARK-2410) Thrift/JDBC Server

[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2410: Re opening this again due to test issues. > Thrift/JDBC Server > -- > >

[jira] [Commented] (SPARK-2410) Thrift/JDBC Server

[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075833#comment-14075833 ] Patrick Wendell commented on SPARK-2410: {code} [info] - test query execution agai

[jira] [Resolved] (SPARK-2659) HiveQL: Division operator should always perform fractional division

[ https://issues.apache.org/jira/browse/SPARK-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2659. - Resolution: Fixed Fix Version/s: 1.1.0 > HiveQL: Division operator should always p

[jira] [Updated] (SPARK-2711) Create a ShuffleMemoryManager that allocates across spilling collections in the same task

[ https://issues.apache.org/jira/browse/SPARK-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2711: - Description: Right now if there are two ExternalAppendOnlyMaps, they don't compete correctly for

[jira] [Created] (SPARK-2711) Create a ShuffleMemoryManager that allocates across spilling collections in the same task

Matei Zaharia created SPARK-2711: Summary: Create a ShuffleMemoryManager that allocates across spilling collections in the same task Key: SPARK-2711 URL: https://issues.apache.org/jira/browse/SPARK-2711

[jira] [Closed] (SPARK-2575) SVMWithSGD throwing Input Validation failed

[ https://issues.apache.org/jira/browse/SPARK-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-2575. Resolution: Not a Problem Assignee: Xiangrui Meng > SVMWithSGD throwing Input Validation fail

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075816#comment-14075816 ] Xiangrui Meng commented on SPARK-2550: -- After you merge new changes from the master,

[jira] [Updated] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-2710: Summary: Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class) (was: Build SchemaRDD fro

[jira] [Updated] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-2710: Description: Spark SQL can take Parquet files or JSON files as a table directly (without given a case clas

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075799#comment-14075799 ] Teng Qiu commented on SPARK-2710: - a problem is, there is nothing to push down... have no

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075796#comment-14075796 ] Anand Avati commented on SPARK-2707: The changes to just get compiled with 2.3.x can b

[jira] [Comment Edited] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075793#comment-14075793 ] Teng Qiu edited comment on SPARK-2710 at 7/27/14 11:31 PM: --- i wi

[jira] [Comment Edited] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075793#comment-14075793 ] Teng Qiu edited comment on SPARK-2710 at 7/27/14 11:30 PM: --- i wi

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075793#comment-14075793 ] Teng Qiu commented on SPARK-2710: - i will write a derby jdbc testsuite later, manual teste

[jira] [Resolved] (SPARK-2514) Random RDD generator

[ https://issues.apache.org/jira/browse/SPARK-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2514. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1520 [https://gith

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075789#comment-14075789 ] Apache Spark commented on SPARK-2710: - User 'chutium' has created a pull request for t

[jira] [Resolved] (SPARK-1777) Pass "cached" blocks directly to disk if memory is not large enough

[ https://issues.apache.org/jira/browse/SPARK-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1777. -- Resolution: Fixed > Pass "cached" blocks directly to disk if memory is not large enough > -

[jira] [Updated] (SPARK-1777) Pass "cached" blocks directly to disk if memory is not large enough

[ https://issues.apache.org/jira/browse/SPARK-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1777: - Priority: Critical (was: Major) > Pass "cached" blocks directly to disk if memory is not large e

[jira] [Created] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

Teng Qiu created SPARK-2710: --- Summary: Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class) Key: SPARK-2710 URL: https://issues.apache.org/jira/browse/SPARK-2710 Project: Spark I

[jira] [Commented] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075770#comment-14075770 ] Michael Yannakopoulos commented on SPARK-2708: -- This issue is resolved. Initi

[jira] [Commented] (SPARK-2614) Add the spark-examples-xxx-.jar to the Debian packages created with mvn ... -Pdeb (using assembly/pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075768#comment-14075768 ] Apache Spark commented on SPARK-2614: - User 'tzolov' has created a pull request for th

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075765#comment-14075765 ] Sean Owen commented on SPARK-2420: -- Spark doesn't conflict then, but the user code may co

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075764#comment-14075764 ] Patrick Wendell commented on SPARK-2420: Yeah, I think users having to add guava 1

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075762#comment-14075762 ] Sean Owen commented on SPARK-2420: -- Yep, there's an argument there. The downsides are tha

[jira] [Created] (SPARK-2709) Add a tool for certifying Spark API compatiblity

Patrick Wendell created SPARK-2709: -- Summary: Add a tool for certifying Spark API compatiblity Key: SPARK-2709 URL: https://issues.apache.org/jira/browse/SPARK-2709 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075758#comment-14075758 ] Patrick Wendell edited comment on SPARK-2420 at 7/27/14 9:14 PM: ---

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075758#comment-14075758 ] Patrick Wendell commented on SPARK-2420: I put some thought into this as well. One

[jira] [Comment Edited] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075758#comment-14075758 ] Patrick Wendell edited comment on SPARK-2420 at 7/27/14 9:13 PM: ---

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075754#comment-14075754 ] Apache Spark commented on SPARK-2420: - User 'srowen' has created a pull request for th

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075755#comment-14075755 ] Sean Owen commented on SPARK-2420: -- There aren't great answers to this one. I also ended

[jira] [Resolved] (SPARK-2665) Add EqualNS support for HiveQL

[ https://issues.apache.org/jira/browse/SPARK-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2665. - Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Cheng Hao > Add EqualNS

[jira] [Updated] (SPARK-2614) Add the spark-examples-xxx-.jar to the Debian packages created with mvn ... -Pdeb (using assembly/pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Tzolov updated SPARK-2614: Summary: Add the spark-examples-xxx-.jar to the Debian packages created with mvn ... -Pdeb

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075744#comment-14075744 ] Aaron Davidson commented on SPARK-2707: --- That doesn't sound like a bad idea -- actua

[jira] [Commented] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075738#comment-14075738 ] Sean Owen commented on SPARK-2708: -- (Nit: might mark it as Not A Problem or something, le

[jira] [Resolved] (SPARK-2410) Thrift/JDBC Server

[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2410. Resolution: Fixed Issue resolved by pull request 1600 [https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075736#comment-14075736 ] Michael Yannakopoulos commented on SPARK-2708: -- Yes, you are right! Thanks fo

[jira] [Closed] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Yannakopoulos closed SPARK-2708. Resolution: Fixed > [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' make

[jira] [Commented] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075735#comment-14075735 ] Michael Yannakopoulos commented on SPARK-2708: -- I am doing it right now! I am

[jira] [Updated] (SPARK-2678) `Spark-submit` overrides user application options

[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2678: --- Priority: Blocker (was: Major) > `Spark-submit` overrides user application options > ---

[jira] [Commented] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

[ https://issues.apache.org/jira/browse/SPARK-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075728#comment-14075728 ] Sean Owen commented on SPARK-2708: -- I don't see any failures when I run the tests from ma

[jira] [Updated] (SPARK-2673) Improve Spark so that we can attach Debugger to Executors easily

[ https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2673: --- Component/s: Spark Core > Improve Spark so that we can attach Debugger to Executors easily >

[jira] [Updated] (SPARK-2702) Upgrade Tachyon dependency to 0.5.0

[ https://issues.apache.org/jira/browse/SPARK-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2702: --- Component/s: Spark Core > Upgrade Tachyon dependency to 0.5.0 > -

[jira] [Updated] (SPARK-2082) Stratified sampling implementation in PairRDDFunctions

[ https://issues.apache.org/jira/browse/SPARK-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2082: --- Component/s: MLlib > Stratified sampling implementation in PairRDDFunctions > ---

[jira] [Updated] (SPARK-1498) Spark can hang if pyspark tasks fail

[ https://issues.apache.org/jira/browse/SPARK-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1498: --- Component/s: PySpark > Spark can hang if pyspark tasks fail > ---

[jira] [Resolved] (SPARK-2705) Wrong stage description in Web UI

[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2705. Resolution: Fixed Fix Version/s: 1.1.0 > Wrong stage description in Web UI > --

[jira] [Updated] (SPARK-2705) Wrong stage description in Web UI

[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2705: --- Assignee: Cheng Lian > Wrong stage description in Web UI > -

[jira] [Updated] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2703: --- Component/s: Spark Core > Make Tachyon related unit tests execute without deploying a Tachyon

[jira] [Commented] (SPARK-2705) Wrong stage description in Web UI

[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075722#comment-14075722 ] Patrick Wendell commented on SPARK-2705: Fixed via: https://github.com/apache/spar

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075721#comment-14075721 ] Patrick Wendell commented on SPARK-2707: What are the features we want to use here

[jira] [Commented] (SPARK-2688) Need a way to run multiple data pipeline concurrently

[ https://issues.apache.org/jira/browse/SPARK-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075720#comment-14075720 ] Sean Owen commented on SPARK-2688: -- If you persist/cache rdd2, it is not recomputed. You

[jira] [Commented] (SPARK-2648) Randomize order of executors when fetching shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075719#comment-14075719 ] Patrick Wendell commented on SPARK-2648: I was looking more at the current code. F

[jira] [Updated] (SPARK-2688) Need a way to run multiple data pipeline concurrently

[ https://issues.apache.org/jira/browse/SPARK-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated SPARK-2688: --- Description: Suppose we want to do the following data processing: {code} rdd1 -> rdd2 -> rdd3

[jira] [Created] (SPARK-2708) [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining.

Michael Yannakopoulos created SPARK-2708: Summary: [APACHE-SPARK] [CORE] Build Fails: Case class 'TaskUIData' makes sbt complaining. Key: SPARK-2708 URL: https://issues.apache.org/jira/browse/SPARK-2708

[jira] [Comment Edited] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075673#comment-14075673 ] Guoqiang Li edited comment on SPARK-2677 at 7/27/14 6:26 PM: -

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075675#comment-14075675 ] Michael Yannakopoulos commented on SPARK-2550: -- The errors are related to the

[jira] [Comment Edited] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075673#comment-14075673 ] Guoqiang Li edited comment on SPARK-2677 at 7/27/14 6:17 PM: -

[jira] [Commented] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075673#comment-14075673 ] Guoqiang Li commented on SPARK-2677: If {{yarn.scheduler.fair.preemption}} is set to t

[jira] [Updated] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2677: --- Affects Version/s: 0.9.2 > BasicBlockFetchIterator#next can wait forever > --

[jira] [Commented] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075672#comment-14075672 ] Patrick Wendell commented on SPARK-2677: Just as an FYI - this has been observed a

[jira] [Updated] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2677: --- Target Version/s: 1.1.0, 1.0.3 Fix Version/s: (was: 1.0.3)

[jira] [Updated] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2677: --- Affects Version/s: 1.0.1 > BasicBlockFetchIterator#next can wait forever > --

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075654#comment-14075654 ] Michael Yannakopoulos commented on SPARK-2550: -- Hi Xiangrui, Is it only my p

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075652#comment-14075652 ] Aaron Davidson commented on SPARK-2707: --- It does sound mostly mechanical and I belie

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075648#comment-14075648 ] Yardena commented on SPARK-2707: Some minor source changes may be required, see http://do

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075645#comment-14075645 ] Aaron Davidson commented on SPARK-2707: --- Are there any anticipated issues in upgradi

[jira] [Created] (SPARK-2707) Upgrade to Akka 2.3

Yardena created SPARK-2707: -- Summary: Upgrade to Akka 2.3 Key: SPARK-2707 URL: https://issues.apache.org/jira/browse/SPARK-2707 Project: Spark Issue Type: New Feature Components: Spark Cor

[jira] [Commented] (SPARK-2532) Fix issues with consolidated shuffle

[ https://issues.apache.org/jira/browse/SPARK-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075639#comment-14075639 ] Apache Spark commented on SPARK-2532: - User 'mridulm' has created a pull request for t

[jira] [Updated] (SPARK-2681) Spark can hang when fetching shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2681: --- Attachment: jstack-26027.log [~pwendell] Jstack output has been uploaded. > Spark can hang when fetc

[jira] [Updated] (SPARK-2681) Spark can hang when fetching shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2681: --- Affects Version/s: (was: 1.0.0) 1.0.1 > Spark can hang when fetching shuff

[jira] [Updated] (SPARK-2679) Ser/De for Double to enable calling Java API from python in MLlib

[ https://issues.apache.org/jira/browse/SPARK-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2679: - Assignee: Doris Xin > Ser/De for Double to enable calling Java API from python in MLlib > ---

[jira] [Resolved] (SPARK-2679) Ser/De for Double to enable calling Java API from python in MLlib

[ https://issues.apache.org/jira/browse/SPARK-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2679. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1581 [https://gith

[jira] [Created] (SPARK-2706) Enable Spark to support Hive 0.13

Chunjun Xiao created SPARK-2706: --- Summary: Enable Spark to support Hive 0.13 Key: SPARK-2706 URL: https://issues.apache.org/jira/browse/SPARK-2706 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-2705) Wrong stage description in Web UI

[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075609#comment-14075609 ] Cheng Lian commented on SPARK-2705: --- PR: https://github.com/apache/spark/pull/1524 > Wr

[jira] [Created] (SPARK-2705) Wrong stage description in Web UI

Cheng Lian created SPARK-2705: - Summary: Wrong stage description in Web UI Key: SPARK-2705 URL: https://issues.apache.org/jira/browse/SPARK-2705 Project: Spark Issue Type: Bug Componen