[jira] [Assigned] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3200: --- Assignee: Apache Spark (was: Prashant Sharma) > Class defined with reference to external var

[jira] [Assigned] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3200: --- Assignee: Prashant Sharma (was: Apache Spark) > Class defined with reference to external var

[jira] [Created] (SPARK-6949) Support Date and Decimal in Column expression of DataFrame Python API

2015-04-15 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6949: - Summary: Support Date and Decimal in Column expression of DataFrame Python API Key: SPARK-6949 URL: https://issues.apache.org/jira/browse/SPARK-6949 Project: Spark

[jira] [Assigned] (SPARK-1406) PMML model evaluation support via MLib

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1406: --- Assignee: Apache Spark (was: Vincenzo Selvaggio) > PMML model evaluation support via MLib >

[jira] [Assigned] (SPARK-1406) PMML model evaluation support via MLib

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1406: --- Assignee: Vincenzo Selvaggio (was: Apache Spark) > PMML model evaluation support via MLib >

[jira] [Updated] (SPARK-2312) Spark Actors do not handle unknown messages in their receive methods

2015-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2312: - Priority: Trivial (was: Minor) Target Version/s: (was: 1.1.0) Fix Version/s: (was

[jira] [Assigned] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1537: --- Assignee: Apache Spark > Add integration with Yarn's Application Timeline Server > --

[jira] [Assigned] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1537: --- Assignee: (was: Apache Spark) > Add integration with Yarn's Application Timeline Server >

[jira] [Commented] (SPARK-2505) Weighted Regularizer

2015-04-15 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497103#comment-14497103 ] DB Tsai commented on SPARK-2505: For example, in GLMNET package, it allows users to regula

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497133#comment-14497133 ] Michael Armbrust commented on SPARK-4502: - Yeah, I don't think we will get to this

[jira] [Updated] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-6950: -- Description: In Spark 1.2.x, I was able to set my spark event log directory to be a different location

[jira] [Created] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-6950: - Summary: Spark master UI believes some applications are in progress when they are actually completed Key: SPARK-6950 URL: https://issues.apache.org/jira/browse/SPARK-6950 P

[jira] [Resolved] (SPARK-6772) spark sql error when running code on large number of records

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6772. - Resolution: Not A Problem In both cases I think its highly likely that you have bad input

[jira] [Created] (SPARK-6951) History server slow startup if the event log directory is large

2015-04-15 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-6951: - Summary: History server slow startup if the event log directory is large Key: SPARK-6951 URL: https://issues.apache.org/jira/browse/SPARK-6951 Project: Spark Issu

[jira] [Updated] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6950: --- Component/s: Web UI > Spark master UI believes some applications are in progress when they are

[jira] [Resolved] (SPARK-5632) not able to resolve dot('.') in field name

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5632. - Resolution: Fixed https://github.com/apache/spark/commit/4754e16f4746ebd882b2ce7f1efc6e4d4

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497170#comment-14497170 ] Michael Armbrust commented on SPARK-6231: - This is not fixed, and is actually pret

[jira] [Updated] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6231: Assignee: (was: Michael Armbrust) > Join on two tables (generated from same one) is brok

[jira] [Updated] (SPARK-6579) save as parquet with overwrite failed when linking with Hadoop 1.0.4

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6579: Assignee: (was: Michael Armbrust) > save as parquet with overwrite failed when linking w

[jira] [Commented] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497253#comment-14497253 ] Sean Owen commented on SPARK-6950: -- Same as issue resolved in SPARK-5344? SPARK-6107? >

[jira] [Updated] (SPARK-6898) Special chars in column names is broken

2015-04-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6898: Assignee: Wenchen Fan > Special chars in column names is broken > --- >

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

2015-04-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Issue Type: New Feature (was: Bug) > Support HA in standalone cluster mode >

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

2015-04-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Assignee: Tao Wang > Support HA in standalone cluster mode > - > >

[jira] [Resolved] (SPARK-2775) HiveContext does not support dots in column names.

2015-04-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2775. - Resolution: Duplicate > HiveContext does not support dots in column names. >

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2015-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497265#comment-14497265 ] Sean Owen commented on SPARK-6951: -- Not exactly the same thing, but automatically cleanin

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-15 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497267#comment-14497267 ] Paul Wu commented on SPARK-6936: Currently, I synchronized the part, which seems to be wor

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497271#comment-14497271 ] sjk commented on SPARK-6932: Spark-4590, just like it's name "Early investigation of parameter

[jira] [Resolved] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5277. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5237 [https:/

[jira] [Commented] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497273#comment-14497273 ] Matt Cheah commented on SPARK-6950: --- It is not the same as SPARK-6107. I'm not sure if S

[jira] [Comment Edited] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497273#comment-14497273 ] Matt Cheah edited comment on SPARK-6950 at 4/15/15 11:16 PM: -

[jira] [Comment Edited] (SPARK-6950) Spark master UI believes some applications are in progress when they are actually completed

2015-04-15 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497273#comment-14497273 ] Matt Cheah edited comment on SPARK-6950 at 4/15/15 11:18 PM: -

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497295#comment-14497295 ] Sean Owen commented on SPARK-6932: -- [~shijinkui] Yes I'm asking how these two relate. Is

[jira] [Created] (SPARK-6952) spark-daemon.sh fails on long classpath

2015-04-15 Thread Punya Biswal (JIRA)
Punya Biswal created SPARK-6952: --- Summary: spark-daemon.sh fails on long classpath Key: SPARK-6952 URL: https://issues.apache.org/jira/browse/SPARK-6952 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6952) spark-daemon.sh PID reuse check fails on long classpath

2015-04-15 Thread Punya Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punya Biswal updated SPARK-6952: Summary: spark-daemon.sh PID reuse check fails on long classpath (was: spark-daemon.sh fails on lon

[jira] [Updated] (SPARK-4286) Support External Shuffle Service with Mesos integration

2015-04-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4286: - Component/s: Shuffle > Support External Shuffle Service with Mesos integration > -

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread shijinkui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497333#comment-14497333 ] shijinkui commented on SPARK-6932: -- hi, [~srowen]. this issue is one implement of SPARK-4

[jira] [Assigned] (SPARK-6953) Speedup tests of PySpark, reduce logging

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6953: --- Assignee: Davies Liu (was: Apache Spark) > Speedup tests of PySpark, reduce logging > --

[jira] [Commented] (SPARK-6953) Speedup tests of PySpark, reduce logging

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497339#comment-14497339 ] Apache Spark commented on SPARK-6953: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-6953) Speedup tests of PySpark, reduce logging

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6953: --- Assignee: Apache Spark (was: Davies Liu) > Speedup tests of PySpark, reduce logging > --

[jira] [Assigned] (SPARK-6952) spark-daemon.sh PID reuse check fails on long classpath

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6952: --- Assignee: Apache Spark > spark-daemon.sh PID reuse check fails on long classpath > --

[jira] [Assigned] (SPARK-6952) spark-daemon.sh PID reuse check fails on long classpath

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6952: --- Assignee: (was: Apache Spark) > spark-daemon.sh PID reuse check fails on long classpath >

[jira] [Created] (SPARK-6953) Speedup tests of PySpark, reduce logging

2015-04-15 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6953: - Summary: Speedup tests of PySpark, reduce logging Key: SPARK-6953 URL: https://issues.apache.org/jira/browse/SPARK-6953 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6952) spark-daemon.sh PID reuse check fails on long classpath

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497340#comment-14497340 ] Apache Spark commented on SPARK-6952: - User 'punya' has created a pull request for thi

[jira] [Assigned] (SPARK-6287) Add support for dynamic allocation in the Mesos coarse-grained scheduler

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6287: --- Assignee: Apache Spark > Add support for dynamic allocation in the Mesos coarse-grained sched

[jira] [Assigned] (SPARK-6287) Add support for dynamic allocation in the Mesos coarse-grained scheduler

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6287: --- Assignee: (was: Apache Spark) > Add support for dynamic allocation in the Mesos coarse-gr

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-04-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2691: - Target Version/s: 1.4.0 Affects Version/s: 1.0.0 Issue Type: New Feature (was: Improvement

[jira] [Updated] (SPARK-6924) driver hands when net is broken

2015-04-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Description: In yarn-client mode, client is deployed out side of cluster. When the net between client and cluster

[jira] [Updated] (SPARK-6924) driver hands when net is broken

2015-04-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Summary: driver hands when net is broken (was: Client hands when net is broken) > driver hands when net is broke

[jira] [Created] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-6954: Summary: Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative Key: SPARK-6954 URL: https://issues.apache.org/jira/browse/SPARK-6954

[jira] [Updated] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-6954: - Description: I have a simple test case for dynamic allocation on YARN that fails with the followi

[jira] [Updated] (SPARK-6924) driver hands when net is broken

2015-04-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Description: In yarn-client mode, client is deployed out side of cluster. When the net between client and cluster

[jira] [Updated] (SPARK-6924) driver hangs when net is broken

2015-04-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Summary: driver hangs when net is broken (was: driver hands when net is broken) > driver hangs when net is broke

[jira] [Assigned] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6954: --- Assignee: Apache Spark > Dynamic allocation: numExecutorsPending in ExecutorAllocationManager

[jira] [Commented] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497433#comment-14497433 ] Apache Spark commented on SPARK-6954: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6954: --- Assignee: (was: Apache Spark) > Dynamic allocation: numExecutorsPending in ExecutorAlloca

[jira] [Created] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

2015-04-15 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-6955: --- Summary: Do not let Yarn Shuffle Server retry its server port. Key: SPARK-6955 URL: https://issues.apache.org/jira/browse/SPARK-6955 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6924) driver hangs when net is broken

2015-04-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Description: In yarn-client mode, client is deployed out side of cluster. When the net between client and cluster

[jira] [Updated] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-6954: - Description: I have a simple test case for dynamic allocation on YARN that fails with the followi

[jira] [Commented] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497465#comment-14497465 ] Sandy Ryza commented on SPARK-6954: --- Hi [~cheolsoo], are you running with a version of S

[jira] [Commented] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497474#comment-14497474 ] Apache Spark commented on SPARK-6955: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6955: --- Assignee: Apache Spark > Do not let Yarn Shuffle Server retry its server port. >

[jira] [Assigned] (SPARK-6955) Do not let Yarn Shuffle Server retry its server port.

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6955: --- Assignee: (was: Apache Spark) > Do not let Yarn Shuffle Server retry its server port. > -

[jira] [Updated] (SPARK-6954) Dynamic allocation: numExecutorsPending in ExecutorAllocationManager should never become negative

2015-04-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-6954: - Affects Version/s: (was: 1.3.0) 1.3.1 Hi [~sandyr], Thank you for the q

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497483#comment-14497483 ] Qiping Li commented on SPARK-6932: -- [~srowen], thanks for your comments. {quote} Yes I'

[jira] [Comment Edited] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497483#comment-14497483 ] Qiping Li edited comment on SPARK-6932 at 4/16/15 2:47 AM: --- [~sr

[jira] [Commented] (SPARK-6198) Support "select current_database()"

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497495#comment-14497495 ] Apache Spark commented on SPARK-6198: - User 'DoingDone9' has created a pull request fo

[jira] [Commented] (SPARK-4590) Early investigation of parameter server

2015-04-15 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497511#comment-14497511 ] Reza Zadeh commented on SPARK-4590: --- I agree IndexedRDD is not the best way forward as i

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497520#comment-14497520 ] Reza Zadeh commented on SPARK-6932: --- Hi Qiping, thank you for this proposal. I agree tha

[jira] [Assigned] (SPARK-6867) Dropout regularization

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6867: --- Assignee: Apache Spark > Dropout regularization > -- > >

[jira] [Assigned] (SPARK-6867) Dropout regularization

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6867: --- Assignee: (was: Apache Spark) > Dropout regularization > -- > >

[jira] [Commented] (SPARK-6867) Dropout regularization

2015-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497524#comment-14497524 ] Apache Spark commented on SPARK-6867: - User 'rakeshchalasani' has created a pull reque

[jira] [Created] (SPARK-6956) Improve DataFrame API compatibility with Pandas

2015-04-15 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-6956: -- Summary: Improve DataFrame API compatibility with Pandas Key: SPARK-6956 URL: https://issues.apache.org/jira/browse/SPARK-6956 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-6957) groupby

2015-04-15 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-6957: -- Summary: groupby Key: SPARK-6957 URL: https://issues.apache.org/jira/browse/SPARK-6957 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-6958) sort

2015-04-15 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-6958: -- Summary: sort Key: SPARK-6958 URL: https://issues.apache.org/jira/browse/SPARK-6958 Project: Spark Issue Type: Sub-task Reporter: Reynold Xin

[jira] [Resolved] (SPARK-6938) Add informative error messages to require statements.

2015-04-15 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6938. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5532 [https://githu

[jira] [Updated] (SPARK-6938) Add informative error messages to require statements.

2015-04-15 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6938: - Assignee: Juliet Hougland > Add informative error messages to require statements. > --

[jira] [Commented] (SPARK-6921) Spark SQL API "saveAsParquetFile" will output tachyon file with different block size

2015-04-15 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497580#comment-14497580 ] zhangxiongfei commented on SPARK-6921: -- I also did another test on HDFS files. 1)Set

[jira] [Closed] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-15 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-6933. --- Resolution: Duplicate > Thrift Server couldn't strip .inprogress suffix after being stopped >

[jira] [Created] (SPARK-6959) Support for datetime comparisions in filter for dataframes in pyspark

2015-04-15 Thread cynepia (JIRA)
cynepia created SPARK-6959: -- Summary: Support for datetime comparisions in filter for dataframes in pyspark Key: SPARK-6959 URL: https://issues.apache.org/jira/browse/SPARK-6959 Project: Spark Issu

[jira] [Commented] (SPARK-6844) Memory leak occurs when register temp table with cache table on

2015-04-15 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497627#comment-14497627 ] Jack Hu commented on SPARK-6844: Hi, [~marmbrus] Do we have a plan to port this to 1.3.X

[jira] [Resolved] (SPARK-6893) Better handling of pipeline parameters in PySpark

2015-04-15 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6893. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5534 [https://githu

<    1   2   3