[jira] [Commented] (SPARK-3432) Fix logging of unit test execution time

[ https://issues.apache.org/jira/browse/SPARK-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255106#comment-14255106 ] Nicholas Chammas commented on SPARK-3432: - [~rxin] Is this still an issue? As far

[jira] [Commented] (SPARK-2261) Spark application event logs are not very NameNode-friendly

[ https://issues.apache.org/jira/browse/SPARK-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255111#comment-14255111 ] Tomas Hudik commented on SPARK-2261: hi Marcelo, is this

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255115#comment-14255115 ] Sean Owen commented on SPARK-2075: -- [~sunrui] You are asking if the Maven Central

[jira] [Commented] (SPARK-4910) build failed

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255119#comment-14255119 ] Tomas Hudik commented on SPARK-4910: @Sean - you are right. It is working for hadoop2:

[jira] [Commented] (SPARK-4910) build failed

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255129#comment-14255129 ] Apache Spark commented on SPARK-4910: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-4367) 2 Phase-shuffle to optimize the DISTINCT aggregation

[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4367: - Summary: 2 Phase-shuffle to optimize the DISTINCT aggregation (was: Process the distinct value before

[jira] [Updated] (SPARK-4367) Partial aggregation support the DISTINCT aggregation

[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4367: - Summary: Partial aggregation support the DISTINCT aggregation (was: 2 Phase-shuffle to optimize the

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255152#comment-14255152 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255150#comment-14255150 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255151#comment-14255151 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255149#comment-14255149 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255153#comment-14255153 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255154#comment-14255154 ] Cheng Lian commented on SPARK-2973: --- (Sorry for spamming the comments, experienced some

[jira] [Created] (SPARK-4913) Fix incorrect event log path

Liang-Chi Hsieh created SPARK-4913: -- Summary: Fix incorrect event log path Key: SPARK-4913 URL: https://issues.apache.org/jira/browse/SPARK-4913 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4913) Fix incorrect event log path

[ https://issues.apache.org/jira/browse/SPARK-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255197#comment-14255197 ] Apache Spark commented on SPARK-4913: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-4914) Two sets of datanucleus versions left in lib_managed after running dev/run-tests

Cheng Lian created SPARK-4914: - Summary: Two sets of datanucleus versions left in lib_managed after running dev/run-tests Key: SPARK-4914 URL: https://issues.apache.org/jira/browse/SPARK-4914 Project:

[jira] [Commented] (SPARK-4914) Two sets of datanucleus versions left in lib_managed after running dev/run-tests

[ https://issues.apache.org/jira/browse/SPARK-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255203#comment-14255203 ] Apache Spark commented on SPARK-4914: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-4910) Build failed with Hadoop 1.x profile: isFile is not a member of org.apache.hadoop.fs.FileStatus

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4910: -- Affects Version/s: 1.2.1 Build failed with Hadoop 1.x profile: isFile is not a member of

[jira] [Updated] (SPARK-4910) Build failed with Hadoop 1.x profile: isFile is not a member of org.apache.hadoop.fs.FileStatus

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4910: -- Summary: Build failed with Hadoop 1.x profile: isFile is not a member of

[jira] [Updated] (SPARK-4910) Build failed with Hadoop 1.x profile: isFile is not a member of org.apache.hadoop.fs.FileStatus

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4910: -- Affects Version/s: (was: 1.2.1) Build failed with Hadoop 1.x profile: isFile is not a member of

[jira] [Resolved] (SPARK-4910) Build failed with Hadoop 1.x profile: isFile is not a member of org.apache.hadoop.fs.FileStatus

[ https://issues.apache.org/jira/browse/SPARK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4910. --- Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sean Owen This was fixed by Sean's

[jira] [Commented] (SPARK-4590) Early investigation of parameter server

[ https://issues.apache.org/jira/browse/SPARK-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255308#comment-14255308 ] Reza Zadeh commented on SPARK-4590: --- Here is an initial review of current systems and

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255344#comment-14255344 ] Nathan M commented on SPARK-3174: - Is there a JIRA to add this feature to Mesos? Provide

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255344#comment-14255344 ] Nathan M edited comment on SPARK-3174 at 12/22/14 1:36 AM: --- This

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255356#comment-14255356 ] Sun Rui commented on SPARK-2075: [~srowen] Yes, I totally agree with you matching version

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255364#comment-14255364 ] Shivaram Venkataraman commented on SPARK-2075: -- [~sunrui] What I can see from

[jira] [Updated] (SPARK-4094) checkpoint should still be available after rdd actions

[ https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-4094: --- Description: rdd.checkpoint() must be called before any actions on this rdd, if there is any other

[jira] [Commented] (SPARK-4094) checkpoint should still be available after rdd actions

[ https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255367#comment-14255367 ] Zhang, Liye commented on SPARK-4094: HI [~sowen], I'm also wondering why the original

[jira] [Commented] (SPARK-4903) RDD remains cached after DROP TABLE

[ https://issues.apache.org/jira/browse/SPARK-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255379#comment-14255379 ] guowei commented on SPARK-4903: --- uncache table test it is OK on my workspace RDD remains

[jira] [Updated] (SPARK-4465) runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[ https://issues.apache.org/jira/browse/SPARK-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-4465: Fix Version/s: (was: 1.2.0) 1.2.1 runAsSparkUser doesn't affect TaskRunner

[jira] [Updated] (SPARK-4465) runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[ https://issues.apache.org/jira/browse/SPARK-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-4465: Priority: Critical (was: Major) runAsSparkUser doesn't affect TaskRunner in Mesos environment at

[jira] [Updated] (SPARK-4465) runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[ https://issues.apache.org/jira/browse/SPARK-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-4465: Affects Version/s: 1.2.0 runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[jira] [Updated] (SPARK-4465) runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[ https://issues.apache.org/jira/browse/SPARK-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-4465: Component/s: Deploy runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

[jira] [Commented] (SPARK-3257) Enable :cp to add JARs in spark-shell (Scala 2.11)

[ https://issues.apache.org/jira/browse/SPARK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255442#comment-14255442 ] Chip Senkbeil commented on SPARK-3257: -- Did this make it into Apache Spark 1.2.0? I

[jira] [Updated] (SPARK-4915) Wrong class name of external shuffle service in the dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4915: -- Description: docs/job-scheduling.md says as follows: {quote} To enable this service, set

[jira] [Created] (SPARK-4915) Wrong class name of external shuffle service in the dynamic allocation

Tsuyoshi OZAWA created SPARK-4915: - Summary: Wrong class name of external shuffle service in the dynamic allocation Key: SPARK-4915 URL: https://issues.apache.org/jira/browse/SPARK-4915 Project:

[jira] [Updated] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4915: -- Summary: Wrong classname of external shuffle service in the doc for dynamic allocation (was:

[jira] [Commented] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255454#comment-14255454 ] Apache Spark commented on SPARK-4915: - User 'oza' has created a pull request for this

[jira] [Resolved] (SPARK-3432) Fix logging of unit test execution time

[ https://issues.apache.org/jira/browse/SPARK-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3432. Resolution: Not a Problem Assignee: Reynold Xin Somehow this has been fixed! Fix logging

[jira] [Resolved] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2075. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Anonymous classes are

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255477#comment-14255477 ] Apache Spark commented on SPARK-2075: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-4916) [SQL][DOCS]Update SQL programming guide about cache section

Gankun Luo created SPARK-4916: - Summary: [SQL][DOCS]Update SQL programming guide about cache section Key: SPARK-4916 URL: https://issues.apache.org/jira/browse/SPARK-4916 Project: Spark Issue

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255521#comment-14255521 ] Twinkle Sachdeva commented on SPARK-4705: - hi, Can you please assign this to me?