[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643957#comment-14643957 ] Apache Spark commented on SPARK-3181: - User 'fjiang6' has created a pull request for

[jira] [Commented] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643969#comment-14643969 ] Apache Spark commented on SPARK-9390: - User 'cloud-fan' has created a pull request for

[jira] [Updated] (SPARK-9391) Support minus, dot, and intercept operators in SparkR RFormula

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9391: - Assignee: Eric Liang Support minus, dot, and intercept operators in SparkR RFormula

[jira] [Updated] (SPARK-9391) Support minus, dot, and intercept operators in SparkR RFormula

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9391: - Shepherd: Xiangrui Meng Affects Version/s: 1.5.0 Target Version/s: 1.5.0

[jira] [Commented] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643960#comment-14643960 ] Apache Spark commented on SPARK-9402: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9402: --- Assignee: Reynold Xin (was: Apache Spark) Remove CodegenFallback from Abs / FormatNumber

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-07-28 Thread James Aley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643984#comment-14643984 ] James Aley commented on SPARK-9338: --- It seems to work in Postgres and Redshift for me. I

[jira] [Commented] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-28 Thread Pierre Borckmans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644063#comment-14644063 ] Pierre Borckmans commented on SPARK-9280: - [~marmbrus] Is it an intended behaviour

[jira] [Created] (SPARK-9402) Remove CodegenFallback from Abs

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9402: -- Summary: Remove CodegenFallback from Abs Key: SPARK-9402 URL: https://issues.apache.org/jira/browse/SPARK-9402 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9403) Implement code generation for In / InSet

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9403: --- Summary: Implement code generation for In / InSet (was: Implement code generation for In)

[jira] [Assigned] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9390: --- Assignee: (was: Apache Spark) Create an array abstract class ArrayData and a default

[jira] [Assigned] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9390: --- Assignee: Apache Spark Create an array abstract class ArrayData and a default

[jira] [Created] (SPARK-9401) Fully implement code generation for ConcatWs

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9401: -- Summary: Fully implement code generation for ConcatWs Key: SPARK-9401 URL: https://issues.apache.org/jira/browse/SPARK-9401 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9379) org.apache.spark.sql.catalyst.SqlParser should be extensible easily

2015-07-28 Thread Rishi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643951#comment-14643951 ] Rishi commented on SPARK-9379: -- Thanks Michael for the reply. Precisely for plug-able SQL

[jira] [Assigned] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9402: --- Assignee: Apache Spark (was: Reynold Xin) Remove CodegenFallback from Abs / FormatNumber

[jira] [Commented] (SPARK-9362) Exception when using DataFrame groupby().sum on Decimal type in Python

2015-07-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643942#comment-14643942 ] Davies Liu commented on SPARK-9362: --- Could you test this with master? I think master

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644142#comment-14644142 ] yuhao yang commented on SPARK-9273: --- Hi Joseph. The CNN was implemented based on

[jira] [Resolved] (SPARK-9394) CodeFormatter should handle parentheses

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9394. Resolution: Fixed Fix Version/s: 1.5.0 CodeFormatter should handle parentheses

[jira] [Commented] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-07-28 Thread Alex Sobrino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644033#comment-14644033 ] Alex Sobrino commented on SPARK-9089: - Hi, we're running into this same issue. Any

[jira] [Updated] (SPARK-5077) Map output statuses can still exceed spark.akka.frameSize

2015-07-28 Thread Alex Slusarenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Slusarenko updated SPARK-5077: --- Affects Version/s: 1.4.1 Map output statuses can still exceed spark.akka.frameSize

[jira] [Created] (SPARK-9400) Implement code generation for StringLocate

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9400: -- Summary: Implement code generation for StringLocate Key: SPARK-9400 URL: https://issues.apache.org/jira/browse/SPARK-9400 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644148#comment-14644148 ] yuhao yang commented on SPARK-9273: --- Besides, do you happen to know any other

[jira] [Resolved] (SPARK-9420) Move expressions in sql/core package to catalyst.

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9420. Resolution: Fixed Fix Version/s: 1.5.0 Move expressions in sql/core package to catalyst.

[jira] [Commented] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

2015-07-28 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645258#comment-14645258 ] nirav patel commented on SPARK-4492: There are many reasons users don't want to use

[jira] [Commented] (SPARK-3270) Spark API for Application Extensions

2015-07-28 Thread Steve Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645131#comment-14645131 ] Steve Ash commented on SPARK-3270: -- I would like each executor to have some singletons

[jira] [Commented] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645322#comment-14645322 ] Apache Spark commented on SPARK-8742: - User 'falaki' has created a pull request for

[jira] [Assigned] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8742: --- Assignee: (was: Apache Spark) Improve SparkR error messages for DataFrame API

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-07-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645333#comment-14645333 ] Saisai Shao commented on SPARK-4352: Hi [~tgraves], to be clear the original way of

[jira] [Resolved] (SPARK-9393) Fix several error-handling bugs in ScriptTransform operator

2015-07-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9393. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7710

[jira] [Assigned] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9422: --- Assignee: Apache Spark (was: Yin Huai) Remove the placeholder attributes used in the

[jira] [Created] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

2015-07-28 Thread nirav patel (JIRA)
nirav patel created SPARK-9423: -- Summary: Why do every other spark comiter keep suggesting to use spark-submit script Key: SPARK-9423 URL: https://issues.apache.org/jira/browse/SPARK-9423 Project: Spark

[jira] [Commented] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645168#comment-14645168 ] Apache Spark commented on SPARK-9422: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9422: --- Assignee: Yin Huai (was: Apache Spark) Remove the placeholder attributes used in the

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

2015-07-28 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645250#comment-14645250 ] Mark Grover commented on SPARK-9384: FYI: Opened WIP pull request:

[jira] [Assigned] (SPARK-9384) Easier setting of executor and driver classpath

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9384: --- Assignee: Apache Spark Easier setting of executor and driver classpath

[jira] [Commented] (SPARK-8917) Add @since tags to mllib.linalg

2015-07-28 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645248#comment-14645248 ] Yu Ishikawa commented on SPARK-8917: Please assign this issue to me. Add @since tags

[jira] [Issue Comment Deleted] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

2015-07-28 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-4492: --- Comment: was deleted (was: There are many reasons users don't want to use 'spark-submit' script so

[jira] [Resolved] (SPARK-9418) Use sort-merge join as the default shuffle join

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9418. Resolution: Fixed Fix Version/s: 1.5.0 Use sort-merge join as the default shuffle join

[jira] [Assigned] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8742: --- Assignee: Apache Spark Improve SparkR error messages for DataFrame API

[jira] [Updated] (SPARK-9411) Make page size configurable

2015-07-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9411: -- Description: We need to make page sizes configurable so we can reduce them in unit tests and increase

[jira] [Updated] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5561: - Shepherd: Xiangrui Meng Generalize PeriodicGraphCheckpointer for RDDs

[jira] [Updated] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6129: - Shepherd: Sean Owen Create MLlib metrics user guide with algorithm definitions and complete code

[jira] [Updated] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6129: - Assignee: Seth Hendrickson Create MLlib metrics user guide with algorithm definitions and

[jira] [Commented] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645165#comment-14645165 ] Apache Spark commented on SPARK-9421: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9421: --- Assignee: Josh Rosen (was: Apache Spark) Fix null-handling bug in UnsafeRow.getDouble,

[jira] [Created] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

2015-07-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9422: --- Summary: Remove the placeholder attributes used in the aggregation buffers Key: SPARK-9422 URL: https://issues.apache.org/jira/browse/SPARK-9422 Project: Spark Issue

[jira] [Assigned] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9421: --- Assignee: Apache Spark (was: Josh Rosen) Fix null-handling bug in UnsafeRow.getDouble,

[jira] [Created] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

2015-07-28 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9421: - Summary: Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType) Key: SPARK-9421 URL: https://issues.apache.org/jira/browse/SPARK-9421

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645232#comment-14645232 ] Joseph K. Bradley commented on SPARK-9246: -- Please go ahead! The code cutoff for

[jira] [Assigned] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9056: --- Assignee: Apache Spark Rename configuration `spark.streaming.minRememberDuration` to

[jira] [Commented] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645272#comment-14645272 ] Apache Spark commented on SPARK-9056: - User 'sabhyankar' has created a pull request

[jira] [Assigned] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9056: --- Assignee: (was: Apache Spark) Rename configuration

[jira] [Resolved] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

2015-07-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9421. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7736

[jira] [Updated] (SPARK-9426) Job page DAG visualization is not shown

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9426: - Attachment: Screen Shot 2015-07-28 at 7.03.09 PM.png Job page DAG visualization is not shown

[jira] [Created] (SPARK-9426) Job page DAG visualization is not shown

2015-07-28 Thread Andrew Or (JIRA)
Andrew Or created SPARK-9426: Summary: Job page DAG visualization is not shown Key: SPARK-9426 URL: https://issues.apache.org/jira/browse/SPARK-9426 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4300) Race condition during SparkWorker shutdown

2015-07-28 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645331#comment-14645331 ] Alex Liu commented on SPARK-4300: - We find this issue still exists in 1.3.1 {code} ERROR

[jira] [Resolved] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9422. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7737

[jira] [Resolved] (SPARK-9247) Use BytesToBytesMap in unsafe broadcast join

2015-07-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9247. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7592

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-28 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645201#comment-14645201 ] Meihua Wu commented on SPARK-9246: -- [~josephkb] I would like to work on this.

[jira] [Created] (SPARK-9424) Document recent Parquet changes in Spark 1.5

2015-07-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-9424: - Summary: Document recent Parquet changes in Spark 1.5 Key: SPARK-9424 URL: https://issues.apache.org/jira/browse/SPARK-9424 Project: Spark Issue Type:

[jira] [Created] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9425: - Summary: Support DecimalType in UnsafeRow Key: SPARK-9425 URL: https://issues.apache.org/jira/browse/SPARK-9425 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9384) Easier setting of executor and driver classpath

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9384: --- Assignee: (was: Apache Spark) Easier setting of executor and driver classpath

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645249#comment-14645249 ] Apache Spark commented on SPARK-9384: - User 'markgrover' has created a pull request

[jira] [Commented] (SPARK-9411) Make page size configurable

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645295#comment-14645295 ] Apache Spark commented on SPARK-9411: - User 'JoshRosen' has created a pull request for

[jira] [Reopened] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samphel Norden reopened SPARK-9347: --- I dont think spark-8125 is the issue to which this shd be linked... Spark 8838 is the relevant

[jira] [Commented] (SPARK-3684) Can't configure local dirs in Yarn mode

2015-07-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644359#comment-14644359 ] Thomas Graves commented on SPARK-3684: -- What is thie use case for this? YARN

[jira] [Closed] (SPARK-5791) [Spark SQL] show poor performance when multiple table do join operation

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou closed SPARK-5791. -- Resolution: Done [Spark SQL] show poor performance when multiple table do join operation

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-07-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644364#comment-14644364 ] Thomas Graves commented on SPARK-4352: -- Sorry I haven't followed this. To be clear

[jira] [Commented] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644374#comment-14644374 ] Apache Spark commented on SPARK-9398: - User 'yjshen' has created a pull request for

[jira] [Updated] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9402: --- Summary: Remove CodegenFallback from Abs / FormatNumber (was: Remove CodegenFallback from Abs)

[jira] [Created] (SPARK-9403) Implement code generation for In

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9403: -- Summary: Implement code generation for In Key: SPARK-9403 URL: https://issues.apache.org/jira/browse/SPARK-9403 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9390: --- Assignee: Wenchen Fan Create an array abstract class ArrayData and a default implementation backed

[jira] [Created] (SPARK-9404) UnsafeArrayData

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9404: -- Summary: UnsafeArrayData Key: SPARK-9404 URL: https://issues.apache.org/jira/browse/SPARK-9404 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644149#comment-14644149 ] yuhao yang commented on SPARK-9273: --- Thanks Alexander. I'll keep you posted for any new

[jira] [Assigned] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9398: --- Assignee: Apache Spark (was: Yijie Shen) Add unit test for null inputs for date functions

[jira] [Assigned] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9398: --- Assignee: Yijie Shen (was: Apache Spark) Add unit test for null inputs for date functions

[jira] [Created] (SPARK-9427) Add expression functions in SparkR

2015-07-28 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-9427: -- Summary: Add expression functions in SparkR Key: SPARK-9427 URL: https://issues.apache.org/jira/browse/SPARK-9427 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-07-28 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645464#comment-14645464 ] Yu Ishikawa commented on SPARK-9427: I'll work this issue. Add expression functions

[jira] [Created] (SPARK-9428) Add unit test for null inputs for string functions

2015-07-28 Thread Yijie Shen (JIRA)
Yijie Shen created SPARK-9428: - Summary: Add unit test for null inputs for string functions Key: SPARK-9428 URL: https://issues.apache.org/jira/browse/SPARK-9428 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

2015-07-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-9423. Resolution: Invalid Why do every other spark comiter keep suggesting to use spark-submit

[jira] [Commented] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

2015-07-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645495#comment-14645495 ] Patrick Wendell commented on SPARK-9423: This is not a valid issue for JIRA (we

[jira] [Closed] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou closed SPARK-7268. -- Resolution: Done [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

[jira] [Created] (SPARK-9406) Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp

2015-07-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9406: --- Summary: Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp Key: SPARK-9406 URL: https://issues.apache.org/jira/browse/SPARK-9406 Project: Spark

[jira] [Commented] (SPARK-1503) Implement Nesterov's accelerated first-order method

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644560#comment-14644560 ] Xiangrui Meng commented on SPARK-1503: -- There are couple stop criteria in TFOCS

[jira] [Commented] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644462#comment-14644462 ] Yi Zhou commented on SPARK-7268: In latest spark 1.5 master code , the issue is not

[jira] [Created] (SPARK-9405) approximateCountDiscting does not work with GroupBy

2015-07-28 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-9405: Summary: approximateCountDiscting does not work with GroupBy Key: SPARK-9405 URL: https://issues.apache.org/jira/browse/SPARK-9405 Project: Spark Issue

[jira] [Commented] (SPARK-8920) Add @since tags to mllib.linalg

2015-07-28 Thread Sameer Abhyankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644522#comment-14644522 ] Sameer Abhyankar commented on SPARK-8920: - I am working on this and will have a PR

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644557#comment-14644557 ] Liang-Chi Hsieh commented on SPARK-9347: Besides common metadata, I think there

[jira] [Resolved] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8919. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7325

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644583#comment-14644583 ] Samphel Norden commented on SPARK-9347: --- _metadata is also generated but at top

[jira] [Updated] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8919: - Assignee: (was: Bryan Cutler) Add @since tags to mllib.recommendation

[jira] [Updated] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8919: - Shepherd: Bryan Cutler Add @since tags to mllib.recommendation

[jira] [Commented] (SPARK-6884) Random forest: predict class probabilities

2015-07-28 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644474#comment-14644474 ] Olivier Girardot commented on SPARK-6884: - can you publish your branch ? Random

[jira] [Commented] (SPARK-9406) Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644495#comment-14644495 ] Yin Huai commented on SPARK-9406: - [~adrian-wang] Seems you added this test. Can you take

[jira] [Assigned] (SPARK-1503) Implement Nesterov's accelerated first-order method

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1503: --- Assignee: Apache Spark (was: Aaron Staple) Implement Nesterov's accelerated first-order

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644518#comment-14644518 ] Liang-Chi Hsieh commented on SPARK-9347: Currently, as we discussed in the PR, we

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644571#comment-14644571 ] Liang-Chi Hsieh commented on SPARK-9347: Without any _metadata files in partition

[jira] [Commented] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644572#comment-14644572 ] Vinod KC commented on SPARK-8919: - Please assign this issue to me Add @since tags to

[jira] [Commented] (SPARK-8905) Spark Streaming receiving socket data sporadically on Mesos 0.22.1

2015-07-28 Thread Buck (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644594#comment-14644594 ] Buck commented on SPARK-8905: - Seems like Pyspark should mirror Scala's behavior here and not

[jira] [Assigned] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1655: --- Assignee: Apache Spark (was: Aaron Staple) In naive Bayes, store conditional probabilities

  1   2   3   >