[jira] [Created] (SPARK-9402) Remove CodegenFallback from Abs

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9402: -- Summary: Remove CodegenFallback from Abs Key: SPARK-9402 URL: https://issues.apache.org/jira/browse/SPARK-9402 Project: Spark Issue Type: Sub-task Comp

[jira] [Updated] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9402: --- Summary: Remove CodegenFallback from Abs / FormatNumber (was: Remove CodegenFallback from Abs) > Rem

[jira] [Created] (SPARK-9403) Implement code generation for In

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9403: -- Summary: Implement code generation for In Key: SPARK-9403 URL: https://issues.apache.org/jira/browse/SPARK-9403 Project: Spark Issue Type: Sub-task Com

[jira] [Updated] (SPARK-9403) Implement code generation for In / InSet

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9403: --- Summary: Implement code generation for In / InSet (was: Implement code generation for In) > Implemen

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643957#comment-14643957 ] Apache Spark commented on SPARK-3181: - User 'fjiang6' has created a pull request for t

[jira] [Updated] (SPARK-9391) Support minus, dot, and intercept operators in SparkR RFormula

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9391: - Assignee: Eric Liang > Support minus, dot, and intercept operators in SparkR RFormula > --

[jira] [Updated] (SPARK-9391) Support minus, dot, and intercept operators in SparkR RFormula

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9391: - Shepherd: Xiangrui Meng Affects Version/s: 1.5.0 Target Version/s: 1.5.0

[jira] [Commented] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643960#comment-14643960 ] Apache Spark commented on SPARK-9402: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9402: --- Assignee: Reynold Xin (was: Apache Spark) > Remove CodegenFallback from Abs / FormatNumber >

[jira] [Assigned] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9402: --- Assignee: Apache Spark (was: Reynold Xin) > Remove CodegenFallback from Abs / FormatNumber >

[jira] [Commented] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643969#comment-14643969 ] Apache Spark commented on SPARK-9390: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9390: --- Assignee: Apache Spark > Create an array abstract class ArrayData and a default implementatio

[jira] [Assigned] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9390: --- Assignee: (was: Apache Spark) > Create an array abstract class ArrayData and a default im

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-07-28 Thread James Aley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643984#comment-14643984 ] James Aley commented on SPARK-9338: --- It seems to work in Postgres and Redshift for me. I

[jira] [Resolved] (SPARK-9394) CodeFormatter should handle parentheses

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9394. Resolution: Fixed Fix Version/s: 1.5.0 > CodeFormatter should handle parentheses > --

[jira] [Created] (SPARK-9404) UnsafeArrayData

2015-07-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9404: -- Summary: UnsafeArrayData Key: SPARK-9404 URL: https://issues.apache.org/jira/browse/SPARK-9404 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9390: --- Assignee: Wenchen Fan > Create an array abstract class ArrayData and a default implementation backed

[jira] [Commented] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-07-28 Thread Alex Sobrino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644033#comment-14644033 ] Alex Sobrino commented on SPARK-9089: - Hi, we're running into this same issue. Any pro

[jira] [Commented] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-28 Thread Pierre Borckmans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644063#comment-14644063 ] Pierre Borckmans commented on SPARK-9280: - [~marmbrus] Is it an intended behaviour

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644142#comment-14644142 ] yuhao yang commented on SPARK-9273: --- Hi Joseph. The CNN was implemented based on custome

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644148#comment-14644148 ] yuhao yang commented on SPARK-9273: --- Besides, do you happen to know any other implementa

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644149#comment-14644149 ] yuhao yang commented on SPARK-9273: --- Thanks Alexander. I'll keep you posted for any new

[jira] [Updated] (SPARK-5077) Map output statuses can still exceed spark.akka.frameSize

2015-07-28 Thread Alex Slusarenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Slusarenko updated SPARK-5077: --- Affects Version/s: 1.4.1 > Map output statuses can still exceed spark.akka.frameSize > ---

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

2015-07-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644196#comment-14644196 ] Yanbo Liang commented on SPARK-6885: [~josephkb] Thanks for your comments. After surv

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

2015-07-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644197#comment-14644197 ] Yanbo Liang commented on SPARK-6885: [~josephkb] Thanks for your comments. After surv

[jira] [Issue Comment Deleted] (SPARK-6885) Decision trees: predict class probabilities

2015-07-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-6885: --- Comment: was deleted (was: [~josephkb] Thanks for your comments. After survey I found that we have tw

[jira] [Comment Edited] (SPARK-6885) Decision trees: predict class probabilities

2015-07-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644196#comment-14644196 ] Yanbo Liang edited comment on SPARK-6885 at 7/28/15 10:34 AM: --

[jira] [Comment Edited] (SPARK-6885) Decision trees: predict class probabilities

2015-07-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644196#comment-14644196 ] Yanbo Liang edited comment on SPARK-6885 at 7/28/15 10:33 AM: --

[jira] [Reopened] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samphel Norden reopened SPARK-9347: --- I dont think spark-8125 is the issue to which this shd be linked... Spark 8838 is the relevant ji

[jira] [Updated] (SPARK-8828) Revert the change of SPARK-5680

2015-07-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8828: - Assignee: Yijie Shen > Revert the change of SPARK-5680 > --- > >

[jira] [Updated] (SPARK-9351) remove literals from grouping expressions in Aggregate

2015-07-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9351: - Assignee: Wenchen Fan > remove literals from grouping expressions in Aggregate > -

[jira] [Reopened] (SPARK-9382) Tachyon version mismatch

2015-07-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-9382: -- > Tachyon version mismatch > > > Key: SPARK-9382 >

[jira] [Resolved] (SPARK-9382) Tachyon version mismatch

2015-07-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9382. -- Resolution: Duplicate Fix Version/s: (was: 1.4.1) > Tachyon version mismatch > --

[jira] [Commented] (SPARK-3684) Can't configure local dirs in Yarn mode

2015-07-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644359#comment-14644359 ] Thomas Graves commented on SPARK-3684: -- What is thie use case for this? YARN specifi

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-07-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644364#comment-14644364 ] Thomas Graves commented on SPARK-4352: -- Sorry I haven't followed this. To be clear th

[jira] [Commented] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644374#comment-14644374 ] Apache Spark commented on SPARK-9398: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9398: --- Assignee: Apache Spark (was: Yijie Shen) > Add unit test for null inputs for date functions

[jira] [Assigned] (SPARK-9398) Add unit test for null inputs for date functions

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9398: --- Assignee: Yijie Shen (was: Apache Spark) > Add unit test for null inputs for date functions

[jira] [Closed] (SPARK-5791) [Spark SQL] show poor performance when multiple table do join operation

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou closed SPARK-5791. -- Resolution: Done > [Spark SQL] show poor performance when multiple table do join operation > ---

[jira] [Commented] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644462#comment-14644462 ] Yi Zhou commented on SPARK-7268: In latest spark 1.5 master code , the issue is not existe

[jira] [Closed] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou closed SPARK-7268. -- Resolution: Done > [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN > -

[jira] [Commented] (SPARK-6884) Random forest: predict class probabilities

2015-07-28 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644474#comment-14644474 ] Olivier Girardot commented on SPARK-6884: - can you publish your branch ? > Random

[jira] [Created] (SPARK-9405) approximateCountDiscting does not work with GroupBy

2015-07-28 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-9405: Summary: approximateCountDiscting does not work with GroupBy Key: SPARK-9405 URL: https://issues.apache.org/jira/browse/SPARK-9405 Project: Spark Issue Type:

[jira] [Created] (SPARK-9406) Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp

2015-07-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9406: --- Summary: Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp Key: SPARK-9406 URL: https://issues.apache.org/jira/browse/SPARK-9406 Project: Spark

[jira] [Commented] (SPARK-9406) Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644495#comment-14644495 ] Yin Huai commented on SPARK-9406: - [~adrian-wang] Seems you added this test. Can you take

[jira] [Assigned] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1655: --- Assignee: Apache Spark (was: Aaron Staple) > In naive Bayes, store conditional probabilities

[jira] [Assigned] (SPARK-1503) Implement Nesterov's accelerated first-order method

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1503: --- Assignee: Aaron Staple (was: Apache Spark) > Implement Nesterov's accelerated first-order me

[jira] [Assigned] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1655: --- Assignee: Aaron Staple (was: Apache Spark) > In naive Bayes, store conditional probabilities

[jira] [Assigned] (SPARK-1503) Implement Nesterov's accelerated first-order method

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1503: --- Assignee: Apache Spark (was: Aaron Staple) > Implement Nesterov's accelerated first-order me

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644518#comment-14644518 ] Liang-Chi Hsieh commented on SPARK-9347: Currently, as we discussed in the PR, we

[jira] [Commented] (SPARK-8920) Add @since tags to mllib.linalg

2015-07-28 Thread Sameer Abhyankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644522#comment-14644522 ] Sameer Abhyankar commented on SPARK-8920: - I am working on this and will have a PR

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644525#comment-14644525 ] Samphel Norden commented on SPARK-9347: --- Understood. However, what I noticed is that

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644557#comment-14644557 ] Liang-Chi Hsieh commented on SPARK-9347: Besides common metadata, I think there ar

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644558#comment-14644558 ] Samphel Norden commented on SPARK-9347: --- table is partitioned using key=value folder

[jira] [Commented] (SPARK-1503) Implement Nesterov's accelerated first-order method

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644560#comment-14644560 ] Xiangrui Meng commented on SPARK-1503: -- There are couple stop criteria in TFOCS (impl

[jira] [Resolved] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8919. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7325 [https://githu

[jira] [Updated] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8919: - Assignee: (was: Bryan Cutler) > Add @since tags to mllib.recommendation >

[jira] [Updated] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8919: - Shepherd: Bryan Cutler > Add @since tags to mllib.recommendation > ---

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644571#comment-14644571 ] Liang-Chi Hsieh commented on SPARK-9347: Without any _metadata files in partition

[jira] [Commented] (SPARK-8919) Add @since tags to mllib.recommendation

2015-07-28 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644572#comment-14644572 ] Vinod KC commented on SPARK-8919: - Please assign this issue to me > Add @since tags to ml

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-28 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644583#comment-14644583 ] Samphel Norden commented on SPARK-9347: --- _metadata is also generated but at top leve

[jira] [Commented] (SPARK-8905) Spark Streaming receiving socket data sporadically on Mesos 0.22.1

2015-07-28 Thread Buck (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644594#comment-14644594 ] Buck commented on SPARK-8905: - Seems like Pyspark should mirror Scala's behavior here and not

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644608#comment-14644608 ] Seth Hendrickson commented on SPARK-8971: - I'd like to work on this JIRA if it's s

[jira] [Resolved] (SPARK-9402) Remove CodegenFallback from Abs / FormatNumber

2015-07-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9402. Resolution: Fixed Fix Version/s: 1.5.0 > Remove CodegenFallback from Abs / FormatNumber > ---

[jira] [Created] (SPARK-9407) Parquet shouldn't push down predicates over a column whose underlying Parquet type is an ENUM

2015-07-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-9407: - Summary: Parquet shouldn't push down predicates over a column whose underlying Parquet type is an ENUM Key: SPARK-9407 URL: https://issues.apache.org/jira/browse/SPARK-9407

[jira] [Resolved] (SPARK-9406) Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9406. - Resolution: Duplicate > Flaky test: o.a.s.sql.DatetimeExpressionsSuite.function current_timestamp > --

[jira] [Updated] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9225: - Assignee: Meihua Wu (was: Xiangrui Meng) > LDASuite needs unit tests for empty documents > --

[jira] [Assigned] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-9225: Assignee: Xiangrui Meng > LDASuite needs unit tests for empty documents > -

[jira] [Updated] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9225: - Shepherd: Xiangrui Meng Target Version/s: 1.5.0 > LDASuite needs unit tests for empty

[jira] [Commented] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644640#comment-14644640 ] Apache Spark commented on SPARK-9196: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9196: --- Assignee: Adrian Wang (was: Apache Spark) > DatetimeExpressionsSuite: function current_times

[jira] [Assigned] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9196: --- Assignee: Apache Spark (was: Adrian Wang) > DatetimeExpressionsSuite: function current_times

[jira] [Updated] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-07-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9338: Issue Type: New Feature (was: Bug) > Aliases from SELECT not available in GROUP BY > --

[jira] [Commented] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644663#comment-14644663 ] Yin Huai commented on SPARK-9196: - I submitted a PR to ignore this test for now (https://

[jira] [Updated] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7105: - Assignee: Manoj Kumar (was: Yu Ishikawa) > Support model save/load in Python's GaussianMixture >

[jira] [Updated] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7105: - Shepherd: Xiangrui Meng > Support model save/load in Python's GaussianMixture > --

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644670#comment-14644670 ] Feynman Liang commented on SPARK-8971: -- I don't think anyone's working on it. [~mengx

[jira] [Resolved] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

2015-07-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9397. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7717 [https:/

[jira] [Commented] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644687#comment-14644687 ] Apache Spark commented on SPARK-5561: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5561: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Generalize PeriodicGraphCheckpointer for R

[jira] [Assigned] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5561: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Generalize PeriodicGraphCheckpointer for R

[jira] [Commented] (SPARK-5791) [Spark SQL] show poor performance when multiple table do join operation

2015-07-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644689#comment-14644689 ] Yin Huai commented on SPARK-5791: - [~jameszhouyi] So, the performance issue of join operat

[jira] [Updated] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8971: - Assignee: Seth Hendrickson > Support balanced class labels when splitting train/cross validation s

[jira] [Updated] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8971: - Target Version/s: 1.6.0 (was: 1.5.0) > Support balanced class labels when splitting train/cross v

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644691#comment-14644691 ] Xiangrui Meng commented on SPARK-8971: -- Assigned. Note that this should call `sampleB

[jira] [Comment Edited] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-07-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644691#comment-14644691 ] Xiangrui Meng edited comment on SPARK-8971 at 7/28/15 5:25 PM: -

[jira] [Created] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-28 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-9408: -- Summary: Refactor mllib/linalg.py to mllib/linalg Key: SPARK-9408 URL: https://issues.apache.org/jira/browse/SPARK-9408 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-8920) Add @since tags to mllib.linalg

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8920: --- Assignee: (was: Apache Spark) > Add @since tags to mllib.linalg > ---

[jira] [Assigned] (SPARK-8920) Add @since tags to mllib.linalg

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8920: --- Assignee: Apache Spark > Add @since tags to mllib.linalg > --- >

[jira] [Commented] (SPARK-8920) Add @since tags to mllib.linalg

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644728#comment-14644728 ] Apache Spark commented on SPARK-8920: - User 'sabhyankar' has created a pull request fo

[jira] [Commented] (SPARK-3684) Can't configure local dirs in Yarn mode

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644767#comment-14644767 ] Andrew Or commented on SPARK-3684: -- OK, let's close this then. My original use case was f

[jira] [Closed] (SPARK-3684) Can't configure local dirs in Yarn mode

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3684. Resolution: Won't Fix > Can't configure local dirs in Yarn mode > --- >

[jira] [Closed] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7268. Resolution: Cannot Reproduce > [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

[jira] [Commented] (SPARK-8921) Add @since tags to mllib.stat

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644772#comment-14644772 ] Apache Spark commented on SPARK-8921: - User 'BimalTandel' has created a pull request f

[jira] [Reopened] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-7268: -- > [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN > --

[jira] [Commented] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644774#comment-14644774 ] Andrew Or commented on SPARK-7268: -- By the way [~yizhou] is this still an issue with the

[jira] [Assigned] (SPARK-8921) Add @since tags to mllib.stat

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8921: --- Assignee: Apache Spark > Add @since tags to mllib.stat > - > >

[jira] [Assigned] (SPARK-8921) Add @since tags to mllib.stat

2015-07-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8921: --- Assignee: (was: Apache Spark) > Add @since tags to mllib.stat > -

[jira] [Commented] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644773#comment-14644773 ] Andrew Or commented on SPARK-7268: -- I just re-closed this as "Cannot reproduce" since tha

[jira] [Comment Edited] (SPARK-7268) [Spark SQL] Throw 'Shutdown hooks cannot be modified during shutdown' on YARN

2015-07-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644774#comment-14644774 ] Andrew Or edited comment on SPARK-7268 at 7/28/15 6:04 PM: --- By t

  1   2   3   >