[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-09-28 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934731#comment-14934731 ] Dilip Biswal commented on SPARK-8654: - I would like to work on this issue.. > Analys

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934724#comment-14934724 ] Saisai Shao commented on SPARK-10858: - [~tgraves], I assume you're using yarn-cluster

[jira] [Commented] (SPARK-10263) Add @Since annotation to ml.param and ml.*

2015-09-28 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934717#comment-14934717 ] Hiroshi Takahashi commented on SPARK-10263: --- I'll work on this issue. > Add @S

[jira] [Commented] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-28 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934706#comment-14934706 ] Hiroshi Takahashi commented on SPARK-10268: --- I think there are no public classe

[jira] [Comment Edited] (SPARK-9776) Another instance of Derby may have already booted the database

2015-09-28 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934588#comment-14934588 ] KaiXinXIaoLei edited comment on SPARK-9776 at 9/29/15 6:14 AM: -

[jira] [Commented] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-28 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934669#comment-14934669 ] Hiroshi Takahashi commented on SPARK-10268: --- I'll work on this issue. > Add @S

[jira] [Resolved] (SPARK-10670) Link to each language's API in codetabs in ML docs: spark.ml

2015-09-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10670. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8901 [https://gi

[jira] [Commented] (SPARK-10852) DataFrame aggregated column cannot be accessed properly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934620#comment-14934620 ] Apache Spark commented on SPARK-10852: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-10852) DataFrame aggregated column cannot be accessed properly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10852: Assignee: (was: Apache Spark) > DataFrame aggregated column cannot be accessed properl

[jira] [Assigned] (SPARK-10852) DataFrame aggregated column cannot be accessed properly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10852: Assignee: Apache Spark > DataFrame aggregated column cannot be accessed properly > ---

[jira] [Commented] (SPARK-7245) Spearman correlation for DataFrames

2015-09-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934610#comment-14934610 ] Xiangrui Meng commented on SPARK-7245: -- [~JihongMA] may have already worked on this.

[jira] [Reopened] (SPARK-9776) Another instance of Derby may have already booted the database

2015-09-28 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei reopened SPARK-9776: -- In security cluster, and using yarn-client mode, this problem still exist. > Another instance of De

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934584#comment-14934584 ] Sean Owen commented on SPARK-10865: --- Is this really different from https://issues.apach

[jira] [Assigned] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10866: Assignee: Apache Spark > [Spark SQL] [UDF] the floor function got wrong return value type

[jira] [Assigned] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10865: Assignee: (was: Apache Spark) > [Spark SQL] [UDF] the ceil/ceiling function got wrong

[jira] [Commented] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934553#comment-14934553 ] Apache Spark commented on SPARK-10866: -- User 'chenghao-intel' has created a pull req

[jira] [Assigned] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10866: Assignee: (was: Apache Spark) > [Spark SQL] [UDF] the floor function got wrong return

[jira] [Assigned] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10865: Assignee: Apache Spark > [Spark SQL] [UDF] the ceil/ceiling function got wrong return valu

[jira] [Commented] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934554#comment-14934554 ] Sean Owen commented on SPARK-10866: --- Duplicate of SPARK-10724? > [Spark SQL] [UDF] the

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934552#comment-14934552 ] Apache Spark commented on SPARK-10865: -- User 'chenghao-intel' has created a pull req

[jira] [Created] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-09-28 Thread Yi Zhou (JIRA)
Yi Zhou created SPARK-10866: --- Summary: [Spark SQL] [UDF] the floor function got wrong return value type Key: SPARK-10866 URL: https://issues.apache.org/jira/browse/SPARK-10866 Project: Spark Issue

[jira] [Resolved] (SPARK-10644) Applications wait even if free executors are available

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10644. --- Resolution: Not A Problem [~nbalagopal] I'm not sure why you keep ignoring the memory issue, as it se

[jira] [Updated] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-10865: Description: As per ceil/ceiling definition,it should get BIGINT return value -ceil(DOUBLE a), ceiling(DOUB

[jira] [Created] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-09-28 Thread Yi Zhou (JIRA)
Yi Zhou created SPARK-10865: --- Summary: [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type Key: SPARK-10865 URL: https://issues.apache.org/jira/browse/SPARK-10865 Project: Spark

[jira] [Commented] (SPARK-10644) Applications wait even if free executors are available

2015-09-28 Thread Balagopal Nair (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934544#comment-14934544 ] Balagopal Nair commented on SPARK-10644: Let me try to explain this one last time

[jira] [Resolved] (SPARK-10833) Inline, organize BSD/MIT licenses in LICENSE

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10833. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-10644) Applications wait even if free executors are available

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934532#comment-14934532 ] Sean Owen commented on SPARK-10644: --- No, this is not true. This is the opposite of the

[jira] [Updated] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10858: -- Priority: Minor (was: Major) Is that such a bad thing? it seems specific to the file scheme? > YARN:

[jira] [Comment Edited] (SPARK-9318) Add `merge` as synonym for join

2015-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934376#comment-14934376 ] Shivaram Venkataraman edited comment on SPARK-9318 at 9/29/15 2:04 AM: -

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934484#comment-14934484 ] Shivaram Venkataraman commented on SPARK-9318: -- Sure. Feel free to send a PR

[jira] [Created] (SPARK-10864) SparkUI: app name is hidden if window is resized

2015-09-28 Thread Andrew Or (JIRA)
Andrew Or created SPARK-10864: - Summary: SparkUI: app name is hidden if window is resized Key: SPARK-10864 URL: https://issues.apache.org/jira/browse/SPARK-10864 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

2015-09-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10864: -- Attachment: Screen Shot 2015-09-28 at 5.44.06 PM.png > SparkUI: app name is hidden if window is resized

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

2015-09-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934377#comment-14934377 ] Felix Cheung commented on SPARK-9319: - [~falaki]? > Add support for setting column na

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-09-28 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934376#comment-14934376 ] Narine Kokhlikyan commented on SPARK-9318: -- Hi guys, can we reopen this issue Sh

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934357#comment-14934357 ] Apache Spark commented on SPARK-10863: -- User 'olarayej' has created a pull request f

[jira] [Assigned] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10863: Assignee: (was: Apache Spark) > Method coltypes() to return the R column types of a Da

[jira] [Assigned] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10863: Assignee: Apache Spark > Method coltypes() to return the R column types of a DataFrame > -

[jira] [Commented] (SPARK-7245) Spearman correlation for DataFrames

2015-09-28 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934323#comment-14934323 ] Narine Kokhlikyan commented on SPARK-7245: -- Is there anyone working on this right

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934322#comment-14934322 ] Oscar D. Lara Yejas commented on SPARK-10863: - I have changed this JIRA as a

[jira] [Updated] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-10863: Issue Type: Sub-task (was: Task) Parent: SPARK-9315 > Method coltypes() to

[jira] [Updated] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-10863: Issue Type: Task (was: New Feature) > Method coltypes() to return the R column typ

[jira] [Comment Edited] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934307#comment-14934307 ] Oscar D. Lara Yejas edited comment on SPARK-10863 at 9/28/15 11:13 PM:

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934307#comment-14934307 ] Oscar D. Lara Yejas commented on SPARK-10863: - Spark data types are different

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934302#comment-14934302 ] Shivaram Venkataraman commented on SPARK-10863: --- This seems like it is cove

[jira] [Closed] (SPARK-10821) RandomForest serialization OOM during findBestSplits

2015-09-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10821. - Resolution: Done > RandomForest serialization OOM during findBestSplits > ---

[jira] [Commented] (SPARK-10821) RandomForest serialization OOM during findBestSplits

2015-09-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934298#comment-14934298 ] Joseph K. Bradley commented on SPARK-10821: --- Hi, this is more a question for th

[jira] [Commented] (SPARK-10787) Reset ObjectOutputStream more often to prevent OOME

2015-09-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934292#comment-14934292 ] Ted Yu commented on SPARK-10787: I can think of two approaches: 1. Cloning ObjectOutputSt

[jira] [Commented] (SPARK-10045) Add support for DataFrameStatFunctions in SparkR

2015-09-28 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934268#comment-14934268 ] Narine Kokhlikyan commented on SPARK-10045: --- Hi everyone, how about standard d

[jira] [Assigned] (SPARK-10412) In SQL tab, show execution memory per physical operator

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10412: Assignee: Apache Spark > In SQL tab, show execution memory per physical operator > ---

[jira] [Commented] (SPARK-10412) In SQL tab, show execution memory per physical operator

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934237#comment-14934237 ] Apache Spark commented on SPARK-10412: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-10412) In SQL tab, show execution memory per physical operator

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10412: Assignee: (was: Apache Spark) > In SQL tab, show execution memory per physical operato

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934233#comment-14934233 ] Oscar D. Lara Yejas commented on SPARK-10863: - I'm working on this one. -Osc

[jira] [Created] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-09-28 Thread Oscar D. Lara Yejas (JIRA)
Oscar D. Lara Yejas created SPARK-10863: --- Summary: Method coltypes() to return the R column types of a DataFrame Key: SPARK-10863 URL: https://issues.apache.org/jira/browse/SPARK-10863 Project:

[jira] [Commented] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934152#comment-14934152 ] Shivaram Venkataraman commented on SPARK-9466: -- I ran into this again today w

[jira] [Updated] (SPARK-10862) Univariate Statistics: Adding median & quantile support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10862: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-10384 > Univariate Statistics: Adding me

[jira] [Updated] (SPARK-10862) Univariate Statistics: Adding median & quantile support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10862: -- Summary: Univariate Statistics: Adding median & quantile support as UDAF (was: Univariate Statistics:

[jira] [Updated] (SPARK-10860) Bivariate Statistics: Chi-Squared independence test

2015-09-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10860: -- Assignee: Jihong MA > Bivariate Statistics: Chi-Squared independence test > ---

[jira] [Created] (SPARK-10862) Univariate Statistics: Adding median support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
Jihong MA created SPARK-10862: - Summary: Univariate Statistics: Adding median support as UDAF Key: SPARK-10862 URL: https://issues.apache.org/jira/browse/SPARK-10862 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-10861) Univariate Statistics: Adding range support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934109#comment-14934109 ] Jihong MA commented on SPARK-10861: --- I will send a PR soon. > Univariate Statistics:

[jira] [Resolved] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-09-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10859. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 This issue has been resolved by

[jira] [Updated] (SPARK-10861) Univariate Statistics: Adding range support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10861: -- Summary: Univariate Statistics: Adding range support as UDAF (was: Univariate Statistics: Adding range

[jira] [Updated] (SPARK-10861) Univariate Statistics: Adding range support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10861: -- Description: Range support for continuous (was: Range support as UDAF ) > Univariate Statistics: Addin

[jira] [Updated] (SPARK-10861) Univariate Statistics: Adding range support for continuous

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10861: -- Description: Range support as UDAF > Univariate Statistics: Adding range support for continuous > ---

[jira] [Updated] (SPARK-10861) Univariate Statistics: Adding range support for continuous

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10861: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-10384 > Univariate Statistics: Adding ra

[jira] [Created] (SPARK-10861) Univariate Statistics: Adding range support for continuous

2015-09-28 Thread Jihong MA (JIRA)
Jihong MA created SPARK-10861: - Summary: Univariate Statistics: Adding range support for continuous Key: SPARK-10861 URL: https://issues.apache.org/jira/browse/SPARK-10861 Project: Spark Issue

[jira] [Commented] (SPARK-10860) Bivariate Statistics: Chi-Squared independence test

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934098#comment-14934098 ] Jihong MA commented on SPARK-10860: --- [~josephkb] please assign this JIRA to me. Thanks

[jira] [Updated] (SPARK-10860) Bivariate Statistics: Chi-Squared independence test

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10860: -- Description: Pearson's chi-squared independence test > Bivariate Statistics: Chi-Squared independence t

[jira] [Updated] (SPARK-10860) Bivariate Statistics: Chi-Squared independence test

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10860: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-10385 > Bivariate Statistics: Chi-Square

[jira] [Created] (SPARK-10860) Bivariate Statistics: Chi-Squared independence test

2015-09-28 Thread Jihong MA (JIRA)
Jihong MA created SPARK-10860: - Summary: Bivariate Statistics: Chi-Squared independence test Key: SPARK-10860 URL: https://issues.apache.org/jira/browse/SPARK-10860 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-10646) Bivariate Statistics: Pearson's Chi-Squared goodness of fit test

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10646: -- Description: Pearson's chi-squared goodness of fit test for observed against the expected distribution.

[jira] [Updated] (SPARK-10645) Bivariate Statistics: Spearman's Correlation support as UDAF

2015-09-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-10645: -- Description: Spearman's rank correlation coefficient : https://en.wikipedia.org/wiki/Spearman%27s_rank_

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-09-28 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934044#comment-14934044 ] Jason C Lee commented on SPARK-10847: - Instead of Py4JJavaError: An error occurred w

[jira] [Assigned] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10782: Assignee: (was: Apache Spark) > Duplicate examples for drop_duplicates and DropDuplica

[jira] [Assigned] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10782: Assignee: Apache Spark > Duplicate examples for drop_duplicates and DropDuplicates > -

[jira] [Commented] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933985#comment-14933985 ] Apache Spark commented on SPARK-10782: -- User 'asokadiggs' has created a pull request

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-28 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933966#comment-14933966 ] Hans van den Bogert edited comment on SPARK-10474 at 9/28/15 8:56 PM: -

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-28 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933966#comment-14933966 ] Hans van den Bogert commented on SPARK-10474: - Checked using CHANGES file: {

[jira] [Resolved] (SPARK-10395) Simplify CatalystReadSupport

2015-09-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10395. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8553 [https://github.c

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-28 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933966#comment-14933966 ] Hans van den Bogert edited comment on SPARK-10474 at 9/28/15 8:55 PM: -

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933956#comment-14933956 ] Yin Huai commented on SPARK-10474: -- Just a sanity check. Can you take a look and see if

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-28 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933947#comment-14933947 ] Hans van den Bogert commented on SPARK-10474: - I think I'm still seeing this:

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-09-28 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933924#comment-14933924 ] Shea Parkes commented on SPARK-10847: - This issue caused me to learn enough about Sca

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-09-28 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933903#comment-14933903 ] Seth Hendrickson commented on SPARK-7129: - Thanks for clearing those up! One thin

[jira] [Assigned] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10859: Assignee: Apache Spark (was: Davies Liu) > Predicates pushed to InmemoryColumnarTableScan

[jira] [Assigned] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10859: Assignee: Davies Liu (was: Apache Spark) > Predicates pushed to InmemoryColumnarTableScan

[jira] [Commented] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933839#comment-14933839 ] Apache Spark commented on SPARK-10859: -- User 'davies' has created a pull request for

[jira] [Comment Edited] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-28 Thread Asoka Diggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933792#comment-14933792 ] Asoka Diggs edited comment on SPARK-10782 at 9/28/15 7:11 PM: -

[jira] [Created] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-09-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10859: -- Summary: Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly Key: SPARK-10859 URL: https://issues.apache.org/jira/browse/SPARK-10859 Project: Spark

[jira] [Commented] (SPARK-10782) Duplicate examples for drop_duplicates and DropDuplicates

2015-09-28 Thread Asoka Diggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933792#comment-14933792 ] Asoka Diggs commented on SPARK-10782: - A reasonable sounding request, but I'm not fam

[jira] [Commented] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

2015-09-28 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933729#comment-14933729 ] Alan Braithwaite commented on SPARK-10647: -- Actually reading that, it makes more

[jira] [Updated] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

2015-09-28 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10647: - Description: The property `spark.deploy.zookeeper.dir` doesn't match up with the other p

[jira] [Created] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-09-28 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10858: - Summary: YARN: archives/jar/files rename with # doesn't work unless scheme given Key: SPARK-10858 URL: https://issues.apache.org/jira/browse/SPARK-10858 Project: Sp

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-09-28 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933707#comment-14933707 ] Jason C Lee commented on SPARK-10847: - I would like to work on this. > Pyspark - Dat

[jira] [Comment Edited] (SPARK-9798) CrossValidatorModel Documentation Improvements

2015-09-28 Thread rerngvit yanggratoke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933700#comment-14933700 ] rerngvit yanggratoke edited comment on SPARK-9798 at 9/28/15 6:16 PM: --

[jira] [Commented] (SPARK-9798) CrossValidatorModel Documentation Improvements

2015-09-28 Thread rerngvit yanggratoke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933700#comment-14933700 ] rerngvit yanggratoke commented on SPARK-9798: - I have an update PR on this iss

[jira] [Created] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-28 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10857: - Summary: SQL injection bug in JdbcDialect.getTableExistsQuery() Key: SPARK-10857 URL: https://issues.apache.org/jira/browse/SPARK-10857 Project: Spark Issu

[jira] [Closed] (SPARK-10824) DataFrame show method - show(df) should show first N number of rows, similar to R

2015-09-28 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan closed SPARK-10824. - Resolution: Fixed > DataFrame show method - show(df) should show first N number of rows,

[jira] [Commented] (SPARK-6328) Python API for StreamingListener

2015-09-28 Thread Daniel Jalova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933652#comment-14933652 ] Daniel Jalova commented on SPARK-6328: -- I would like to work on this. > Python API f

[jira] [Created] (SPARK-10856) SQL Server dialect needs to map java.sql.Timestamp to DATETIME instead of TIMESTAMP

2015-09-28 Thread Henrik Behrens (JIRA)
Henrik Behrens created SPARK-10856: -- Summary: SQL Server dialect needs to map java.sql.Timestamp to DATETIME instead of TIMESTAMP Key: SPARK-10856 URL: https://issues.apache.org/jira/browse/SPARK-10856

[jira] [Resolved] (SPARK-10844) SparkR: Add correlation function to dataframe

2015-09-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10844. --- Resolution: Duplicate > SparkR: Add correlation function to dataframe > -

  1   2   >