[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilterScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Description: See screenshot. It's been OOM'ing on Master SBT tests specifically with the Hadoop 2.3

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilterScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Attachment: master SBT.png Consistently failing test: o.a.s.sql.sources.FilterScanSuite

[jira] [Commented] (SPARK-8168) Add Python friendly constructor to PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577748#comment-14577748 ] Apache Spark commented on SPARK-8168: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-8168) Add Python friendly constructor to PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8168: --- Assignee: Xiangrui Meng (was: Apache Spark) Add Python friendly constructor to

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Affects Version/s: (was: 1.4.1) Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Target Version/s: 1.5.0 (was: 1.4.1, 1.5.0) Consistently failing test:

[jira] [Assigned] (SPARK-8168) Add Python friendly constructor to PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8168: --- Assignee: Apache Spark (was: Xiangrui Meng) Add Python friendly constructor to

[jira] [Created] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

Patrick Woody created SPARK-8167: Summary: Tasks that fail due to YARN preemption can cause job failure Key: SPARK-8167 URL: https://issues.apache.org/jira/browse/SPARK-8167 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8062: -- Comment: was deleted (was: While working to try to reproduce this bug, I noticed something rather

[jira] [Resolved] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8062. --- Resolution: Fixed Fix Version/s: 1.2.3 Issue resolved by pull request 6618

[jira] [Issue Comment Deleted] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8062: -- Comment: was deleted (was: Alright, I've filed https://issues.apache.org/jira/browse/SPARK-8086 to

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577599#comment-14577599 ] Alex commented on SPARK-2344: - Hi guys, What is the status of this issue? Beniamino - are

[jira] [Resolved] (SPARK-8116) sc.range() doesn't match python range()

[ https://issues.apache.org/jira/browse/SPARK-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8116. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Ted

[jira] [Commented] (SPARK-7426) spark.ml AttributeFactory.fromStructField should allow other NumericTypes

[ https://issues.apache.org/jira/browse/SPARK-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577648#comment-14577648 ] Joseph K. Bradley commented on SPARK-7426: -- Hi, I'm sorry for the slow review!

[jira] [Created] (SPARK-8166) Failing test: o.a.s.sql.sources.FilterScanSuite

Andrew Or created SPARK-8166: Summary: Failing test: o.a.s.sql.sources.FilterScanSuite Key: SPARK-8166 URL: https://issues.apache.org/jira/browse/SPARK-8166 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilterScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Summary: Consistently failing test: o.a.s.sql.sources.FilterScanSuite (was: Failing test:

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Summary: Consistently failing test: o.a.s.sql.sources.FilteredScanSuite (was: Consistently failing test:

[jira] [Commented] (SPARK-8102) Big performance difference when joining 3 tables in different order

[ https://issues.apache.org/jira/browse/SPARK-8102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577602#comment-14577602 ] Yin Huai commented on SPARK-8102: - For the first query, {code} -- snippet 1 SELECT

[jira] [Updated] (SPARK-8166) Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[ https://issues.apache.org/jira/browse/SPARK-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8166: - Affects Version/s: 1.5.0 Consistently failing test: o.a.s.sql.sources.FilteredScanSuite

[jira] [Commented] (SPARK-7426) spark.ml AttributeFactory.fromStructField should allow other NumericTypes

[ https://issues.apache.org/jira/browse/SPARK-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577629#comment-14577629 ] Mike Dusenberry commented on SPARK-7426: [~josephkb] Do you have any thoughts on

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577727#comment-14577727 ] Matt Cheah commented on SPARK-8167: --- To be clear this is independent of SPARK-7451.

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577552#comment-14577552 ] Kannan Rajah commented on SPARK-1403: - A similar problem has been reported while

[jira] [Resolved] (SPARK-8121) When using with Hadoop 1.x, spark.sql.parquet.output.committer.class is overriden by spark.sql.sources.outputCommitterClass

[ https://issues.apache.org/jira/browse/SPARK-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8121. - Resolution: Fixed Fix Version/s: 1.4.1 Issue resolved by pull request 6705

[jira] [Created] (SPARK-8168) Add Python friendly constructor to PipelineModel

Xiangrui Meng created SPARK-8168: Summary: Add Python friendly constructor to PipelineModel Key: SPARK-8168 URL: https://issues.apache.org/jira/browse/SPARK-8168 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-8158) HiveShim improvement

[ https://issues.apache.org/jira/browse/SPARK-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8158. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Adrian Wang HiveShim improvement

[jira] [Updated] (SPARK-7917) Spark doesn't clean up Application Directories (local dirs)

[ https://issues.apache.org/jira/browse/SPARK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7917: - Priority: Minor (was: Major) Spark doesn't clean up Application Directories (local dirs)

[jira] [Resolved] (SPARK-8148) Do not use FloatType in partition column inference

[ https://issues.apache.org/jira/browse/SPARK-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8148. Resolution: Fixed Fix Version/s: (was: 1.4.0) 1.5.0 Do not use

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Woody updated SPARK-8167: - Priority: Critical (was: Major) Tasks that fail due to YARN preemption can cause job failure

[jira] [Updated] (SPARK-8126) Use temp directory under build dir for unit tests

[ https://issues.apache.org/jira/browse/SPARK-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8126: - Fix Version/s: 1.4.1 Use temp directory under build dir for unit tests

[jira] [Created] (SPARK-8169) Add StopWordsRemover as a transformer

Xiangrui Meng created SPARK-8169: Summary: Add StopWordsRemover as a transformer Key: SPARK-8169 URL: https://issues.apache.org/jira/browse/SPARK-8169 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-8172) Driver UI should enable viewing of dead executors' logs

Josh Rosen created SPARK-8172: - Summary: Driver UI should enable viewing of dead executors' logs Key: SPARK-8172 URL: https://issues.apache.org/jira/browse/SPARK-8172 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8162) Run spark-shell cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578141#comment-14578141 ] Apache Spark commented on SPARK-8162: - User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-8162) Run spark-shell cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8162: - Affects Version/s: 1.5.0 Run spark-shell cause NullPointerException

[jira] [Updated] (SPARK-8162) Run spark-shell cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8162: - Priority: Blocker (was: Major) Run spark-shell cause NullPointerException

[jira] [Created] (SPARK-8173) A class which holds all the constants should be present

sahitya pavurala created SPARK-8173: --- Summary: A class which holds all the constants should be present Key: SPARK-8173 URL: https://issues.apache.org/jira/browse/SPARK-8173 Project: Spark

[jira] [Created] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

Ashwin Shankar created SPARK-8170: - Summary: Ctrl-C in pyspark shell doesn't kill running job Key: SPARK-8170 URL: https://issues.apache.org/jira/browse/SPARK-8170 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

[ https://issues.apache.org/jira/browse/SPARK-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578114#comment-14578114 ] Josh Rosen commented on SPARK-8171: --- Note: I don't plan to work on this myself; someone

[jira] [Created] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

Josh Rosen created SPARK-8171: - Summary: Support Javascript-based infinite scrolling in Spark log viewers Key: SPARK-8171 URL: https://issues.apache.org/jira/browse/SPARK-8171 Project: Spark

[jira] [Closed] (SPARK-8162) Run spark-shell cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8162. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Target Version/s: 1.4.1,

[jira] [Commented] (SPARK-7886) Add built-in expressions to FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578049#comment-14578049 ] Apache Spark commented on SPARK-7886: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-8162) Run spark-shell cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8162: - Affects Version/s: 1.4.1 Run spark-shell cause NullPointerException

[jira] [Reopened] (SPARK-8163) CheckPoint mechanism did not work well when error happened in big streaming

[ https://issues.apache.org/jira/browse/SPARK-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus reopened SPARK-8163: - CheckPoint mechanism did not work well when error happened in big streaming

[jira] [Commented] (SPARK-8163) CheckPoint mechanism did not work well when error happened in big streaming

[ https://issues.apache.org/jira/browse/SPARK-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578161#comment-14578161 ] SaintBacchus commented on SPARK-8163: - Hi [~sowen] all the description was the problem

[jira] [Updated] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated SPARK-8170: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7006 Ctrl-C in pyspark shell

[jira] [Commented] (SPARK-4809) Improve Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578146#comment-14578146 ] Ronald Chen commented on SPARK-4809: This change makes no sense. This breaks

[jira] [Comment Edited] (SPARK-3577) Add task metric to report spill time

[ https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578240#comment-14578240 ] Ming Chen edited comment on SPARK-3577 at 6/9/15 5:26 AM: -- Why

[jira] [Created] (SPARK-8174) unix_timestamp

Reynold Xin created SPARK-8174: -- Summary: unix_timestamp Key: SPARK-8174 URL: https://issues.apache.org/jira/browse/SPARK-8174 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-8174) unix_timestamp

[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Description: 3 variants: {code} unix_timestamp(): long Gets current Unix timestamp in seconds.

[jira] [Updated] (SPARK-8175) from_unixtime function

[ https://issues.apache.org/jira/browse/SPARK-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8175: --- Summary: from_unixtime function (was: from_unixtime expression) from_unixtime function

[jira] [Created] (SPARK-8180) day / dayofmonth function

Reynold Xin created SPARK-8180: -- Summary: day / dayofmonth function Key: SPARK-8180 URL: https://issues.apache.org/jira/browse/SPARK-8180 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-8180) day / dayofmonth function

[ https://issues.apache.org/jira/browse/SPARK-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8180: --- Description: day(string date): int dayofmonth(date): int Returns the day part of a date or a

[jira] [Updated] (SPARK-8178) quarter function

[ https://issues.apache.org/jira/browse/SPARK-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8178: --- Description: quarter(string|date|timestamp): int Returns the quarter of the year for a date,

[jira] [Updated] (SPARK-8177) year function

[ https://issues.apache.org/jira/browse/SPARK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8177: --- Description: year(string|date|timestamp): int Returns the year part of a date or a timestamp string:

[jira] [Updated] (SPARK-8180) day / dayofmonth function

[ https://issues.apache.org/jira/browse/SPARK-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8180: --- Description: day(string|date|timestamp): int dayofmonth(string|date|timestamp): int Returns the day

[jira] [Updated] (SPARK-8181) hour function

[ https://issues.apache.org/jira/browse/SPARK-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8181: --- Description: hour(string|date|timestamp): int Returns the hour of the timestamp: hour('2009-07-30

[jira] [Updated] (SPARK-8179) month function

[ https://issues.apache.org/jira/browse/SPARK-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8179: --- Description: month(string|date|timestamp): int Returns the month part of a date or a timestamp

[jira] [Updated] (SPARK-8182) minute function

[ https://issues.apache.org/jira/browse/SPARK-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8182: --- Description: minute(string|date|timestamp): int Returns the minute of the timestamp. See

[jira] [Updated] (SPARK-8176) to_date function

[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Description: to_date(date|timestamp): date to_date(string): string Returns the date part of a

[jira] [Created] (SPARK-8183) second function

Reynold Xin created SPARK-8183: -- Summary: second function Key: SPARK-8183 URL: https://issues.apache.org/jira/browse/SPARK-8183 Project: Spark Issue Type: Sub-task Reporter: Reynold

[jira] [Updated] (SPARK-8183) second function

[ https://issues.apache.org/jira/browse/SPARK-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8183: --- Target Version/s: 1.5.0 second function --- Key: SPARK-8183

[jira] [Created] (SPARK-8181) hour function

Reynold Xin created SPARK-8181: -- Summary: hour function Key: SPARK-8181 URL: https://issues.apache.org/jira/browse/SPARK-8181 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-8182) minute function

Reynold Xin created SPARK-8182: -- Summary: minute function Key: SPARK-8182 URL: https://issues.apache.org/jira/browse/SPARK-8182 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-8186) date_add function

[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8186: --- Target Version/s: 1.5.0 date_add function - Key: SPARK-8186

[jira] [Commented] (SPARK-3577) Add task metric to report spill time

[ https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578240#comment-14578240 ] Ming Chen commented on SPARK-3577: -- Why have not the metric been added? I think this is

[jira] [Commented] (SPARK-7886) Add built-in expressions to FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578335#comment-14578335 ] Apache Spark commented on SPARK-7886: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-8174) unix_timestamp expression

[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Summary: unix_timestamp expression (was: unix_timestamp) unix_timestamp expression

[jira] [Updated] (SPARK-8175) from_unixtime expression

[ https://issues.apache.org/jira/browse/SPARK-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8175: --- Summary: from_unixtime expression (was: from_unixtime) from_unixtime expression

[jira] [Created] (SPARK-8175) from_unixtime

Reynold Xin created SPARK-8175: -- Summary: from_unixtime Key: SPARK-8175 URL: https://issues.apache.org/jira/browse/SPARK-8175 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-8174) unix_timestamp function

[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Description: 3 variants: {code} unix_timestamp(): long Gets current Unix timestamp in seconds.

[jira] [Updated] (SPARK-8174) unix_timestamp function

[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Summary: unix_timestamp function (was: unix_timestamp expression) unix_timestamp function

[jira] [Created] (SPARK-8176) to_date function

Reynold Xin created SPARK-8176: -- Summary: to_date function Key: SPARK-8176 URL: https://issues.apache.org/jira/browse/SPARK-8176 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-8177) year function

Reynold Xin created SPARK-8177: -- Summary: year function Key: SPARK-8177 URL: https://issues.apache.org/jira/browse/SPARK-8177 Project: Spark Issue Type: Sub-task Reporter: Reynold

[jira] [Closed] (SPARK-8168) Add Python friendly constructor to PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai closed SPARK-8168. -- Resolution: Fixed Issue resolved by pull request https://github.com/apache/spark/pull/6709 Add Python

[jira] [Resolved] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6820. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Updated] (SPARK-8177) year function

[ https://issues.apache.org/jira/browse/SPARK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8177: --- Target Version/s: 1.5.0 year function - Key: SPARK-8177

[jira] [Created] (SPARK-8179) month function

Reynold Xin created SPARK-8179: -- Summary: month function Key: SPARK-8179 URL: https://issues.apache.org/jira/browse/SPARK-8179 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-8178) quarter function

Reynold Xin created SPARK-8178: -- Summary: quarter function Key: SPARK-8178 URL: https://issues.apache.org/jira/browse/SPARK-8178 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-8176) to_date function

[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Description: to_date(string|date|timestamp): string Returns the date part of a timestamp string:

[jira] [Created] (SPARK-8184) weekofyear function

Reynold Xin created SPARK-8184: -- Summary: weekofyear function Key: SPARK-8184 URL: https://issues.apache.org/jira/browse/SPARK-8184 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-8183) second function

[ https://issues.apache.org/jira/browse/SPARK-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8183: --- Description: second(string|date|timestamp): int Returns the second of the timestamp. See

[jira] [Created] (SPARK-8185) datediff function

Reynold Xin created SPARK-8185: -- Summary: datediff function Key: SPARK-8185 URL: https://issues.apache.org/jira/browse/SPARK-8185 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-8186) date_add function

Reynold Xin created SPARK-8186: -- Summary: date_add function Key: SPARK-8186 URL: https://issues.apache.org/jira/browse/SPARK-8186 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Updated] (SPARK-8155) support of proxy user not working in spaced username on windows

[ https://issues.apache.org/jira/browse/SPARK-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaveen Raajan updated SPARK-8155: - Fix Version/s: (was: 1.3.0) support of proxy user not working in spaced username on windows

[jira] [Commented] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576639#comment-14576639 ] Reynold Xin commented on SPARK-8072: Yes - adding a rule in CheckAnalysis.scala to

[jira] [Resolved] (SPARK-8154) Remove Term/Code type aliases in code generation

[ https://issues.apache.org/jira/browse/SPARK-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8154. Resolution: Fixed Fix Version/s: 1.5.0 Remove Term/Code type aliases in code generation

[jira] [Assigned] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

[ https://issues.apache.org/jira/browse/SPARK-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8153: --- Assignee: Apache Spark Add configuration for disabling partial aggregation in runtime

[jira] [Comment Edited] (SPARK-8096) how to convert dataframe field to LabelPoint

[ https://issues.apache.org/jira/browse/SPARK-8096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573922#comment-14573922 ] bofei.xiao edited comment on SPARK-8096 at 6/8/15 6:28 AM: --- I'm

[jira] [Created] (SPARK-8159) Improve expression coverage

Reynold Xin created SPARK-8159: -- Summary: Improve expression coverage Key: SPARK-8159 URL: https://issues.apache.org/jira/browse/SPARK-8159 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576721#comment-14576721 ] Saisai Shao commented on SPARK-4352: Hi [~sandyr], I re-implement the allocation

[jira] [Closed] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-8157. -- Resolution: Not A Problem see https://github.com/apache/spark/pull/6698 should use expression.unapply

[jira] [Assigned] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8157: --- Assignee: Apache Spark should use expression.unapply to match in HiveTypeCoercion

[jira] [Created] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

Adrian Wang created SPARK-8157: -- Summary: should use expression.unapply to match in HiveTypeCoercion Key: SPARK-8157 URL: https://issues.apache.org/jira/browse/SPARK-8157 Project: Spark Issue

[jira] [Updated] (SPARK-8158) HiveShim improvement

[ https://issues.apache.org/jira/browse/SPARK-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-8158: --- Component/s: SQL HiveShim improvement Key: SPARK-8158

[jira] [Updated] (SPARK-7082) Binary processing external sort-merge join

[ https://issues.apache.org/jira/browse/SPARK-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7082: --- Summary: Binary processing external sort-merge join (was: Binary processing sort-merge join)

[jira] [Created] (SPARK-8160) Tungsten style external aggregation

Reynold Xin created SPARK-8160: -- Summary: Tungsten style external aggregation Key: SPARK-8160 URL: https://issues.apache.org/jira/browse/SPARK-8160 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7792) HiveContext registerTempTable not thread safe

[ https://issues.apache.org/jira/browse/SPARK-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576681#comment-14576681 ] Apache Spark commented on SPARK-7792: - User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-7792) HiveContext registerTempTable not thread safe

[ https://issues.apache.org/jira/browse/SPARK-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7792: --- Assignee: Apache Spark HiveContext registerTempTable not thread safe

[jira] [Created] (SPARK-8158) HiveShim improvement

Adrian Wang created SPARK-8158: -- Summary: HiveShim improvement Key: SPARK-8158 URL: https://issues.apache.org/jira/browse/SPARK-8158 Project: Spark Issue Type: Improvement Reporter:

[jira] [Resolved] (SPARK-8011) DecimalType is not a datatype

[ https://issues.apache.org/jira/browse/SPARK-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bipin Roshan Nag resolved SPARK-8011. - Resolution: Not A Problem DecimalType is not a datatype -

[jira] [Commented] (SPARK-8011) DecimalType is not a datatype

[ https://issues.apache.org/jira/browse/SPARK-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576709#comment-14576709 ] Bipin Roshan Nag commented on SPARK-8011: - It works. Thanks. DecimalType is not

  1   2   >