[jira] [Resolved] (SPARK-29365) Support date and timestamp subtraction

[ https://issues.apache.org/jira/browse/SPARK-29365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29365. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26036 [https://gi

[jira] [Created] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

Julien Peloton created SPARK-29367: -- Summary: pandas udf not working with latest pyarrow release (0.15.0) Key: SPARK-29367 URL: https://issues.apache.org/jira/browse/SPARK-29367 Project: Spark

[jira] [Created] (SPARK-29368) Port interval.sql

Maxim Gekk created SPARK-29368: -- Summary: Port interval.sql Key: SPARK-29368 URL: https://issues.apache.org/jira/browse/SPARK-29368 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-29368) Port interval.sql

[ https://issues.apache.org/jira/browse/SPARK-29368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945666#comment-16945666 ] Maxim Gekk commented on SPARK-29368: I am working on this > Port interval.sql > ---

[jira] [Created] (SPARK-29369) Accept strings without `interval` prefix in casting to intervals

Maxim Gekk created SPARK-29369: -- Summary: Accept strings without `interval` prefix in casting to intervals Key: SPARK-29369 URL: https://issues.apache.org/jira/browse/SPARK-29369 Project: Spark

[jira] [Updated] (SPARK-28885) Follow ANSI store assignment rules in table insertion by default

[ https://issues.apache.org/jira/browse/SPARK-28885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-28885: --- Description: When inserting a value into a column with the different data type, Spark perfo

[jira] [Created] (SPARK-29370) Interval strings without explicit unit markings

Maxim Gekk created SPARK-29370: -- Summary: Interval strings without explicit unit markings Key: SPARK-29370 URL: https://issues.apache.org/jira/browse/SPARK-29370 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-29324) saveAsTable with overwrite mode results in metadata loss

[ https://issues.apache.org/jira/browse/SPARK-29324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945676#comment-16945676 ] Alexander Hagerf commented on SPARK-29324: -- I fail to see the point, this is th

[jira] [Created] (SPARK-29371) Support interval field values with fractional parts

Maxim Gekk created SPARK-29371: -- Summary: Support interval field values with fractional parts Key: SPARK-29371 URL: https://issues.apache.org/jira/browse/SPARK-29371 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-28558) DatasetWriter partitionBy is changing the group file permissions in 2.4 for parquets

[ https://issues.apache.org/jira/browse/SPARK-28558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945755#comment-16945755 ] Nicolas Laduguie commented on SPARK-28558: -- Hi everybody, any news about a reso

[jira] [Commented] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945801#comment-16945801 ] Wenchen Fan commented on SPARK-29336: - This algorithm was implemented in Spark many

[jira] [Commented] (SPARK-29280) DataFrameReader should support a compression option

[ https://issues.apache.org/jira/browse/SPARK-29280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945803#comment-16945803 ] Wenchen Fan commented on SPARK-29280: - sounds reasonable to me. > DataFrameReader s

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945806#comment-16945806 ] Rodney Aaron Stainback commented on SPARK-28938: No I mean the base imag

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945826#comment-16945826 ] Rodney Aaron Stainback commented on SPARK-28938: List of CVEs mage ID C

[jira] [Comment Edited] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945826#comment-16945826 ] Rodney Aaron Stainback edited comment on SPARK-28938 at 10/7/19 12:07 PM:

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodney Aaron Stainback updated SPARK-28938: --- Attachment: twistlock.txt > Kubernetes using unsupported docker image >

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodney Aaron Stainback updated SPARK-28938: --- Attachment: cve-spark.txt cve-spark-r.txt cve

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945883#comment-16945883 ] Rodney Aaron Stainback commented on SPARK-28938: I also download spark-2

[jira] [Resolved] (SPARK-29328) Incorrect calculation mean seconds per month

[ https://issues.apache.org/jira/browse/SPARK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29328. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25998 [https://gi

[jira] [Assigned] (SPARK-29328) Incorrect calculation mean seconds per month

[ https://issues.apache.org/jira/browse/SPARK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29328: Assignee: Maxim Gekk > Incorrect calculation mean seconds per month > ---

[jira] [Updated] (SPARK-29328) Incorrect calculation mean seconds per month

[ https://issues.apache.org/jira/browse/SPARK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29328: - Description: Existing implementation assumes 31 days per month or 372 days per year which is fa

[jira] [Updated] (SPARK-29328) Incorrect calculation mean seconds per month

[ https://issues.apache.org/jira/browse/SPARK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29328: - Issue Type: Improvement (was: Bug) I edited this to reflect the narrower change in the merged P

[jira] [Updated] (SPARK-28978) PySpark: Can't pass more than 256 arguments to a UDF

[ https://issues.apache.org/jira/browse/SPARK-28978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Fulton updated SPARK-28978: --- Affects Version/s: 2.3.2 2.4.4 > PySpark: Can't pass more than 256 arguments

[jira] [Created] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

Shubham Chaurasia created SPARK-29372: - Summary: Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch Key: SPARK-29372 URL: https://issues.apache.org/jira/browse/SPARK-29372

[jira] [Resolved] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28938. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26037 [https://

[jira] [Assigned] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28938: - Assignee: L. C. Hsieh > Kubernetes using unsupported docker image > ---

[jira] [Assigned] (SPARK-29360) PySpark FPGrowthModel supports getter/setter

[ https://issues.apache.org/jira/browse/SPARK-29360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29360: Assignee: Huaxin Gao > PySpark FPGrowthModel supports getter/setter > ---

[jira] [Resolved] (SPARK-29360) PySpark FPGrowthModel supports getter/setter

[ https://issues.apache.org/jira/browse/SPARK-29360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29360. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26035 [https://gi

[jira] [Assigned] (SPARK-29143) Pyspark feature models support column setters/getters

[ https://issues.apache.org/jira/browse/SPARK-29143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29143: Assignee: Huaxin Gao > Pyspark feature models support column setters/getters > --

[jira] [Resolved] (SPARK-29143) Pyspark feature models support column setters/getters

[ https://issues.apache.org/jira/browse/SPARK-29143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29143. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25908 [https://gi

[jira] [Commented] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945985#comment-16945985 ] L. C. Hsieh commented on SPARK-29336: - It is long time ago, but from the comment see

[jira] [Updated] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-29372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chaurasia updated SPARK-29372: -- Description: In case of vectorized DSv2 readers i.e. if it implements {{SupportsScanC

[jira] [Resolved] (SPARK-29342) Make casting strings to intervals case insensitive

[ https://issues.apache.org/jira/browse/SPARK-29342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29342. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26010 [https://

[jira] [Assigned] (SPARK-29342) Make casting strings to intervals case insensitive

[ https://issues.apache.org/jira/browse/SPARK-29342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29342: - Assignee: Maxim Gekk > Make casting strings to intervals case insensitive > --

[jira] [Created] (SPARK-29373) DataSourceV2: Commands should not submit a spark job.

Terry Kim created SPARK-29373: - Summary: DataSourceV2: Commands should not submit a spark job. Key: SPARK-29373 URL: https://issues.apache.org/jira/browse/SPARK-29373 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-29372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946036#comment-16946036 ] Andrew Malone Melo commented on SPARK-29372: Coincidentally enough, I just l

[jira] [Created] (SPARK-29374) do not allow arbitrary v2 catalog as session catalog

Wenchen Fan created SPARK-29374: --- Summary: do not allow arbitrary v2 catalog as session catalog Key: SPARK-29374 URL: https://issues.apache.org/jira/browse/SPARK-29374 Project: Spark Issue Type

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946062#comment-16946062 ] Dongjoon Hyun commented on SPARK-28938: --- [~AceHack]. That's the reason why I think

[jira] [Created] (SPARK-29375) Exchange reuse across all subquery levels

Peter Toth created SPARK-29375: -- Summary: Exchange reuse across all subquery levels Key: SPARK-29375 URL: https://issues.apache.org/jira/browse/SPARK-29375 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946069#comment-16946069 ] Mukul Murthy commented on SPARK-29358: -- I agree that it should not change the curre

[jira] [Commented] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946093#comment-16946093 ] Bryan Cutler commented on SPARK-29367: -- There was a change in the Arrow IPC format,

[jira] [Assigned] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-29367: Assignee: Bryan Cutler > pandas udf not working with latest pyarrow release (0.15.0) > --

[jira] [Updated] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-29367: - Issue Type: Documentation (was: Bug) > pandas udf not working with latest pyarrow release (0.15

[jira] [Updated] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28816: - Priority: Minor (was: Major) > Document ADD JAR statement in SQL Reference. > -

[jira] [Assigned] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28816: Assignee: Huaxin Gao > Document ADD JAR statement in SQL Reference. > ---

[jira] [Resolved] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28816. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25895 [https://gi

[jira] [Created] (SPARK-29376) Upgrade Apache Arrow to 0.15.0

Bryan Cutler created SPARK-29376: Summary: Upgrade Apache Arrow to 0.15.0 Key: SPARK-29376 URL: https://issues.apache.org/jira/browse/SPARK-29376 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946140#comment-16946140 ] Huaxin Gao commented on SPARK-22390: I am slowly catching up the changes in Data Sou

[jira] [Comment Edited] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946140#comment-16946140 ] Huaxin Gao edited comment on SPARK-22390 at 10/7/19 6:54 PM: -

[jira] [Resolved] (SPARK-28815) Document ADD FILE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-28815. Resolution: Fixed > Document ADD FILE statement in SQL Reference. > --

[jira] [Commented] (SPARK-28815) Document ADD FILE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946141#comment-16946141 ] Huaxin Gao commented on SPARK-28815: This is done along with ADD JAR in https://iss

[jira] [Commented] (SPARK-29207) Document LIST JAR in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946142#comment-16946142 ] Huaxin Gao commented on SPARK-29207: This is done along with ADD JAR in https://iss

[jira] [Resolved] (SPARK-29208) Document LIST FILE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-29208. Resolution: Fixed This is done along with ADD JAR in https://issues.apache.org/jira/browse/SPARK-

[jira] [Resolved] (SPARK-29207) Document LIST JAR in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-29207. Resolution: Fixed > Document LIST JAR in SQL Reference > -- > >

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946153#comment-16946153 ] Rodney Aaron Stainback commented on SPARK-28938: Any chance of updating

[jira] [Commented] (SPARK-29325) approxQuantile() results are incorrect and vary significantly for small changes in relativeError

[ https://issues.apache.org/jira/browse/SPARK-29325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946166#comment-16946166 ] Frank Astier commented on SPARK-29325: -- I noticed that the algorithm is sensitive t

[jira] [Resolved] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-29189. -- Fix Version/s: 3.0.0 Resolution: Fixed > Add an option to ignore block locations when l

[jira] [Commented] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946176#comment-16946176 ] Imran Rashid commented on SPARK-29189: -- Fixed by pr https://github.com/apache/spark

[jira] [Assigned] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-29189: Assignee: Wang, Gang > Add an option to ignore block locations when listing file > --

[jira] [Commented] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946187#comment-16946187 ] L. C. Hsieh commented on SPARK-29336: - Actually I found the merging is changed by ot

[jira] [Assigned] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-27468: Assignee: Marcelo Masiero Vanzin > "Storage Level" in "RDD Storage Page" is not correct >

[jira] [Resolved] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-27468. -- Fix Version/s: 3.0.0 Resolution: Fixed Resolved by https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-23179) Support option to throw exception if overflow occurs during Decimal arithmetic

[ https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-23179: - Parent: SPARK-27764 (was: SPARK-26217) > Support option to throw exception if overflow occurs d

[jira] [Updated] (SPARK-26976) Forbid reserved keywords as identifiers when ANSI mode is on

[ https://issues.apache.org/jira/browse/SPARK-26976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26976: - Parent: SPARK-27764 (was: SPARK-26217) > Forbid reserved keywords as identifiers when ANSI mode

[jira] [Updated] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-23264: - Parent: SPARK-27764 (was: SPARK-26217) > Support interval values without INTERVAL clauses > ---

[jira] [Updated] (SPARK-27149) Support LOCALTIMESTAMP when ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-27149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-27149: - Parent: SPARK-27764 (was: SPARK-26217) > Support LOCALTIMESTAMP when ANSI mode enabled > --

[jira] [Updated] (SPARK-27148) Support CURRENT_TIME and LOCALTIME when ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-27148: - Parent: SPARK-27764 (was: SPARK-26217) > Support CURRENT_TIME and LOCALTIME when ANSI mode enab

[jira] [Updated] (SPARK-29096) The exact math method should be called only when there is a corresponding function in Math

[ https://issues.apache.org/jira/browse/SPARK-29096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-29096: - Parent: SPARK-27764 (was: SPARK-26217) > The exact math method should be called only when there

[jira] [Updated] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26215: - Parent: SPARK-27764 (was: SPARK-26217) > define reserved keywords after SQL standard >

[jira] [Updated] (SPARK-26218) Throw exception on overflow for integers

[ https://issues.apache.org/jira/browse/SPARK-26218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26218: - Parent: SPARK-27764 (was: SPARK-26217) > Throw exception on overflow for integers > ---

[jira] [Resolved] (SPARK-26217) Compliance to SQL standard (SQL:2011)

[ https://issues.apache.org/jira/browse/SPARK-26217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-26217. -- Resolution: Duplicate This issue is part of SPARK-27764, I'll move all the sub-tasks and mark

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946261#comment-16946261 ] Dongjoon Hyun commented on SPARK-28938: --- [~AceHack]. That is completely different

[jira] [Commented] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946266#comment-16946266 ] Julien Peloton commented on SPARK-29367: Thanks, it works like a charm! Julien

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Affects Version/s: 2.4.4 > Kubernetes using unsupported docker image > ---

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Fix Version/s: 2.4.5 > Kubernetes using unsupported docker image > ---

[jira] [Updated] (SPARK-28938) Move to supported OpenJDK docker image for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Summary: Move to supported OpenJDK docker image for Kubernetes (was: Kubernetes using unsuppo

[jira] [Commented] (SPARK-28938) Move to supported OpenJDK docker image for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946275#comment-16946275 ] Dongjoon Hyun commented on SPARK-28938: --- Since `branch-2.4` is our LTS branch, thi

[jira] [Resolved] (SPARK-25667) Refactor SynthBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25667. --- Resolution: Won't Do Hi, [~yumwang] and [~cloud_fan]. I'll close this issue as `Won't Do` be

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-11215: --- Assignee: L. C. Hsieh (was: Yanbo Liang) > Add multiple columns support to StringIndexer >

[jira] [Commented] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946343#comment-16946343 ] Dongjoon Hyun commented on SPARK-25668: --- I'll make a PR soon. > Refactor TPCDSQue

[jira] [Assigned] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25668: - Assignee: Dongjoon Hyun > Refactor TPCDSQueryBenchmark to use main method > ---

[jira] [Created] (SPARK-29377) parity between scala ml tuning and python ml tuning

Huaxin Gao created SPARK-29377: -- Summary: parity between scala ml tuning and python ml tuning Key: SPARK-29377 URL: https://issues.apache.org/jira/browse/SPARK-29377 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-29377) parity between scala ml tuning and python ml tuning

[ https://issues.apache.org/jira/browse/SPARK-29377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946352#comment-16946352 ] Huaxin Gao commented on SPARK-29377: I will submit a PR soon. > parity between sca

[jira] [Updated] (SPARK-29224) Implement Factorization Machines as a ml-pipeline component

[ https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mob-ai updated SPARK-29224: --- Affects Version/s: (was: 2.4.3) 3.0.0 > Implement Factorization Machines as a ml-

[jira] [Updated] (SPARK-29224) Implement Factorization Machines as a ml-pipeline component

[ https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mob-ai updated SPARK-29224: --- Affects Version/s: (was: 3.0.0) 2.4.3 > Implement Factorization Machines as a ml-

[jira] [Commented] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946422#comment-16946422 ] huangtianhua commented on SPARK-29286: -- Thanks all. I will test this on arm instanc

[jira] [Created] (SPARK-29378) Make AppVeyor's SparkR with Arrow tests compatible with Arrow R 0.15

Hyukjin Kwon created SPARK-29378: Summary: Make AppVeyor's SparkR with Arrow tests compatible with Arrow R 0.15 Key: SPARK-29378 URL: https://issues.apache.org/jira/browse/SPARK-29378 Project: Spark

[jira] [Resolved] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25668. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26049 [https://gi

[jira] [Resolved] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25475. -- Resolution: Done > Refactor all benchmark to save the result as a separate file >

[jira] [Assigned] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25475: - Assignee: Yuming Wang > Refactor all benchmark to save the result as a separate file >

[jira] [Commented] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946477#comment-16946477 ] Dongjoon Hyun commented on SPARK-25475: --- Hi, All. Thank you for all your guide and

[jira] [Comment Edited] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946477#comment-16946477 ] Dongjoon Hyun edited comment on SPARK-25475 at 10/8/19 4:37 AM: --

[jira] [Updated] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25475: -- Fix Version/s: 3.0.0 > Refactor all benchmark to save the result as a separate file >

[jira] [Resolved] (SPARK-24619) DOCO - usage of authenticate.secret between masters/workers not clear

[ https://issues.apache.org/jira/browse/SPARK-24619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24619. -- Resolution: Incomplete > DOCO - usage of authenticate.secret between masters/workers not clear

[jira] [Resolved] (SPARK-23328) Disallow default value None in na.replace/replace when 'to_replace' is not a dictionary

[ https://issues.apache.org/jira/browse/SPARK-23328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23328. -- Resolution: Incomplete > Disallow default value None in na.replace/replace when 'to_replace' i

[jira] [Resolved] (SPARK-24515) No need to warning user when output commit coordination enabled

[ https://issues.apache.org/jira/browse/SPARK-24515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24515. -- Resolution: Incomplete > No need to warning user when output commit coordination enabled > ---

[jira] [Resolved] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS

[ https://issues.apache.org/jira/browse/SPARK-25087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25087. -- Resolution: Incomplete > update/port all builds to run on ubuntu 16.04 LTS > -

[jira] [Resolved] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25467. -- Resolution: Incomplete > Python date/datetime objects in dataframes increment by 1 day when co

[jira] [Resolved] (SPARK-20625) SQL test running on Windows hadoop command warning

[ https://issues.apache.org/jira/browse/SPARK-20625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20625. -- Resolution: Incomplete > SQL test running on Windows hadoop command warning >

[jira] [Resolved] (SPARK-23653) Show sql statement in spark SQL UI

[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23653. -- Resolution: Incomplete > Show sql statement in spark SQL UI >

  1   2   3   4   5   6   >