[jira] [Updated] (SPARK-29815) Missing persist in ml.tuning.CrossValidator.fit()

[ https://issues.apache.org/jira/browse/SPARK-29815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29815: -- Description: dataset.toDF.rdd in ml.tuning.CrossValidator.fit(dataset: Dataset[_]) will generate two

[jira] [Updated] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29816: -- Description: The rdd scoreAndLabels.combineByKey is used by two actions: sortByKey and count(), so it

[jira] [Created] (SPARK-29856) Conditional unnecessary persist on RDDs in ML algorithms

Dong Wang created SPARK-29856: - Summary: Conditional unnecessary persist on RDDs in ML algorithms Key: SPARK-29856 URL: https://issues.apache.org/jira/browse/SPARK-29856 Project: Spark Issue Type

[jira] [Resolved] (SPARK-29001) Print better log when process of events becomes slow

[ https://issues.apache.org/jira/browse/SPARK-29001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29001. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25702 [https://gith

[jira] [Assigned] (SPARK-29519) SHOW TBLPROPERTIES should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29519: --- Assignee: Pablo Langa Blanco > SHOW TBLPROPERTIES should look up catalog/table like v2 comm

[jira] [Resolved] (SPARK-29519) SHOW TBLPROPERTIES should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29519. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26176 [https://gith

[jira] [Created] (SPARK-29855) typed literals with negative sign with proper result or exception

Kent Yao created SPARK-29855: Summary: typed literals with negative sign with proper result or exception Key: SPARK-29855 URL: https://issues.apache.org/jira/browse/SPARK-29855 Project: Spark Is

[jira] [Commented] (SPARK-29853) lpad returning empty instead of NULL for empty pad value

[ https://issues.apache.org/jira/browse/SPARK-29853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972079#comment-16972079 ] Ankit Raj Boudh commented on SPARK-29853: - @[~hyukjin.kwon] , please review the

[jira] [Updated] (SPARK-29854) lpad and rpad built in function not throw Exception for invalid len value

[ https://issues.apache.org/jira/browse/SPARK-29854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-29854: - Description: Spark Returns Empty String) 0: jdbc:hive2://10.18.19.208:23040/def

[jira] [Updated] (SPARK-29854) lpad and rpad built in function not throw Exception for invalid len value

[ https://issues.apache.org/jira/browse/SPARK-29854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-29854: - Description: Spark Returns Empty String) 0: jdbc:hive2://10.18.19.208:23040/def

[jira] [Commented] (SPARK-29854) lpad and rpad built in function not throw Exception for invalid len value

[ https://issues.apache.org/jira/browse/SPARK-29854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972076#comment-16972076 ] Ankit Raj Boudh commented on SPARK-29854: - i will raise PR for this. > lpad and

[jira] [Created] (SPARK-29854) lpad and rpad built in function not throw Exception for invalid len value

ABHISHEK KUMAR GUPTA created SPARK-29854: Summary: lpad and rpad built in function not throw Exception for invalid len value Key: SPARK-29854 URL: https://issues.apache.org/jira/browse/SPARK-29854

[jira] [Commented] (SPARK-29853) lpad returning empty instead of NULL for empty pad value

[ https://issues.apache.org/jira/browse/SPARK-29853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972073#comment-16972073 ] Ankit Raj Boudh commented on SPARK-29853: - i will PR for this > lpad returning

[jira] [Created] (SPARK-29853) lpad returning empty instead of NULL for empty pad value

ABHISHEK KUMAR GUPTA created SPARK-29853: Summary: lpad returning empty instead of NULL for empty pad value Key: SPARK-29853 URL: https://issues.apache.org/jira/browse/SPARK-29853 Project: Spar

[jira] [Comment Edited] (SPARK-29776) rpad returning invalid value when parameter is empty

[ https://issues.apache.org/jira/browse/SPARK-29776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972035#comment-16972035 ] Ankit Raj Boudh edited comment on SPARK-29776 at 11/12/19 5:32 AM: ---

[jira] [Commented] (SPARK-29778) saveAsTable append mode is not passing writer options

[ https://issues.apache.org/jira/browse/SPARK-29778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972048#comment-16972048 ] Wesley Hoffman commented on SPARK-29778: Looks like my PR linked right up. How h

[jira] [Updated] (SPARK-29792) SQL metrics cannot be updated to subqueries in AQE

[ https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-29792: --- Description: After merged  [SPARK-28583|https://issues.apache.org/jira/browse/SPARK-28583], the subqueries i

[jira] [Commented] (SPARK-29776) rpad returning invalid value when parameter is empty

[ https://issues.apache.org/jira/browse/SPARK-29776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972035#comment-16972035 ] Ankit Raj Boudh commented on SPARK-29776: - yes, today i will submit PR for this.

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972019#comment-16972019 ] zhao bo commented on SPARK-29106: - The arm worker is back. Sorry for late. > Add jenkin

[jira] [Assigned] (SPARK-29808) StopWordsRemover should support multi-cols

[ https://issues.apache.org/jira/browse/SPARK-29808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29808: Assignee: Huaxin Gao > StopWordsRemover should support multi-cols > -

[jira] [Updated] (SPARK-29851) V2 Catalog: Default behavior of dropping namespace is cascading

[ https://issues.apache.org/jira/browse/SPARK-29851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-29851: -- Summary: V2 Catalog: Default behavior of dropping namespace is cascading (was: DataSourceV2: Default

[jira] [Updated] (SPARK-29852) Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-29852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-29852: --- Issue Type: Improvement (was: New Feature) > Implement parallel preemptive RDD.toLocalIterator and

[jira] [Created] (SPARK-29852) Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator

Peng Cheng created SPARK-29852: -- Summary: Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator Key: SPARK-29852 URL: https://issues.apache.org/jira/browse/SPARK-29852 Project: Sp

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971971#comment-16971971 ] zhao bo commented on SPARK-29106: - Er,, linaro seems in trouble. The VM can not online n

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971968#comment-16971968 ] zhao bo commented on SPARK-29106: - Thanks very much, [~shaneknapp] .  So apologize that

[jira] [Created] (SPARK-29851) DataSourceV2: Default behavior of dropping namespace is cascading

Terry Kim created SPARK-29851: - Summary: DataSourceV2: Default behavior of dropping namespace is cascading Key: SPARK-29851 URL: https://issues.apache.org/jira/browse/SPARK-29851 Project: Spark

[jira] [Assigned] (SPARK-29755) ClassCastException occurs when reading events from SHS

[ https://issues.apache.org/jira/browse/SPARK-29755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29755: -- Assignee: Jungtaek Lim > ClassCastException occurs when reading event

[jira] [Resolved] (SPARK-29755) ClassCastException occurs when reading events from SHS

[ https://issues.apache.org/jira/browse/SPARK-29755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29755. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Resolved] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-26154. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Assigned] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-26154: -- Assignee: Jungtaek Lim > Stream-stream joins - left outer join gives

[jira] [Assigned] (SPARK-29766) Aggregate metrics asynchronously in SQL listener

[ https://issues.apache.org/jira/browse/SPARK-29766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29766: - Assignee: Marcelo Masiero Vanzin > Aggregate metrics asynchronously in SQL listener > -

[jira] [Resolved] (SPARK-29766) Aggregate metrics asynchronously in SQL listener

[ https://issues.apache.org/jira/browse/SPARK-29766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29766. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26405 [https://

[jira] [Resolved] (SPARK-29770) Allow setting spark.app.id when spark-submit for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-29770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29770. Resolution: Won't Fix See comments in PR. > Allow setting spark.app.id wh

[jira] [Commented] (SPARK-29672) remove python2 tests and test infra

[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971868#comment-16971868 ] Shane Knapp commented on SPARK-29672: - the PR is complete, all tests pass and i'm wa

[jira] [Commented] (SPARK-29803) remove all instances of 'from __future__ import print_function'

[ https://issues.apache.org/jira/browse/SPARK-29803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971866#comment-16971866 ] Shane Knapp commented on SPARK-29803: - so after reading the python2 EOL roadmap/anno

[jira] [Updated] (SPARK-29850) sort-merge-join an empty table should not memory leak

[ https://issues.apache.org/jira/browse/SPARK-29850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29850: -- Affects Version/s: 2.3.4 > sort-merge-join an empty table should not memory leak > ---

[jira] [Updated] (SPARK-29850) sort-merge-join an empty table should not memory leak

[ https://issues.apache.org/jira/browse/SPARK-29850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29850: -- Affects Version/s: 2.4.4 > sort-merge-join an empty table should not memory leak > ---

[jira] [Updated] (SPARK-27189) Add Executor metrics and memory usage instrumentation to the metrics system

[ https://issues.apache.org/jira/browse/SPARK-27189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-27189: Summary: Add Executor metrics and memory usage instrumentation to the metrics system (was: Add Ex

[jira] [Resolved] (SPARK-29805) Enable nested schema pruning and pruning on expressions by default

[ https://issues.apache.org/jira/browse/SPARK-29805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29805. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26443 [https://github.com/a

[jira] [Resolved] (SPARK-29801) ML models unify toString method

[ https://issues.apache.org/jira/browse/SPARK-29801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29801. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26439 [https://

[jira] [Assigned] (SPARK-29801) ML models unify toString method

[ https://issues.apache.org/jira/browse/SPARK-29801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29801: - Assignee: zhengruifeng > ML models unify toString method >

[jira] [Commented] (SPARK-29762) GPU Scheduling - default task resource amount to 1

[ https://issues.apache.org/jira/browse/SPARK-29762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971798#comment-16971798 ] Thomas Graves commented on SPARK-29762: --- this is actually more complex then you mi

[jira] [Assigned] (SPARK-29825) Add join conditions in join-related tests of SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29825: - Assignee: Takeshi Yamamuro > Add join conditions in join-related tests of SQLQueryTestS

[jira] [Resolved] (SPARK-29825) Add join conditions in join-related tests of SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29825. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26459 [https://

[jira] [Commented] (SPARK-29808) StopWordsRemover should support multi-cols

[ https://issues.apache.org/jira/browse/SPARK-29808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971757#comment-16971757 ] Huaxin Gao commented on SPARK-29808: I will work on this. [~podongfeng] > StopWords

[jira] [Commented] (SPARK-29776) rpad returning invalid value when parameter is empty

[ https://issues.apache.org/jira/browse/SPARK-29776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971739#comment-16971739 ] Hyukjin Kwon commented on SPARK-29776: -- [~Ankitraj] have you made some progresses o

[jira] [Commented] (SPARK-29773) Unable to process empty ORC files in Hive Table using Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971740#comment-16971740 ] Hyukjin Kwon commented on SPARK-29773: -- ping [~aermakov], have you tried this out?

[jira] [Commented] (SPARK-29792) SQL metrics cannot be updated to subqueries in AQE

[ https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971738#comment-16971738 ] Hyukjin Kwon commented on SPARK-29792: -- What does this JIRA mean? Can you fill the

[jira] [Commented] (SPARK-29797) Read key-value metadata in Parquet files written by Apache Arrow

[ https://issues.apache.org/jira/browse/SPARK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971737#comment-16971737 ] Hyukjin Kwon commented on SPARK-29797: -- ping [~isaacm] do you have any suggestion a

[jira] [Commented] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

[ https://issues.apache.org/jira/browse/SPARK-29673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971736#comment-16971736 ] Hyukjin Kwon commented on SPARK-29673: -- Thanks [~shaneknapp]. I will make a try soo

[jira] [Commented] (SPARK-29803) remove all instances of 'from __future__ import print_function'

[ https://issues.apache.org/jira/browse/SPARK-29803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971735#comment-16971735 ] Hyukjin Kwon commented on SPARK-29803: -- {quote} as spark 3.0+ technically does NOT

[jira] [Commented] (SPARK-29804) Spark-shell is failing on YARN mode

[ https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971731#comment-16971731 ] Hyukjin Kwon commented on SPARK-29804: -- Please don't set target version and Critica

[jira] [Resolved] (SPARK-29804) Spark-shell is failing on YARN mode

[ https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29804. -- Fix Version/s: (was: 2.4.4) Resolution: Invalid > Spark-shell is failing on YARN mo

[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

[ https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29804: - Target Version/s: (was: 2.4.4) > Spark-shell is failing on YARN mode > ---

[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

[ https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29804: - Priority: Major (was: Blocker) > Spark-shell is failing on YARN mode >

[jira] [Commented] (SPARK-29806) Using multiline option for a JSON file which is not multiline results in silent truncation of data.

[ https://issues.apache.org/jira/browse/SPARK-29806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971730#comment-16971730 ] Hyukjin Kwon commented on SPARK-29806: -- {{multiline}} in JSON source currently only

[jira] [Commented] (SPARK-29830) PySpark.context.Sparkcontext.binaryfiles improved memory with buffer

[ https://issues.apache.org/jira/browse/SPARK-29830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971727#comment-16971727 ] Hyukjin Kwon commented on SPARK-29830: -- (Please avoid to set target version which i

[jira] [Updated] (SPARK-29830) PySpark.context.Sparkcontext.binaryfiles improved memory with buffer

[ https://issues.apache.org/jira/browse/SPARK-29830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29830: - Target Version/s: (was: 3.0.0) > PySpark.context.Sparkcontext.binaryfiles improved memory with

[jira] [Commented] (SPARK-22340) pyspark setJobGroup doesn't match java threads

[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971723#comment-16971723 ] Ruslan Dautkhanov commented on SPARK-22340: --- Glad to see this is solved.  A n

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971680#comment-16971680 ] Aman Omer commented on SPARK-29838: --- Sure, I have started coding for this one and anal

[jira] [Commented] (SPARK-29844) Improper unpersist strategy in ml.recommendation.ASL.train

[ https://issues.apache.org/jira/browse/SPARK-29844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971654#comment-16971654 ] Sean R. Owen commented on SPARK-29844: -- Nice, I wonder what else CacheCheck will tu

[jira] [Created] (SPARK-29850) sort-merge-join an empty table should not memory leak

Wenchen Fan created SPARK-29850: --- Summary: sort-merge-join an empty table should not memory leak Key: SPARK-29850 URL: https://issues.apache.org/jira/browse/SPARK-29850 Project: Spark Issue Typ

[jira] [Updated] (SPARK-29844) Improper unpersist strategy in ml.recommendation.ASL.train

[ https://issues.apache.org/jira/browse/SPARK-29844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29844: - Priority: Minor (was: Major) > Improper unpersist strategy in ml.recommendation.ASL.train > ---

[jira] [Commented] (SPARK-29848) PostgreSQL dialect: cast to bigint

[ https://issues.apache.org/jira/browse/SPARK-29848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971580#comment-16971580 ] Rakesh Raushan commented on SPARK-29848: I will work on this one > PostgreSQL

[jira] [Commented] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-29849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971579#comment-16971579 ] Rakesh Raushan commented on SPARK-29849: I will work on this > Spark trunc() fu

[jira] [Commented] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-29849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971574#comment-16971574 ] Aman Omer commented on SPARK-29849: --- I am checking this issue. > Spark trunc() func d

[jira] [Issue Comment Deleted] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-29849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29849: -- Comment: was deleted (was: I am checking this issue.) > Spark trunc() func does not support for numbe

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971570#comment-16971570 ] wuyi commented on SPARK-29838: -- Hey guys, what's going on here ? I see [~aman_omer] you has

[jira] [Created] (SPARK-29849) Spark trunc() func does not support for number group as PostgreSQL

ABHISHEK KUMAR GUPTA created SPARK-29849: Summary: Spark trunc() func does not support for number group as PostgreSQL Key: SPARK-29849 URL: https://issues.apache.org/jira/browse/SPARK-29849 Pr

[jira] [Updated] (SPARK-29844) Improper unpersist strategy in ml.recommendation.ASL.train

[ https://issues.apache.org/jira/browse/SPARK-29844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29844: -- Affects Version/s: (was: 3.0.0) 2.4.3 > Improper unpersist strategy in ml.r

[jira] [Assigned] (SPARK-29822) Cast error when there are spaces between signs and values

[ https://issues.apache.org/jira/browse/SPARK-29822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29822: --- Assignee: Kent Yao > Cast error when there are spaces between signs and values > --

[jira] [Resolved] (SPARK-29822) Cast error when there are spaces between signs and values

[ https://issues.apache.org/jira/browse/SPARK-29822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29822. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26449 [https://gith

[jira] [Created] (SPARK-29848) PostgreSQL dialect: cast to bigint

ABHISHEK KUMAR GUPTA created SPARK-29848: Summary: PostgreSQL dialect: cast to bigint Key: SPARK-29848 URL: https://issues.apache.org/jira/browse/SPARK-29848 Project: Spark Issue Type

[jira] [Commented] (SPARK-29845) PostgreSQL dialect: cast to decimal

[ https://issues.apache.org/jira/browse/SPARK-29845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971516#comment-16971516 ] Rakesh Raushan commented on SPARK-29845: I will work on this > PostgreSQL diale

[jira] [Commented] (SPARK-29847) PostgreSQL dialect: cast to varchar

[ https://issues.apache.org/jira/browse/SPARK-29847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971513#comment-16971513 ] Aman Omer commented on SPARK-29847: --- I am checking this one. > PostgreSQL dialect: ca

[jira] [Commented] (SPARK-29846) PostgreSQL dialect: cast to char

[ https://issues.apache.org/jira/browse/SPARK-29846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971505#comment-16971505 ] Ankit Raj Boudh commented on SPARK-29846: - I will raise PR for this. > PostgreS

[jira] [Created] (SPARK-29847) PostgreSQL dialect: cast to varchar

ABHISHEK KUMAR GUPTA created SPARK-29847: Summary: PostgreSQL dialect: cast to varchar Key: SPARK-29847 URL: https://issues.apache.org/jira/browse/SPARK-29847 Project: Spark Issue Typ

[jira] [Updated] (SPARK-29846) PostgreSQL dialect: cast to char

[ https://issues.apache.org/jira/browse/SPARK-29846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29846: - Description: Make SparkSQL's cast to char behavior be consistent with PostgreSQL when spark.sql

[jira] [Updated] (SPARK-29846) PostgreSQL dialect: cast to char

[ https://issues.apache.org/jira/browse/SPARK-29846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29846: - Description: Make SparkSQL's cast to char behavior be consistent with PostgreSQL when spark.sql

[jira] [Created] (SPARK-29846) PostgreSQL dialect: cast to char

jobit mathew created SPARK-29846: Summary: PostgreSQL dialect: cast to char Key: SPARK-29846 URL: https://issues.apache.org/jira/browse/SPARK-29846 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29845) PostgreSQL dialect: cast to decimal

jobit mathew created SPARK-29845: Summary: PostgreSQL dialect: cast to decimal Key: SPARK-29845 URL: https://issues.apache.org/jira/browse/SPARK-29845 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29840) PostgreSQL dialect: cast to integer

[ https://issues.apache.org/jira/browse/SPARK-29840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971476#comment-16971476 ] Aman Omer commented on SPARK-29840: --- Working on this. > PostgreSQL dialect: cast to i

[jira] [Commented] (SPARK-29842) PostgreSQL dialect: cast to double

[ https://issues.apache.org/jira/browse/SPARK-29842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971477#comment-16971477 ] Aman Omer commented on SPARK-29842: --- I will work on this > PostgreSQL dialect: cast t

[jira] [Commented] (SPARK-29843) PostgreSQL dialect: cast to float

[ https://issues.apache.org/jira/browse/SPARK-29843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971478#comment-16971478 ] Aman Omer commented on SPARK-29843: --- I will work on this > PostgreSQL dialect: cast t

[jira] [Updated] (SPARK-29844) Improper unpersist strategy in ml.recommendation.ASL.train

[ https://issues.apache.org/jira/browse/SPARK-29844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29844: -- Summary: Improper unpersist strategy in ml.recommendation.ASL.train (was: Wrong unpersist strategy in

[jira] [Created] (SPARK-29844) Wrong unpersist strategy in ml.recommendation.ASL.train

Dong Wang created SPARK-29844: - Summary: Wrong unpersist strategy in ml.recommendation.ASL.train Key: SPARK-29844 URL: https://issues.apache.org/jira/browse/SPARK-29844 Project: Spark Issue Type:

[jira] [Created] (SPARK-29843) PostgreSQL dialect: cast to float

jobit mathew created SPARK-29843: Summary: PostgreSQL dialect: cast to float Key: SPARK-29843 URL: https://issues.apache.org/jira/browse/SPARK-29843 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29842) PostgreSQL dialect: cast to double

jobit mathew created SPARK-29842: Summary: PostgreSQL dialect: cast to double Key: SPARK-29842 URL: https://issues.apache.org/jira/browse/SPARK-29842 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29841) PostgreSQL dialect: cast to date

[ https://issues.apache.org/jira/browse/SPARK-29841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971470#comment-16971470 ] pavithra ramachandran commented on SPARK-29841: --- i will check > PostgreSQ

[jira] [Created] (SPARK-29841) PostgreSQL dialect: cast to date

jobit mathew created SPARK-29841: Summary: PostgreSQL dialect: cast to date Key: SPARK-29841 URL: https://issues.apache.org/jira/browse/SPARK-29841 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29840) PostgreSQL dialect: cast to integer

jobit mathew created SPARK-29840: Summary: PostgreSQL dialect: cast to integer Key: SPARK-29840 URL: https://issues.apache.org/jira/browse/SPARK-29840 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29839) Supporting STORED AS in CREATE TABLE LIKE

[ https://issues.apache.org/jira/browse/SPARK-29839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-29839: --- Summary: Supporting STORED AS in CREATE TABLE LIKE (was: Support STORED AS in CREATE TABLE LIKE) >

[jira] [Created] (SPARK-29839) Support STORED AS in CREATE TABLE LIKE

Lantao Jin created SPARK-29839: -- Summary: Support STORED AS in CREATE TABLE LIKE Key: SPARK-29839 URL: https://issues.apache.org/jira/browse/SPARK-29839 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29775) Support truncate multiple tables

[ https://issues.apache.org/jira/browse/SPARK-29775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971448#comment-16971448 ] Rakesh Raushan commented on SPARK-29775: i will work on this > Support truncat

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971433#comment-16971433 ] Aman Omer commented on SPARK-29838: --- Already working on this. Thanks [~jobitmathew] >

[jira] [Created] (SPARK-29838) PostgreSQL dialect: cast to timestamp

jobit mathew created SPARK-29838: Summary: PostgreSQL dialect: cast to timestamp Key: SPARK-29838 URL: https://issues.apache.org/jira/browse/SPARK-29838 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29837) PostgreSQL dialect: cast to boolean

[ https://issues.apache.org/jira/browse/SPARK-29837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-29837: - Parent: SPARK-29836 Issue Type: Sub-task (was: Task) > PostgreSQL dialect: cast to boolean > --

[jira] [Created] (SPARK-29837) PostgreSQL dialect: cast to boolean

wuyi created SPARK-29837: Summary: PostgreSQL dialect: cast to boolean Key: SPARK-29837 URL: https://issues.apache.org/jira/browse/SPARK-29837 Project: Spark Issue Type: Task Components: SQ

[jira] [Created] (SPARK-29836) PostgreSQL dialect: cast

wuyi created SPARK-29836: Summary: PostgreSQL dialect: cast Key: SPARK-29836 URL: https://issues.apache.org/jira/browse/SPARK-29836 Project: Spark Issue Type: Improvement Components: SQL