[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301403#comment-17301403 ] Lauri Koobas commented on SPARK-34714: -- Didn't I? When I copy-paste the only code example in the

[jira] [Commented] (SPARK-34741) MergeIntoTable should avoid ambiguous reference

[ https://issues.apache.org/jira/browse/SPARK-34741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301396#comment-17301396 ] Apache Spark commented on SPARK-34741: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34741) MergeIntoTable should avoid ambiguous reference

[ https://issues.apache.org/jira/browse/SPARK-34741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34741: Assignee: Apache Spark > MergeIntoTable should avoid ambiguous reference >

[jira] [Assigned] (SPARK-34741) MergeIntoTable should avoid ambiguous reference

[ https://issues.apache.org/jira/browse/SPARK-34741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34741: Assignee: (was: Apache Spark) > MergeIntoTable should avoid ambiguous reference >

[jira] [Updated] (SPARK-34741) MergeIntoTable should avoid ambiguous reference

[ https://issues.apache.org/jira/browse/SPARK-34741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34741: - Description: When resolving the {{UpdateAction}}, which could reference attributes from both target and source

[jira] [Created] (SPARK-34741) MergeIntoTable should avoid ambiguous reference

wuyi created SPARK-34741: Summary: MergeIntoTable should avoid ambiguous reference Key: SPARK-34741 URL: https://issues.apache.org/jira/browse/SPARK-34741 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34693) Support null in conversions to and from Arrow

[ https://issues.apache.org/jira/browse/SPARK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301376#comment-17301376 ] Hyukjin Kwon commented on SPARK-34693: -- Which codes did you run? It would be great if you can

[jira] [Commented] (SPARK-34694) Improve Spark SQL Source Filter to allow pushdown of filters span multiple columns

[ https://issues.apache.org/jira/browse/SPARK-34694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301375#comment-17301375 ] Hyukjin Kwon commented on SPARK-34694: -- {code} (l_commitdate#11 < l_receiptdate#12) (l_shipdate#10

[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301373#comment-17301373 ] Hyukjin Kwon commented on SPARK-34714: -- [~laurikoobas] can you provide a self-contained reproducer?

[jira] [Commented] (SPARK-34733) Spark UI not showing memory used of partitions in memory

[ https://issues.apache.org/jira/browse/SPARK-34733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301372#comment-17301372 ] Hyukjin Kwon commented on SPARK-34733: -- [~sams] can you confirm if this happens in Apache Spark

[jira] [Commented] (SPARK-34740) can class pyspark.mllib.evaluation.RegressionMetrics() accept DataFrame as the parameter?

[ https://issues.apache.org/jira/browse/SPARK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301371#comment-17301371 ] Hyukjin Kwon commented on SPARK-34740: -- pyspark.mllib is for RDD only. You should implement this in

[jira] [Resolved] (SPARK-34740) can class pyspark.mllib.evaluation.RegressionMetrics() accept DataFrame as the parameter?

[ https://issues.apache.org/jira/browse/SPARK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34740. -- Resolution: Invalid > can class pyspark.mllib.evaluation.RegressionMetrics() accept DataFrame

[jira] [Created] (SPARK-34740) can class pyspark.mllib.evaluation.RegressionMetrics() accept DataFrame as the parameter?

xifeng created SPARK-34740: -- Summary: can class pyspark.mllib.evaluation.RegressionMetrics() accept DataFrame as the parameter? Key: SPARK-34740 URL: https://issues.apache.org/jira/browse/SPARK-34740

[jira] [Commented] (SPARK-23745) Remove the directories of the “hive.downloaded.resources.dir” when HiveThriftServer2 stopped

[ https://issues.apache.org/jira/browse/SPARK-23745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301335#comment-17301335 ] Apache Spark commented on SPARK-23745: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-23745) Remove the directories of the “hive.downloaded.resources.dir” when HiveThriftServer2 stopped

[ https://issues.apache.org/jira/browse/SPARK-23745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301334#comment-17301334 ] Apache Spark commented on SPARK-23745: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301332#comment-17301332 ] Apache Spark commented on SPARK-21449: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34737. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31831

[jira] [Assigned] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34737: Assignee: Max Gekk > Discrepancy between TIMESTAMP_SECONDS and cast from float >

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301291#comment-17301291 ] Jungtaek Lim commented on SPARK-31427: -- If you have to use foreachBatch to enable specific

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301281#comment-17301281 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/14/21, 9:26 PM: -- hi

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301281#comment-17301281 ] Nick Hryhoriev commented on SPARK-31427: hi [~xccui] , after some deep investigation, I can add:

[jira] [Assigned] (SPARK-34739) Add an year-month interval to a timestamp

[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34739: Assignee: Max Gekk (was: Apache Spark) > Add an year-month interval to a timestamp >

[jira] [Assigned] (SPARK-34739) Add an year-month interval to a timestamp

[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34739: Assignee: Apache Spark (was: Max Gekk) > Add an year-month interval to a timestamp >

[jira] [Commented] (SPARK-34739) Add an year-month interval to a timestamp

[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301266#comment-17301266 ] Apache Spark commented on SPARK-34739: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-32082) Project Zen: Improving Python usability

[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301176#comment-17301176 ] Danny Meijer commented on SPARK-32082: -- That's true - the first time around it will be a HUGE

[jira] [Updated] (SPARK-34739) Add an year-month interval to a timestamp

[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34739: - Description: Support adding of YearMonthIntervalType values to TIMESTAMP values. (was: Support adding

[jira] [Created] (SPARK-34739) Add an year-month interval to a timestamp

Max Gekk created SPARK-34739: Summary: Add an year-month interval to a timestamp Key: SPARK-34739 URL: https://issues.apache.org/jira/browse/SPARK-34739 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

Attila Zsolt Piros created SPARK-34738: -- Summary: Upgrade Minikube and kubernetes cluster version on Jenkins Key: SPARK-34738 URL: https://issues.apache.org/jira/browse/SPARK-34738 Project: Spark

[jira] [Commented] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301077#comment-17301077 ] Apache Spark commented on SPARK-34737: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34737: Assignee: (was: Apache Spark) > Discrepancy between TIMESTAMP_SECONDS and cast from

[jira] [Commented] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301076#comment-17301076 ] Apache Spark commented on SPARK-34737: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34737: Assignee: Apache Spark > Discrepancy between TIMESTAMP_SECONDS and cast from float >

[jira] [Assigned] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34735: Assignee: (was: Apache Spark) > Add modified configs for SQL execution in UI >

[jira] [Assigned] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34735: Assignee: Apache Spark > Add modified configs for SQL execution in UI >

[jira] [Commented] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301073#comment-17301073 ] Apache Spark commented on SPARK-34735: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301072#comment-17301072 ] Apache Spark commented on SPARK-34735: -- User 'ulysses-you' has created a pull request for this